Colfax is a city in Richland County, North Dakota in the United States. The population was 91 at the 2000 census. Colfax was founded in 1881. It is part of the Wahpeton, ND–MN Micropolitan Statistical Area. In the mid 1960's it billed itself as the "smallest town in the U.S. with a public swimming pool".