Kampot’s Central Market, downtown, is definitely the busiest place in town. Food, clothes, jewelry, fish, restaurants, household goods, pretty much everything you can buy in town is located in the market, and on the surrounding streets.
The market is at the intersection of the road to Phnom Penh, and the street from the new bridge. Morning, 8am to 10am is the busiest time. Closes when it’s night. You can get a motodup (motorcycle taxi) from the riverside for about 2,000 Riel (50 cents U.S.) or PASSAPP for 3,000 Riel (75 cents U.S.), a free app that calls a 3 wheeled taxi, or walk about 5 to 10 minutes to get here from anywhere downtown.
Go in the afternoon if you don’t like crowds.
Worth an hour walk through, and it’s a great place for photography.