Owen Sound police responded after a passerby spotted a body floating near the east side of the inner harbour.
Police and firefighters responded about 8:30am Wednesday morning to discover a 62-year-old deceased male in the water.
Police say foul play is not suspected.
Next of kin are bring notified.