Outboard marine propulsion devices having cooling systems

An outboard marine propulsion device comprises an internal combustion engine having a cylinder head and a cylinder block and an exhaust manifold that discharges exhaust gases from the engine towards a vertically elongated exhaust tube. The exhaust manifold has a plurality of inlet runners that receive the exhaust gases from the engine, and a vertically extending collecting passage that conveys the exhaust gases from the plurality of inlet runners upwardly to a bend that redirects the exhaust gases downwardly towards the exhaust tube. A cooling water jacket is on the exhaust manifold and conveys cooling water alongside the exhaust manifold. A catalyst housing is coupled to the exhaust manifold and a cooling water jacket is on the catalyst housing and carries cooling water alongside the catalyst housing. A catalyst is disposed in the catalyst housing.