No busted diaphragm doesn't mean the pump isn't toast... the rubber can stretch/dry out and provide little to no vacuum to pump with, spring can also break on the pump lever. Take the fuel line out of the carb and stick it into a clear bottle, crank the engine and see if fuel spurts out in a healthy manner, then you know if its bad.
I have the Mercruiser 165 I/L 6, 1974 and my fuel pump had a ball valve plumbed to the fuel inlet port. I broke that ball valve and replaced it but it wasn't sealed and leaking JUST ENOUGH air to cause the pump to provide weak flow and too little fuel to the carb. And FYI my fuel pump has the standard short lever, no long extension on it.
Marine Engine Dot com is a great resource if you want an exploded parts diagram for your engine, check the serial # on the block to be sure you're dealing with the right block and cam set up. Sounds like someone did some rebuild work on yours already.