it has been my experience that changing prop pitch by 2-3 inches does not usually change top end speed very much, because the increased RPMs will mostly make up for the lower pitch. for instance with a 13 pitch prop at 4700 RPMs the theoretical speed is 29 MPH. with a 11 pitch prop theoretical speed is 27 MPH. All of this is just theoretical because every boat is different and each boat will have what I call a sweet spot prop that seems to give you the best over all performance.
It is also my understanding that over loading an outboard with too large of a prop so that it does not reach the proper RPMs can lead to shorter motor life and excessive fuel usage.
But I do agree that the motor should be checked and eliminate any motor malfunctions as prop sizing is not a substitute for a needed motor repair.
Ken also mentioned checking motor height. possibly jacking the motor up would reduce drag but if it starts cavitating you have gone too high.
There are a number of things that can be done to help, but if after finely tuning the motor your RPMs are still that low I would change prop to get over 5K at least.
That boat probably would do much better with a 70, if your 50 runs good sell it and find a good 70, I just sold a 1995 rude 70 in great condition for $1200. I got a 225 for sale if you want to really make that boat go...just joking