I have an aftermarket prop on my Johnny. It came with a stainless steel spacer that goes between the nut and the prop. Looks like a fat shotglass, with a splined hole in the bottom.
The original spacer that came with my other (Johnny) prop is too thin to use with this newer prop. You might check with the prop manufacturer and see what they recommend.