Re: Wind
You'll start seeing white caps with wind starting at 14-17mph. If the women will be riding along, they'll almost always mention being "chilly" about the same time you see those. Other than that, so much depends on what you're doing? Fishing in a sheltered cove, pulling a tube on a busy lake with 1-3 ft waves, etc.
Bottom line, other than maybe thunderstorms, generally if you want to go you can find something to do in about any weather.
Loading a boat at a ramp exposed to a healthy cross wind? That might be a challenge loading by yourself, for those not willing to get wet, or maybe those without a lot of experience, but certainly "doable". Just don't get in a hurry....