Just checked the bolt(should of done that in the first place). It wasn't loose per se...but I was able to turn it 1/16th or so and snug it up. I'm guessing that the leaking will stop now.
Out of curiosity...is the base gasket expensive and/or a pain in the arse to change? Aside from small oil loss(assuming the gasket is bad, does a bad base gasket affect performance?