TL;DR : I think I need a new switch box.
Alright, a few developments.
1. When I took off the carb again, the gasket was ripped and covering part of the intake. That wasn't the initial problem, but when I replaced it I was able to get it idling normally (well, sometimes on 1 cylinder) without...