Isopropyl Alcohol comes in multiple strengths:
Try what you have at home, then go higher % if it doesn't quite take it off......
10+ Things to Do with Dry-Erase Markers
Check out # 9. I wonder if they have alcohol in them? Anyways, I have used it to get sharpie off.