Yes, same part for both sides. The reason the arrow is there is so the water hole comes out the right spot for cooling. If you put it the other way, the water would short circuit the cylinders and to mostly through the head. Bad things would happen...
Port side (viewed from back):
Starboard side (viewed from back):