The 400# difference is not enough to cause this.
Need photos of:
Axle, from the front or rear. Is it curved, either up or down on the outside edges?
Tires on trailer, view from the front, looking at the tread. Is this camber clearly visible?
Also photo of the spindle sticking straight out...