You're almost always going to find some on the magnetic plug and sometimes it's going to look like a lot. The important thing to notice is if there is a noticeable excessive amount still flowing into the oil drain pan while draining....If so then you have a heavy concern of something severely wrong.
Slow, grinding shifting, bigger/heavier stainless steel props, heavy acceleration loads, infrequent oil changes could contribute to more noticeable fine metal shavings on the magnetic plug.