There are a number of gems that are magnetic to some degree. Some, such as Pyrrhotite, are natrually, strongly magnetic. Others, such as Pyroxmangite, only become magnetic after heating. It’s not surprising that all of these gems contain various amounts of iron. Some of these gems are Diamagnetic.