Even thousands of years ago, you can find native copper in some places. If you’re lucky this isn’t that hard. Also, I’m not certain on the properties required, but I think you just need a decent conductor, not copper specifically. Copper is just conductive, pretty available, and easy to work with. Also, there are naturally forming magnets. You don’t need to make one.