The big ones where I lived (Huntsman) were no big deal. They weren’t poisonous and pretty harmless. They’d be in every house though. We had a black widow equivalent (Redback) which were poisonous but small and easy to identify and just hung out in the rocks in gardens.
The only one that would freak me out is the Funnel Web spider but they are really only in Sydney. Thick and black and when they bite they don’t want to let go. If they bite you on the abdomen area make sure you haul ass to the hospital.
Up north is the bird eating spider. I’ve seen the webs but never saw them. Not poisonous but still.......