Definitely!
Depending on where you're living, it could be quite a challenge (I'm struggling at the moment, but I've managed to get two seedlings established enough that they might be able to survive the winter, fingers crossed), but I'm sure that the reward would be worth it. Either way, they're pretty low-maintenance plants so I reckon it would be worth it anyways.
I've found acacias can also be a real pain to grow, at least in my climate (although this probably only applies to acacia acuminata). At the moment I've been trying to track down some acacia mucronata subsp. longifolia seeds, as being Victorian natives, they might stand a better chance. I would have a shot at acacias as well though, even just seeing the adorable little acacias grow their first phyllodes definitely makes growing them worth it :d