Is there a difference between $5 Walmart sunglasses and non-polarized Oakleys?

I mean, if sunglasses aren't polarized, does it even matter what brand they are? My eyes are really sensitive to sunlight and I need a good pair. Is it worth it to get polarized, or even just non-polarized?