Extraordinary stuff

I don't understand the word "extraordinary." Wouldn't that mean more ordinary? How is that a good thing?