1 - MySQL is significantly faster in the early stages, but PostgreSQL scales better.
2 - Until recently, only PostgreSQL supported foreign keys. With MySQL 4.0 and InnoDB that isn't the case any longer.
3 - PgSQL is an object/relational database whereas MySQL is simply a relational database. Likely means nothing to most people.
A really good article that compares the two from a real world perspective:
http://www.webtechniques.com/archives/2001/09/jepson/