Right-click on the title of it on the task-bar, and chose kill.. There are several kill-signals you can chose to send, to be realy mean you could open up a consol and type:
~ > kill -9 `pidof xmms`
Heres an earlier discussion on the kill capcability.
And here is a 101 course in the shell.