How do I remove a member?

Click on your guild header, scroll down to the member list, and click ‘remove member’ next to the member in question. Nice and painfree.