Is there a way to kick the guild leader out as right hand if he is not performing well, and is a general liability to the entire guild?
Hostile takeover
No - you have to all leave and set up a new guild. Admin will remove a leader only if inactive.
He has been inactive for a while now. Who do we have to approach?
Raise a ticket. They'll check his activity, and take it from there.