When you are in the project view, you see the users next to the button for settings. When you press the plus sign, a screen will appear where you can see all users in the project. To remove a user, press the trash can next to the users' e-mail.
To be able to remove a user from a project, you need to have administrator or extended permissions in Refapp.