You can remove previously added users from your account by clicking on settings from the top menu

Select User Management from the left menu and click on the trash can icon to remove the user from your account,

The user will be unassigned from all the leads assigned to the user.