You can find the feature from the "Game friends" list on the left side of the lobby.
Select "Manage all" button and select all friends that you wish to remove from the list.
Once you press the "Remove" button, selected friends will be removed from your friends list.
※ The maximum number of friends that can be deleted at once is 50.