You can add users to channels with restricted access as follows:
Creating channels
Sending direct messages