Group hosts can access your profile if it's public or if you are a member of their community. They can only access details of any messages and interactions within the groups they host. Your DMs are entirely confidential, and nobody else has access to them.
For more information, see What information is available to the administrators of the groups I’m in?