giving apps permission to drive or gmail

If you give mailsapps or filemanagers on Android (those with a few millions users and likely trustable) access to your gmail-account or google drive, do they in general store these data (mails/files) on their servers as well? Or is it relatively safe to give them this permission?