file encryption – Can a host access a VPS disk’s encrypted directory directly while running?

I have an Ubuntu VPS running at a remote host. The disk is not encrypted but I have a specific directory that is encrypted for which I must provide a password via an SSH session (not stored anywhere on the VPS) to “unlock” it so that the services can run on this VPS and serve the content decrypted.

Assuming the bad admin cannot login to the system like I do via SSH. Can the bad admin read the encrypted directory’s decrypted content while running and/or can the bad admin gain access to the in-memory key for the encrypted directory?