I have created a Kubernetes CronJob (in AKS) to run a database dump (the database is not located inside the Kubernetes cluster). This CronJob create a Job each day which will dump the database in a single file and upload this file in a remote backend (Azure Blob Storage). The dump file is currently 40GB and it uses the local disk from the node on which the pod is executed.
Even if the dump file is ephemeral in the Kubernetes cluster, as it deleted once the pod is deleted, I would like to now if there is a better approach then using the local node disk (to avoid the case where the local node file system become full).
Do you any suggestion?
Thanks a lot!