I have Kubernates jobs which each require ~300GB of temporary disk space whilst they are running, then send files to an external service when done.
Currently I'm using DigitalOcean managed Kubernates with their storage optmised Droplets. However this is much more expensive than using Droplets with less vCPU but atatched block storage.
These jobs are automated (run by a Python script). DigitalOcean's support article talks about creating a StatefulSet but I don't understand how to do this at each jobs runtime, or if this is the right approach.
So how would you reccomend the following? Running Kubernates jobs which each require ~300GB of temp space but relatively low vCPU and Memory.