Skip to main content
4 votes

When to use Apache Airflow (MWAA) in AWS instead of AWS Batch?

AWS MWAA uses Apache Airflow to create workflows and DAGS (Directed Acyclic Graphs) with Python to orchestrate complex, dependent tasks. AWS Batch is, as the name states, a batch processing service ...
Preston Martin's user avatar
  • 3,278
1 vote

How widespread, used is CWL, common workflow language?

This question is almost certainly going to be closed "off-topic", but since I have some experience with communities using CWL in the past, I'll provide my bit. First, a correction to your ...
Bruce Becker's user avatar
  • 3,613
1 vote

Apache Airflow federation - observe remote dag in full detail?

I spent a long time on this problem and made 2 custom solutions as nothing out of the box exists. Both steps require you to either use both the experimental and the extra plugin API or to have access ...
John Humphreys's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible