We have numerous airflow instances running in different organizations/teams around the company. While we have built a highly scaleable centralized airflow service, we do have cases where we need to depend on another airflow instance to run a dag.
Our DevOps team often gets tasked with running larger orchestrations across teams, and we prefer to keep a highly detailed view of all tasks, even if they are in a remote airflow.
Is there any good way to monitor, with full fidelity, all of the tasks in a remote airflow? Something similar to the sub-dag operator for a remote airflow would be sufficient.