In a previous post, we discussed Setting up an Apache Airflow Cluster. In this post we’ll talk about the shortcomings of a typical Apache Airflow Cluster and what can be done to provide a Highly Available Airflow Cluster. A Typical Apache Airflow Cluster In a typical multi-node Airflow cluster you can separate out all the major processes onto separate machines. Here are the main processes: Web Ser
![Making Apache Airflow Highly Available - Home](https://cdn-ak-scissors.b.st-hatena.com/image/square/781c63d02acea39bd0e5c909c967b04213818900/height=288;version=1;width=512/http%3A%2F%2Fsite.clairvoyantsoft.com%2Fwp-content%2Fuploads%2F2016%2F12%2FPDC_Diagrams-08.png)