Over time, I have come to be of the opinion that DevOps was born when
the philosophy of the Agile methodology was applied to Operations.
Similarly so with SecOps.
Wikipedia indicates that Agile software development is about "early delivery", "adaptive planning" and "rapid and flexible response to change". In order to deliver early, automation is key in DevOps.
What then would be DataOps - applying agile methods to Big Data & Data
Analytics look like?
According to Wikipedia, DataOps tries to incorporate DevOps best practices to enhance data analytics.
How is this similar to agile software development and DevOps and where
might it be different?
- Quick action on change
- Fail fast
- Tools & platforms: ansible, terraform, AWS, GCP, AKS, EKS
- Focus on BigData
- Knowledge about NoSQL Hadoop, Hbase, Cassandra, MongoDB needed
- How to tune relational database like postgres, mysql that contains large amount of data
- More emphasize on bigdata tools like Spark