3

This site already has great answers for questions like What is DevOps and what is SecOps.

Over time, I have come to be of the opinion that DevOps was born when the philosophy of the Agile methodology was applied to Operations. Similarly so with SecOps.

What then would be DataOps - applying agile methods to Big Data & Data Analytics look like? How is this similar to agile software development and DevOps and where might it be different?

Improve this question
6
  • 1
    Can you give us some evidence that DataOps is actually a thing? has it been mentioned in blogs/papers/conferences? Does it have synonyms? Thanks :)
    – Bruce Becker
    Commented Nov 14, 2019 at 10:37
  • The biggest points of difference would be that with 'DataOps', that is presumably going to very tied to managing state. But I could imagine that it could be understood to be tied to concepts such as data-streaming and event-sourcing. A world of possibilities.
    – Cameron Kerr
    Commented Nov 15, 2019 at 4:27
  • 2
    @BruceBecker - it has a Wikipedia Page and a manifesto and also made Oracle's Blog
    – James Shewey
    Commented Nov 15, 2019 at 6:54
  • Could you update the question so it is not "primarily opinion-based" anymore? Please let us know when you have updated the question.
    – 030
    Commented Nov 15, 2019 at 12:16
  • @030 - I'm not quite sure how this feels primarily opinion based. Could you elaborate on why you feel that way and what this question would look like if it wasn't? How is this question worded differently than the "What is DevOps / What is SecOps" questions that runs afoul of this guideline?
    – James Shewey
    Commented Nov 15, 2019 at 16:27

2 Answers 2

Reset to default
2

Over time, I have come to be of the opinion that DevOps was born when the philosophy of the Agile methodology was applied to Operations. Similarly so with SecOps.

Wikipedia indicates that Agile software development is about "early delivery", "adaptive planning" and "rapid and flexible response to change". In order to deliver early, automation is key in DevOps.

What then would be DataOps - applying agile methods to Big Data & Data Analytics look like?

According to Wikipedia, DataOps tries to incorporate DevOps best practices to enhance data analytics.

How is this similar to agile software development and DevOps and where might it be different?

Similar

  • Quick action on change
  • Fail fast
  • Adaptation
  • Tools & platforms: ansible, terraform, AWS, GCP, AKS, EKS

Differences

  • Focus on BigData
  • Knowledge about NoSQL Hadoop, Hbase, Cassandra, MongoDB needed
  • How to tune relational database like postgres, mysql that contains large amount of data
  • More emphasize on bigdata tools like Spark
Improve this answer
-1

The ultimately goals of agile and DevOps are the same - to improve the speed and quality of software development see the following articles which give a better understanding -

Atlassian : DevOps vs Agile

PhoenixNAP: Head to head comparison

Improve this answer
1
  • 1
    The question (title) is about DataOps, not "Agile" of "DevOps". So how does this answer answer address the original question?
    – Pierre.Vriens ♦
    Commented Jun 17, 2022 at 15:12

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.