6
votes
Accepted
Docker memory storage
According to the documentation, memory storage is intended for testing purposes only and should never be used in production. The only practical purpose I can think of for this might be state testing, ...
- 4,068
5
votes
How can continuous integration scale for very large projects/teams?
Yes, but it's by preventing the things you mention in your question as much as possible.
You are right that there are only so much developers that can work on the same code before things become ...
- 575
4
votes
How can Agile methodologies, CI/CD be applied to massive, monolithic software projects with 100s/1000s of developers?
Well, you won't be able to apply an Agile methodology to a large team. One of usual principle is to work on Pizza Team (Less than 10 persons which can share a large pizza for diner together) because ...
- 11.4k
4
votes
How can continuous integration scale for very large projects/teams?
As the number of developers working on the same branch increases the risk of breakages/blockages increases. Eventually a point is reached where on average by the time a breakage is fixed a new one ...
- 340
3
votes
Accepted
Running multiple websites on Docker in isolated or shared database containers?
Docker and all the other fancy names are just tools. The examples are just examples.
Resource-wise, Docker changes nothing much beyond usual Linx/Unix multiprocessing. It does not have the overhead ...
- 4,906
3
votes
Accepted
Best method of retrieving environment information via Salt Stack?
SaltStack provides a method for modifying grains and adding additional information to the grains dictionary in several different ways by either setting them in the /etc/salt/minion config and/or ...
- 583
3
votes
How can Agile methodologies, CI/CD be applied to massive, monolithic software projects with 100s/1000s of developers?
We went from a large, monolithic backend application worked on by 100s of devs into docker based microservices, deployments using ansible and similar DevOps fluff. Here are some notes on the process:
...
- 1,577
2
votes
Accepted
Scaling issues with Nagios as CaSC
Personally I don't think using CasC itself will have any negative scalability impact.
Fundamentally CasC means the actual config files are not hand-maintaned, instead they're auto-generated following ...
- 6,750
2
votes
How can Agile methodologies, CI/CD be applied to massive, monolithic software projects with 100s/1000s of developers?
Yes, splitting the bigger team into smaller, agile-size sub-teams is obviously necessary. But it's far from sufficient to also be performant overall, at the bigger team level.
With a highly scalable ...
- 6,750
1
vote
Scaling a stateful service which has primary/secondary architecture by setting a property
You are looking for the leader election pattern. This can be implemented in many different ways. It typically means that an instance take a lock in some form of persistent storage, e.g. a PostgreSQL ...
- 1,025
1
vote
Accepted
What is it called to deploy major changes for limited number of customers first?
Canary release/deployment is the term you are looking for. Usually in a canary deployment, a small percentage (10% for example) of your infrastructure is updated with the latest revisions of your ...
- 3,278
1
vote
Pattern(s) to scale node.js based ETL
I ended up following this path
Rather than use cron, i used a scheduling framework (in my case Bree.js) which allowed me to "jobify" the tasks and also execute these tasks in separate ...
- 131
1
vote
if the bottle neck is the number of connections, is it better to scale redis by sharding or by replication?
Redis Cluster could be considered as an OOTB solution for the Scalability requirements. There is another interesting open source library known as Redis Shard for sharding implementations on Redis. ...
- 123
1
vote
Scaling issues with Nagios as CaSC
Having a CasC setup means that you are in a better position to deal with any scalability issues that should arise later. It should take you a while to max out a nagios box. As long as you haven't ...
- 1,893
1
vote
Scaling issues with Nagios as CaSC
From my experience in managing a Nagios deployment with version controlled configuration files and CI/CD, it works really well. You can collaborate with other teams more easily since you can grant ...
- 1,405
1
vote
How can Agile methodologies, CI/CD be applied to massive, monolithic software projects with 100s/1000s of developers?
I've been working on couple of Agile projects with over 100 developers without any problems, so from my personal experience, to deal with such big workflow, here are some suggestions:
Team definitely ...
- 7,981
Only top scored, non community-wiki answers of a minimum length are eligible