Questions tagged [continuous-integration]
Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.
262
questions
0
votes
1
answer
12
views
How to declaratively configure self hosted build agents for CI?
We assemble android application using GH Actions on self-hosted agents.
Right now we upgraded a couple of libraries and now we need to use another JDK version.
Issue is that right now we need to ...
0
votes
0
answers
7
views
How to deploy all services for a preview environment without rebuilding them all when one changes
I am trying to create a preview environment for each pull request. We are using a monorepo with about 2 dozen microservice. To have a fully functional preview environment we need all the services to ...
- 101
0
votes
1
answer
20
views
GitLab CI: How to properly push file to a repo using ci file?
I'm trying to setup a GitLab CI pipeline which runs a script (convert-inventory-format.sh) that update a yaml file. I would then like to commit that file to a Git repository and push it.
However, the ...
- 1
0
votes
1
answer
14
views
QA instability due to lack of stable UAT/staging environment
Our testing teams are facing extensive downtime due to testing in a shared QA environment.
When our front end teams perform end to end testing, their test (QA) environment points to the back end ...
- 101
1
vote
0
answers
35
views
AWS Cloudformation with AWS SAM cli - is it possible to rollback?
After updating a cloudformation stack via sam build, sam package and sam deploy is it possible to rollback to the previous configuration?
My use case
I've set up a Gitlab project with the ...
- 141
2
votes
1
answer
55
views
Best practice multiple pipelines into production
Working with a larger corporate. They are planning on opening a second pipeline for a hybrid mobile app. This second pipeline will be for hotfixes straight into production. My gut feeling is that this ...
- 121
1
vote
1
answer
35
views
User-level secrets in GitHub Actions
I would like to create a GitHub workflow for running tests against a REST API. The API needs a key that is always tied to a user, there is no global "testing" key.
Is there a way for each ...
- 11
0
votes
0
answers
58
views
Azure DevOps: Track build status for commits in mutliple repositories pipeline
I have a multi-repo pipeline
Can azure track build status for commits for repositories other than the self repo that contains the azure-pipelines.yaml file?
Ie, when a commit is built in another ...
- 111
0
votes
0
answers
35
views
docker prune all images but keep images downloaded or created less than 48 hours ago?
Problem we're trying to overcome: We'd like to reduce pulling from JFrog on our Bamboo agents as sometimes the same docker images may be pulled multiple times over the course of a pipeline. We'd like ...
- 153
1
vote
0
answers
17
views
Docker Postgres images with data
I have a bunch of DB backups used for QA and Integration Testing.
From time to time, the schema of these DBs gets updated.
I thought of Building Images for each DB instance and commit changes after ...
- 111
1
vote
2
answers
83
views
Pause renovatebot for single PR
We have configured renovate for few of our repositories. It generates PRs after approval via dependency dashboard and automerges patch releases.
But there is one update which fails the CI - it look ...
- 21
0
votes
1
answer
50
views
Automated preview environments from microservices in multiple repositories?
I have multiple microservices (with Dockerfiles) in GitHub repositories.
Although I do unit testing on each microservice, I want to spin up all the services as a preview environment for E2E testing (...
Janman
1
vote
0
answers
31
views
How can I point Cloud Run to my latest container image when its path changes based on version?
I am trying to model continuous deployment infrastructure in Terraform.
The problem I have is Cloud Run requires a path to the container image, and that image's path changes based on its 'version'.
...
- 111
0
votes
1
answer
160
views
strip all comments from helm package
I have a lot of comments in my helm chart in my repository.
I want to deliver my helm chart to others without these comments.
I am hoping to be able to do this during my CI pipeline. I have a step in ...
- 411
0
votes
0
answers
52
views
Improvements to Azure Release workflow
I am looking for some feedback on how we can improve our release pipeline in Azure.
We have multiple environments with a corresponding deploy/* branch. Once these deploy branches are updated a release ...
- 113
0
votes
0
answers
33
views
Options for smaller-scale CI/CD with Docker Containers
To give some background
I am in a small development team (<5) working for an ecommerce company. We sell product on many sites (Amazon, Walmart, Wayfair, etc..).
The majority of the development ...
- 1
0
votes
0
answers
187
views
Single jenkinsfile for multiple target environment
I use Jenkins 2.376.
Beside feature branches I have 3 main branch in GIT : test, stage, prod and 3 JOBs for deployment of these main branches.
I want to have single identical Jenkinsfile in Git for ...
0
votes
1
answer
12
views
Why is the development of a REST-API Webserver Application with less expected changes after its short term initial build a DevOps project?
I am thinking about setting up a project where a one-year development / built phase of a rest-API Server is planned. Providing an initial version in three months and deploying updates every month ...
- 101
0
votes
0
answers
24
views
Using a Specific User for GHA jobs
I have a bunch of GHA runners running as pods in k8s.
I want to make sure that these jobs are running via a specific user, like user tom.
I have tom setup as a k8s pod user via the container image. ...
- 151
1
vote
1
answer
239
views
Trunk Based Development Deployment Pipeline
We are currently working on transitioning to Trunk Based Development and starting to look at our deployment pipeline and how we can improve.
Our current workflow:
All engineers work on the trunk, ...
- 113
0
votes
0
answers
33
views
What is the best practice for containerizing a cross-platform CI/CD environment?
I'm looking for advice on what the best practice is for implementing a containerized CI/CD environment within GitHub Actions, which supports Windows, MacOS & Linux (Ubuntu) environments, used for ...
- 101
0
votes
3
answers
83
views
Does Jenkins essentially function like a package manager for your software product?
I'm a relatively new IT Ops guy in a software (web) development company. Recently I deployed a virtual machine on OpenStack, because some developer needs it, and then I installed their application (...
- 101
0
votes
1
answer
98
views
What is manual, what is automatic in Continuous Delivery?
I've read lots of articles about the concept on the internet. I thought I got it, but some statements in other articles make me confused.
In order to simplify and clarify things, I'll presume I use ...
- 101
0
votes
2
answers
119
views
How do I run a CI build in a docker image matching the current `Dockerfile` while being resource-aware?
Given a repository containing a Dockerfile that defines the build environment used by the CI pipeline as well as by the developer (e.g. as a Visual Studio Code devcontainer), the CI pipeline shall ...
- 101
0
votes
1
answer
751
views
Setting up gitlab phpstan pipeline
I have tried to start using phpstan pipeline on gitlab according to this guide.
The problem is that the pipeline does not work at all (Command 'sh' is not defined) and i don't know how to fix it.
Here ...
- 103
0
votes
2
answers
71
views
Docker Compose on AWS
I have no experience with AWS and I would like to know what the best approach is when it comes to embedding an environment built using Docker Compose (a simple application with two services, API and ...
1
vote
1
answer
29
views
What is difference between testing in context of CI and CT pipelines?
What is the difference between testing in the context of Continuous Integration pipeline vs testing in context of Continuous Testing pipeline? The definition of testing is a bit blurred to me in the ...
- 111
0
votes
0
answers
15
views
Missing values: gaps during deployments
Some context:
I have little experience with ci/CD and manage a fast paced growing application since it saw the light of the day for the first time. It is composed by several microservices at different ...
- 43
0
votes
0
answers
38
views
CD on testing server with Docker and Jars
I am asking if this is an anti-pattern or not one of the best practices of CI.
We have a testing server running Spring Boot Java applications backends inside containers.
What we are doing now is :
...
- 101
2
votes
1
answer
72
views
CI pipeline including upload to pypi repo
How should a ci pipeline be set up that publishes a python wheel to a private pypi server?
Say I have a publish job like this one:
publish:
image: $PYTHON_IMAGE
stage: publish
before_script:
...
- 121
1
vote
1
answer
2k
views
decode base64 Github Secrets
I am setting up a pipeline to run Cypress automated tests using github actions/workflows on my code anytime there is a push to the repo. I came into a scenario where I want to generate dyanmic .env ...
- 133
0
votes
1
answer
157
views
Run a dev server in CI pipeline
I have a CI pipeline setup using Github Action/Workflows, where I want to run Cypress Automated tests; however I am having some problems of when trying to run my dev server. Let me show you my ...
- 133
1
vote
1
answer
33
views
Check TZ in Container Image without creating instance?
I have a requirement to assure that the container image we build runs in UTC only. I'd like to avoid starting it up just to check the link on /etc/localtime. I thought maybe a tool like dive that ...
- 333
1
vote
1
answer
500
views
Is it a good practice to run unit tests inside build job in Gitlab CI?
We want to run unit tests against a built Docker image and not by installing the environment inside Gitlab CI runner
We don't want to push the docker image to a registry and pull it back in a test job ...
1
vote
0
answers
92
views
From dev to production workflow
We are creating micro services environment which needs to be delivered to prod, now we want to start the CICD design, is there any reference which talks about getting from a Commit ->PR-> tests-&...
- 111
6
votes
1
answer
3k
views
Colored logging messages from Python script within GitLab CI
I am using a docker container for my GitLab CI and would like to have any output/logging messages in color inside the CI. What I mean: the commands from .gitlab-ci.yml are in color, but the outputs of ...
- 63
3
votes
0
answers
1k
views
Share cache between gitlab.com owned runner and self hosted runner
We are in the middle of migrating from Self Hosted GitLab to Gitlab.com (Cloud). This also means that we are shifting building through shell, to building through Docker (using Kaniko).
A summary of ...
- 131
0
votes
1
answer
899
views
Deploying microservices in a consistent way using different gitlab repositories
I'm looking for a good organization to deploy our solution consisting in multiple apps using Gitlab and K8S.
Our SaaS app that is made of :
A backend app, mostly our API (django)
A user app (React)
...
- 103
0
votes
3
answers
102
views
What is CI and how is it different from CT?
Wikipedia insists that
(CI) is the practice of merging all developers' working copies to a shared mainline several times a day
which sounds to me like "branches are prohibited" which makes ...
- 103
0
votes
2
answers
1k
views
What is the best practice for a multibranch pipeline configuration?
I'm messing around with a multibranch pipeline in jenkins. Currently we have zero pipelines in production and everything is using freestyle jobs which is very sloppy. I have my own multibranch ...
- 21
2
votes
0
answers
484
views
Pipeline could not pull repo in GitLab CI/CD
I have a the repo with test CI pipeline, which is the following:
# .gitlab-ci.yml
image:
name: gcc
build:
stage: build
script:
- echo 123
And it fails:
Running with gitlab-runner 14.3.1 (...
- 121
3
votes
2
answers
285
views
Parametrize gitlab ci pipeline
There is the following simple pipeline:
build → test → deploy
that uses specified python version for all stages, for example 3.8.
How can I scale (parametrize) it for python with versions: 3.7, 3.8 ...
- 31
2
votes
1
answer
417
views
What's the best practice for managing / deploying multi-environments in production app?
I'm spinning up a production site and wanted to get advice on the latest best practices to manage and deploy multiple environments. At a high level, I'd like to have a good balance between keeping ...
- 21
0
votes
1
answer
44
views
Continuous integration of an operating system
I want to hire a VPS but my problem is that most if not all of the VPS companies out there expect me to work with it as is and if I want to majorly upgrade it, I must, backup everything I have added ...
- 1
0
votes
1
answer
189
views
GitLab variable false but job is running
I'm triggering job via API, passing custom variables.
Here is example request: curl -X POST -F token=${TRIGGER_TOKEN} -F ref=${branch} -F "variables[SHOULD_COPY_ASSETS]=false"
This how job ...
- 1
3
votes
1
answer
474
views
Incorporating python linter(flake8) in the CI/CD pipeline that use GitHub, Github Actions in a code base that is not in compliance
I have a codebase that is not in compliance with flake8. The CI/CD pipeline uses GitHub/GitHub actions. I would like to start adding python flake8 (to check for complexity, errors and code smells) ...
- 131
2
votes
1
answer
527
views
Deploy an application using dll files to IIS on a VM
I hope I am posting this in the correct forum, but to me at least, it seemed that the focus was more on deployment.
I am currently stuck after having successfully refactored an application by ...
- 31
1
vote
1
answer
50
views
Sorting out automated testing in CI pipeline and getting conflicting information related to building, unit testing and Docker images
I seem to get a unique response for every person that I ask, or every article that I read, which is just confusing me even more.
Basically, I'm trying to setup automated testing in the CI pipeline ...
- 155
1
vote
0
answers
110
views
Is it possible to control Packer from golang?
We use Terraform quite a bit and it has some nice tooling like Terratest where you can essentially call Terraform from within Golang wrapped inside an API with proper error handling.
I wonder if ...
7
votes
1
answer
426
views
How would you build docker images in Kubernetes while distributing its layer caching among all pod builders at scale?
We are using Azure DevOps as our CICD platform.
We have our own self hosted Linux agents which we integrated into our CICD Azure Kubernetes Cluster .
We use these agents to build our Docker images ...
- 129