Questions tagged [continuous-integration]

Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.

Filter by
Sorted by
Tagged with
0 votes
1 answer
12 views

How to declaratively configure self hosted build agents for CI?

We assemble android application using GH Actions on self-hosted agents. Right now we upgraded a couple of libraries and now we need to use another JDK version. Issue is that right now we need to ...
Alevinevich's user avatar
0 votes
0 answers
7 views

How to deploy all services for a preview environment without rebuilding them all when one changes

I am trying to create a preview environment for each pull request. We are using a monorepo with about 2 dozen microservice. To have a fully functional preview environment we need all the services to ...
Yamaha32088's user avatar
0 votes
1 answer
20 views

GitLab CI: How to properly push file to a repo using ci file?

I'm trying to setup a GitLab CI pipeline which runs a script (convert-inventory-format.sh) that update a yaml file. I would then like to commit that file to a Git repository and push it. However, the ...
DiklaS's user avatar
  • 1
0 votes
1 answer
14 views

QA instability due to lack of stable UAT/staging environment

Our testing teams are facing extensive downtime due to testing in a shared QA environment. When our front end teams perform end to end testing, their test (QA) environment points to the back end ...
Half_Duplex's user avatar
1 vote
0 answers
35 views

AWS Cloudformation with AWS SAM cli - is it possible to rollback?

After updating a cloudformation stack via sam build, sam package and sam deploy is it possible to rollback to the previous configuration? My use case I've set up a Gitlab project with the ...
fudo's user avatar
  • 141
2 votes
1 answer
55 views

Best practice multiple pipelines into production

Working with a larger corporate. They are planning on opening a second pipeline for a hybrid mobile app. This second pipeline will be for hotfixes straight into production. My gut feeling is that this ...
lindsaymacvean's user avatar
1 vote
1 answer
35 views

User-level secrets in GitHub Actions

I would like to create a GitHub workflow for running tests against a REST API. The API needs a key that is always tied to a user, there is no global "testing" key. Is there a way for each ...
Parzival's user avatar
0 votes
0 answers
58 views

Azure DevOps: Track build status for commits in mutliple repositories pipeline

I have a multi-repo pipeline Can azure track build status for commits for repositories other than the self repo that contains the azure-pipelines.yaml file? Ie, when a commit is built in another ...
xvan's user avatar
  • 111
0 votes
0 answers
35 views

docker prune all images but keep images downloaded or created less than 48 hours ago?

Problem we're trying to overcome: We'd like to reduce pulling from JFrog on our Bamboo agents as sometimes the same docker images may be pulled multiple times over the course of a pipeline. We'd like ...
Alistair Hardy's user avatar
1 vote
0 answers
17 views

Docker Postgres images with data

I have a bunch of DB backups used for QA and Integration Testing. From time to time, the schema of these DBs gets updated. I thought of Building Images for each DB instance and commit changes after ...
xvan's user avatar
  • 111
1 vote
2 answers
83 views

Pause renovatebot for single PR

We have configured renovate for few of our repositories. It generates PRs after approval via dependency dashboard and automerges patch releases. But there is one update which fails the CI - it look ...
void's user avatar
  • 21
0 votes
1 answer
50 views

Automated preview environments from microservices in multiple repositories?

I have multiple microservices (with Dockerfiles) in GitHub repositories. Although I do unit testing on each microservice, I want to spin up all the services as a preview environment for E2E testing (...
user avatar
1 vote
0 answers
31 views

How can I point Cloud Run to my latest container image when its path changes based on version?

I am trying to model continuous deployment infrastructure in Terraform. The problem I have is Cloud Run requires a path to the container image, and that image's path changes based on its 'version'. ...
Check12's user avatar
  • 111
0 votes
1 answer
160 views

strip all comments from helm package

I have a lot of comments in my helm chart in my repository. I want to deliver my helm chart to others without these comments. I am hoping to be able to do this during my CI pipeline. I have a step in ...
Inbar Rose's user avatar
0 votes
0 answers
52 views

Improvements to Azure Release workflow

I am looking for some feedback on how we can improve our release pipeline in Azure. We have multiple environments with a corresponding deploy/* branch. Once these deploy branches are updated a release ...
Rob Fyffe's user avatar
  • 113
0 votes
0 answers
33 views

Options for smaller-scale CI/CD with Docker Containers

To give some background I am in a small development team (<5) working for an ecommerce company. We sell product on many sites (Amazon, Walmart, Wayfair, etc..). The majority of the development ...
ConnerP's user avatar
0 votes
0 answers
187 views

Single jenkinsfile for multiple target environment

I use Jenkins 2.376. Beside feature branches I have 3 main branch in GIT : test, stage, prod and 3 JOBs for deployment of these main branches. I want to have single identical Jenkinsfile in Git for ...
SmokingTurtle's user avatar
0 votes
1 answer
12 views

Why is the development of a REST-API Webserver Application with less expected changes after its short term initial build a DevOps project?

I am thinking about setting up a project where a one-year development / built phase of a rest-API Server is planned. Providing an initial version in three months and deploying updates every month ...
user3352632's user avatar
0 votes
0 answers
24 views

Using a Specific User for GHA jobs

I have a bunch of GHA runners running as pods in k8s. I want to make sure that these jobs are running via a specific user, like user tom. I have tom setup as a k8s pod user via the container image. ...
Mohammed Ali's user avatar
1 vote
1 answer
239 views

Trunk Based Development Deployment Pipeline

We are currently working on transitioning to Trunk Based Development and starting to look at our deployment pipeline and how we can improve. Our current workflow: All engineers work on the trunk, ...
Rob Fyffe's user avatar
  • 113
0 votes
0 answers
33 views

What is the best practice for containerizing a cross-platform CI/CD environment?

I'm looking for advice on what the best practice is for implementing a containerized CI/CD environment within GitHub Actions, which supports Windows, MacOS & Linux (Ubuntu) environments, used for ...
John Bergqvist's user avatar
0 votes
3 answers
83 views

Does Jenkins essentially function like a package manager for your software product?

I'm a relatively new IT Ops guy in a software (web) development company. Recently I deployed a virtual machine on OpenStack, because some developer needs it, and then I installed their application (...
Noob_Guy's user avatar
  • 101
0 votes
1 answer
98 views

What is manual, what is automatic in Continuous Delivery?

I've read lots of articles about the concept on the internet. I thought I got it, but some statements in other articles make me confused. In order to simplify and clarify things, I'll presume I use ...
moztemur's user avatar
  • 101
0 votes
2 answers
119 views

How do I run a CI build in a docker image matching the current `Dockerfile` while being resource-aware?

Given a repository containing a Dockerfile that defines the build environment used by the CI pipeline as well as by the developer (e.g. as a Visual Studio Code devcontainer), the CI pipeline shall ...
Roland Sarrazin's user avatar
0 votes
1 answer
751 views

Setting up gitlab phpstan pipeline

I have tried to start using phpstan pipeline on gitlab according to this guide. The problem is that the pipeline does not work at all (Command 'sh' is not defined) and i don't know how to fix it. Here ...
Kyborek's user avatar
  • 103
0 votes
2 answers
71 views

Docker Compose on AWS

I have no experience with AWS and I would like to know what the best approach is when it comes to embedding an environment built using Docker Compose (a simple application with two services, API and ...
DevOpsBeginner's user avatar
1 vote
1 answer
29 views

What is difference between testing in context of CI and CT pipelines?

What is the difference between testing in the context of Continuous Integration pipeline vs testing in context of Continuous Testing pipeline? The definition of testing is a bit blurred to me in the ...
Lukasz Dynowski's user avatar
0 votes
0 answers
15 views

Missing values: gaps during deployments

Some context: I have little experience with ci/CD and manage a fast paced growing application since it saw the light of the day for the first time. It is composed by several microservices at different ...
the_piper's user avatar
0 votes
0 answers
38 views

CD on testing server with Docker and Jars

I am asking if this is an anti-pattern or not one of the best practices of CI. We have a testing server running Spring Boot Java applications backends inside containers. What we are doing now is : ...
joe1531's user avatar
  • 101
2 votes
1 answer
72 views

CI pipeline including upload to pypi repo

How should a ci pipeline be set up that publishes a python wheel to a private pypi server? Say I have a publish job like this one: publish: image: $PYTHON_IMAGE stage: publish before_script: ...
plazmakeks's user avatar
1 vote
1 answer
2k views

decode base64 Github Secrets

I am setting up a pipeline to run Cypress automated tests using github actions/workflows on my code anytime there is a push to the repo. I came into a scenario where I want to generate dyanmic .env ...
uneeb meer's user avatar
0 votes
1 answer
157 views

Run a dev server in CI pipeline

I have a CI pipeline setup using Github Action/Workflows, where I want to run Cypress Automated tests; however I am having some problems of when trying to run my dev server. Let me show you my ...
uneeb meer's user avatar
1 vote
1 answer
33 views

Check TZ in Container Image without creating instance?

I have a requirement to assure that the container image we build runs in UTC only. I'd like to avoid starting it up just to check the link on /etc/localtime. I thought maybe a tool like dive that ...
Josiah's user avatar
  • 333
1 vote
1 answer
500 views

Is it a good practice to run unit tests inside build job in Gitlab CI?

We want to run unit tests against a built Docker image and not by installing the environment inside Gitlab CI runner We don't want to push the docker image to a registry and pull it back in a test job ...
Alexander Reshytko's user avatar
1 vote
0 answers
92 views

From dev to production workflow

We are creating micro services environment which needs to be delivered to prod, now we want to start the CICD design, is there any reference which talks about getting from a Commit ->PR-> tests-&...
Alberto's user avatar
  • 111
6 votes
1 answer
3k views

Colored logging messages from Python script within GitLab CI

I am using a docker container for my GitLab CI and would like to have any output/logging messages in color inside the CI. What I mean: the commands from .gitlab-ci.yml are in color, but the outputs of ...
ziggyler's user avatar
3 votes
0 answers
1k views

Share cache between gitlab.com owned runner and self hosted runner

We are in the middle of migrating from Self Hosted GitLab to Gitlab.com (Cloud). This also means that we are shifting building through shell, to building through Docker (using Kaniko). A summary of ...
Jordi Kroon's user avatar
0 votes
1 answer
899 views

Deploying microservices in a consistent way using different gitlab repositories

I'm looking for a good organization to deploy our solution consisting in multiple apps using Gitlab and K8S. Our SaaS app that is made of : A backend app, mostly our API (django) A user app (React) ...
Yohan D's user avatar
  • 103
0 votes
3 answers
102 views

What is CI and how is it different from CT?

Wikipedia insists that (CI) is the practice of merging all developers' working copies to a shared mainline several times a day which sounds to me like "branches are prohibited" which makes ...
Vorac's user avatar
  • 103
0 votes
2 answers
1k views

What is the best practice for a multibranch pipeline configuration?

I'm messing around with a multibranch pipeline in jenkins. Currently we have zero pipelines in production and everything is using freestyle jobs which is very sloppy. I have my own multibranch ...
collin_tgz's user avatar
2 votes
0 answers
484 views

Pipeline could not pull repo in GitLab CI/CD

I have a the repo with test CI pipeline, which is the following: # .gitlab-ci.yml image: name: gcc build: stage: build script: - echo 123 And it fails: Running with gitlab-runner 14.3.1 (...
Ivan's user avatar
  • 121
3 votes
2 answers
285 views

Parametrize gitlab ci pipeline

There is the following simple pipeline: build → test → deploy that uses specified python version for all stages, for example 3.8. How can I scale (parametrize) it for python with versions: 3.7, 3.8 ...
Arseny's user avatar
  • 31
2 votes
1 answer
417 views

What's the best practice for managing / deploying multi-environments in production app?

I'm spinning up a production site and wanted to get advice on the latest best practices to manage and deploy multiple environments. At a high level, I'd like to have a good balance between keeping ...
user30768's user avatar
0 votes
1 answer
44 views

Continuous integration of an operating system

I want to hire a VPS but my problem is that most if not all of the VPS companies out there expect me to work with it as is and if I want to majorly upgrade it, I must, backup everything I have added ...
Semo's user avatar
  • 1
0 votes
1 answer
189 views

GitLab variable false but job is running

I'm triggering job via API, passing custom variables. Here is example request: curl -X POST -F token=${TRIGGER_TOKEN} -F ref=${branch} -F "variables[SHOULD_COPY_ASSETS]=false" This how job ...
monz777's user avatar
3 votes
1 answer
474 views

Incorporating python linter(flake8) in the CI/CD pipeline that use GitHub, Github Actions in a code base that is not in compliance

I have a codebase that is not in compliance with flake8. The CI/CD pipeline uses GitHub/GitHub actions. I would like to start adding python flake8 (to check for complexity, errors and code smells) ...
MasterOfTheHouse's user avatar
2 votes
1 answer
527 views

Deploy an application using dll files to IIS on a VM

I hope I am posting this in the correct forum, but to me at least, it seemed that the focus was more on deployment. I am currently stuck after having successfully refactored an application by ...
Sasquatch's user avatar
1 vote
1 answer
50 views

Sorting out automated testing in CI pipeline and getting conflicting information related to building, unit testing and Docker images

I seem to get a unique response for every person that I ask, or every article that I read, which is just confusing me even more. Basically, I'm trying to setup automated testing in the CI pipeline ...
cjones's user avatar
  • 155
1 vote
0 answers
110 views

Is it possible to control Packer from golang?

We use Terraform quite a bit and it has some nice tooling like Terratest where you can essentially call Terraform from within Golang wrapped inside an API with proper error handling. I wonder if ...
Mathis Van Eetvelde's user avatar
7 votes
1 answer
426 views

How would you build docker images in Kubernetes while distributing its layer caching among all pod builders at scale?

We are using Azure DevOps as our CICD platform. We have our own self hosted Linux agents which we integrated into our CICD Azure Kubernetes Cluster . We use these agents to build our Docker images ...
Shaked KO's user avatar
  • 129

1
2 3 4 5 6