2022 Developer Survey is open! Take survey.

Questions tagged [continuous-integration]

Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

Missing values: gaps during deployments

Some context: I have little experience with ci/CD and manage a fast paced growing application since it saw the light of the day for the first time. It is composed by several microservices at different ...
user avatar
0 votes
0 answers
12 views

"Lazy-building" of libraries with Jenkins

I have a project with multiple "products" which all use a common shared library. This shared library is a very great proportion of the compilation effort, so it would be good if we could ...
user avatar
0 votes
0 answers
15 views

What is LDAP and how it is configured in Docker containers?

Background- I am new to working with linux and docker, and I have been told to configure LDAP in a "oraclelinux-8 arm64v8" Docker image. (so that kerberos lookup can be done) What I have ...
user avatar
0 votes
0 answers
8 views

load list to pod running redis, from external source

I have a job which is running redis pod.: apiVersion: batch/v1 kind: Job metadata: name: redis-job spec: parallelism: 1 ttlSecondsAfterFinished: 10 template: metadata: name: redis-...
user avatar
0 votes
0 answers
9 views

which type of tenancy should be used in a large application in Mongo?

I know the difference between multi-tenancy and single tenancy. Single tenancy Single-tenancy is an architecture in which a single instance of a software application and supporting infrastructure ...
user avatar
0 votes
0 answers
19 views

When should I run Code Vulnerability Test in CI/CD?

I want to implement a pipeline with GitHub Action for testing and whenever there is a pull request for the main branch, the following test would be executed. My workflow is as below order: Linter ...
user avatar
  • 101
0 votes
0 answers
26 views

CD on testing server with Docker and Jars

I am asking if this is an anti-pattern or not one of the best practices of CI. We have a testing server running Spring Boot Java applications backends inside containers. What we are doing now is : ...
user avatar
0 votes
0 answers
20 views

Unsupported certificate option "-t" at cpanel terminal

I'm creating a ssh key authentication in the cpanel terminal as recommended by cpanel, So I'll be able to integrate git version control: https://support.cpanel.net/hc/en-us/articles/4404218477207-How-...
user avatar
0 votes
0 answers
17 views

How can I separate code build from container build for MRs?

I'd really like to optimize our CI builds. Currently every time I push a code change to an MR our gitlab runners a 20-to-40 minute job to build our docker image which is ~8 GB. My understanding is ...
user avatar
2 votes
1 answer
30 views

CI pipeline including upload to pypi repo

How should a ci pipeline be set up that publishes a python wheel to a private pypi server? Say I have a publish job like this one: publish: image: $PYTHON_IMAGE stage: publish before_script: ...
user avatar
0 votes
1 answer
225 views

decode base64 Github Secrets

I am setting up a pipeline to run Cypress automated tests using github actions/workflows on my code anytime there is a push to the repo. I came into a scenario where I want to generate dyanmic .env ...
user avatar
0 votes
1 answer
57 views

Run a dev server in CI pipeline

I have a CI pipeline setup using Github Action/Workflows, where I want to run Cypress Automated tests; however I am having some problems of when trying to run my dev server. Let me show you my ...
user avatar
0 votes
1 answer
18 views

Check TZ in Container Image without creating instance?

I have a requirement to assure that the container image we build runs in UTC only. I'd like to avoid starting it up just to check the link on /etc/localtime. I thought maybe a tool like dive that ...
user avatar
  • 273
0 votes
0 answers
490 views

Best practices for running UI tests using Playwright with Azure Pipelines

I'm very new when it comes to CI/CD. I know bits and pieces about testing during development. I'm here to find some guidance on connecting the dots of what I know into a functional workflow. I have a ...
user avatar
1 vote
1 answer
91 views

Is it a good practice to run unit tests inside build job in Gitlab CI?

We want to run unit tests against a built Docker image and not by installing the environment inside Gitlab CI runner We don't want to push the docker image to a registry and pull it back in a test job ...
user avatar
1 vote
0 answers
74 views

From dev to production workflow

We are creating micro services environment which needs to be delivered to prod, now we want to start the CICD design, is there any reference which talks about getting from a Commit ->PR-> tests-&...
user avatar
  • 111
3 votes
1 answer
470 views

Colored logging messages from Python script within GitLab CI

I am using a docker container for my GitLab CI and would like to have any output/logging messages in color inside the CI. What I mean: the commands from .gitlab-ci.yml are in color, but the outputs of ...
user avatar
2 votes
0 answers
341 views

Share cache between gitlab.com owned runner and self hosted runner

We are in the middle of migrating from Self Hosted GitLab to Gitlab.com (Cloud). This also means that we are shifting building through shell, to building through Docker (using Kaniko). A summary of ...
user avatar
0 votes
1 answer
153 views

Deploying microservices in a consistent way using different gitlab repositories

I'm looking for a good organization to deploy our solution consisting in multiple apps using Gitlab and K8S. Our SaaS app that is made of : A backend app, mostly our API (django) A user app (React) ...
user avatar
  • 103
0 votes
0 answers
68 views

Gitlab Parent-Child pipeline: using branches in the parent pipeline repository for new feature implementations

Environment: Parent-child pipeline branch off of main. Branch: testBranch Expected functioning config name: .scan.yml:refs/testBranch@url/scanPipeline Working config name (this uses the default master/...
user avatar
  • 101
0 votes
3 answers
65 views

What is CI and how is it different from CT?

Wikipedia insists that (CI) is the practice of merging all developers' working copies to a shared mainline several times a day which sounds to me like "branches are prohibited" which makes ...
user avatar
  • 103
0 votes
2 answers
181 views

What is the best practice for a multibranch pipeline configuration?

I'm messing around with a multibranch pipeline in jenkins. Currently we have zero pipelines in production and everything is using freestyle jobs which is very sloppy. I have my own multibranch ...
user avatar
0 votes
0 answers
13 views

Codepipeline , bitbucket cloud, and deployments dashboard

After reviewing this post, https://aws.amazon.com/blogs/devops/aws-codepipeline-build-status-in-a-third-party-git-repository/, I was able to set up feedback from AWS codepipeline in bitbucket and have ...
user avatar
  • 119
2 votes
0 answers
266 views

Pipeline could not pull repo in GitLab CI/CD

I have a the repo with test CI pipeline, which is the following: # .gitlab-ci.yml image: name: gcc build: stage: build script: - echo 123 And it fails: Running with gitlab-runner 14.3.1 (...
user avatar
  • 121
1 vote
1 answer
50 views

Parametrize gitlab ci pipeline

There is the following simple pipeline: build → test → deploy that uses specified python version for all stages, for example 3.8. How can I scale (parametrize) it for python with versions: 3.7, 3.8 ...
user avatar
  • 11
1 vote
0 answers
32 views

What's the best practice for managing / deploying multi-environments in production app?

I'm spinning up a production site and wanted to get advice on the latest best practices to manage and deploy multiple environments. At a high level, I'd like to have a good balance between keeping ...
user avatar
0 votes
0 answers
17 views

Is there any way to restrict the pipeline to deploy build artifact on feature branch push?

I have connected our bitbucket repository with the Acquia pipeline. I cloned the dev branch of our repo to local and checked out a new branch (dev-deeplink) out of it. After completing the feature, I ...
user avatar
0 votes
1 answer
39 views

Continuous integration of an operating system

I want to hire a VPS but my problem is that most if not all of the VPS companies out there expect me to work with it as is and if I want to majorly upgrade it, I must, backup everything I have added ...
user avatar
  • 1
0 votes
1 answer
51 views

GitLab variable false but job is running

I'm triggering job via API, passing custom variables. Here is example request: curl -X POST -F token=${TRIGGER_TOKEN} -F ref=${branch} -F "variables[SHOULD_COPY_ASSETS]=false" This how job ...
user avatar
2 votes
0 answers
113 views

Incorporating python linter(flake8) in the CI/CD pipeline that use GitHub, Github Actions in a code base that is not in compliance

I have a codebase that is not in compliance with flake8. The CI/CD pipeline uses GitHub/GitHub actions. I would like to start adding python flake8 (to check for complexity, errors and code smells) ...
user avatar
2 votes
1 answer
153 views

Deploy an application using dll files to IIS on a VM

I hope I am posting this in the correct forum, but to me at least, it seemed that the focus was more on deployment. I am currently stuck after having successfully refactored an application by ...
user avatar
1 vote
1 answer
40 views

Sorting out automated testing in CI pipeline and getting conflicting information related to building, unit testing and Docker images

I seem to get a unique response for every person that I ask, or every article that I read, which is just confusing me even more. Basically, I'm trying to setup automated testing in the CI pipeline ...
user avatar
  • 155
1 vote
0 answers
39 views

Is it possible to control Packer from golang?

We use Terraform quite a bit and it has some nice tooling like Terratest where you can essentially call Terraform from within Golang wrapped inside an API with proper error handling. I wonder if ...
user avatar
5 votes
1 answer
166 views

How would you build docker images in Kubernetes while distributing its layer caching among all pod builders at scale?

We are using Azure DevOps as our CICD platform. We have our own self hosted Linux agents which we integrated into our CICD Azure Kubernetes Cluster . We use these agents to build our Docker images ...
user avatar
  • 109
-1 votes
1 answer
460 views

How to get ConsoleFull Output,changeLog of upstream job along with downstream jobs console full output and changeLog in jenkins pipeline jobs!

Lets say we have Jobs A , B , C ,D and E. Job A triggers Job B ; Job B triggers Job C; Job C triggers Job D;, Job D triggers Job E; When one of the child job fails for example: Job c fails then email ...
user avatar
  • 1
3 votes
0 answers
41 views

Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?

If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
user avatar
  • 31
0 votes
3 answers
456 views

Do I have to include gitlab variables in my terraform code in order for my credentials to be recognized?

I am trying to set up a pipeline, which is supposed to deploy terraform code into an aws account. The code works fine locally, and I have setup and imported the state bucket and dynamodb table which ...
user avatar
  • 141
1 vote
1 answer
32 views

Testing docker image builds when low level libraries change

Background In our organization we have many small repos for shared libraries used among our applications. Particularly, we have many Python libraries and Python applications. We have a structures like:...
user avatar
  • 121
2 votes
1 answer
98 views

Should I struggle for minimalistic context in GitLab CI jobs?

I'm designing a build & deploy pipeline for our project. We have two jobs: build -- builds a docker image with our app and pushes it to a container registry. deploy -- communicates with an ...
user avatar
  • 123
0 votes
1 answer
32 views

How to create pipeline with jenkins? [closed]

I followed this tutorial and when i get to 29:32 the option "Build Pipeline View" is not displayed in the list i only get list view and my view.What can be the cause of this ? ( i followed ...
user avatar
1 vote
2 answers
782 views

Container Image Promotion across environments in ECR/ECS

We have started doing some initial work on deploying containers on ECS Fargate service. However we are not yet completely figured out how to manage our image promotion across different environments. ...
user avatar
0 votes
1 answer
161 views

Advantages of using Code-pipeline and Codebuild for CI/CD over Bitbucket pipeline?

What are the advantages of using AWS Codepipeline/code build for our pipeline over the bitbucket pipeline. ? Some of the factors that I can think of: Pricing? Pipeline for a serverless application ...
user avatar
  • 119
0 votes
1 answer
463 views

Gitlab CI/CD: deploy docker image to existing kubernetes cluster

I have node.js application that I need to deploy to exising kubernetes cluster. The cluster is setup using kops on AWS. I have created .gitlab-ci.yml file for building docker images. So, whenever a ...
user avatar
0 votes
1 answer
90 views

Auto create Jenkins jobs for branches and pull request via declarative code in scm

I am looking to auto create jobs in jenkins upon pull request , branches, master push etc similar to what we do in Gitlab. My SCM is butbucket here. I have so far setup docker based agent integration ...
user avatar
  • 3
2 votes
2 answers
5k views

Can I run multiple pipelines in a single GitLab repo using GitLab CI/CD?

I know that I can't have multiple gitlab-ci.yml files in one repo, but it still seems fairly limited. Say for example I have one set of tests I want to run whenever a change is pushed or on PRs, and ...
user avatar
  • 123
1 vote
2 answers
631 views

Gitlab runner fails with connection timeout

I have gitlab runner with, docker as executor and docker:latest as default image. Runner is connected to the project and runs pipeline, but it stuck at Reinitialized existing Git repository in /...
user avatar
1 vote
1 answer
71 views

Sonarqube taking massive amounts of memory

I am running Sonarqube on a monolithic application on our CI server and the scanner (not the Sonarqube server) is taking over 60GB of memory. Is this normal? What can I do so the scanner will not use ...
user avatar
  • 1,153
1 vote
0 answers
111 views

Monorepo manifests image tag replacement in Github Actions

I have a mono repo with NodeJS app (or better said, components of an app). There are 3 apps in the repo, each has its own directory and Dockerfile: /core /worker /frontend There’s also /deployments ...
user avatar
  • 111
2 votes
2 answers
102 views

How can I make artifacts available to the QA team with a user-friendly UI?

Currently developers push to master, jenkins picks that up, builds it, and then I go to artifacts, download the APK files and upload them in a Microsoft teams group so that the QA team can download ...
user avatar
0 votes
1 answer
295 views

Pull request and merge actions in CI/CD

The CI/CD pipeline supports pipelines per branch but no pipeline for feature branches is triggered automatically. There are pipelines deployed for the following branches: development, master. The ...
user avatar
  • 119

1
2 3 4 5