Questions tagged [continuous-integration]
Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.
246
questions
0
votes
0
answers
12
views
Missing values: gaps during deployments
Some context:
I have little experience with ci/CD and manage a fast paced growing application since it saw the light of the day for the first time. It is composed by several microservices at different ...
- 33
0
votes
0
answers
12
views
"Lazy-building" of libraries with Jenkins
I have a project with multiple "products" which all use a common shared library. This shared library is a very great proportion of the compilation effort, so it would be good if we could ...
- 101
0
votes
0
answers
15
views
What is LDAP and how it is configured in Docker containers?
Background-
I am new to working with linux and docker, and I have been told to configure LDAP in a "oraclelinux-8 arm64v8" Docker image. (so that kerberos lookup can be done)
What I have ...
0
votes
0
answers
8
views
load list to pod running redis, from external source
I have a job which is running redis pod.:
apiVersion: batch/v1
kind: Job
metadata:
name: redis-job
spec:
parallelism: 1
ttlSecondsAfterFinished: 10
template:
metadata:
name: redis-...
0
votes
0
answers
9
views
which type of tenancy should be used in a large application in Mongo?
I know the difference between multi-tenancy and single tenancy.
Single tenancy
Single-tenancy is an architecture in which a single instance of a software application and supporting infrastructure ...
- 101
0
votes
0
answers
19
views
When should I run Code Vulnerability Test in CI/CD?
I want to implement a pipeline with GitHub Action for testing and whenever there is a pull request for the main branch, the following test would be executed.
My workflow is as below order:
Linter ...
- 101
0
votes
0
answers
26
views
CD on testing server with Docker and Jars
I am asking if this is an anti-pattern or not one of the best practices of CI.
We have a testing server running Spring Boot Java applications backends inside containers.
What we are doing now is :
...
- 1
0
votes
0
answers
20
views
Unsupported certificate option "-t" at cpanel terminal
I'm creating a ssh key authentication in the cpanel terminal as recommended by cpanel, So I'll be able to integrate git version control:
https://support.cpanel.net/hc/en-us/articles/4404218477207-How-...
- 3
0
votes
0
answers
17
views
How can I separate code build from container build for MRs?
I'd really like to optimize our CI builds. Currently every time I push a code change to an MR our gitlab runners a 20-to-40 minute job to build our docker image which is ~8 GB. My understanding is ...
2
votes
1
answer
30
views
CI pipeline including upload to pypi repo
How should a ci pipeline be set up that publishes a python wheel to a private pypi server?
Say I have a publish job like this one:
publish:
image: $PYTHON_IMAGE
stage: publish
before_script:
...
- 21
0
votes
1
answer
225
views
decode base64 Github Secrets
I am setting up a pipeline to run Cypress automated tests using github actions/workflows on my code anytime there is a push to the repo. I came into a scenario where I want to generate dyanmic .env ...
- 123
0
votes
1
answer
57
views
Run a dev server in CI pipeline
I have a CI pipeline setup using Github Action/Workflows, where I want to run Cypress Automated tests; however I am having some problems of when trying to run my dev server. Let me show you my ...
- 123
0
votes
1
answer
18
views
Check TZ in Container Image without creating instance?
I have a requirement to assure that the container image we build runs in UTC only. I'd like to avoid starting it up just to check the link on /etc/localtime. I thought maybe a tool like dive that ...
- 273
0
votes
0
answers
490
views
Best practices for running UI tests using Playwright with Azure Pipelines
I'm very new when it comes to CI/CD. I know bits and pieces about testing during development. I'm here to find some guidance on connecting the dots of what I know into a functional workflow.
I have a ...
- 101
1
vote
1
answer
91
views
Is it a good practice to run unit tests inside build job in Gitlab CI?
We want to run unit tests against a built Docker image and not by installing the environment inside Gitlab CI runner
We don't want to push the docker image to a registry and pull it back in a test job ...
1
vote
0
answers
74
views
From dev to production workflow
We are creating micro services environment which needs to be delivered to prod, now we want to start the CICD design, is there any reference which talks about getting from a Commit ->PR-> tests-&...
- 111
3
votes
1
answer
470
views
Colored logging messages from Python script within GitLab CI
I am using a docker container for my GitLab CI and would like to have any output/logging messages in color inside the CI. What I mean: the commands from .gitlab-ci.yml are in color, but the outputs of ...
- 33
2
votes
0
answers
341
views
Share cache between gitlab.com owned runner and self hosted runner
We are in the middle of migrating from Self Hosted GitLab to Gitlab.com (Cloud). This also means that we are shifting building through shell, to building through Docker (using Kaniko).
A summary of ...
- 121
0
votes
1
answer
153
views
Deploying microservices in a consistent way using different gitlab repositories
I'm looking for a good organization to deploy our solution consisting in multiple apps using Gitlab and K8S.
Our SaaS app that is made of :
A backend app, mostly our API (django)
A user app (React)
...
- 103
0
votes
0
answers
68
views
Gitlab Parent-Child pipeline: using branches in the parent pipeline repository for new feature implementations
Environment: Parent-child pipeline branch off of main.
Branch: testBranch
Expected functioning config name:
.scan.yml:refs/testBranch@url/scanPipeline
Working config name (this uses the default master/...
- 101
0
votes
3
answers
65
views
What is CI and how is it different from CT?
Wikipedia insists that
(CI) is the practice of merging all developers' working copies to a shared mainline several times a day
which sounds to me like "branches are prohibited" which makes ...
- 103
0
votes
2
answers
181
views
What is the best practice for a multibranch pipeline configuration?
I'm messing around with a multibranch pipeline in jenkins. Currently we have zero pipelines in production and everything is using freestyle jobs which is very sloppy. I have my own multibranch ...
0
votes
0
answers
13
views
Codepipeline , bitbucket cloud, and deployments dashboard
After reviewing this post, https://aws.amazon.com/blogs/devops/aws-codepipeline-build-status-in-a-third-party-git-repository/, I was able to set up feedback from AWS codepipeline in bitbucket and have ...
- 119
2
votes
0
answers
266
views
Pipeline could not pull repo in GitLab CI/CD
I have a the repo with test CI pipeline, which is the following:
# .gitlab-ci.yml
image:
name: gcc
build:
stage: build
script:
- echo 123
And it fails:
Running with gitlab-runner 14.3.1 (...
- 121
1
vote
1
answer
50
views
Parametrize gitlab ci pipeline
There is the following simple pipeline:
build → test → deploy
that uses specified python version for all stages, for example 3.8.
How can I scale (parametrize) it for python with versions: 3.7, 3.8 ...
- 11
1
vote
0
answers
32
views
What's the best practice for managing / deploying multi-environments in production app?
I'm spinning up a production site and wanted to get advice on the latest best practices to manage and deploy multiple environments. At a high level, I'd like to have a good balance between keeping ...
- 11
0
votes
0
answers
17
views
Is there any way to restrict the pipeline to deploy build artifact on feature branch push?
I have connected our bitbucket repository with the Acquia pipeline.
I cloned the dev branch of our repo to local and checked out a new branch (dev-deeplink) out of it. After completing the feature, I ...
0
votes
1
answer
39
views
Continuous integration of an operating system
I want to hire a VPS but my problem is that most if not all of the VPS companies out there expect me to work with it as is and if I want to majorly upgrade it, I must, backup everything I have added ...
- 1
0
votes
1
answer
51
views
GitLab variable false but job is running
I'm triggering job via API, passing custom variables.
Here is example request: curl -X POST -F token=${TRIGGER_TOKEN} -F ref=${branch} -F "variables[SHOULD_COPY_ASSETS]=false"
This how job ...
- 1
2
votes
0
answers
113
views
Incorporating python linter(flake8) in the CI/CD pipeline that use GitHub, Github Actions in a code base that is not in compliance
I have a codebase that is not in compliance with flake8. The CI/CD pipeline uses GitHub/GitHub actions. I would like to start adding python flake8 (to check for complexity, errors and code smells) ...
- 121
2
votes
1
answer
153
views
Deploy an application using dll files to IIS on a VM
I hope I am posting this in the correct forum, but to me at least, it seemed that the focus was more on deployment.
I am currently stuck after having successfully refactored an application by ...
- 31
1
vote
1
answer
40
views
Sorting out automated testing in CI pipeline and getting conflicting information related to building, unit testing and Docker images
I seem to get a unique response for every person that I ask, or every article that I read, which is just confusing me even more.
Basically, I'm trying to setup automated testing in the CI pipeline ...
- 155
1
vote
0
answers
39
views
Is it possible to control Packer from golang?
We use Terraform quite a bit and it has some nice tooling like Terratest where you can essentially call Terraform from within Golang wrapped inside an API with proper error handling.
I wonder if ...
5
votes
1
answer
166
views
How would you build docker images in Kubernetes while distributing its layer caching among all pod builders at scale?
We are using Azure DevOps as our CICD platform.
We have our own self hosted Linux agents which we integrated into our CICD Azure Kubernetes Cluster .
We use these agents to build our Docker images ...
- 109
-1
votes
1
answer
460
views
How to get ConsoleFull Output,changeLog of upstream job along with downstream jobs console full output and changeLog in jenkins pipeline jobs!
Lets say we have Jobs A , B , C ,D and E.
Job A triggers Job B ;
Job B triggers Job C;
Job C triggers Job D;,
Job D triggers Job E;
When one of the child job fails for example: Job c fails then email ...
- 1
3
votes
0
answers
41
views
Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?
If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
- 31
0
votes
3
answers
456
views
Do I have to include gitlab variables in my terraform code in order for my credentials to be recognized?
I am trying to set up a pipeline, which is supposed to deploy terraform code into an aws account. The code works fine locally, and I have setup and imported the state bucket and dynamodb table which ...
- 141
1
vote
1
answer
32
views
Testing docker image builds when low level libraries change
Background
In our organization we have many small repos for shared libraries used among our applications. Particularly, we have many Python libraries and Python applications. We have a structures like:...
- 121
2
votes
1
answer
98
views
Should I struggle for minimalistic context in GitLab CI jobs?
I'm designing a build & deploy pipeline for our project. We have two jobs:
build -- builds a docker image with our app and pushes it to a container registry.
deploy -- communicates with an ...
- 123
0
votes
1
answer
32
views
How to create pipeline with jenkins? [closed]
I followed this tutorial and when i get to 29:32 the option "Build Pipeline View" is not displayed in the list i only get list view and my view.What can be the cause of this ? ( i followed ...
- 105
1
vote
2
answers
782
views
Container Image Promotion across environments in ECR/ECS
We have started doing some initial work on deploying containers on ECS Fargate service.
However we are not yet completely figured out how to manage our image promotion across different environments.
...
- 111
0
votes
1
answer
161
views
Advantages of using Code-pipeline and Codebuild for CI/CD over Bitbucket pipeline?
What are the advantages of using AWS Codepipeline/code build for our pipeline over the bitbucket pipeline. ?
Some of the factors that I can think of:
Pricing?
Pipeline for a serverless application
...
- 119
0
votes
1
answer
463
views
Gitlab CI/CD: deploy docker image to existing kubernetes cluster
I have node.js application that I need to deploy to exising kubernetes cluster.
The cluster is setup using kops on AWS.
I have created .gitlab-ci.yml file for building docker images.
So, whenever a ...
- 101
0
votes
1
answer
90
views
Auto create Jenkins jobs for branches and pull request via declarative code in scm
I am looking to auto create jobs in jenkins upon pull request , branches, master push etc similar to what we do in Gitlab. My SCM is butbucket here.
I have so far setup docker based agent integration ...
- 3
2
votes
2
answers
5k
views
Can I run multiple pipelines in a single GitLab repo using GitLab CI/CD?
I know that I can't have multiple gitlab-ci.yml files in one repo, but it still seems fairly limited. Say for example I have one set of tests I want to run whenever a change is pushed or on PRs, and ...
- 123
1
vote
2
answers
631
views
Gitlab runner fails with connection timeout
I have gitlab runner with, docker as executor and docker:latest as default image.
Runner is connected to the project and runs pipeline, but it stuck at
Reinitialized existing Git repository in /...
1
vote
1
answer
71
views
Sonarqube taking massive amounts of memory
I am running Sonarqube on a monolithic application on our CI server and the scanner (not the Sonarqube server) is taking over 60GB of memory.
Is this normal?
What can I do so the scanner will not use ...
- 1,153
1
vote
0
answers
111
views
Monorepo manifests image tag replacement in Github Actions
I have a mono repo with NodeJS app (or better said, components of an app).
There are 3 apps in the repo, each has its own directory and Dockerfile:
/core
/worker
/frontend
There’s also /deployments ...
- 111
2
votes
2
answers
102
views
How can I make artifacts available to the QA team with a user-friendly UI?
Currently developers push to master, jenkins picks that up, builds it, and then I go to artifacts, download the APK files and upload them in a Microsoft teams group so that the QA team can download ...
0
votes
1
answer
295
views
Pull request and merge actions in CI/CD
The CI/CD pipeline supports pipelines per branch but no pipeline for feature branches is triggered automatically. There are pipelines deployed for the following branches: development, master. The ...
- 119