Questions tagged [continuous-integration]
Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.
224
questions
0
votes
0answers
23 views
Parametrize gitlab ci pipeline
There is the following simple pipeline:
build → test → deploy
that uses specified python version for all stages, for example 3.8.
How can I scale (parametrize) it for python with versions: 3.7, 3.8 ...
1
vote
0answers
17 views
What's the best practice for managing / deploying multi-environments in production app?
I'm spinning up a production site and wanted to get advice on the latest best practices to manage and deploy multiple environments. At a high level, I'd like to have a good balance between keeping ...
0
votes
0answers
13 views
Is there any way to restrict the pipeline to deploy build artifact on feature branch push?
I have connected our bitbucket repository with the Acquia pipeline.
I cloned the dev branch of our repo to local and checked out a new branch (dev-deeplink) out of it. After completing the feature, I ...
0
votes
1answer
32 views
Continuous integration of an operating system
I want to hire a VPS but my problem is that most if not all of the VPS companies out there expect me to work with it as is and if I want to majorly upgrade it, I must, backup everything I have added ...
0
votes
1answer
25 views
GitLab variable false but job is running
I'm triggering job via API, passing custom variables.
Here is example request: curl -X POST -F token=${TRIGGER_TOKEN} -F ref=${branch} -F "variables[SHOULD_COPY_ASSETS]=false"
This how job ...
2
votes
0answers
25 views
Incorporating python linter(flake8) in the CI/CD pipeline that use GitHub, Github Actions in a code base that is not in compliance
I have a codebase that is not in compliance with flake8. The CI/CD pipeline uses GitHub/GitHub actions. I would like to start adding python flake8 (to check for complexity, errors and code smells) ...
2
votes
1answer
46 views
Deploy an application using dll files to IIS on a VM
I hope I am posting this in the correct forum, but to me at least, it seemed that the focus was more on deployment.
I am currently stuck after having successfully refactored an application by ...
0
votes
0answers
20 views
CI upgrade vs new secnario verfication
we are creating a new CI system for our k8s services, the services (most of them are API's )are deployed to k8s and on each PR we are trigger our CI process
Currently we thought about 2 scenarios
...
1
vote
1answer
31 views
Sorting out automated testing in CI pipeline and getting conflicting information related to building, unit testing and Docker images
I seem to get a unique response for every person that I ask, or every article that I read, which is just confusing me even more.
Basically, I'm trying to setup automated testing in the CI pipeline ...
1
vote
0answers
23 views
Is it possible to control Packer from golang?
We use Terraform quite a bit and it has some nice tooling like Terratest where you can essentially call Terraform from within Golang wrapped inside an API with proper error handling.
I wonder if ...
5
votes
1answer
71 views
How would you build docker images in Kubernetes while distributing its layer caching among all pod builders at scale?
We are using Azure DevOps as our CICD platform.
We have our own self hosted Linux agents which we integrated into our CICD Azure Kubernetes Cluster .
We use these agents to build our Docker images ...
-1
votes
1answer
85 views
How to get ConsoleFull Output,changeLog of upstream job along with downstream jobs console full output and changeLog in jenkins pipeline jobs!
Lets say we have Jobs A , B , C ,D and E.
Job A triggers Job B ;
Job B triggers Job C;
Job C triggers Job D;,
Job D triggers Job E;
When one of the child job fails for example: Job c fails then email ...
2
votes
0answers
35 views
Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?
If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
0
votes
3answers
153 views
Do I have to include gitlab variables in my terraform code in order for my credentials to be recognized?
I am trying to set up a pipeline, which is supposed to deploy terraform code into an aws account. The code works fine locally, and I have setup and imported the state bucket and dynamodb table which ...
1
vote
1answer
29 views
Testing docker image builds when low level libraries change
Background
In our organization we have many small repos for shared libraries used among our applications. Particularly, we have many Python libraries and Python applications. We have a structures like:...
2
votes
1answer
79 views
Should I struggle for minimalistic context in GitLab CI jobs?
I'm designing a build & deploy pipeline for our project. We have two jobs:
build -- builds a docker image with our app and pushes it to a container registry.
deploy -- communicates with an ...
0
votes
1answer
31 views
How to create pipeline with jenkins? [closed]
I followed this tutorial and when i get to 29:32 the option "Build Pipeline View" is not displayed in the list i only get list view and my view.What can be the cause of this ? ( i followed ...
1
vote
2answers
250 views
Container Image Promotion across environments in ECR/ECS
We have started doing some initial work on deploying containers on ECS Fargate service.
However we are not yet completely figured out how to manage our image promotion across different environments.
...
0
votes
1answer
71 views
Advantages of using Code-pipeline and Codebuild for CI/CD over Bitbucket pipeline?
What are the advantages of using AWS Codepipeline/code build for our pipeline over the bitbucket pipeline. ?
Some of the factors that I can think of:
Pricing?
Pipeline for a serverless application
...
0
votes
1answer
231 views
Gitlab CI/CD: deploy docker image to existing kubernetes cluster
I have node.js application that I need to deploy to exising kubernetes cluster.
The cluster is setup using kops on AWS.
I have created .gitlab-ci.yml file for building docker images.
So, whenever a ...
0
votes
1answer
36 views
Auto create Jenkins jobs for branches and pull request via declarative code in scm
I am looking to auto create jobs in jenkins upon pull request , branches, master push etc similar to what we do in Gitlab. My SCM is butbucket here.
I have so far setup docker based agent integration ...
0
votes
2answers
1k views
Can I run multiple pipelines in a single GitLab repo using GitLab CI/CD?
I know that I can't have multiple gitlab-ci.yml files in one repo, but it still seems fairly limited. Say for example I have one set of tests I want to run whenever a change is pushed or on PRs, and ...
1
vote
2answers
329 views
Gitlab runner fails with connection timeout
I have gitlab runner with, docker as executor and docker:latest as default image.
Runner is connected to the project and runs pipeline, but it stuck at
Reinitialized existing Git repository in /...
1
vote
1answer
41 views
Sonarqube taking massive amounts of memory
I am running Sonarqube on a monolithic application on our CI server and the scanner (not the Sonarqube server) is taking over 60GB of memory.
Is this normal?
What can I do so the scanner will not use ...
1
vote
0answers
79 views
Monorepo manifests image tag replacement in Github Actions
I have a mono repo with NodeJS app (or better said, components of an app).
There are 3 apps in the repo, each has its own directory and Dockerfile:
/core
/worker
/frontend
There’s also /deployments ...
2
votes
2answers
62 views
How can I make artifacts available to the QA team with a user-friendly UI?
Currently developers push to master, jenkins picks that up, builds it, and then I go to artifacts, download the APK files and upload them in a Microsoft teams group so that the QA team can download ...
1
vote
0answers
184 views
Branching strategy and CI/CD
We are planning to use the Git-flow branching strategy with CI/CD. It's a conscious decision not to use Trunk based development.
Here's what the pipeline looks like:
Here's what the process looks ...
0
votes
1answer
144 views
Pull request and merge actions in CI/CD
The CI/CD pipeline supports pipelines per branch but no pipeline for feature branches is triggered automatically. There are pipelines deployed for the following branches: development, master. The ...
1
vote
0answers
26 views
Azure DevOps issue with GIT, Visual Studio and Azure (Umbraco)
I am completely new to Visual Studio, .net and Azure DevOps
I have a problem with GIT using the GIT bits (rather than CMD), in Visual Studio
I have a .Net application (Umbraco), that has been built ...
-1
votes
1answer
689 views
invalid base hashes in `extends` with 'include' -- gitlab-ci
I have a huge .gitlab-ci.yml file that I am trying to turn into the "main" ci file by moving some parts to another files which will then be called with the use of the "include" ...
2
votes
1answer
129 views
Using Docker images as vehicles for binary deployment artifacts
Let's say we're in an environment where we have a modern CI/CD pipeline for a number of containerized apps. We also have a number legacy apps which haven't been containerized yet.
I'm wondering how ...
0
votes
1answer
404 views
Trigger gitlab downstream pipeline from a upstream pipeline in a multi-project using trigger, rules and custom configuration variables
I have this scenario where I want to run the trigger in build stage only when $FLAG variable has been set by the .pre stage. However, the build stage never runs.
How should I conditionally trigger a ...
0
votes
1answer
19 views
iptables rules to permit GitHub Actions from breaking (chains default to DROP)
Assuming my iptables rules default to DROP on the INPUT and OUTPUT chains, what is the bare minimum set of rules that I must add to my chains to prevent a script running in GitHub Actions from ...
0
votes
1answer
171 views
devops - Optomizing gitlab cicd pipeline's caching
I have a gitlab yaml I've been working on for a bit and while everything works it seems like each job takes quite a bit longer than it should. I tend to think the culprit is that npm files are fetched ...
1
vote
0answers
29 views
Single Build Command / Continuous Integration
I was reading the Continuous Integration by Martin Fowler article yesterday, the article is from 2006 but I think it is still very applicable today, the statement around a single command stuck in my ...
1
vote
2answers
269 views
gitlab CI job fails after manual ftp deploy (lftp) command completes successfully
Scenario
I'm using LFTP to deploy files via sftp. The transfer completes successfully and all files get to the destination but for some reason the job fails.
Question
How can I find out what is ...
1
vote
1answer
63 views
How to render assets when building a static website with GitLab Pages and Jekyll
I'm using Jekyll to build a static site and deploy it with GitLab Pages. This site is compounded of posts (contained in the site/_posts folder) and refer to other HTML and Markdown documents that I ...
1
vote
1answer
66 views
How to copy library source code from other Git repo to an Android Gradle application GitLab build process?
There is an Android application using Grandle for build. It uses a "library" stated in build.gradle file:
dependencies {
api project(path: ':specialproject.speciallibrary', configuration:...
1
vote
1answer
34 views
Devops CICD run ReactJS application while testing with jest + puppeteer [closed]
Scenario
I'm working on getting my end-to-end tests to work in a GitLab pipeline. Currently all the tests run locally but I'm having an issue getting them to run using GitLab's continuous integration ...
0
votes
1answer
273 views
Gitlab CI push to docker-registry fails
I have GitLab server and a separate docker-registry. I have created a testuser with a testpassword.
My .gitlab-ci.yml
image: docker:latest
services:
- docker:18.09.7-dind
variables:
...
2
votes
1answer
185 views
Gitlab: Always having the possibility to launch a manual job (even if something failed before)
I'm using gitlab-ci. I have a pipeline that has the following steps :
code-verification
some tests
deploy (manual)
some more tests
rollback (manual)
Both the deploy and the rollback job have to ...
2
votes
1answer
169 views
How to specify 'os' for free gitlab runners ('runs-on' equivalent)
How can I specify the operating system in the .gitlab-ci file to indicate which underlying OS on which the gitlab-runner should be running when using the 2,000 minutes of free execution in with gitlab....
2
votes
1answer
55 views
Create pull request for docker dependency package if outdated
Platform: GitHub
CI/CD: GitHub Actions
Additional technologies: Docker with Ubuntu base image
I'm creating a Dockerfile and I need to install a package (such as Terraform). Every time the '...
1
vote
3answers
118 views
Run integration test with ansible playbook using terraform provisioning
Ok so I am totally new to devops! I am an experienced developer, but at my new job I have been tasked to automate CI/CD. Non-existing so far. Only CI with Travis.
So the ideal workflow is:
Push to CI ...
1
vote
1answer
27 views
Does Buildbot support complicated build/deploy scenarios?
I need a tool/framework for CI/CD which can:
Support multi-repository project
Build and ship only changed part (frontend/backend) using revison hashes to decide
Ship some branches (release candidate ...
6
votes
2answers
1k views
How is it a good practice to version your helm charts for each deployment?
I'm trying to set up a process to release a web app with helm in my company and I can't find a satisfying way.
Basically each for each push in a feature branch, I want to:
Build a docker image and ...
0
votes
1answer
51 views
What are the daily job duties of a devops? [duplicate]
I have been working for linux management over 10 years. In the last 5 years, I have added a lot of coding experience through software development like php, ruby, go, etc. I wanna be a devops, but I ...
1
vote
1answer
46 views
Continuous deployment
I have a nodejs application using expressjs. This server is handing a website built on vuejs, an application using angular and another angular app. Everything is working and I deployed to AWS eb using ...
0
votes
1answer
750 views
How comes a GitLab CI/CD job cant' find its artifacts?
In the Open Source ventilator project, we aim to provide those who focus on testing with a ready-to-go flash file for the Arduino controller board.
While the binaries seem to be there, for some ...
1
vote
1answer
177 views
What can be considered as an artifact [duplicate]
Recently, I have had a lecture at my university about advanced testing and CI. To understand all concepts, I was searching what artifact represents, specifically in DevOps sphere. I found many ...
