Questions tagged [continuous-integration]
Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.
224
questions
0
votes
0answers
18 views
minimal VM image for running docker
I'm looking for a minimal VM to build docker images in a self-hosted (gitlab-)CI environment.
For security reasons, i don't want to enable DinD on my normal build nodes.
Instead, I want to use a ...
1
vote
0answers
15 views
Is it possible to control Packer from golang?
We use Terraform quite a bit and it has some nice tooling like Terratest where you can essentially call Terraform from within Golang wrapped inside an API with proper error handling.
I wonder if ...
5
votes
0answers
39 views
+50
How would you build docker images in Kubernetes while distributing its layer caching among all pod builders at scale?
We are using Azure DevOps as our CICD platform.
We have our own self hosted Linux agents which we integrated into our CICD Azure Kubernetes Cluster .
We use these agents to build our Docker images ...
-1
votes
0answers
8 views
How to get ConsoleFull Output,changeLog of upstream job along with downstream jobs console full output and changeLog in jenkins pipeline jobs!
Lets say we have Jobs A , B , C ,D and E.
Job A triggers Job B ;
Job B triggers Job C;
Job C triggers Job D;,
Job D triggers Job E;
When one of the child job fails for example: Job c fails then email ...
2
votes
0answers
32 views
Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?
If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
0
votes
2answers
52 views
Do I have to include gitlab variables in my terraform code in order for my credentials to be recognized?
I am trying to set up a pipeline, which is supposed to deploy terraform code into an aws account. The code works fine locally, and I have setup and imported the state bucket and dynamodb table which ...
1
vote
1answer
28 views
Testing docker image builds when low level libraries change
Background
In our organization we have many small repos for shared libraries used among our applications. Particularly, we have many Python libraries and Python applications. We have a structures like:...
2
votes
1answer
74 views
Should I struggle for minimalistic context in GitLab CI jobs?
I'm designing a build & deploy pipeline for our project. We have two jobs:
build -- builds a docker image with our app and pushes it to a container registry.
deploy -- communicates with an ...
0
votes
1answer
29 views
How to create pipeline with jenkins? [closed]
I followed this tutorial and when i get to 29:32 the option "Build Pipeline View" is not displayed in the list i only get list view and my view.What can be the cause of this ? ( i followed ...
0
votes
2answers
131 views
Container Image Promotion across environments in ECR/ECS
We have started doing some initial work on deploying containers on ECS Fargate service.
However we are not yet completely figured out how to manage our image promotion across different environments.
...
0
votes
1answer
36 views
Advantages of using Code-pipeline and Codebuild for CI/CD over Bitbucket pipeline?
What are the advantages of using AWS Codepipeline/code build for our pipeline over the bitbucket pipeline. ?
Some of the factors that I can think of:
Pricing?
Pipeline for a serverless application
...
0
votes
1answer
172 views
Gitlab CI/CD: deploy docker image to existing kubernetes cluster
I have node.js application that I need to deploy to exising kubernetes cluster.
The cluster is setup using kops on AWS.
I have created .gitlab-ci.yml file for building docker images.
So, whenever a ...
0
votes
0answers
22 views
Rebuilding, unit testing, etc if a microservice hasn't been changed
Lets say you have the following services:
admin
api
client
But there are only changes to admin.
And your pipeline is like the following:
1. PR ->
2. Build microservice ->
3. Unit test ...
0
votes
1answer
31 views
Auto create Jenkins jobs for branches and pull request via declarative code in scm
I am looking to auto create jobs in jenkins upon pull request , branches, master push etc similar to what we do in Gitlab. My SCM is butbucket here.
I have so far setup docker based agent integration ...
-1
votes
0answers
7 views
Is it possible to set ENV vars dynamically in Buildkite Pipeline?
I'm looking to add a step to Buildkite Pipeline, that would run certain commands (execute shell file basically) and set some ENV variables that I can use as conditionals in consequent steps. Is it ...
0
votes
2answers
329 views
Can I run multiple pipelines in a single GitLab repo using GitLab CI/CD?
I know that I can't have multiple gitlab-ci.yml files in one repo, but it still seems fairly limited. Say for example I have one set of tests I want to run whenever a change is pushed or on PRs, and ...
1
vote
2answers
181 views
Gitlab runner fails with connection timeout
I have gitlab runner with, docker as executor and docker:latest as default image.
Runner is connected to the project and runs pipeline, but it stuck at
Reinitialized existing Git repository in /...
1
vote
1answer
34 views
Sonarqube taking massive amounts of memory
I am running Sonarqube on a monolithic application on our CI server and the scanner (not the Sonarqube server) is taking over 60GB of memory.
Is this normal?
What can I do so the scanner will not use ...
1
vote
0answers
65 views
Monorepo manifests image tag replacement in Github Actions
I have a mono repo with NodeJS app (or better said, components of an app).
There are 3 apps in the repo, each has its own directory and Dockerfile:
/core
/worker
/frontend
There’s also /deployments ...
2
votes
2answers
59 views
How can I make artifacts available to the QA team with a user-friendly UI?
Currently developers push to master, jenkins picks that up, builds it, and then I go to artifacts, download the APK files and upload them in a Microsoft teams group so that the QA team can download ...
1
vote
0answers
116 views
Branching strategy and CI/CD
We are planning to use the Git-flow branching strategy with CI/CD. It's a conscious decision not to use Trunk based development.
Here's what the pipeline looks like:
Here's what the process looks ...
0
votes
0answers
17 views
Setting up PR Build in Jenkins when raised from stash
Setting up a PR request to have a build run in Jenkins. Our source repository is Stash.
Essentially, the PR will be from any branch (each developer will create their own branches) to develop
I have ...
0
votes
1answer
68 views
Pull request and merge actions in CI/CD
The CI/CD pipeline supports pipelines per branch but no pipeline for feature branches is triggered automatically. There are pipelines deployed for the following branches: development, master. The ...
-1
votes
0answers
15 views
How to lunch a Digital Ocean dropplet directly into a container Image?
From a CI pipeline I would like to be able to do the following.
Launch a droplet of a specific cpu/ram configuration with metadata to run a specific container image on start up
have the droplet run a ...
1
vote
0answers
25 views
Azure DevOps issue with GIT, Visual Studio and Azure (Umbraco)
I am completely new to Visual Studio, .net and Azure DevOps
I have a problem with GIT using the GIT bits (rather than CMD), in Visual Studio
I have a .Net application (Umbraco), that has been built ...
-1
votes
1answer
469 views
invalid base hashes in `extends` with 'include' — gitlab-ci
I have a huge .gitlab-ci.yml file that I am trying to turn into the "main" ci file by moving some parts to another files which will then be called with the use of the "include" ...
2
votes
1answer
109 views
Using Docker images as vehicles for binary deployment artifacts
Let's say we're in an environment where we have a modern CI/CD pipeline for a number of containerized apps. We also have a number legacy apps which haven't been containerized yet.
I'm wondering how ...
0
votes
1answer
275 views
Trigger gitlab downstream pipeline from a upstream pipeline in a multi-project using trigger, rules and custom configuration variables
I have this scenario where I want to run the trigger in build stage only when $FLAG variable has been set by the .pre stage. However, the build stage never runs.
How should I conditionally trigger a ...
0
votes
0answers
27 views
How can I provide an unpackaged vendor binary to my build environment?
I want to run CI processes that depend on a vendor application which is released periodically as a new ZIP file (about 500MB), downloaded from behind a login on the vendor's website. When a new ...
0
votes
1answer
19 views
iptables rules to permit GitHub Actions from breaking (chains default to DROP)
Assuming my iptables rules default to DROP on the INPUT and OUTPUT chains, what is the bare minimum set of rules that I must add to my chains to prevent a script running in GitHub Actions from ...
-1
votes
0answers
73 views
Deploying angular app to Azure with Github Actions failed. package.json not found
I am trying to deploy an Angular(10) WebApp to Azure with CI/CD using the Github Actions but I get an error saying the package.json cannot be found while running the npm install command.
This is my ...
0
votes
1answer
93 views
devops - Optomizing gitlab cicd pipeline's caching
I have a gitlab yaml I've been working on for a bit and while everything works it seems like each job takes quite a bit longer than it should. I tend to think the culprit is that npm files are fetched ...
1
vote
0answers
24 views
Single Build Command / Continuous Integration
I was reading the Continuous Integration by Martin Fowler article yesterday, the article is from 2006 but I think it is still very applicable today, the statement around a single command stuck in my ...
1
vote
2answers
209 views
gitlab CI job fails after manual ftp deploy (lftp) command completes successfully
Scenario
I'm using LFTP to deploy files via sftp. The transfer completes successfully and all files get to the destination but for some reason the job fails.
Question
How can I find out what is ...
1
vote
1answer
51 views
How to render assets when building a static website with GitLab Pages and Jekyll
I'm using Jekyll to build a static site and deploy it with GitLab Pages. This site is compounded of posts (contained in the site/_posts folder) and refer to other HTML and Markdown documents that I ...
1
vote
1answer
46 views
How to copy library source code from other Git repo to an Android Gradle application GitLab build process?
There is an Android application using Grandle for build. It uses a "library" stated in build.gradle file:
dependencies {
api project(path: ':specialproject.speciallibrary', configuration:...
1
vote
1answer
30 views
Devops CICD run ReactJS application while testing with jest + puppeteer [closed]
Scenario
I'm working on getting my end-to-end tests to work in a GitLab pipeline. Currently all the tests run locally but I'm having an issue getting them to run using GitLab's continuous integration ...
0
votes
1answer
239 views
Gitlab CI push to docker-registry fails
I have GitLab server and a separate docker-registry. I have created a testuser with a testpassword.
My .gitlab-ci.yml
image: docker:latest
services:
- docker:18.09.7-dind
variables:
...
1
vote
0answers
21 views
Pipeline gitlab showned as “running” even though it isn't
I'm using gitlab CI/CD and I have a pipeline which does the following things :
code verification
build
some test
deploy in a test environment (manual)
Some more tests
If we don't do the deploy, ...
2
votes
1answer
135 views
Gitlab: Always having the possibility to launch a manual job (even if something failed before)
I'm using gitlab-ci. I have a pipeline that has the following steps :
code-verification
some tests
deploy (manual)
some more tests
rollback (manual)
Both the deploy and the rollback job have to ...
2
votes
1answer
119 views
How to specify 'os' for free gitlab runners ('runs-on' equivalent)
How can I specify the operating system in the .gitlab-ci file to indicate which underlying OS on which the gitlab-runner should be running when using the 2,000 minutes of free execution in with gitlab....
2
votes
1answer
54 views
Create pull request for docker dependency package if outdated
Platform: GitHub
CI/CD: GitHub Actions
Additional technologies: Docker with Ubuntu base image
I'm creating a Dockerfile and I need to install a package (such as Terraform). Every time the '...
1
vote
3answers
96 views
Run integration test with ansible playbook using terraform provisioning
Ok so I am totally new to devops! I am an experienced developer, but at my new job I have been tasked to automate CI/CD. Non-existing so far. Only CI with Travis.
So the ideal workflow is:
Push to CI ...
1
vote
1answer
25 views
Does Buildbot support complicated build/deploy scenarios?
I need a tool/framework for CI/CD which can:
Support multi-repository project
Build and ship only changed part (frontend/backend) using revison hashes to decide
Ship some branches (release candidate ...
6
votes
2answers
958 views
How is it a good practice to version your helm charts for each deployment?
I'm trying to set up a process to release a web app with helm in my company and I can't find a satisfying way.
Basically each for each push in a feature branch, I want to:
Build a docker image and ...
1
vote
0answers
13 views
How do I add my own package to a GitHub workflow?
I am trying to use the basic .NET Core Github workflow as shown here, but I am having trouble with a GitHub package I created. When the workflow gets to the Install Depedencies which performs a donet ...
0
votes
1answer
46 views
What are the daily job duties of a devops? [duplicate]
I have been working for linux management over 10 years. In the last 5 years, I have added a lot of coding experience through software development like php, ruby, go, etc. I wanna be a devops, but I ...
1
vote
1answer
45 views
Continuous deployment
I have a nodejs application using expressjs. This server is handing a website built on vuejs, an application using angular and another angular app. Everything is working and I deployed to AWS eb using ...
0
votes
1answer
433 views
How comes a GitLab CI/CD job cant' find its artifacts?
In the Open Source ventilator project, we aim to provide those who focus on testing with a ready-to-go flash file for the Arduino controller board.
While the binaries seem to be there, for some ...
1
vote
1answer
165 views
What can be considered as an artifact [duplicate]
Recently, I have had a lecture at my university about advanced testing and CI. To understand all concepts, I was searching what artifact represents, specifically in DevOps sphere. I found many ...
