Questions tagged [continuous-integration]
Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.
221
questions
0
votes
0answers
6 views
Testing docker image builds when low level libraries change
Background
In our organization we have many small repos for shared libraries used among our applications. Particularly, we have many Python libraries and Python applications. We have a structures like:...
0
votes
0answers
29 views
Should I struggle for minimalistic context in GitLab CI jobs?
I'm designing a build & deploy pipeline for our project. We have two jobs:
build -- builds a docker image with our app and pushes it to a container registry.
deploy -- communicates with an ...
0
votes
1answer
21 views
How to create pipeline with jenkins? [closed]
I followed this tutorial and when i get to 29:32 the option "Build Pipeline View" is not displayed in the list i only get list view and my view.What can be the cause of this ? ( i followed ...
0
votes
2answers
26 views
Container Image Promotion across environments in ECR/ECS
We have started doing some initial work on deploying containers on ECS Fargate service.
However we are not yet completely figured out how to manage our image promotion across different environments.
...
0
votes
1answer
11 views
Advantages of using Code-pipeline and Codebuild for CI/CD over Bitbucket pipeline?
What are the advantages of using AWS Codepipeline/code build for our pipeline over the bitbucket pipeline. ?
Some of the factors that I can think of:
Pricing?
Pipeline for a serverless application
...
0
votes
1answer
47 views
Gitlab CI/CD: deploy docker image to existing kubernetes cluster
I have node.js application that I need to deploy to exising kubernetes cluster.
The cluster is setup using kops on AWS.
I have created .gitlab-ci.yml file for building docker images.
So, whenever a ...
0
votes
0answers
22 views
Rebuilding, unit testing, etc if a microservice hasn't been changed
Lets say you have the following services:
admin
api
client
But there are only changes to admin.
And your pipeline is like the following:
1. PR ->
2. Build microservice ->
3. Unit test ...
0
votes
1answer
23 views
Auto create Jenkins jobs for branches and pull request via declarative code in scm
I am looking to auto create jobs in jenkins upon pull request , branches, master push etc similar to what we do in Gitlab. My SCM is butbucket here.
I have so far setup docker based agent integration ...
0
votes
0answers
5 views
Is it possible to set ENV vars dynamically in Buildkite Pipeline?
I'm looking to add a step to Buildkite Pipeline, that would run certain commands (execute shell file basically) and set some ENV variables that I can use as conditionals in consequent steps. Is it ...
0
votes
2answers
42 views
Can I run multiple pipelines in a single GitLab repo using GitLab CI/CD?
I know that I can't have multiple gitlab-ci.yml files in one repo, but it still seems fairly limited. Say for example I have one set of tests I want to run whenever a change is pushed or on PRs, and ...
1
vote
2answers
50 views
Gitlab runner fails with connection timeout
I have gitlab runner with, docker as executor and docker:latest as default image.
Runner is connected to the project and runs pipeline, but it stuck at
Reinitialized existing Git repository in /...
1
vote
1answer
30 views
Sonarqube taking massive amounts of memory
I am running Sonarqube on a monolithic application on our CI server and the scanner (not the Sonarqube server) is taking over 60GB of memory.
Is this normal?
What can I do so the scanner will not use ...
1
vote
0answers
47 views
Monorepo manifests image tag replacement in Github Actions
I have a mono repo with NodeJS app (or better said, components of an app).
There are 3 apps in the repo, each has its own directory and Dockerfile:
/core
/worker
/frontend
There’s also /deployments ...
0
votes
0answers
9 views
How to build maven project and deploy artifacts remotely using automation?
I wanted to know how I could build a maven project and then automatically deploy the artifacts based on environmental files? Basically, I have a spring boot application(hosted on GitHub) that I want ...
0
votes
0answers
47 views
Azure Continuous Delivery Error: Configuration failed at step: 'Creating assets'
I'm trying to set up a CI pipeline in Azure Devops and have a Virtual Machine in Azure. I tried to configure a CD pipeline from the VM Continuos Delivery Setting and am getting the following warning: &...
2
votes
2answers
53 views
How can I make artifacts available to the QA team with a user-friendly UI?
Currently developers push to master, jenkins picks that up, builds it, and then I go to artifacts, download the APK files and upload them in a Microsoft teams group so that the QA team can download ...
1
vote
0answers
61 views
Branching strategy and CI/CD
We are planning to use the Git-flow branching strategy with CI/CD. It's a conscious decision not to use Trunk based development.
Here's what the pipeline looks like:
Here's what the process looks ...
0
votes
0answers
15 views
Setting up PR Build in Jenkins when raised from stash
Setting up a PR request to have a build run in Jenkins. Our source repository is Stash.
Essentially, the PR will be from any branch (each developer will create their own branches) to develop
I have ...
0
votes
1answer
34 views
Pull request and merge actions in CI/CD
The CI/CD pipeline supports pipelines per branch but no pipeline for feature branches is triggered automatically. There are pipelines deployed for the following branches: development, master. The ...
0
votes
0answers
11 views
How to lunch a Digital Ocean dropplet directly into a container Image?
From a CI pipeline I would like to be able to do the following.
Launch a droplet of a specific cpu/ram configuration with metadata to run a specific container image on start up
have the droplet run a ...
1
vote
0answers
22 views
Azure DevOps issue with GIT, Visual Studio and Azure (Umbraco)
I am completely new to Visual Studio, .net and Azure DevOps
I have a problem with GIT using the GIT bits (rather than CMD), in Visual Studio
I have a .Net application (Umbraco), that has been built ...
-1
votes
1answer
278 views
invalid base hashes in `extends` with 'include' — gitlab-ci
I have a huge .gitlab-ci.yml file that I am trying to turn into the "main" ci file by moving some parts to another files which will then be called with the use of the "include" ...
2
votes
1answer
77 views
Using Docker images as vehicles for binary deployment artifacts
Let's say we're in an environment where we have a modern CI/CD pipeline for a number of containerized apps. We also have a number legacy apps which haven't been containerized yet.
I'm wondering how ...
0
votes
1answer
104 views
Trigger gitlab downstream pipeline from a upstream pipeline in a multi-project using trigger, rules and custom configuration variables
I have this scenario where I want to run the trigger in build stage only when $FLAG variable has been set by the .pre stage. However, the build stage never runs.
How should I conditionally trigger a ...
0
votes
0answers
17 views
How can I provide an unpackaged vendor binary to my build environment?
I want to run CI processes that depend on a vendor application which is released periodically as a new ZIP file (about 500MB), downloaded from behind a login on the vendor's website. When a new ...
0
votes
1answer
16 views
iptables rules to permit GitHub Actions from breaking (chains default to DROP)
Assuming my iptables rules default to DROP on the INPUT and OUTPUT chains, what is the bare minimum set of rules that I must add to my chains to prevent a script running in GitHub Actions from ...
0
votes
0answers
38 views
Deploying angular app to Azure with Github Actions failed. package.json not found
I am trying to deploy an Angular(10) WebApp to Azure with CI/CD using the Github Actions but I get an error saying the package.json cannot be found while running the npm install command.
This is my ...
0
votes
0answers
14 views
Can OLTP be an option to mock my database in my CI Tests?
I am working on some .NET applications with a rest API. These comprise both .NET Core and .NET Framework applications. In the CI build process, unit tests are running on Azure Devops Server. My unit ...
0
votes
1answer
42 views
devops - Optomizing gitlab cicd pipeline's caching
I have a gitlab yaml I've been working on for a bit and while everything works it seems like each job takes quite a bit longer than it should. I tend to think the culprit is that npm files are fetched ...
1
vote
0answers
19 views
Single Build Command / Continuous Integration
I was reading the Continuous Integration by Martin Fowler article yesterday, the article is from 2006 but I think it is still very applicable today, the statement around a single command stuck in my ...
1
vote
2answers
154 views
gitlab CI job fails after manual ftp deploy (lftp) command completes successfully
Scenario
I'm using LFTP to deploy files via sftp. The transfer completes successfully and all files get to the destination but for some reason the job fails.
Question
How can I find out what is ...
1
vote
1answer
29 views
How to render assets when building a static website with GitLab Pages and Jekyll
I'm using Jekyll to build a static site and deploy it with GitLab Pages. This site is compounded of posts (contained in the site/_posts folder) and refer to other HTML and Markdown documents that I ...
1
vote
1answer
18 views
How to copy library source code from other Git repo to an Android Gradle application GitLab build process?
There is an Android application using Grandle for build. It uses a "library" stated in build.gradle file:
dependencies {
api project(path: ':specialproject.speciallibrary', configuration:...
1
vote
1answer
29 views
Devops CICD run ReactJS application while testing with jest + puppeteer [closed]
Scenario
I'm working on getting my end-to-end tests to work in a GitLab pipeline. Currently all the tests run locally but I'm having an issue getting them to run using GitLab's continuous integration ...
0
votes
1answer
168 views
Gitlab CI push to docker-registry fails
I have GitLab server and a separate docker-registry. I have created a testuser with a testpassword.
My .gitlab-ci.yml
image: docker:latest
services:
- docker:18.09.7-dind
variables:
...
1
vote
0answers
18 views
Pipeline gitlab showned as “running” even though it isn't
I'm using gitlab CI/CD and I have a pipeline which does the following things :
code verification
build
some test
deploy in a test environment (manual)
Some more tests
If we don't do the deploy, ...
2
votes
0answers
67 views
Gitlab: Always having the possibility to launch a manual job (even if something failed before)
I'm using gitlab-ci. I have a pipeline that has the following steps :
code-verification
some tests
deploy (manual)
some more tests
rollback (manual)
Both the deploy and the rollback job have to ...
2
votes
1answer
64 views
How to specify 'os' for free gitlab runners ('runs-on' equivalent)
How can I specify the operating system in the .gitlab-ci file to indicate which underlying OS on which the gitlab-runner should be running when using the 2,000 minutes of free execution in with gitlab....
2
votes
1answer
53 views
Create pull request for docker dependency package if outdated
Platform: GitHub
CI/CD: GitHub Actions
Additional technologies: Docker with Ubuntu base image
I'm creating a Dockerfile and I need to install a package (such as Terraform). Every time the '...
1
vote
3answers
71 views
Run integration test with ansible playbook using terraform provisioning
Ok so I am totally new to devops! I am an experienced developer, but at my new job I have been tasked to automate CI/CD. Non-existing so far. Only CI with Travis.
So the ideal workflow is:
Push to CI ...
1
vote
1answer
23 views
Does Buildbot support complicated build/deploy scenarios?
I need a tool/framework for CI/CD which can:
Support multi-repository project
Build and ship only changed part (frontend/backend) using revison hashes to decide
Ship some branches (release candidate ...
5
votes
2answers
414 views
How is it a good practice to version your helm charts for each deployment?
I'm trying to set up a process to release a web app with helm in my company and I can't find a satisfying way.
Basically each for each push in a feature branch, I want to:
Build a docker image and ...
1
vote
0answers
13 views
How do I add my own package to a GitHub workflow?
I am trying to use the basic .NET Core Github workflow as shown here, but I am having trouble with a GitHub package I created. When the workflow gets to the Install Depedencies which performs a donet ...
0
votes
1answer
46 views
What are the daily job duties of a devops? [duplicate]
I have been working for linux management over 10 years. In the last 5 years, I have added a lot of coding experience through software development like php, ruby, go, etc. I wanna be a devops, but I ...
1
vote
1answer
45 views
Continuous deployment
I have a nodejs application using expressjs. This server is handing a website built on vuejs, an application using angular and another angular app. Everything is working and I deployed to AWS eb using ...
0
votes
1answer
183 views
How comes a GitLab CI/CD job cant' find its artifacts?
In the Open Source ventilator project, we aim to provide those who focus on testing with a ready-to-go flash file for the Arduino controller board.
While the binaries seem to be there, for some ...
1
vote
1answer
154 views
What can be considered as an artifact [duplicate]
Recently, I have had a lecture at my university about advanced testing and CI. To understand all concepts, I was searching what artifact represents, specifically in DevOps sphere. I found many ...
2
votes
1answer
46 views
On Premise CI / CD recommendations for Docker images
We have TFS building Docker images, and loading them into a Private Registry on one network, our Development Network. Everything works well, and we are generally happy with the CI process in that ...
4
votes
1answer
44 views
What are best practices for over-committing resources in a staging environment?
Suppose there is a staging environment very strapped for resources as new development, data workloads and other applications grow. Ideally one would like to maintain production parity, even at the ...
4
votes
1answer
320 views
What is a gating continuous integration (CI) system?
I often find myself in the position of mentioning gating CI systems and I thought it would be good to have a post I can easily reference explaining what that is. So here goes:
What is a gating CI ...
