Questions tagged [cicd]
For questions about Continuous Integration/Continuous Delivery/Continuous Deployment (CI/CD) tools and or processes
115
questions
0
votes
0
answers
12
views
CI/CD ArgoCD - how can we schedule a nightly build with ArgoCD? So deploy a temporary set of Kubernetes resources
Each night we run a nightly build. A 'docker-compose' stack is deployed, a Test docker container runs the tests. Works fine.
We started migrating to Kubernetes with ArgoCD.
How can we deploy a ...
- 101
1
vote
0
answers
57
views
What are the differences between Azure DevOps (Pipelines) and GitHub Actions?
My team is thinking of switching from Azure DevOps to GitHub Actions, currently we are using Azure DevOps Pipelines to handle code deployments. Our release pipelines are configured in a way where they ...
- 111
0
votes
0
answers
8
views
Concourse Pipeline Not Retrieving Configuration Values from AWS Secrets Manager
I'm experiencing an issue where my Concourse pipeline isn't picking up configuration values from AWS Secrets Manager. I have set everything up according to the documentation, ensured the necessary IAM ...
0
votes
0
answers
27
views
Gitlab ci variables disappearing in pipeline run
We have a large, fairly complex set of yaml files that defines pipeline configurations for multiple apps using gitlab ci. A single pipeline consists of a dozen or more separate yaml configs that use ...
- 1
0
votes
0
answers
23
views
Helm and cicd in a multi-repository environment: how to introduce a concept of build?
We have a set of microservices stored in multiple repositories which we deploy on k8s. Currently we use a simple cicd which is triggered by commit to repo. The cicd then builds an image, places image ...
- 101
0
votes
1
answer
276
views
GitLab CI: How to properly push file to a repo using ci file?
I'm trying to setup a GitLab CI pipeline which runs a script (convert-inventory-format.sh) that update a yaml file. I would then like to commit that file to a Git repository and push it.
However, the ...
- 1
0
votes
0
answers
54
views
Why i cant include a .yml in CI/CD, using rules with mine variables?
Why my pipeline doesn't work? I just want include this .yml if "NATIVE_COMPILE" is "true".
variables:
NATIVE_COMPILE : "true"
include:
- project: 'pipelines/cicd'
...
0
votes
1
answer
604
views
How to wait for gitlab downstream pipelines to finish before going to next stage?
I'm not sure this is the way to proceed, but I'm starting using downstream pipelines.
I have 3 projects :
Project A : web-frontend-1
Project B : web-frontend-2
Project C : global-e2e-testing
I'm ...
- 113
0
votes
0
answers
22
views
How to run pytorch on gitlab-runner via docker?
I am learning gitlab ci/cd with a AI/Deep learning application in mind. But I wasn't sure how pytorch could be used in a gitlab-runner.
According to documentation:
The following multi-platform Docker ...
- 111
0
votes
0
answers
438
views
Unsecure container registry declaration in Gitlab CI/CD
I have the following .gitlab-ci.yml file :
stages:
- publish
- deploy
variables:
TAG_LATEST: $CI_REGISTRY_IMAGE/$CI_COMMIT_REF_NAME:latest
TAG_COMMIT: $CI_REGISTRY_IMAGE/$CI_COMMIT_REF_NAME:$...
- 1
1
vote
1
answer
110
views
What is the point of starting pipeline when MR creating?
Can you explain what the point of starting pipeline for source branch again when I do MR in default branch? I mean, when I did git push before in my feature branch which I want to merge with master, ...
- 35
0
votes
0
answers
70
views
Azure Veracode Upload and Scan Integration
What are the steps required to integrate a .NET (.NET 6.0) web application with Veracode Upload and Scan task in an Azure CI/CD pipeline?
According to Veracode's packaging requirements outlined in the ...
1
vote
0
answers
10
views
How to find failed steps with `gh`
I have a Github Actions workflow which contains several steps that allow continuation on error via continue-on-error: true. It is a scheduled workflow; the steps are independent of each other, and one ...
- 4,866
0
votes
0
answers
47
views
Comparison of two CI/CD strategies with k8s deployment previews
I am implementing a new CI/CD strategy across my organization's several dozen repos.
The main goal is to move from a dedicated QA environment branch to deployment previews in ad-hoc environments ...
- 103
0
votes
0
answers
105
views
How to deploy a Docker image from DockerHub to AWS Beanstalk using Gitlab CI/CD?
I am not very familiar with Gitlab CI/CD, Docker (Hub) and AWS but I am trying to deploy a Docker image from Docker Hub to an AWS Beanstalk environment (so basically as a new version to a running ...
- 1
0
votes
1
answer
146
views
In Gitlab is there a way to automatically change a tag on a ticket when an MR is created and/or when a deployment is completed
In Gitlab we have a flow where our tickets go from "In Progress" to "Code Review" when an MR is created and from "Code Review" to "Ready for Testing" when a ...
- 51
2
votes
1
answer
3k
views
Run GitLab job only if variable is provided
I have two jobs in my gitlab ci pipeline 'job a' and 'job b'. I want only 'job a' to run if variable x is provided and run 'job b' if variable b isn't provided.
Something like this.
job a:
rule:
...
- 23
0
votes
0
answers
31
views
How to enable Continuous Deployment to an internal server from BitBucket
I need some guidance and advice please on if / how I can implement a CI / CD pipeline for a corporate PHP Laravel application that is hosted on an internal server. Unfortunately my DevOps knowledge is ...
0
votes
0
answers
7
views
Automating toil jobs on a cluster
Imagine a highly loaded and highly secure production cluster of Openstack(actually it can be any thing else either), there are multiple toil works that are completely independent, or implemented in ...
- 101
0
votes
0
answers
298
views
Add a job to a Gitlab pipeline if a tools exit code is 0
I would like to add a job to a pipeline in Gitlab, but only if a tool, e.g. Maven, exits with exit code 0.
For example, I would like to run the job for integration tests only if a given profile exists....
- 103
1
vote
2
answers
69
views
Simple CICD workflow for small-scale deployments?
I work for a small startup. We have 3 environments (Production, Development, and Staging) and GitHub is used as VCS.
All env runs on EC2 with docker.
Can someone suggest me a simple CICD solution that ...
- 21
4
votes
2
answers
662
views
What is the best way to install ArgoCD as code?
Working on getting a full deployment pipeline set up using GitOps and Everything as Code. I, therefore, need to be able to spin everything up and down with a single click (or pretty close to it!). My ...
- 251
0
votes
0
answers
114
views
How do I associate a git branch to a kubernetes namespace?
Say I want to map git branches to k8s namespaces, like this:
master branch -> prd namespace
devel branch -> dev namespace
for my Gitlab CI pipeline to deploy helm charts to the right ...
- 1
1
vote
0
answers
37
views
Proper separation of IaC and code deployment via CI / CD
We're about to implement infrastructure-as-code on our project. We already have CI/CD pipelines that deploy:
A CloudFormation stack for an ECS service
Several CloudFormation stacks for AWS lamdbas (...
- 111
1
vote
0
answers
256
views
How to manually specify variables for child pipeline in bridge job?
Right now i have this gitlab-ci.yml.
stages:
- Build
- Deploy
...
Deploy:
stage: Deploy
when: manual
trigger: services/service1
variables:
BUILD_NAME: "${BUILD_NAME}"
...
1
vote
1
answer
4k
views
Azure Devops solution for max excution time
Azure Devops has a 60 minutes max execution time for pipelines but sometimes my deployment takes much more than this, the pipeline time out and, since is a time out, no further tasks are run in the ...
- 243
0
votes
1
answer
151
views
Deployment with manual confirmation of each change
I am new to CI/CD and Gitlab.
I have a Python project for parsing a LaTeX book to HTML and uploading those HTMLs to our online course platform.
Without CI/CD my pipeline would look like this:
Fix ...
3
votes
1
answer
336
views
Which CI/CD tool(s) should a DevOps newbie learn?
I'm new to DevOps and I'm learning that:
The adoption of containerization and GitOps have been clear trends
Some CI/CD tools (e.g. Jenkins X) are more geared toward this trend than others (e.g. ...
- 75
1
vote
3
answers
69
views
How to apply DevOps with just one developer?
Background:
I am a self-taught Java developer, focusing mostly on desktop JavaFX applications. I work for a large company and have developed a fairly large piece of software that is relied upon by my ...
- 111
1
vote
0
answers
95
views
From dev to production workflow
We are creating micro services environment which needs to be delivered to prod, now we want to start the CICD design, is there any reference which talks about getting from a Commit ->PR-> tests-&...
- 111
3
votes
1
answer
130
views
Deliver docker container on the server with no internet
I have a project which is written in Python. After I push it's going to be pulled by another team and after that they are going to deliver the project to windows server machine wich has no internet. ...
- 133
2
votes
1
answer
393
views
Gitlab pipeline + Jump host + execute HELM
What is worked:
Steps:
directly go to server via SSH (behind the JH)
via SSH to another server
pull from Artifactory for testing only
executing HELM chart to pull from artifactory and deploy on k8s ...
- 121
0
votes
2
answers
149
views
Recommended starting guide on CICD
I'm new to the community, and I looked around a bit but didn't find a good point to start from. I have a specific problem I want to solve, but while trying to think of a solution I realized I need a ...
- 101
0
votes
1
answer
117
views
CICD with dockerized web app
I am having troubles understanding the following DevOps concept.
I have developed a dockerized web app using docker-compose. It is in my local and I can upload it to any cloud service I want and it ...
- 101
3
votes
1
answer
579
views
Do GitLab Runner worker nodes need to have network access to GitLab?
GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand.
The documentation says that: "GitLab Runner is going to need to talk to your ...
- 141
2
votes
1
answer
261
views
Why should I tag a commit to create a release?
I work on a new CICD, replacing Jenkins-X 2 by GitHub Actions.
After seeing a lot of actions to create a release + changelog, I found that a lot of them are trigger by a tag on a commit to launch the ...
- 61
2
votes
0
answers
809
views
GitLab CI/CD get CI_MERGE_REQUEST_LABELS after merge successfully
I know that the docs say, that the variable CI_MERGE_REQUEST_LABELS is available if pipeline is a merge request pipeline and the MR is open.
My dream was it to label my MR's with patch, minor or major ...
- 21
0
votes
1
answer
208
views
GitLab variable false but job is running
I'm triggering job via API, passing custom variables.
Here is example request: curl -X POST -F token=${TRIGGER_TOKEN} -F ref=${branch} -F "variables[SHOULD_COPY_ASSETS]=false"
This how job ...
- 1
1
vote
1
answer
1k
views
What means "Reconciliation" from Argo CD
I m looking a metric in Grafana from a official Dashboard from Argo CD, the panel its named "Reconciliation Activity" and use the following metric:
argocd_app_reconcile_count
I look for a ...
6
votes
1
answer
2k
views
Where does the string docker.example.com in my GitLab CI job come from?
I am trying to have a Docker image deployed to my server by GitLab CI, but it only worked once¹ and then dies with the error message below. Here is the .gitlab-ci.yml snippet:
deploy-image:
image: ...
- 375
2
votes
1
answer
746
views
How do I fail a gitlab pipeline job?
I am currently using dependency checker to scan my applications via gitlab
This is how my pipeline looks like.
dependency_scanning:
stage: security_scan
script:
# Run dependency check on all ...
- 123
0
votes
1
answer
7k
views
ERROR This job is stuck because the project doesn't have any runners online assigned to it. even though i have added runner and it is alive
Despite of the fact runner is alive. Why this error is coming
- 11
1
vote
1
answer
522
views
Modularizing CI/CD pipelines in Jenkins or in other tools?
I have the following case:
There are a couple of repositories (well, two-digit number). Each of them has some sort of (declarative) Jenkins pipeline - it would be one of three types:
run tests -> ...
- 123
0
votes
1
answer
572
views
How can I deal with container "patching" in a strict release process?
I am building a new Container and Kubernetes system for my company. Overall it is going well, but container patching has me a bit confused.
We follow a fairly strict release process. New versions ...
- 206
2
votes
1
answer
717
views
How to only include directory contents in Azure Publish Artifact without full filepath?
I've been using Azure Pipelines and Releases to build and publish artifacts.
In SolutionX, there are projects ProjectY and ProjectYTests.
I build everything in the solution (to run the tests) and then ...
- 393
0
votes
1
answer
2k
views
How to build, package and deploy a react-native-web app in a Docker container?
Given there is a react-native-web solution, what needs to be done to build it and run inside a Docker container?
What is the build environment/toolchain?
Which environment is required to run?
From ...
- 6,802
0
votes
1
answer
42
views
Jenkins and Kubernetes Design Involving GitHub
I am new to DevOps and am currently designing a CI/CD pipeline that involves integrating GitHub webhooks with Jenkins in a Kubernetes environment, and I would like to see whether this is feasible or ...
- 1
0
votes
1
answer
34
views
How to create pipeline with jenkins? [closed]
I followed this tutorial and when i get to 29:32 the option "Build Pipeline View" is not displayed in the list i only get list view and my view.What can be the cause of this ? ( i followed ...
- 105
1
vote
1
answer
345
views
Sonarqube taking massive amounts of memory
I am running Sonarqube on a monolithic application on our CI server and the scanner (not the Sonarqube server) is taking over 60GB of memory.
Is this normal?
What can I do so the scanner will not use ...
- 1,413
1
vote
0
answers
159
views
Monorepo manifests image tag replacement in Github Actions
I have a mono repo with NodeJS app (or better said, components of an app).
There are 3 apps in the repo, each has its own directory and Dockerfile:
/core
/worker
/frontend
There’s also /deployments ...
- 111