Skip to main content

Questions tagged [continuous-integration]

Continuous-Integration (CI) is the process of merging developer's working code copies to a shared codebase frequently to prevent or minimize integration problems. For questions about a specific CI system like [Jenkins] or [Travis-CI] use those tags instead.

Filter by
Sorted by
Tagged with
0 votes
1 answer
182 views

Stage and jobs blocks breaks gitlab CI with "configuration is invalid: jobs jobs config should implement a script: or a trigger: keyword"

.gitlab-ci.yml with stages: - test jobs: lint: stage: test image: python:3.8 # Assuming same image for both jobs script: - pip install black - black --check . ...
MosQuan's user avatar
0 votes
0 answers
86 views

Push from CI to private docker registry behind cloudflared with gated access through SSO

I have a portainer, that is running a registry and a cloudflared tunnel. The portainer web UI is secured by cloudflare zero trust tunnel. So this setup works. Now I want to deploy software I build ...
Joshua Behrens's user avatar
1 vote
1 answer
113 views

Spacelift - external state access - cannot create a workspace error

I am trying to use Spacelift's external state access however I get the following error: Error: Error loading state error │ │ with module.service.data.terraform_remote_state.environment, │ on ../...
Danielle Murphy's user avatar
0 votes
1 answer
28 views

How to declaratively configure self hosted build agents for CI?

We assemble android application using GH Actions on self-hosted agents. Right now we upgraded a couple of libraries and now we need to use another JDK version. Issue is that right now we need to ...
Alevinevich's user avatar
1 vote
2 answers
2k views

GitLab CI: How to properly push file to a repo using ci file?

I'm trying to setup a GitLab CI pipeline which runs a script (convert-inventory-format.sh) that update a yaml file. I would then like to commit that file to a Git repository and push it. However, the ...
DiklaS's user avatar
  • 11
0 votes
1 answer
41 views

QA instability due to lack of stable UAT/staging environment

Our testing teams are facing extensive downtime due to testing in a shared QA environment. When our front end teams perform end to end testing, their test (QA) environment points to the back end ...
Half_Duplex's user avatar
2 votes
1 answer
253 views

Best practice multiple pipelines into production

Working with a larger corporate. They are planning on opening a second pipeline for a hybrid mobile app. This second pipeline will be for hotfixes straight into production. My gut feeling is that this ...
lindsaymacvean's user avatar
1 vote
1 answer
97 views

User-level secrets in GitHub Actions

I would like to create a GitHub workflow for running tests against a REST API. The API needs a key that is always tied to a user, there is no global "testing" key. Is there a way for each ...
Parzival's user avatar
1 vote
2 answers
223 views

Pause renovatebot for single PR

We have configured renovate for few of our repositories. It generates PRs after approval via dependency dashboard and automerges patch releases. But there is one update which fails the CI - it look ...
void's user avatar
  • 21
0 votes
1 answer
93 views

Automated preview environments from microservices in multiple repositories?

I have multiple microservices (with Dockerfiles) in GitHub repositories. Although I do unit testing on each microservice, I want to spin up all the services as a preview environment for E2E testing (...
user avatar
0 votes
1 answer
341 views

strip all comments from helm package

I have a lot of comments in my helm chart in my repository. I want to deliver my helm chart to others without these comments. I am hoping to be able to do this during my CI pipeline. I have a step in ...
Inbar Rose's user avatar
0 votes
1 answer
15 views

Why is the development of a REST-API Webserver Application with less expected changes after its short term initial build a DevOps project?

I am thinking about setting up a project where a one-year development / built phase of a rest-API Server is planned. Providing an initial version in three months and deploying updates every month ...
user3352632's user avatar
1 vote
1 answer
513 views

Trunk Based Development Deployment Pipeline

We are currently working on transitioning to Trunk Based Development and starting to look at our deployment pipeline and how we can improve. Our current workflow: All engineers work on the trunk, ...
Rob Fyffe's user avatar
  • 113
0 votes
3 answers
148 views

Does Jenkins essentially function like a package manager for your software product?

I'm a relatively new IT Ops guy in a software (web) development company. Recently I deployed a virtual machine on OpenStack, because some developer needs it, and then I installed their application (...
Noob_Guy's user avatar
  • 109
0 votes
1 answer
188 views

What is manual, what is automatic in Continuous Delivery?

I've read lots of articles about the concept on the internet. I thought I got it, but some statements in other articles make me confused. In order to simplify and clarify things, I'll presume I use ...
moztemur's user avatar
  • 101
0 votes
2 answers
159 views

How do I run a CI build in a docker image matching the current `Dockerfile` while being resource-aware?

Given a repository containing a Dockerfile that defines the build environment used by the CI pipeline as well as by the developer (e.g. as a Visual Studio Code devcontainer), the CI pipeline shall ...
Roland Sarrazin's user avatar
1 vote
1 answer
1k views

Setting up gitlab phpstan pipeline

I have tried to start using phpstan pipeline on gitlab according to this guide. The problem is that the pipeline does not work at all (Command 'sh' is not defined) and i don't know how to fix it. Here ...
Kyborek's user avatar
  • 113
0 votes
2 answers
92 views

Docker Compose on AWS

I have no experience with AWS and I would like to know what the best approach is when it comes to embedding an environment built using Docker Compose (a simple application with two services, API and ...
DevOpsBeginner's user avatar
1 vote
1 answer
31 views

What is difference between testing in context of CI and CT pipelines?

What is the difference between testing in the context of Continuous Integration pipeline vs testing in context of Continuous Testing pipeline? The definition of testing is a bit blurred to me in the ...
Lukasz Dynowski's user avatar
2 votes
1 answer
95 views

CI pipeline including upload to pypi repo

How should a ci pipeline be set up that publishes a python wheel to a private pypi server? Say I have a publish job like this one: publish: image: $PYTHON_IMAGE stage: publish before_script: ...
plazmakeks's user avatar
3 votes
1 answer
3k views

decode base64 Github Secrets

I am setting up a pipeline to run Cypress automated tests using github actions/workflows on my code anytime there is a push to the repo. I came into a scenario where I want to generate dyanmic .env ...
uneeb meer's user avatar
0 votes
1 answer
205 views

Run a dev server in CI pipeline

I have a CI pipeline setup using Github Action/Workflows, where I want to run Cypress Automated tests; however I am having some problems of when trying to run my dev server. Let me show you my ...
uneeb meer's user avatar
1 vote
1 answer
44 views

Check TZ in Container Image without creating instance?

I have a requirement to assure that the container image we build runs in UTC only. I'd like to avoid starting it up just to check the link on /etc/localtime. I thought maybe a tool like dive that ...
Josiah's user avatar
  • 363
1 vote
1 answer
811 views

Is it a good practice to run unit tests inside build job in Gitlab CI?

We want to run unit tests against a built Docker image and not by installing the environment inside Gitlab CI runner We don't want to push the docker image to a registry and pull it back in a test job ...
Alexander Reshytko's user avatar
6 votes
1 answer
4k views

Colored logging messages from Python script within GitLab CI

I am using a docker container for my GitLab CI and would like to have any output/logging messages in color inside the CI. What I mean: the commands from .gitlab-ci.yml are in color, but the outputs of ...
ziggyler's user avatar
3 votes
0 answers
2k views

Share cache between gitlab.com owned runner and self hosted runner

We are in the middle of migrating from Self Hosted GitLab to Gitlab.com (Cloud). This also means that we are shifting building through shell, to building through Docker (using Kaniko). A summary of ...
Jordi Kroon's user avatar
0 votes
1 answer
1k views

Deploying microservices in a consistent way using different gitlab repositories

I'm looking for a good organization to deploy our solution consisting in multiple apps using Gitlab and K8S. Our SaaS app that is made of : A backend app, mostly our API (django) A user app (React) ...
Yohan D's user avatar
  • 103
0 votes
3 answers
125 views

What is CI and how is it different from CT?

Wikipedia insists that (CI) is the practice of merging all developers' working copies to a shared mainline several times a day which sounds to me like "branches are prohibited" which makes ...
Vorac's user avatar
  • 103
1 vote
3 answers
2k views

What is the best practice for a multibranch pipeline configuration?

I'm messing around with a multibranch pipeline in jenkins. Currently we have zero pipelines in production and everything is using freestyle jobs which is very sloppy. I have my own multibranch ...
collin_tgz's user avatar
2 votes
0 answers
595 views

Pipeline could not pull repo in GitLab CI/CD

I have a the repo with test CI pipeline, which is the following: # .gitlab-ci.yml image: name: gcc build: stage: build script: - echo 123 And it fails: Running with gitlab-runner 14.3.1 (...
Ivan's user avatar
  • 121
5 votes
3 answers
455 views

Parametrize gitlab ci pipeline

There is the following simple pipeline: build → test → deploy that uses specified python version for all stages, for example 3.8. How can I scale (parametrize) it for python with versions: 3.7, 3.8 ...
Arseny's user avatar
  • 51
2 votes
1 answer
1k views

What's the best practice for managing / deploying multi-environments in production app?

I'm spinning up a production site and wanted to get advice on the latest best practices to manage and deploy multiple environments. At a high level, I'd like to have a good balance between keeping ...
user30768's user avatar
0 votes
1 answer
46 views

Continuous integration of an operating system

I want to hire a VPS but my problem is that most if not all of the VPS companies out there expect me to work with it as is and if I want to majorly upgrade it, I must, backup everything I have added ...
Semo's user avatar
  • 1
3 votes
1 answer
911 views

Incorporating python linter(flake8) in the CI/CD pipeline that use GitHub, Github Actions in a code base that is not in compliance

I have a codebase that is not in compliance with flake8. The CI/CD pipeline uses GitHub/GitHub actions. I would like to start adding python flake8 (to check for complexity, errors and code smells) ...
MasterOfTheHouse's user avatar
2 votes
1 answer
765 views

Deploy an application using dll files to IIS on a VM

I hope I am posting this in the correct forum, but to me at least, it seemed that the focus was more on deployment. I am currently stuck after having successfully refactored an application by ...
Sasquatch's user avatar
1 vote
1 answer
56 views

Sorting out automated testing in CI pipeline and getting conflicting information related to building, unit testing and Docker images

I seem to get a unique response for every person that I ask, or every article that I read, which is just confusing me even more. Basically, I'm trying to setup automated testing in the CI pipeline ...
cheslijones's user avatar
0 votes
0 answers
139 views

Is it possible to control Packer from golang?

We use Terraform quite a bit and it has some nice tooling like Terratest where you can essentially call Terraform from within Golang wrapped inside an API with proper error handling. I wonder if ...
Mathis Van Eetvelde's user avatar
7 votes
1 answer
649 views

How would you build docker images in Kubernetes while distributing its layer caching among all pod builders at scale?

We are using Azure DevOps as our CICD platform. We have our own self hosted Linux agents which we integrated into our CICD Azure Kubernetes Cluster . We use these agents to build our Docker images ...
Shaked KO's user avatar
  • 129
-1 votes
1 answer
2k views

How to get ConsoleFull Output,changeLog of upstream job along with downstream jobs console full output and changeLog in jenkins pipeline jobs!

Lets say we have Jobs A , B , C ,D and E. Job A triggers Job B ; Job B triggers Job C; Job C triggers Job D;, Job D triggers Job E; When one of the child job fails for example: Job c fails then email ...
suman's user avatar
  • 1
3 votes
0 answers
46 views

Is there an all-in-one control center software that can be used to manage build and test execution and to visualize test results?

If there are no constraints with regards to other components used in the system at all, do you know a software that can be used as a sort of "cockpit" / control center to visualize test ...
Hunter2's user avatar
  • 31
0 votes
3 answers
1k views

Do I have to include gitlab variables in my terraform code in order for my credentials to be recognized?

I am trying to set up a pipeline, which is supposed to deploy terraform code into an aws account. The code works fine locally, and I have setup and imported the state bucket and dynamodb table which ...
Lucky's user avatar
  • 141
1 vote
1 answer
48 views

Testing docker image builds when low level libraries change

Background In our organization we have many small repos for shared libraries used among our applications. Particularly, we have many Python libraries and Python applications. We have a structures like:...
flakes's user avatar
  • 121
2 votes
1 answer
111 views

Should I struggle for minimalistic context in GitLab CI jobs?

I'm designing a build & deploy pipeline for our project. We have two jobs: build -- builds a docker image with our app and pushes it to a container registry. deploy -- communicates with an ...
Himura's user avatar
  • 123
0 votes
1 answer
34 views

How to create pipeline with jenkins? [closed]

I followed this tutorial and when i get to 29:32 the option "Build Pipeline View" is not displayed in the list i only get list view and my view.What can be the cause of this ? ( i followed ...
Youssef Boudaya's user avatar
2 votes
2 answers
3k views

Container Image Promotion across environments in ECR/ECS

We have started doing some initial work on deploying containers on ECS Fargate service. However we are not yet completely figured out how to manage our image promotion across different environments. ...
aashitvyas's user avatar
0 votes
1 answer
333 views

Advantages of using Code-pipeline and Codebuild for CI/CD over Bitbucket pipeline?

What are the advantages of using AWS Codepipeline/code build for our pipeline over the bitbucket pipeline. ? Some of the factors that I can think of: Pricing? Pipeline for a serverless application ...
systemdebt's user avatar
0 votes
1 answer
1k views

Gitlab CI/CD: deploy docker image to existing kubernetes cluster

I have node.js application that I need to deploy to exising kubernetes cluster. The cluster is setup using kops on AWS. I have created .gitlab-ci.yml file for building docker images. So, whenever a ...
confusedWarrior's user avatar
0 votes
1 answer
415 views

Auto create Jenkins jobs for branches and pull request via declarative code in scm

I am looking to auto create jobs in jenkins upon pull request , branches, master push etc similar to what we do in Gitlab. My SCM is butbucket here. I have so far setup docker based agent integration ...
vgdub's user avatar
  • 103
10 votes
2 answers
25k views

Can I run multiple pipelines in a single GitLab repo using GitLab CI/CD?

I know that I can't have multiple gitlab-ci.yml files in one repo, but it still seems fairly limited. Say for example I have one set of tests I want to run whenever a change is pushed or on PRs, and ...
Christian Legge's user avatar
1 vote
2 answers
2k views

Gitlab runner fails with connection timeout

I have gitlab runner with, docker as executor and docker:latest as default image. Runner is connected to the project and runs pipeline, but it stuck at Reinitialized existing Git repository in /...
Sachith Muhandiram's user avatar

1
2 3 4 5