Skip to main content

Questions tagged [databases]

A database is an organised collection of data. It is the collection of schemas, tables, queries, reports, views, and other objects. Designers typically organise data to model aspects of reality in a way that supports processes requiring information. Use this tag on questions which ask about database aspects of Continuous Delivery, Continuous Deployment or general DevOps approaches to databases.

Filter by
Sorted by
Tagged with
53 votes
3 answers
17k views

What are the reasons Docker should not be used for databases?

I'm having a discussion with a friend about use cases for Docker. One guy in the team wants to use Docker for everything - like a kind of universal unix process wrapper. The other thinks that Docker ...
hawkeye's user avatar
  • 1,153
21 votes
6 answers
2k views

What practices or tools enable Continuous Deployment of Databases?

Continuous Delivery or Continuous Deployment of infrastructure and code is comparatively simple compared to trying the same approaches for databases, specifically RDBMSs. Code and infrastructure will ...
Richard Slater's user avatar
11 votes
2 answers
2k views

How should I store my environment variables?

This is a very broad question about methods and advice regarding environment variables / structure. But ultimately I'm looking for answers for the very specific question of 'How should I store my ...
Naphta's user avatar
  • 627
8 votes
1 answer
6k views

Why is Prometheus not a good choice for data with high cardinality?

I have a background in relational databases and new to Prometheus. I wonder why Prometheus is not a good choice for high cardinality data? Why do I need to use low cardinality data? It's exact ...
Sybil's user avatar
  • 452
8 votes
2 answers
1k views

How to synchronize deployments (especially of database object changes) on multiple environments [duplicate]

I am the DevOps engineer and a software engineer in a team where months back, the developers moved from having a central Oracle DB to having the DB on a CentOS VM on their individual laptops. The move ...
user1063's user avatar
7 votes
1 answer
1k views

What is the impact of using Helm Deployments instead of StatefulSets for Databases like MongoDB or MySQL?

The definition of a stateless app seems to apply to database servers like MongoDB or MySQL. I found Helm Charts as a kind of template-repository for Kubernetes. However, the stable builds all use ...
Daniel's user avatar
  • 211
6 votes
3 answers
1k views

DynamoDB vs RDS for a counter store?

I have multiple lambda functions, which a file passes through for processing, and I want to store the status of each computation in a counter, for better logging and monitoring. Current plan is to ...
Dawny33's user avatar
  • 2,816
6 votes
3 answers
2k views

How to do blue-green deployment with PL/SQL code?

Is it possible to do blue-green deployment when your software is mostly a set of PL/SQL packages? I don't really want to duplicate the database, the financial risks in case of any desyncs are too big....
Alexey's user avatar
  • 161
5 votes
2 answers
462 views

How to version control shared database?

We have several C# applications using a shared monolithic database (on-premise SQL server) using Stored Procedures as an exclusive interface. The C# code repositories include only Stored Procedures ...
Zikato's user avatar
  • 153
5 votes
2 answers
79 views

Cloud DB operator responsibilities / common tasks

When I feed a search engine with "DBA tasks responsibilities" lots of hits like "What does a DBA do all day?" and even official Oracle manual entries. With modern automation a lot of those tasks don'...
Sybil's user avatar
  • 452
5 votes
2 answers
947 views

Google Cloud Storage vs Redis / ElasticSearch

We're building an application that reads data from an API and displays it in a frontend. Due to API limits, we have to cache the API calls meaning that we save the result of the API calls (both user ...
mrksbnch's user avatar
  • 161
5 votes
1 answer
4k views

Creating ansible host_vars and group_vars files dynamically

Is it possible to populate host_vars and group_vars with results from a database like we do in dynamic inventories? Actually I'm doing it inside my playbook either with lookups, either by using shell ...
storm's user avatar
  • 1,759
4 votes
2 answers
3k views

macOS testing on Desktop: Docker containers vs. Homebrew installation

Often I test some stuff on my MacBook. Mostly database and data store related stuff (MongoDB, MariaDB, Postgres). I install the software with Homebrew and test. I wonder if I should switch to docker? ...
Sybil's user avatar
  • 452
4 votes
2 answers
4k views

Docker MongoDB image - How to specify credentials other than in the compose file?

I'm using this docker image https://hub.docker.com/_/mongo/. That image provides a way of initializing a mongodb root database user with env variables which I can specify in the compose file as ...
joe.js's user avatar
  • 143
4 votes
1 answer
97 views

What strategies exist to transition DB Migrations with Stored Procedures to Continuous Delivery?

Our company has broken up most of our large Monolith application into smaller Microservices and we have a clear plan on how to get new services on Kubrenetes into a CI/CD pipeline. However, we still ...
avi's user avatar
  • 1,279
4 votes
1 answer
72 views

Trade offs of putting an international master database in us-west-2

I'm hoping this isn't so open ended that it veers towards a "discussion" more than an "answerable" question. I need to place an RDS Postgres instance in an AWS region that will act as the master DB ...
Chris's user avatar
  • 151
3 votes
1 answer
8k views

docker: Error response from daemon: Conflict. The container name "/basexhttp" is already in use by container

Am I even correctly following the documentation on creating and running a docker container below? [root@ ~]# [root@ ~]# docker run -d \ > --name basexhttp \ > --publish 1984:1984 \ > ...
Nicholas Saunders's user avatar
3 votes
1 answer
161 views

Zero Downtime Deployment with Database Backward Compatibility [duplicate]

Question Does anyone have experience with Database Backward Compatibility to achieve Zero Downtime Deployment? Are there good links or references that I can read? Reason I am working with a ...
SubtleFuryTuesday's user avatar
3 votes
1 answer
638 views

What is a good storage for storing performance results and visualizing in grafana

Intro I am a tester and need to analyze the results of automated tests (response times and etc.) Current situation 1) I run performance tests using locust.io 2) During test execution, response ...
GrimSmiler's user avatar
2 votes
2 answers
1k views

Log/Data rotation in Docker Container

My question is more on the concept or best practices to follow. I have two docker containers running InfluxDB and Grafana (monitoring applications). I have mounted external volume to each. now, the ...
Chandella07's user avatar
2 votes
1 answer
795 views

Strategies to work around 30 sec timeout

I received a timeout when trying to perform 7000 * 3 inserts into MariaDB in 30 seconds with AWS Python Lambda. I have three ideas how to get around the 30 second API Gateway timeout: Convert the ...
Niklas Rosencrantz's user avatar
2 votes
2 answers
221 views

Merging Git Database Commits from One Branch to Another without Cherrypicking

We have main two Git branches at our company: During our Sprint, Everyone has (local branches) Release branch: Contains prepared/developed code, ready for testing, and Master branch: Production- ...
SkyPool392's user avatar
2 votes
1 answer
356 views

How to Connect Docker Containers?

In "What is a container?" the docker docs show the following nifty image: For my scenario I have only App A and App B; let's designate them Alice and Bob. How do Alice and Bob communicate, ...
Nicholas Saunders's user avatar
2 votes
1 answer
143 views

How to deploy Dev Azure SQL code to Prod Azure SQL using dacpac without knowing the target server credentials

Here is my scenario - I have access to source Azure SQL Database where i did few changes to schema (eg adding a table). Now I want to deploy this SQL code to prod Azure SQL Database using Azure ...
DevOps learner's user avatar
2 votes
2 answers
665 views

Application version and Database Schema version mapping

I am trying to integrate database schema versioning in an existing project where schema is not versioned at all. Is it a good practice to create a tight mapping between application version and ...
Shabin Muhammed's user avatar
2 votes
1 answer
102 views

phpMyAdmin using dockerised database

I have installed mariadb inside docker container, and mariadb is running properly inside that container. I want to get access of mariadb through phpMyAdmin from outside docker container. What will I ...
Raju Jha's user avatar
2 votes
0 answers
479 views

How do I use a raw volume with a database on Kubernetes?

I'm trying to figure out how to launch a web application in a Kubernetes cluster on AWS. Right now I'm not certain about a database. I can see that one can use raw block volumes, which are supposedly ...
x-yuri's user avatar
  • 143
2 votes
0 answers
109 views

Cheapest database option on Azure supporting Offline Data Sync / Azure Mobile Apps

What's the cheapest database option on Azure that can be used with Offline Data Sync? I want to run a productive app on that, but I don't expect many users and as it's only sync I don't need ultra ...
me.at.coding's user avatar
2 votes
0 answers
37 views

Is this a robust implementation of database encryption at rest? [closed]

I am looking forward to implement encryption at rest for two+ SQL database servers (Linux). My goal is (obviously) to avoid storing the clear encryption key on the server or store it in a well-known ...
Arthur le Perroquet's user avatar
2 votes
0 answers
46 views

Which volume solutions are the most convenient when building Docker & microservices based application? [closed]

My application consists of few microservices and web (React) frontend. Basically I have auth microservice, application backend service, various data processing services and frontend rendering server. ...
Kunok's user avatar
  • 121
1 vote
1 answer
73 views

In a Database Per Service model - should i include the database in the service container?

I am implementing a simple setup with two micro services and would like each of them to have their own DB - each service is running in it's own container. Should i include the DB's in each service ...
ABR's user avatar
  • 113
1 vote
1 answer
108 views

Is terraform good option for data management

I have complex stack which consists of infrastructure, application and config parts, which are deployed to datacenters around the world. We have custom inhouse configuration system, based on database ...
Shadow's user avatar
  • 111
1 vote
1 answer
74 views

Is it possible or common to use a Proxy server to refer to a database

From my experience I have used proxy servers to refer to different servers (nginx). I have previously worked on building a mvc framework. Basically there were 8 databases with 10 accounts each. The ...
Kar19's user avatar
  • 113
1 vote
1 answer
3k views

cannot get bash prompt: Error response from daemon: Container foo is not running

A basic jetty container: CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES ...
Nicholas Saunders's user avatar
1 vote
2 answers
224 views

Populate Database

I am using Terraform Cloud to build the infrastructure. One of the resources is a postgresql database. What is the best way to populate the database by creating tables, multiple schema etc after the ...
alexis's user avatar
  • 121
1 vote
1 answer
1k views

RDS DB migrations using ECS and Fargate

I run my app with Docker and ECS. How can I handle database migrations? With fargate there doesn’t seem to be a way to SSH into the container to run any commands so I can’t run my RDS MySQL migrations ...
ajyvardan's user avatar
1 vote
1 answer
41 views

simulate SQL DB usage pattern of a typical cloud native web app with sysbench?

As far as I understand sysbench is for bencharking / test max. performance of a database server. I wish to simulate DB usage pattern of a typical cloud native web app (Twelve-Factor App). Is this ...
Sybil's user avatar
  • 452
1 vote
2 answers
61 views

How many DB instances to use? When to switch to container services?

I'm looking for some insights into cloud management. I won't go into much detail, I just need some general information/resources that I can follow, about these topics: When to use container services ...
dywan666's user avatar
1 vote
1 answer
68 views

File transfer from Application server to Db Server without a shared folder access but using Service Account

I am working as a Business Analyst for an IT firm. My team has stumbled upon a certain feature where they are required to use Service account. We are working for a Bank and they have strong policies ...
Ravish Lambate's user avatar
1 vote
1 answer
24 views

AWS RDS- Determine what Database Tables aren't interacted with?

Is it possible to have AWS-RDS (or another aws service) generate a report on databases that haven't been interacted with (write/read) after a certain period of time? My background is in QA and I'm ...
TinCan's user avatar
  • 43
1 vote
1 answer
73 views

How to share RDS snapshots across account roles?

I'm using an AWS account which has different roles for the different environments we use. For example, we have a Development role for our development environment and a Production role for our ...
xenon's user avatar
  • 111
1 vote
1 answer
72 views

Does anyone have resources, tools, ideas, for automating database create, update, modify, delete

I've been tasked to find a way to automate promotion of database creation, changes and other modification related to application changes in a devops world. My databases include MS SQL, Oracle, MySQL ...
J Anderson's user avatar
0 votes
1 answer
2k views

Include curl commands in a PostgreSQL Docker environment

Using COPY table FROM PROGRAM 'curl "www.example.com/data.csv"'; I am able to copy a CSV directly from the web into a psql table. However, when I am running the same command from inside a ...
sir_olf's user avatar
0 votes
1 answer
95 views

Release rollback approaches?

I've got an old monolithic project using MariaDB and PHP that I'm trying to put on CI/CD. The project has DB migrations to update the DB state. My current CD is built on top of AWS CodeCommit + ...
Daniel's user avatar
  • 103
0 votes
1 answer
112 views

why is "docker run" used to connect to redis?

Trying to understand what's happening here: root@mordor:~# root@mordor:~# docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS ...
Nicholas Saunders's user avatar
0 votes
1 answer
481 views

How to gain console access to a MySQL server running on a docker container from the host?

I thought I had this working a few minutes ago: root $ root $ docker container ls CONTAINER ID IMAGE COMMAND CREATED STATUS ...
Nicholas Saunders's user avatar
0 votes
1 answer
3k views

How can I efficiently scale a data lake?

I am running into problems with AWS Athena data lakes. They were initially very quick, but as we've scaled, they're performing poorly and are becoming expensive and inefficient. What can we do to ...
Joseph's user avatar
  • 45
0 votes
2 answers
40 views

How can I model this schema in MySQL?

I want to create a schema that reflects the following relationships, and I'm trying to do this in MySQL Workbench. (I'm no DB expert) I have 3 environments - sandbox, staging, and production I ...
Chris F's user avatar
  • 433
0 votes
1 answer
9k views

how to connect to a MySQL database in a docker container?

starting up the default mysql server: root $ root $ docker run --name mysql -d -p 3306:3306 -e MYSQL_ROOT_PASSWORD=password mysql/mysql-server:latest ...
Nicholas Saunders's user avatar
0 votes
2 answers
2k views

How do I make a redis container accessible through bridge networking from the host?

I'd like to be able to connect directly to the redis container below: root $ root $ docker images redis REPOSITORY TAG IMAGE ID CREATED SIZE redis ...
Nicholas Saunders's user avatar