Skip to main content

Questions tagged [databases]

A database is an organised collection of data. It is the collection of schemas, tables, queries, reports, views, and other objects. Designers typically organise data to model aspects of reality in a way that supports processes requiring information. Use this tag on questions which ask about database aspects of Continuous Delivery, Continuous Deployment or general DevOps approaches to databases.

Filter by
Sorted by
Tagged with
21 votes
6 answers
2k views

What practices or tools enable Continuous Deployment of Databases?

Continuous Delivery or Continuous Deployment of infrastructure and code is comparatively simple compared to trying the same approaches for databases, specifically RDBMSs. Code and infrastructure will ...
0 votes
0 answers
18 views

Assigning new role to already existing user in RDS

"We have an RDS instance hosted for Aurora PostgreSQL, specifically using the 'db.r5.xlarge' instance type. When we initially set up the RDS instance, a default user named 'rdsadmin' was ...
1 vote
1 answer
106 views

Is terraform good option for data management

I have complex stack which consists of infrastructure, application and config parts, which are deployed to datacenters around the world. We have custom inhouse configuration system, based on database ...
0 votes
1 answer
94 views

Release rollback approaches?

I've got an old monolithic project using MariaDB and PHP that I'm trying to put on CI/CD. The project has DB migrations to update the DB state. My current CD is built on top of AWS CodeCommit + ...
0 votes
1 answer
3k views

How can I efficiently scale a data lake?

I am running into problems with AWS Athena data lakes. They were initially very quick, but as we've scaled, they're performing poorly and are becoming expensive and inefficient. What can we do to ...
3 votes
1 answer
636 views

What is a good storage for storing performance results and visualizing in grafana

Intro I am a tester and need to analyze the results of automated tests (response times and etc.) Current situation 1) I run performance tests using locust.io 2) During test execution, response ...
2 votes
0 answers
470 views

How do I use a raw volume with a database on Kubernetes?

I'm trying to figure out how to launch a web application in a Kubernetes cluster on AWS. Right now I'm not certain about a database. I can see that one can use raw block volumes, which are supposedly ...
1 vote
1 answer
73 views

Is it possible or common to use a Proxy server to refer to a database

From my experience I have used proxy servers to refer to different servers (nginx). I have previously worked on building a mvc framework. Basically there were 8 databases with 10 accounts each. The ...
53 votes
3 answers
17k views

What are the reasons Docker should not be used for databases?

I'm having a discussion with a friend about use cases for Docker. One guy in the team wants to use Docker for everything - like a kind of universal unix process wrapper. The other thinks that Docker ...
5 votes
2 answers
462 views

How to version control shared database?

We have several C# applications using a shared monolithic database (on-premise SQL server) using Stored Procedures as an exclusive interface. The C# code repositories include only Stored Procedures ...
2 votes
2 answers
1k views

Log/Data rotation in Docker Container

My question is more on the concept or best practices to follow. I have two docker containers running InfluxDB and Grafana (monitoring applications). I have mounted external volume to each. now, the ...
1 vote
2 answers
61 views

How many DB instances to use? When to switch to container services?

I'm looking for some insights into cloud management. I won't go into much detail, I just need some general information/resources that I can follow, about these topics: When to use container services ...
0 votes
2 answers
40 views

How can I model this schema in MySQL?

I want to create a schema that reflects the following relationships, and I'm trying to do this in MySQL Workbench. (I'm no DB expert) I have 3 environments - sandbox, staging, and production I ...
6 votes
3 answers
2k views

How to do blue-green deployment with PL/SQL code?

Is it possible to do blue-green deployment when your software is mostly a set of PL/SQL packages? I don't really want to duplicate the database, the financial risks in case of any desyncs are too big....
0 votes
1 answer
479 views

How to gain console access to a MySQL server running on a docker container from the host?

I thought I had this working a few minutes ago: root $ root $ docker container ls CONTAINER ID IMAGE COMMAND CREATED STATUS ...
1 vote
2 answers
223 views

Populate Database

I am using Terraform Cloud to build the infrastructure. One of the resources is a postgresql database. What is the best way to populate the database by creating tables, multiple schema etc after the ...
0 votes
1 answer
111 views

why is "docker run" used to connect to redis?

Trying to understand what's happening here: root@mordor:~# root@mordor:~# docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS ...
0 votes
2 answers
2k views

How do I make a redis container accessible through bridge networking from the host?

I'd like to be able to connect directly to the redis container below: root $ root $ docker images redis REPOSITORY TAG IMAGE ID CREATED SIZE redis ...
2 votes
1 answer
355 views

How to Connect Docker Containers?

In "What is a container?" the docker docs show the following nifty image: For my scenario I have only App A and App B; let's designate them Alice and Bob. How do Alice and Bob communicate, ...
0 votes
1 answer
9k views

how to connect to a MySQL database in a docker container?

starting up the default mysql server: root $ root $ docker run --name mysql -d -p 3306:3306 -e MYSQL_ROOT_PASSWORD=password mysql/mysql-server:latest ...
1 vote
1 answer
3k views

cannot get bash prompt: Error response from daemon: Container foo is not running

A basic jetty container: CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES ...
3 votes
1 answer
8k views

docker: Error response from daemon: Conflict. The container name "/basexhttp" is already in use by container

Am I even correctly following the documentation on creating and running a docker container below? [root@ ~]# [root@ ~]# docker run -d \ > --name basexhttp \ > --publish 1984:1984 \ > ...
0 votes
1 answer
673 views

How to gain root access to an existing docker container?

Able to get a response from the docker hub basex container: nicholas $ nicholas $ lynx http://localhost:8984/ --dump No function found that matches the request. nicholas $ Ran the container as: ...
0 votes
1 answer
2k views

Include curl commands in a PostgreSQL Docker environment

Using COPY table FROM PROGRAM 'curl "www.example.com/data.csv"'; I am able to copy a CSV directly from the web into a psql table. However, when I am running the same command from inside a ...
2 votes
1 answer
143 views

How to deploy Dev Azure SQL code to Prod Azure SQL using dacpac without knowing the target server credentials

Here is my scenario - I have access to source Azure SQL Database where i did few changes to schema (eg adding a table). Now I want to deploy this SQL code to prod Azure SQL Database using Azure ...
0 votes
1 answer
70 views

What can I use to forward a conection to port 3006 on the bastion to an RDS database?

Forwarding a port 3006 database connection from a bastion server to a RDS database? Trying to find the answer online I came across the term Proxy jump but can't find anything on proxy jump for 3006 ...
2 votes
2 answers
657 views

Application version and Database Schema version mapping

I am trying to integrate database schema versioning in an existing project where schema is not versioned at all. Is it a good practice to create a tight mapping between application version and ...
1 vote
1 answer
68 views

File transfer from Application server to Db Server without a shared folder access but using Service Account

I am working as a Business Analyst for an IT firm. My team has stumbled upon a certain feature where they are required to use Service account. We are working for a Bank and they have strong policies ...
1 vote
1 answer
1k views

RDS DB migrations using ECS and Fargate

I run my app with Docker and ECS. How can I handle database migrations? With fargate there doesn’t seem to be a way to SSH into the container to run any commands so I can’t run my RDS MySQL migrations ...
8 votes
2 answers
1k views

How to synchronize deployments (especially of database object changes) on multiple environments [duplicate]

I am the DevOps engineer and a software engineer in a team where months back, the developers moved from having a central Oracle DB to having the DB on a CentOS VM on their individual laptops. The move ...
4 votes
1 answer
72 views

Trade offs of putting an international master database in us-west-2

I'm hoping this isn't so open ended that it veers towards a "discussion" more than an "answerable" question. I need to place an RDS Postgres instance in an AWS region that will act as the master DB ...
0 votes
1 answer
52 views

How to incorporate containers into a standardized dev environment? [closed]

I'm currently working at a small company where we've had a lot of issues being on the same page with entity framework migrations and local databases. I want to start incorporating containers in hopes ...
1 vote
1 answer
23 views

AWS RDS- Determine what Database Tables aren't interacted with?

Is it possible to have AWS-RDS (or another aws service) generate a report on databases that haven't been interacted with (write/read) after a certain period of time? My background is in QA and I'm ...
1 vote
1 answer
72 views

How to share RDS snapshots across account roles?

I'm using an AWS account which has different roles for the different environments we use. For example, we have a Development role for our development environment and a Production role for our ...
2 votes
0 answers
108 views

Cheapest database option on Azure supporting Offline Data Sync / Azure Mobile Apps

What's the cheapest database option on Azure that can be used with Offline Data Sync? I want to run a productive app on that, but I don't expect many users and as it's only sync I don't need ultra ...
4 votes
1 answer
97 views

What strategies exist to transition DB Migrations with Stored Procedures to Continuous Delivery?

Our company has broken up most of our large Monolith application into smaller Microservices and we have a clear plan on how to get new services on Kubrenetes into a CI/CD pipeline. However, we still ...
8 votes
1 answer
6k views

Why is Prometheus not a good choice for data with high cardinality?

I have a background in relational databases and new to Prometheus. I wonder why Prometheus is not a good choice for high cardinality data? Why do I need to use low cardinality data? It's exact ...
7 votes
1 answer
1k views

What is the impact of using Helm Deployments instead of StatefulSets for Databases like MongoDB or MySQL?

The definition of a stateless app seems to apply to database servers like MongoDB or MySQL. I found Helm Charts as a kind of template-repository for Kubernetes. However, the stable builds all use ...
2 votes
1 answer
102 views

phpMyAdmin using dockerised database

I have installed mariadb inside docker container, and mariadb is running properly inside that container. I want to get access of mariadb through phpMyAdmin from outside docker container. What will I ...
2 votes
1 answer
793 views

Strategies to work around 30 sec timeout

I received a timeout when trying to perform 7000 * 3 inserts into MariaDB in 30 seconds with AWS Python Lambda. I have three ideas how to get around the 30 second API Gateway timeout: Convert the ...
2 votes
2 answers
221 views

Merging Git Database Commits from One Branch to Another without Cherrypicking

We have main two Git branches at our company: During our Sprint, Everyone has (local branches) Release branch: Contains prepared/developed code, ready for testing, and Master branch: Production- ...
3 votes
1 answer
160 views

Zero Downtime Deployment with Database Backward Compatibility [duplicate]

Question Does anyone have experience with Database Backward Compatibility to achieve Zero Downtime Deployment? Are there good links or references that I can read? Reason I am working with a ...
1 vote
1 answer
71 views

Does anyone have resources, tools, ideas, for automating database create, update, modify, delete

I've been tasked to find a way to automate promotion of database creation, changes and other modification related to application changes in a devops world. My databases include MS SQL, Oracle, MySQL ...
1 vote
1 answer
73 views

In a Database Per Service model - should i include the database in the service container?

I am implementing a simple setup with two micro services and would like each of them to have their own DB - each service is running in it's own container. Should i include the DB's in each service ...
2 votes
0 answers
37 views

Is this a robust implementation of database encryption at rest? [closed]

I am looking forward to implement encryption at rest for two+ SQL database servers (Linux). My goal is (obviously) to avoid storing the clear encryption key on the server or store it in a well-known ...
2 votes
0 answers
46 views

Which volume solutions are the most convenient when building Docker & microservices based application? [closed]

My application consists of few microservices and web (React) frontend. Basically I have auth microservice, application backend service, various data processing services and frontend rendering server. ...
4 votes
2 answers
4k views

Docker MongoDB image - How to specify credentials other than in the compose file?

I'm using this docker image https://hub.docker.com/_/mongo/. That image provides a way of initializing a mongodb root database user with env variables which I can specify in the compose file as ...
1 vote
1 answer
41 views

simulate SQL DB usage pattern of a typical cloud native web app with sysbench?

As far as I understand sysbench is for bencharking / test max. performance of a database server. I wish to simulate DB usage pattern of a typical cloud native web app (Twelve-Factor App). Is this ...
5 votes
1 answer
4k views

Creating ansible host_vars and group_vars files dynamically

Is it possible to populate host_vars and group_vars with results from a database like we do in dynamic inventories? Actually I'm doing it inside my playbook either with lookups, either by using shell ...
5 votes
2 answers
945 views

Google Cloud Storage vs Redis / ElasticSearch

We're building an application that reads data from an API and displays it in a frontend. Due to API limits, we have to cache the API calls meaning that we save the result of the API calls (both user ...