John Humphreys
  • Member for 2 years, 6 months
  • Last seen this week
Names field in docker ps -a command
0 votes

Run is used for running a new container. Exec is used for doing something inside of an existing container. docker exec -it <container_id_or_name> echo "I'm inside the container!" So, ...

View answer
Allow / white list confirmation from internal target
1 votes

This just sounds like normal monitoring to me, so yeah it makes sense. You can use things like prometheus (free/open source) to do this (with an exporter). https://github.com/czerwonk/ping_exporter ...

View answer
How can you map DNS/host names to their IPs at scale?
2 votes

There may be other ways to achieve this. But the most elegant way we found was using python's socket library. You can get all the info in a one liner, and extract it into a list in another line. It'...

View answer
What is the difference between Fluent Bit and Prometheus?
Accepted answer
0 votes

This is a little off. You are comparing a "Time Series Database" to a "Log Shipper". How Prometheus Works Any service/entity prometheus wants to run monitor has to provide an &...

View answer
How to dockerize a jupyer notebooks project?
2 votes

Yeah, you can totally do this. We actually do a step up above that. We run https://zero-to-jupyterhub.readthedocs.io/ over kubernetes. It gives each user their own notebook server on kubernetes, but ...

View answer
How do we encrypt credentials in Jenkins console output
5 votes

Here's an example of using them in a pipeline safely. In this case, they are injected as environment variables and their value should never have to be shown unless you explicitly choose to print out ...

View answer
Apache Airflow federation - observe remote dag in full detail?
Accepted answer
1 votes

I spent a long time on this problem and made 2 custom solutions as nothing out of the box exists. Both steps require you to either use both the experimental and the extra plugin API or to have access ...

View answer
How to locally resolve host name starting with variable slug?
1 votes

People often use dnsmasq for this. You can wildcard sub-domains like this fairly easily for local testing using it. Here's an example - https://qiita.com/bmj0114/items/9c24d863bcab1a634503 but there ...

View answer
Which cloud region could have the fastest time for a docker image push?
Accepted answer
3 votes

TLDR From cloud instance, just go push to docker hub; you will be routed to the best location automatically. Full details DockerHub is a massive scale and very critical global service. So, you ...

View answer
Angular config maps in kubernetes
2 votes

This one from medium should be fine for your purposes: https://medium.com/@ychetankumarsarma/how-to-manage-angular-application-configurations-for-different-environments-with-docker-and-8ff8c55a1c7d. ...

View answer
Gather resource usage by process in a kubernetes cluster
0 votes

Prometheus can surface any metrics you like, you just need a proper exporter for the apps. E.g. there will be JVM exporters to export JVM heap metrics. Many apps support JMX (also in Java), or other ...

View answer
Back-filling prometheus (and related system) metrics?
Accepted answer
2 votes

Answering my own question (after a few days of research). I have yet to test this but https://github.com/Cleafy/promqueen seems to be designed for this purpose: PromQueen made possible to record ...

View answer
Run more pods than node's CPU with k8s
Accepted answer
1 votes

In addition to the good answer by @therianthropie, here are useful notes to help you understand the situation better.: You can set requests and limits very arbitrarily (and yes, as fractions of a CPU ...

View answer
how to run multiple environments in single job in Jenkins
1 votes

A pretty standard way of doing this would be to chain your jobs or your pipelines. This lets you keep separate jobs (which can be useful), but lets you trigger one job from the other and visualize ...

View answer
Tool or way to support handling dependencies of modules in various platforms (for machine learning in Python)
1 votes

Python is notoriously painful when it comes to dependency and version management. I think its your job to make a portable application, and there are usually methods to do so (even if they boil down ...

View answer
Is it possible to create a module that either creates a resource or sources a data source, based on a boolean value?
Accepted answer
2 votes

You can use the count meta-parameter to achieve the effects of an if-else statement. It is talked about in detail in the link below and I also pulled one relevant example out. I'm not 100% sure if ...

View answer
On Premise CI / CD recommendations for Docker images
1 votes

Jenkins Option If you're comfortable with Jenkins and want to use a CI tool, it is a decent option. It has multiple plugins for watching for files arriving in a file system, and at the end of the ...

View answer
What approach should I take to store environment variables for a repo?
Accepted answer
4 votes

General Notes I don't really understand this one: However, this seems clunky, as I have to create the logic to read this file in every script that is made. You can source all variables from a ...

View answer
I don't fully understand how to use variables in Ansible roles
Accepted answer
1 votes

Your very first role include does not have variables provided with it, so it will fail. Here's an excerpt from above showing this. Notice lines 1-2 have no variables after them (unlike the include ...

View answer
Can I run a Ubuntu 16 Docker image on a Ubuntu 18 host? Will I need to install hardware drivers already available to the host?
Accepted answer
1 votes

The docker container will be abstracted from the way that your host accesses the internet/network, and it should work fine / not care about if it's wifi or not/etc. You can happily run ubuntu docker ...

View answer
How can I build a Linux VM that I can use to test Rest API calls in a lab?
1 votes

You can test basically any rest api call from postman, a free app that runs perfectly well in windows or Linux (or Mac I’m sure). You don’t need anything special. If you want to use Linux specific ...

View answer
EC2 EBS Free Tier - Is Storage Reusable?
2 votes

While I can't find it explicitly written anywhere, I do know that textbooks frequently reference that you can use the free tier to avoid costs, and that they frequently have you create and destroy ...

View answer
Should AWS arn values be treated as secrets?
Accepted answer
9 votes

Well, from a security point of view, it's never bad to give people less information. But, as long as you have sensible security policies in AWS, there is no reason that an arn has to be considered ...

View answer
How to keep many servers (5000+) up-to-date?
Accepted answer
4 votes

I don't think the proposed plan here makes much sense. Tools like Ansible are free and designed to do this with good, central management and logging. Put code in BitBucket. Make a Jenkins server (...

View answer
Workflow with docker in the development environment
1 votes

We use kubernetes / minikube rather than docker-compose, but its the same problem. We generally go with option #1 as: Development is 99% getting the app right. You want to be able to iterate fast/...

View answer
What are best practices for over-committing resources in a staging environment?
1 votes

Very good question; I'm interested to see what comes up here. In terms of cost, obviously each company and team is different. Ideally, everyone should be resource and cost conscious... but most ...

View answer
Weird requests filling apache access logs
0 votes

You're looking at a hex-escaped string. After some googling, I found this entry on server-fault: https://serverfault.com/a/758511/90491. You're looking at a non-decrypted HTTPS request. From Link: ...

View answer
How do I package a jar and a Linux VM to run in Windows?
Accepted answer
1 votes

Generally people go the opposite direction and try to get more to run on Linux as it is generally cheaper (e.g. license free). Also, Windows 10 is more of a personal workstation (vs Windows Server). ...

View answer
Should I chunk my docker images in many small layers instead of one large?
Accepted answer
5 votes

Generally speaking, you want to: Combine multiple related actions/files into a single layer so you don't have tons of layers. Separate out unrelated actions/files which are likely to change ...

View answer
How To Determine Min/Max Resources For Kubernetes Pods?
Accepted answer
1 votes

The DevOps toolkit 2.3 book by Victor Farcic goes into some detail on this. What You Should Understand You as a developer specify whatever requests/limits you like initially. These values have no ...

View answer