Fresh/Brewed

When Systems Fail

This is not a sharp picture - not even that good. I was flying early in the morning friday July 19th when I realized something was really wrong. The ticket counter was in a flurry of checking lists and creating paper tickets. I would learn within 30m that Spirit Airlines was SOL in the airport and the TSA was checking my paper ticket against printed manifests. I couldn't be prouder of my own teams at work for having dug in and weathered the Crowdstrike storm - it's a testament of having skilled, available and committed SREs. By the time I landed and was back at my desk to help, the main production systems were healthy. I can't really speak to the rest - but my day wrapped later than usual friday but it was an amazing team effort and really, I couldn't be prouder of the people I work with at WellSky
Using Azure Storage for Logs

Using Azure Storage for Logs

Published May 31, 2023 by Isaac Johnson

A lot of time I need to handle growing logs. More often than not, I’ll use suites like DataDog to ingest logs, but when I need to store right to the cloud, I have to go another route. In this blo...

OSN 2023: Open Source and Cloud - It Just Makes Sense

OSN 2023: Open Source and Cloud - It Just Makes Sense

Published May 26, 2023 by Isaac Johnson

I was honored to speak at Open Source North this year. I have nothing but love for the conference. However, my talk was scheduled right after lunch in one of the farthest away rooms and arguably ...

PostgreSQL : pg_basebackup and restore

PostgreSQL : pg_basebackup and restore

Published May 22, 2023 by Isaac Johnson

I’ve had a few primary node crashes lately, some of my own doing. One was due to me just knocking the power cord out and the battery draining. Regardless of cause, it made me realize the danger o...

OpenCost

OpenCost

Published May 17, 2023 by Isaac Johnson

A while back we looked at Kubecost as a good Open-Source tool for monitoring costs in Kubernetes. In the last year the OS version has forked into OpenCost and has had plenty of changes.

AWX on a VM two ways

AWX on a VM two ways

Published May 11, 2023 by Isaac Johnson

I often run AWX in Kubernetes, either on-prem K3s, AKS or GKE. It’s easy to setup the Operator and instantiation. In fact, at work, one of our SREs even built out a very slick Terraform module ju...

Uptime Kuma and RunDeck Revisit

Uptime Kuma and RunDeck Revisit

Published May 9, 2023 by Isaac Johnson

Today we’ll look at Uptime Kuma and Rundeck again. Unlike the last time, we’ll focus on running these via Docker on a Linux host (instead of Kubernetes). We’ll handle exposing Uptime via an “Exte...

Theme built by C.S. Rhymes