What We Learned About Prompt Caching in Production

When we started optimizing our AI pipeline costs, we expected model selection to be the biggest lever. It was not. The bigger win came from a relatively small change to how we structured our prompts. ...

Read →

Phlag: A Practical, Self-Hosted Feature Flag System

Feature flags seem simple at first, but they tend to grow complicated over time. You start with a boolean in a config file. Then you need environment overrides. Then kill switches. Then scheduled rol...

Read →

Varnish Workspace Error

We had been having an issue with losing cookies in Varnish. Because of how Varnish works, the way to work around cookies is to store them in headers inbetween states of the request process. We were fi...

Read →

So, I had a heart attack and bypass surgery

Hey y’all. So, I had a heart attack and bypass surgery. Here is the full story.Friday (3/31) and Saturday (4/1) nights I had chest pain that I thought was acid reflux. On Sunday morning, the pai...

Read →

Who am I to call anyone a racist?

Recently, on Facebook, I was asked "Who are you to call anyone a racist?". To be clear, I did not call anyone a racist. But, really, let's say I did call someone a racist? Who am I to call anyone a ra...

Read →