Post Featured Image

AI - How To Run Llama 2 Locally

There are advantages to integrating with large open models. But there are also downsides. How do you control costs? What to do about data security? How do you control model versioning to avoid unexpected regressions? Running your own LLM model on your local machine or your own server is an effective class of solution to these types of engineering challenges.

READ MORE

Post Featured Image

Next-Level Information Systems

In the ever-evolving landscape of technology, the quest for efficiency and clarity in the ocean of data we navigate daily has led to the development of sophisticated information systems. From the rudimentary to the revolutionary, these systems serve as the backbone of our digital society, empowering users to distill complexity into actionable insights. Embark on a journey with me through the tiers of information systems, exploring how they transform chaos into structure and ignorance into understanding.

READ MORE

Post Featured Image

AI - Prompting for Structured Data

AI LLMs are very powerful. They can be used to generate text, code, and even structured data. In this post, I’ll show you how I use LLMs and prompt engineering techniques to generate structured data for powering applications to deliver a consistent experience.

READ MORE

Post Featured Image

Don't Wear Too Many Hats

There are 24 hours in a day. That’s one of the universal constraints that exists for everyone no matter how gifted, talented, or hard-working. How can an engineering leader deliver consistently high-quality work within the natural constraint of time? Focus. That’s how. How can a leader focus, when they have many, many different job responsibilities? Read on to find out.

READ MORE