I design and build software systems from backend to frontend, with a focus on shipping reliable, production-grade code. Currently working on LLM integrations, agentic workflows, and OCR-based data extraction systems.
Projects
An open source extraction framework that is LLM agnostic and uses agentic search to parse data from long documents.
An applied guide to steering LLM generations with logit bias techniques and reusable tooling.
A technique to optimize LLM responses by extracting and refining their internal reasoning chains.
How to query an AWS Bedrock Knowledge Base using the RetrieveAndGenerate API.
A LangChain integration package that enables seamless interaction with Salesforce CRM data in LLM applications.
A Model Context Protocol server for performing numerical computations through LLMs using NumPy.
Blog
View all →The New Programming Layer: Learning to Operate Alien Technology
The programming profession is being refactored with a new layer of abstraction involving agents, prompts, MCP, and tools. Roll up your sleeves.
Do the Simplest Thing: Agent Design for Better Models
Anthropic's 'do the simplest thing that works' guidance applied to building agents that stay simple, observable, and ready for stronger models.
Why Fast, Small Models Are the Way to Go
LLMs fail. The question is not whether your model will fail, but how gracefully and how quickly. Fast failures beat slow failures every time.
Open Source
Popular framework for building LLM-powered applications and agents.
Block's Goose project, an open source initiative for AI Agents.
Huggingface's project focused on lightweight, efficient AI agents.
Open-source LLM Gateway that allows calling 100+ LLM APIs in the OpenAI format.
Work
Resume
Connect
Feel free to contact me at cole@staymellow.ai