Tagged “architecture”

OpenAI's Decisions API Puts a Typed Endpoint on gpt-6-luna

10 Oct 2026

OpenAI's Decisions API returns predicates, choices and scores instead of free text. What's confirmed about it, how it differs from Jev under the hood and what I'd do about it in a production system.

3 min read·

llm agents inference architecture production

Jev Only Picks From the Answers You Give It

23 Sept 2026

TypeSafe AI's Jev returns typed answers with calibrated probabilities to a fixed set of questions and generates no tokens. How it works and where I'd put it in a production system.

2 min read·

llm agents inference architecture production

Modeling Data Lineage in Neo4j: Make the Transformation a Node

25 Aug 2026

Graph modeling choices that decide whether a Neo4j lineage graph can answer "where did this value come from" or only looks like it can.

3 min read·

neo4j data-lineage graph-databases cypher architecture

Ground Truth and LLM Judges Measure Different Things

28 Jul 2026

Why my thesis evaluation pipeline scored every run with both a deterministic benchmark and an LLM judge. The disagreements between them turned out to be the useful part.

2 min read·

evaluation llm rag architecture production

Using the LLM as a Query Planner

14 Jul 2026

In my thesis work the model only routes questions to the right data partition and pushes predicates down to PostGIS and Neo4j. Inference token cost dropped 3x and routing-index quality ended up deciding answer accuracy.

2 min read·

llm rag architecture query-planning production

RAG vs Fine-Tuning: When to Use Which

16 Apr 2026

Everyone asks this question. Most of the answers online are wrong or at least incomplete.

3 min read·

rag fine-tuning llm machine-learning architecture