❌

Normal view

How Does a RAG Reranker Really Work?

26 August 2026 at 10:30

Enterprise Document Intelligence [Vol.1 #2D] - What data scientists say when asked, what the model actually does under the hood, and why the honest answer changes your architecture decisions in enterprise RAG

The post How Does a RAG Reranker Really Work? appeared first on Towards Data Science.

Retrieve One Row from a Table, Not the Whole Table: Row-Level Chunks for RAG

21 August 2026 at 10:30

Enterprise Document Intelligence [Vol.1 #7sexies] - The unit of retrieval doesn’t have to be a page or a paragraph. When the corpus carries tables, each body row with its column headers is a chunk in its own right, and it’s often the one row the reader asked about

The post Retrieve One Row from a Table, Not the Whole Table: Row-Level Chunks for RAG appeared first on Towards Data Science.

AI Agents Don’t Need More Context β€” They Need Typed Context

24 August 2026 at 12:00

AI agents don’t just have a context problemβ€”they have a context typing problem. When instructions, memory, retrieved evidence, and tool outputs are flattened into one string, their semantic boundaries can disappear. I built a lightweight, zero-dependency Python runtime that keeps those boundaries explicit, tracks provenance, and rejects invalid context transformations before they reach the model. This article walks through the implementation, tests, and what this approach doesβ€”and does notβ€”guarantee.

The post AI Agents Don’t Need More Context β€” They Need Typed Context appeared first on Towards Data Science.

Retrieve One Row from a Table, Not the Whole Table: Row-Level Chunks for RAG

21 August 2026 at 16:30

Enterprise Document Intelligence [Vol.1 #7sexies] - The unit of retrieval doesn’t have to be a page or a paragraph. When the corpus carries tables, each body row with its column headers is a chunk in its own right, and it’s often the one row the reader asked about

The post Retrieve One Row from a Table, Not the Whole Table: Row-Level Chunks for RAG appeared first on Towards Data Science.

Kimi K3’s 1M Token Context Window vs. RAG: Cost, Latency and Answer Quality

19 August 2026 at 16:30

A controlled comparison of a top-5 RAG pipeline and a full 127,000 token prompt on the same 12 questions, same system prompt and same model. Graded blind on correctness, completeness and grounding.

The post Kimi K3’s 1M Token Context Window vs. RAG: Cost, Latency and Answer Quality appeared first on Towards Data Science.

Loop Engineering for RAG: The Small Loops Inside Each Step, the Big Loops Across the Pipeline

17 August 2026 at 12:00

Enterprise Document Intelligence [Vol.1 #13bis] - The four bricks return useful results most of the time. Loop engineering is what the system does the rest of the time: when retrieval misses, when generation fails the schema, when the listing comes back incomplete, when an API call times out. Three control surfaces (trigger, termination, recovery) and one rule that separates a useful loop from a spinning one

The post Loop Engineering for RAG: The Small Loops Inside Each Step, the Big Loops Across the Pipeline appeared first on Towards Data Science.

Designing a Persistent Knowledge Layer That Refuses to Guess

16 August 2026 at 15:00

RAG Retrieves, It Never Remembers. A vendor-neutral blueprint for applications that accumulate understanding. Includes a complete Azure-native implementation (Microsoft Foundry, Azure AI Search, Cosmos DB,Β FastAPI) mapped to a property-insurance corpus.Β 

The post Designing a Persistent Knowledge Layer That Refuses to Guess appeared first on Towards Data Science.

Cut an Enterprise RAG Pipeline’s Latency and Cost by Calling the LLM Less, Not by Buying a Faster Model

13 August 2026 at 15:00

Enterprise Document Intelligence [Vol.1 #9ter] - The pipeline from Article 9 calls a model at several steps to be sure it is right. On easy questions that is needless latency. A per-question signal routes them past the model, about two seconds saved for a keyword match.

The post Cut an Enterprise RAG Pipeline’s Latency and Cost by Calling the LLM Less, Not by Buying a Faster Model appeared first on Towards Data Science.

❌