The Agile Monkeys Labs

Research on Information Retrieval, AI, Machine Learning, and more!

LLM-Powered Codebase Analysis: Technical Due Diligence Before Software Estimation

llm
codebase comprehension
technical due diligence
software estimation
software architecture
scope management
engineering estimation
legacy system analysis
integrate vs rebuild
flow mapping
ai-assisted development
scope drift
AI

This is the point where a supposedly small feature often reveals itself. Sometimes it’s a straightforward extension of existing flows. Sometimes it’s an integration into a partially built capability. And sometimes there’s a genuine architectural mismatch that justifies a rebuild.

Mar 19, 2026

AI Agent Platform Architecture: What One Real Agent Taught Us

agent platform
agent governance
feedback loops
roi measurement
action visibility
control plane
agent architecture
platform strategy
ai agents
AI
agents
ROI
governance

A control plane isn’t your starting point. It’s what remains after one real agent has forced you to solve retrieval, permissions, review, action visibility, and outcome tracking.

Mar 19, 2026

RAG Retrieval Evaluation in the Ingestion Pipeline: What We Learned

rag
retrieval evaluation
ingestion pipeline
chunking
metadata quality
canonical identifiers
hybrid search
agentic retrieval
regression detection
knowledge base management
retrieval-augmented generation
AI
retrieval
ingestion
evaluations
knowledge systems

Most retrieval regressions don’t begin when the user asks a question. They begin earlier, when new content is parsed, chunked, labeled, indexed, and quietly made available to the agent. Once we saw that clearly, we stopped treating retrieval QA as a chat problem and started moving it into the…

Mar 19, 2026

Reducing LLM Cost and Latency in Production AI Agents: A Case Study

ai engineering
product strategy
llm
latency
architecture

How we reduced token spend and latency in a production eCommerce agent flow, with before-and-after metrics.

Mar 4, 2026

Legacy Modernization with AI: From 229 Vulnerabilities to Zero

security
legacy modernisation
AI
Spring
Java
Struts

A story about confronting technical debt, outsmarting false alarms, and building bridges across incompatible worlds — without rewriting everything from scratch.

Mar 2, 2026

How to Build Products Out of AI Agents (Instead of Adding AI to Them)

ai
agents
product
evaluation

Why product teams should stop adding AI as a helper and start composing features from agents, tools, prompts, and integrated evaluation.

Feb 26, 2026

Vector Search for Fashion E-commerce: Custom Embedding Lens Without Fine-Tuning

embeddings
search
e-commerce
fine-tuning
personalization

A step-by-step story of how we nudged our vector search toward beach-ready products without fine tuning the whole model (or re-indexing eleven-thousand SKUs).

Feb 11, 2026

AI Document Parsing in Production: Benchmarking GPT, Claude, AWS and Azure

ai
document parsing
ocr
benchmarking
production

64 controlled runs comparing GPT-5.1, Claude Sonnet 4.5, AWS Textract, Azure Document Intelligence, and Google DocAI across passports, certificates, and tax forms.

Dec 11, 2025

AI-Powered E2E Testing: 70% Reduction in Test Execution Time with Stagehand

ai
testing
e2e
automation
stagehand

From ChatGPT experiments to production-ready E2E testing: how Stagehand, Browserbase, and Gemini 2.5 Flash enabled a 70% reduction in test execution time.

Nov 24, 2025

AI Evaluation in Production: Why Evals Are a Mindset, Not a Tool

ai evals
data pipelines
product analytics

Evals is not a UI, or a dashboard, or a platform — it’s about data. Understanding what evaluating really means and building a culture of continuous evaluation.

Nov 17, 2025

AGI Is a Decade Away: Why Autonomous Agents and Practical AI Engineering Start Now

AGI
AI agents
model optimization
information retrieval
AI strategy

Highlights and reflections from The Agile Monkeys team discussion on Andrej Karpathy’s interview with Dwarkesh Patel — exploring cognitive cores, autonomous agents, and the practical path to AI integration.

Nov 13, 2025

How to Migrate LLMs Safely in Production: GPT-4o to GPT-4.1 Case Study

LLM
Evaluation
GPT-4
Production

How we migrated models in production while minimizing risks through a comprehensive multi-level evaluation system.

Jul 24, 2025

Improving Vector Search Recall by Fusing Multi-Modal Embeddings

information retrieval
e-commerce
research
embeddings

Fusing multiple modalities embeddings have demonstrated consistent improvements (14% over just image embeddings) in fashion e-commerce retrieval.

Jul 24, 2025

Mega-Prompt vs Specialized Models vs Fine-Tuning: An E-commerce Search Benchmark

fine-tuning
ecommerce
feature-extraction

Putting the mega‑prompt vs micro‑models hypothesis to the test — can specialization really beat size?

Jul 24, 2025

Apache NiFi for AI Data Pipelines: Pros, Cons and Alternatives

apache nifi
data pipelines
ingestion
information retrieval

Apache NiFi is a powerful visual-coding tool to build data pipelines. We explore its pros and cons and whether it’s the right tool for building your AI data pipelines.

Jul 18, 2025

Feature Augmented Retrieval: How to Improve RAG Without Changing Your LLM

feature extraction
information retrieval

Feature Augmented Retrieval provides a structured, explicit, and adaptive framework that significantly enhances retrieval accuracy and relevance.

Apr 28, 2025
No matching items