I Spent Two Years Building the Median — Hariprasad Sudharshan

Idea #1
Model benchmark scores are widely misread, and the misreading causes bad product decisions. Leaderboard Elo differences of 80–90 points between frontier labs do not mean one model is 80 points 'smarter' than another in any absolute sense. These scores are relative ratings derived from head-to-head comparisons in a specific evaluation environment — they say how models rank against each other in that context, not how much raw intelligence separates them. More importantly, most comparisons people think are model comparisons are actually harness comparisons. Claude Code versus Cursor is not a comparison of the underlying models; it is a comparison of tool integrations, context management, memory systems, workflow orchestration, and UX — the 'harness' around the model. The model is the athlete; the harness is the training system, nutrition, coaching, and race-day setup. Comparing an athlete to a training system is a category error, and making that error in a boardroom produces roadmap decisions based on false signal. The concrete framing: this is equivalent to comparing Jamaica versus the USA in the 100 meters — you are comparing a single sprinter to an entire national athletic development apparatus. The leaderboard frontier gap is so small that on any given day any top model can beat any other. Building a product roadmap around a small moving frontier gap is not a competitive strategy.

Idea #2
The median product is now free, and that changes what competition means. When everyone builds with the same rented models, the same harnesses, and the same training data baked into those models, the outputs converge. This is not plagiarism — it is structural: the same cookie cutter pressed into the same dough produces the same shape. Before 2023, building even a mediocre product required a team, a budget, and months; that cost created differentiation by default. Today, a solo builder can ship a working product in four weeks, but so can the next hundred builders working the same problem. The implication is that shipping is no longer the hard part and therefore no longer the moat. Distribution becomes the moat when product quality converges. The only escape is a genuine unit of novelty — something the model cannot supply because it has not been trained on it yet. The actionable reframe: treat novelty as a budget line, not an afterthought. Before any build starts, name the one thing that is genuinely novel. If you cannot name it, acknowledge the project is a learning exercise and ship accordingly — do not kid yourself that it is a competitive product. Concretely: after two years of building dozens of applications and repeatedly discovering that competitors had shipped identical calculators, tools, and RAG systems — not by copying but by querying the same models — the author rebuilt their inference cost calculator not around a novel tech stack but around a genuinely unaddressed comparison: identical open-weight model costs inside your own enterprise vs. renting tokens from a cloud provider. None of the 244 other calculators they found had done this. One unit of novelty, chosen deliberately.

Idea #3
Coding agents give you the last great design for free — they will never give you the next one. The patterns these models have internalized — RAG, agent loops, vector stores, standard microservice shapes, common orchestration patterns — are the accumulated best practices of what has already been built and documented. A coding agent scaffolding a new project draws on this corpus and produces a convergent, competent, well-structured median. This is genuinely useful and not to be dismissed. But it means the agent's output represents the ceiling of established thinking, not a floor for invention. No coding agent will produce the next Kafka, the next Zookeeper, the next Kubernetes — those were genuinely novel architectural concepts that post-dated the knowledge they would have been trained on. The implication for practice: treat the moment the agent says 'done' as the starting signal, not the finish line. The agent has handled the solved parts; the unsolved parts are now yours. Everything the agent built for free is also being built for free by your competitors right now. Your differentiation work begins exactly where the agent stopped.

Idea #4
AI-assisted development has reversed the natural search-before-build instinct, and this is a trap. When building was expensive — in time, team, and money — the rational response to a new problem was to search first: read the docs, audit what already exists, assess whether building was even necessary. That friction was a feature. It forced evaluation before commitment. AI coding agents have collapsed that friction: you can get a working scaffold in two minutes and a shippable demo in two hours. The result is a reflex: open a problem, open an agent. The cognitive cost of building has dropped so far below the cognitive cost of searching and reading that people default to building. The damage compounds because small wins produce dopamine — seeing your idea become something real in no time is genuinely exciting — so the reflex is self-reinforcing. The trap closes when you realize, four weeks in, that you have built the 400th RAG system. The fix is a deliberate pre-build question: Who has already done this? This one question re-engages the search instinct the AI agent suppressed. If the answer is 'many people with mature open-source options,' the right move is to fork or leverage, not rebuild. The concrete example: when an AI coding agent was directly asked why it built a RAG system from scratch when thousands-star mature open-source alternatives existed, it acknowledged it had simply been asked 'Can you build?' and had built. It would have done something different if asked to search first.

Source: I Spent Two Years Building the Median — Hariprasad Sudharshan (AI Engineer)

Text summarized and optimized using Anthropic’s models and reviewed by a human.