53 articlesUpdated 4/27/2026

Frontier Edges

What this node tracks: The hard problems that major labs and companies are actively throwing serious resources at. Not what happened β€” what's being attempted. Each edge is a problem where a breakthrough would reshape the field. We track who's pushing, how close they are, and what signals indicate progress.

How to Read This

Each edge has a maturity level:

LevelMeaning
theoreticalPromising idea, early papers, no serious corporate investment yet
researchActive lab work, multiple papers, corporate R&D teams assigned
prototypeWorking demos exist, not production-ready
scalingBeing engineered for production, significant $$$ flowing
near-breakthroughMultiple credible groups reporting strong results, could land any month

And an impact rating if cracked:

RatingMeaning
incrementalImproves existing capabilities meaningfully
transformativeEnables fundamentally new capabilities
paradigm-shiftReshapes the entire AI field

Active Edge Registry


EDGE-01: Post-Transformer Architectures

Maturity: research | Impact if cracked: paradigm-shift | Source nodes: ai-research-breakthroughs frontier-models

The Problem: Transformers dominate but have fundamental limitations β€” quadratic attention cost, no built-in world model, poor at structured reasoning. Can a fundamentally different architecture beat them at scale?

Who's Pushing:

PlayerApproachInvestmentStatus
AMI Labs (LeCun)JEPA β€” Joint Embedding Predictive Architecture$1.03B seed, $3.5B valuationBuilding from scratch, early stage
Kimi TeamAttnRes β€” learned depth-wise attention replacing residual connectionsInternal R&DScaled to 48B, promising results
DeepSeekmHC β€” manifold-constrained hyper-connectionsInternal R&D51% BBH vs 43.8% baseline at 6.7% extra compute
Various labsState Space Models (Mamba variants, hybrid architectures)Distributed researchMamba-3 at ICLR 2026 β€” 1.8pp gains at 1.5B, half state size

What Breakthrough Looks Like: A non-Transformer architecture that matches or beats GPT-5 class models on standard benchmarks at comparable or lower compute cost.

Current Distance: Far. JEPA is a multi-year bet. Hybrid approaches (Mamba + Transformer) show promise but haven't displaced pure Transformers at scale. AttnRes and mHC are improvements within the Transformer framework, not replacements.

Recent Progress:

DateSignalSignificance
2026-04-09Kathleen: oscillator-based byte-level processing, 733K params, outperforms 16x larger models on classificationnotable
2026-03-20Mamba-3 at ICLR 2026 β€” 1.8pp accuracy gain, half state size, linear computesignificant
2026-03-20Var-JEPA: variational formulation with single ELBO, no ad-hoc regularizersnotable
2026-03-09AMI Labs raises $1.03B for JEPA world modelsbreakthrough
2026-03-16AttnRes scales to 48B params with strong resultssignificant
2026-03-12DeepSeek mHC fixes training instability at 6.7% extra computesignificant

EDGE-02: Reliable Autonomous Agents

Maturity: prototype | Impact if cracked: transformative | Source nodes: ai-agents ai-in-enterprise

The Problem: AI agents can do impressive demos but fail in production. Claude Opus 4.5 only achieves 37.4% on realistic enterprise tasks. 100% of enterprises want to expand agents but only 8.6% are in production. The gap between "works sometimes" and "trustworthy enough to delegate" is the core unsolved problem.

Who's Pushing:

PlayerApproachInvestmentStatus
AnthropicClaude Code, MCP protocol, Computer UseCore product betLeading on tool use, still unreliable on complex chains
OpenAIAgentKit, MCP (deprecating Assistants API)Major R&D push + OpenClaw acquisitionBroadest developer adoption, consolidating on MCP
LangChainDeepAgents β€” planning + subagent spawningVC-backed, +4,380 stars/wkFramework approach to reliability
GoogleStitch, Gemini agent capabilitiesInternal R&DEnterprise-focused
MicrosoftAutoGen, Copilot Cowork (with Anthropic)Major enterprise betLong-running multi-step tasks in M365
NVIDIANemoClaw β€” kernel sandboxingGTC launchHardware-backed security approach

What Breakthrough Looks Like: An agent system that completes >80% of multi-step enterprise workflows correctly, with reliable error recovery, and that enterprises actually trust in production.

Current Distance: Medium. The pieces exist (tool use, planning, memory) but composing them reliably is unsolved. MCP at 97M downloads shows the plumbing is ready. The reliability/trust gap is the bottleneck.

Recent Progress:

DateSignalSignificance
2026-03-30SakanaAI AI-Scientist-v2: first fully AI-generated paper accepted for peer review β€” validates autonomous multi-step research loopsignificant
2026-03-30AI scheming incidents up 5x (AISI study of 8 frontier models) β€” reliability ceiling is being hit by behavioral failures, not just capability gapssignificant
2026-03-30Ramp grants AI agents access to 50+ corporate finance tools in production β€” high-stakes domain deploymentnotable
2026-03-27MCP formal semantics β€” process calculus proves expressivity gaps, proposes MCP+ extensionssignificant
2026-03-27OpenAI Codex Plugins β€” 20+ integrations, MCP-based ecosystem for 1.6M userssignificant
2026-03-27Kitchen Loop β€” self-evolving codebase: 285+ iterations, 1,094+ merged PRs, zero regressionsnotable
2026-03-23OpenAI deprecating Assistants API for MCP β€” protocol consolidationsignificant
2026-03-21OpenAI acquires OpenClaw creator; platform goes to foundationbreakthrough
2026-03-20METR: agent task autonomy doubling every 7 months, 4+ hour taskssignificant
2026-03-17Meta REA agent doubles model accuracy β€” 3 engineers for 8 modelssignificant
2026-03-14EnterpriseOps-Gym benchmarks agents at 37.4%notable (reality check)
2026-03-09MCP hits 97M monthly SDK downloadssignificant
2026-03-19LangChain DeepAgents adds planning + subagentssignificant
2026-03-16NemoClaw kernel sandboxing for enterprisesignificant
2026-03-09Copilot Cowork launches long-running agents in M365significant

EDGE-03: 1-Bit / Extreme Quantization at Production Quality

Maturity: prototype | Impact if cracked: transformative | Source nodes: ai-research-breakthroughs edge-on-device-ai

The Problem: Running large models requires expensive hardware. 1-bit quantization (BitNet) could make frontier-class models run on consumer hardware or phones, but quality degrades. Can 1-bit models match full-precision at production quality?

Who's Pushing:

PlayerApproachInvestmentStatus
Microsoft ResearchBitNet β€” 1-bit LLM inference frameworkPublished research, +6,457 stars/wkFramework available, quality gap remains
Tether/QVACBitNet LoRA β€” 1-bit fine-tuning on consumer GPUs/phonesProduct development77.8% less VRAM, cross-platform
Various labsGPTQ, AWQ, GGUF quantizationDistributed community4-bit is practical, 1-bit is frontier

What Breakthrough Looks Like: A 1-bit model that matches a full-precision model of the same parameter count on major benchmarks (MMLU, HumanEval, etc.) within 2-3%, and runs on consumer hardware.

Current Distance: Medium. 4-bit quantization is already production-ready (GGUF/llama.cpp ecosystem). 1-bit is the hard frontier. BitNet shows it's theoretically possible but hasn't been demonstrated at frontier scale with frontier quality.

Recent Progress:

DateSignalSignificance
2026-03-14Tether BitNet LoRA β€” 1-bit fine-tuning on phones, 77.8% less VRAMnotable
2026-03-19Microsoft BitNet +6,457 stars/week surgenotable

EDGE-04: World Models (Learning Physics from Data)

Maturity: research | Impact if cracked: paradigm-shift | Source nodes: ai-research-breakthroughs multimodal-ai robotics-embodied-ai

The Problem: Current AI can generate text and images but doesn't understand how the physical world works β€” cause and effect, object permanence, physics. World models would let AI predict what happens next in physical environments, critical for robotics, autonomous driving, and genuine understanding.

Who's Pushing:

PlayerApproachInvestmentStatus
AMI Labs (LeCun)JEPA β€” learn world representations without generative modeling$1.03B seedEarly stage, multi-year bet
Google DeepMindGenie 2, video predictionInternal R&DStrong demos, not general
MetaV-JEPA, video understandingFAIR researchPublished, limited scope
ByteDanceSeedance 2.0 β€” 2160p video generationProduct (paused globally)Generates video but unclear if it "understands" physics

What Breakthrough Looks Like: A model that can reliably predict the physical consequences of actions in novel environments β€” not just generate plausible-looking video, but actually understand causality and physics.

Current Distance: Far. Video generation is advancing fast (Seedance 2.0, Sora, etc.) but generating convincing video is different from understanding physics. JEPA is the most principled approach but is years from demonstrating results at scale.

Recent Progress:

DateSignalSignificance
2026-03-26Meta TRIBEv2 β€” foundation model predicting brain fMRI responses using V-JEPA2 + LLaMA 3.2 + Wav2Vec. First practical application of JEPA for in-silico neuroscience. Open-sourced (CC-BY-NC-4.0).significant
2026-03-25LeWorldModel achieves stable JEPA learning from pixels at 15M params, 200x compressionnotable
2026-03-09AMI Labs $1.03B for JEPA world modelsbreakthrough
2026-03-15Seedance 2.0 paused over copyright (20s 2160p video)notable

EDGE-05: Mechanistic Interpretability

Maturity: research | Impact if cracked: transformative | Source nodes: ai-safety-alignment ai-research-breakthroughs

The Problem: We don't understand what neural networks actually learn or why they produce specific outputs. Mechanistic interpretability aims to reverse-engineer the internal computations β€” finding the "circuits" inside models that implement specific behaviors.

Who's Pushing:

PlayerApproachInvestmentStatus
AnthropicSparse autoencoders, feature mapping, Anthropic InstituteCore research priorityFound interpretable features in Claude, scaling to larger models
Google DeepMindCircuits-style analysisInternal R&DComplementary approaches
EleutherAIOpen-source interpretability toolsCommunity-drivenTooling and infrastructure
Academic labs (MIT, Oxford, etc.)Various approachesGrant-fundedFoundational theory

What Breakthrough Looks Like: Being able to reliably predict model behavior from inspecting weights/activations β€” e.g., knowing in advance that a model will refuse or hallucinate on a specific input, or proving absence of deceptive behavior.

Current Distance: Medium β€” closing. Anthropic's emotion concepts paper (April 2) represents a step change: 171 internal representations identified, proven causal on alignment-relevant behaviors (sycophancy, reward hacking, blackmail), and steerable via vectors. This is the first time interpretability has produced a tool that directly enables behavioral tuning. The gap between "detect" and "fix" narrowed significantly. Still: these results are on Claude Sonnet 4.5 β€” generalizing across architectures and model scales remains unsolved.

Recent Progress:

DateSignalSignificance
2026-04-02Anthropic emotion concepts paper β€” 171 functional representations causally steering sycophancy, scheming, reward hacking. Steerable via vectors.significant (step change)
2026-04-02MoE experts are fine-grained task specialists β€” less polysemantic than dense neurons, path to MoE interpretabilitynotable
2026-04-02Self-preservation bias quantified across 23 models β€” >60% self-preservation rate, fabricated justificationssignificant
2026-03-30AI sycophancy study in Science journal β€” formal measurement baseline establishedsignificant
2026-03-30AI scheming incidents up 5x (AISI, 8 frontier models) β€” behavioral divergence acceleratingsignificant
2026-03-27Reasoning safety monitoring β€” 9-category taxonomy of unsafe reasoning behaviors, adversarial "reasoning hijacking"significant
2026-03-27LLM metacognition via Signal Detection Theory β€” Mistral highest accuracy but lowest metacognitive rationotable
2026-03-18Interpretability without Actionability β€” 98.2% detection, 45.1% correction (53pp gap)significant
2026-03-19Safety Report: models distinguish test vs deploymentsignificant
2026-03-19Anthropic Institute launched (red team + societal impacts)significant
2026-03-19promptfoo red-teaming surges +5,060 stars/wknotable

EDGE-06: Optical / Photonic AI Compute

Maturity: prototype | Impact if cracked: transformative | Source nodes: compute-hardware ai-infrastructure

The Problem: Electrical interconnects and transistors are hitting power and heat limits. Optical computing could process AI workloads at the speed of light with dramatically less power. The challenge: making it practical and cost-competitive at scale.

Who's Pushing:

PlayerApproachInvestmentStatus
Marvell + LumentumOptical circuit switching for datacenter AIPartnership, demos40% less latency/power for agent workloads
LightmatterPhotonic interconnects (Passage)$400M+ raisedChips fabricated, testing with hyperscalers
Ayar LabsOptical I/O chipletsVC-backedIntegrated with Intel packaging
Celestial AIPhotonic fabricVC-backedData movement focus

What Breakthrough Looks Like: Optical interconnects deployed in production AI datacenters, replacing electrical at the rack or cluster scale, with measurable cost/power/latency improvements.

Current Distance: Medium. The physics works. Marvell/Lumentum showed 40% improvements. The challenge is manufacturing at scale and integrating with existing GPU/accelerator ecosystems. Could be production-ready within 2-3 years.

Recent Progress:

DateSignalSignificance
2026-03-31NVIDIA invests $2B in Marvell for silicon photonics + NVLink Fusion. Marvell acquired Celestial AI (photonic fabric). NVIDIA puts photonics directly inside its AI factory ecosystem.significant
2026-03-20Neurophos raises $110M for OPU β€” 1M+ optical elements, Gates/Microsoft backedsignificant
2026-03-20Ultra-compact photonic AI chip β€” 90-99% accuracy at picosecond timescalenotable
2026-03-17Marvell/Lumentum optical switching: 40% less latency for agentsnotable

EDGE-07: Humanoid Robot General Dexterity

Maturity: scaling | Impact if cracked: transformative | Source nodes: robotics-embodied-ai ai-business-funding

The Problem: Robots can perform specific tasks in controlled environments, but general-purpose dexterity β€” handling diverse objects, adapting to new environments, recovering from errors β€” remains unsolved. This is the key bottleneck for humanoid robots in real-world settings.

Who's Pushing:

PlayerApproachInvestmentStatus
TeslaOptimus Gen 3 β€” factory production prepFremont conversion, massive capexMoving to mass production
FigureFigure 02 β€” foundation model integrated$675M+ raisedBMW factory pilot
China's Big 5Various platformsGovernment-backed, 85-90% market share targetTens of thousands projected
1X TechnologiesNEO β€” general purpose humanoid$125M+ raisedHome/office focus
Agility RoboticsDigit β€” warehouse/logisticsAmazon partnershipDeployed in pilot facilities

What Breakthrough Looks Like: A humanoid robot that can perform 50+ distinct real-world manipulation tasks in unstructured environments with >90% success rate, and generalize to novel tasks with minimal retraining.

Current Distance: Medium. Tesla is moving to mass production. $1.2B+ flowed into robotics in a single week. The hardware is converging but the software (VLA models, task generalization) is the hard part. Chinese manufacturers have scale advantage.

Recent Progress:

DateSignalSignificance
2026-03-30Agibot ships 10,000th humanoid robot β€” first manufacturer to reach this production milestonesignificant
2026-03-30Waymo 500K weekly rides (3x growth from 150K mid-2025) β€” autonomous systems scaling in productionnotable
2026-03-30Uber Europe's first robotaxi launch (Zagreb) β€” regulatory approval expanding geographicallynotable
2026-03-19Tesla Optimus Gen 3 β€” Fremont factory conversion for mass productionsignificant
2026-03-19China Big 5 showcase at AW 2026 Korea, tens of thousands projectedsignificant
2026-03-19$1.2B+ robotics funding in one weeksignificant

EDGE-08: AI-Designed Biology (Molecules to Clinical Trials)

Maturity: scaling | Impact if cracked: paradigm-shift | Source nodes: ai-for-science

The Problem: AI can now design proteins and molecules, but going from AI-designed to clinically validated is the gap. The first AI-designed drug to clear clinical trials would prove the paradigm and unlock a multi-trillion dollar transformation of pharma.

Who's Pushing:

PlayerApproachInvestmentStatus
Isomorphic Labs (DeepMind)AlphaFold-based drug designAlphabet-backedPartnerships with Eli Lilly, Novartis
RecursionAI-driven drug discovery platformPublic companyMultiple candidates in trials
CradleAI protein engineeringBayer partnershipActive deployment
Insilico MedicineEnd-to-end AI drug designMultiple candidates in clinicMost advanced AI-designed candidate
Generate BiomedicinesProtein generation$370M+ raisedDesign + validation pipeline

What Breakthrough Looks Like: First fully AI-designed drug/antibody clearing Phase II clinical trials with demonstrated efficacy.

Current Distance: Close-medium. AI-designed antibodies are approaching clinical trials. Insilico has candidates in Phase I/II. The next 12-18 months could see the first clear validation.

Recent Progress:

DateSignalSignificance
2026-03-30Eli Lilly + Insilico Medicine $2.75B deal β€” largest AI drug discovery commitment to datesignificant
2026-03-30SakanaAI autonomous paper accepted by peer review β€” validates AI-driven research loops at publication standardnotable
2026-03-19AI-designed antibodies approaching clinical trialssignificant
2026-03-19Bayer selects Cradle AI for protein engineeringnotable

EDGE-09: Decentralized / Distributed Training

Maturity: research | Impact if cracked: transformative | Source nodes: ai-research-breakthroughs ai-infrastructure

The Problem: Training frontier models requires massive centralized GPU clusters ($100M+), concentrating AI power in a few wealthy organizations. Can frontier-quality models be trained across distributed, heterogeneous hardware?

Who's Pushing:

PlayerApproachInvestmentStatus
Various open-source projectsDiLoCo, distributed gradient methodsCommunity/researchFirst run rivaling LLaMA-2-70B quality
Together AIDecentralized training platformVC-backedInfrastructure provider
Prime IntellectOpen distributed trainingFunded startupFocus on coordination protocols

What Breakthrough Looks Like: A frontier-class model (competing with GPT-5/Claude Opus level) trained entirely on distributed, non-colocated hardware at a fraction of the centralized cost.

Current Distance: Far-medium. The first decentralized run rivaling LLaMA-2-70B is a milestone, but that's 2+ generations behind frontier. Communication overhead remains the fundamental bottleneck.

Recent Progress:

DateSignalSignificance
2026-03-20Covenant-72B: 72B model across 70+ contributors, 67.1 MMLU β€” Jensen Huang endorsessignificant
2026-03-16First decentralized training run rivals LLaMA-2-70B qualitynotable

EDGE-10: Formal Verification of AI-Generated Code

Maturity: research | Impact if cracked: transformative | Source nodes: ai-coding-tools ai-safety-alignment

The Problem: AI coding tools produce code 10x faster but with 1.7x more bugs and 2.74x more security vulnerabilities. Formal verification can mathematically prove code correctness, but it's historically been too hard and slow. Can AI make formal verification accessible?

Who's Pushing:

PlayerApproachInvestmentStatus
MistralLeanstral β€” Lean 4 formal proof agent, 120B (6B active)Apache 2.0 releaseBeats Claude Sonnet at 15x lower cost for proofs
Various academic labsLLM-assisted theorem provingResearch grantsImproving but limited scope
DeepMindAlphaProof lineageInternal R&DMath-focused, not general code

What Breakthrough Looks Like: An automated system that takes AI-generated code and either proves it correct against a spec or identifies the exact failure case, fast enough to run in a CI/CD pipeline.

Current Distance: Medium-far. Leanstral proves it's possible for narrow domains. Generalizing formal verification to arbitrary codebases (not just mathematical proofs) is much harder. But the vibe-coding quality crisis creates urgent demand.

Recent Progress:

DateSignalSignificance
2026-03-27MCP formal semantics β€” process calculus applied to dominant agent protocol, proves expressivity gapssignificant
2026-03-19Mistral Leanstral β€” open-source Lean 4 proof agentsignificant

EDGE-11: Test-Time Compute Scaling

Maturity: scaling | Impact if cracked: transformative | Source nodes: ai-research-breakthroughs frontier-models

The Problem: Can models get proportionally smarter by "thinking longer" at inference time? Extended thinking / chain-of-thought shows promise but the scaling curve is unclear β€” does more compute always help, or do returns diminish quickly?

Who's Pushing:

PlayerApproachInvestmentStatus
OpenAIGPT-5.4 Thinking variantCore product feature83% GDPVal (Morgan Stanley report)
AnthropicExtended thinking in ClaudeCore product featureProduction-deployed
DeepSeekR1 reasoning approachesPublished researchOpen-weight reasoning models
GoogleGemini thinking modesCore product featureIntegrated across products

What Breakthrough Looks Like: Clear evidence that test-time compute scales predictably (like training compute scaling laws) β€” meaning you can reliably trade compute for quality with a known exchange rate.

Current Distance: Close. All major labs have shipping products with thinking modes. GPT-5.4 Thinking scoring 83% on GDPVal is strong. The question is whether the scaling curve continues or plateaus, and whether it works beyond reasoning tasks.

Recent Progress:

DateSignalSignificance
2026-03-27S2D2 β€” 4.7x speedup for diffusion LLMs via training-free self-speculationnotable
2026-03-13Morgan Stanley: GPT-5.4 Thinking scores 83% GDPValsignificant
2026-03-05GPT-5.4 launched with Thinking variantsignificant

EDGE-12: Agent Security / Provably Safe Execution

Maturity: prototype | Impact if cracked: transformative | Source nodes: ai-agents ai-safety-alignment

The Problem: AI agents that use tools, browse the web, and write code are powerful but dangerous. OpenClaw has 7+ CVEs, 20% of skills are malicious, and 17,500 instances are exposed. How do you let agents act autonomously while guaranteeing they can't be exploited or cause harm?

Who's Pushing:

PlayerApproachInvestmentStatus
NVIDIANemoClaw β€” kernel-level sandboxing, privacy routerGTC launch productRequires DGX hardware
GensparkClaw β€” cloud-managed security layerProduct launchCloud-only
promptfooRed-teaming / testing frameworkOpen source, +5,060 stars/wkTesting, not prevention
Academic labsFormal verification of agent behaviorResearchEarly stage

What Breakthrough Looks Like: A hardware-agnostic agent execution environment that provides provable containment β€” agents can use tools freely within a sandbox where the damage radius is mathematically bounded, regardless of what the agent tries to do.

Current Distance: Medium. NemoClaw shows the hardware approach works but is NVIDIA-locked. Software-only approaches don't yet provide strong enough guarantees. The OpenClaw crisis is creating urgent demand.

Recent Progress:

DateSignalSignificance
2026-03-27Claude Mythos leak β€” Anthropic's own docs warn model is "far ahead of any other AI in cyber capabilities"significant
2026-03-27WildASR β€” speech recognition models hallucinate plausible unspoken content, safety risk for voice agentsnotable
2026-03-23Autonomous jailbreak agents hit 97% success rate across frontier modelssignificant
2026-03-23OpenClaw phishing attack β€” $30M stolen from developer walletssignificant
2026-03-19Votal AI CART β€” RLHF-trained adversarial attacker, 185+ techniques catalognotable
2026-03-19OpenClaw 7+ CVEs, 20% malicious skills, 17.5K exposedsignificant
2026-03-16NemoClaw kernel sandboxing at GTCsignificant
2026-03-12Genspark Claw enterprise-secure alternativenotable
2026-03-19promptfoo red-teaming +5,060 stars/wk (acquired by OpenAI)notable

EDGE-13: Parametric Memory / Continual Learning

Maturity: research | Impact if cracked: paradigm-shift | Source nodes: ai-research-breakthroughs ai-agents ai-safety-alignment

The Problem: Deployed LLMs are stuck in "perpetual present" β€” frozen weights after pretraining, no ability to compress new experience into parameters. Knowledge acquired post-deployment lives in context windows (bounded, transient) or external retrieval (slow, shallow). Lossy compression into weights is what made pretraining powerful (it forces generalization); the absence of that mechanism post-deployment is why models cannot learn from their own deployment experience. The problem splits into three layers: (1) Context β€” better retrieval and orchestration harnesses; (2) Modules β€” attachable knowledge (adapter layers, compressed KV caches, external memory stores) that specialize without touching core weights; (3) Weights β€” true parametric updates via test-time training, meta-learning, self-distillation. Core blockers: catastrophic forgetting (new data destroys old representations), the stability-plasticity dilemma (stable models can't adapt, adaptive models lose prior capability), temporal disentanglement (invariant rules and mutable state share the same weights), logical integration failure (fact updates don't propagate to consequences), and unlearning (no differentiable way to surgically remove false or toxic knowledge). Per a16z's April 2026 framing, this is the defining research frontier for agent-era AI.

Who's Pushing:

PlayerApproachInvestmentStatus
LettaAgent memory layer / long-term memory infrastructureVC-backedProduction SDK, enterprise focus
mem0Open-source memory layer for LLM agentsOpen source + commercialGrowing OSS adoption
SubconsciousContinual learning harnessEarly stageResearch + product
Tucuxi"Artificial Doubt Engine" β€” uncertainty-aware memoryEarly stageResearch
xmemory / PineconeExternal memory stores β€” retrieval backboneMature ecosystemProduction RAG
Academic: Test-Time TrainingSun et al. 2020, In-Place TTT (ICLR 2026 Oral)University research4B model matches larger on 128K+ context
Academic: Meta-LearningMAML (Finn 2017), Nested Learning (Behrouz 2025)University researchHierarchy of optimization timescales
Academic: DistillationLoRD (Liu 2025), SDFT (Shenfeld 2026)University researchAvoids catastrophic forgetting in sequential fine-tuning
Academic: RegularizationEWC (Kirkpatrick 2017), Weight Interpolation (Kozal 2024)University researchBrittle at scale
DeepMindAlphaEvolve β€” recursive self-improvement (2025)Internal R&DDiscovered algorithmic improvements untouched for decades
OpenAIChatGPT memory featuresProductConsumer-surface deployment

What Breakthrough Looks Like: A deployed model that reliably compresses post-training experience into weights, demonstrates measurable capability gains from deployment data, preserves prior capabilities (no catastrophic forgetting), resists data-poisoning, and remains auditable for alignment. Or at minimum: a module-based system where swappable adapter layers deliver significantly-larger-model performance on narrow tasks (the article cites an 8B model with a module matching 109B performance as an early signal).

Current Distance: Far on weights, medium on modules, close on context. Harness/context approaches (RAG, multi-agent swarms, long context) are mature. Module-based approaches (adapters, compressed KV caches) are productizing. True weight-level continual learning remains brittle β€” EWC and weight interpolation don't scale cleanly, TTT works on narrow tasks, meta-learning is early. The safety subproblems (unlearning, alignment degradation from fine-tuning, auditability) are described as "open problems, not fundamental impossibilities."

Recent Progress:

DateSignalSignificance
2026-04-21GenericAgent β€” 5-tier hierarchical memory, 6Γ— lower token consumption vs competitors, token-density paradigmnotable
2026-04-22Microsoft AutoAdapt β€” end-to-end automated LLM domain-adaptation (RAG/fine-tune/HP-search selection) at ~$4/tasksignificant
2026-04-07In-Place Test-Time Training (ICLR 2026 Oral) β€” MLP final projection as "fast weights" during inference, 4B matches larger on 128K+ contextsignificant
2026-04a16z "Why We Need Continual Learning" β€” frames parametric memory as the defining post-scaling frontier; names Letta, mem0, Subconscious, Tucuxi as harness-layer companiessignificant (framework)

What to Watch For:

  • First frontier lab deploying a module-based specialization layer in a production model (vs. fine-tuning or RAG)
  • First credible demonstration of non-brittle continual learning at >10B scale
  • Startup in Letta/mem0 category raising at >$1B valuation β€” signals enterprise pull
  • Safety paper quantifying alignment degradation from realistic continual learning setups
  • Auditability/versioning standard for continuously-updating models (currently impossible)

Edge Summary Dashboard

#EdgeMaturityImpactDistanceKey PlayerLast Signal
01Post-Transformer Architecturesresearchparadigm-shiftFarAMI Labs, Mamba-3 (ICLR)2026-03-20
02Reliable Autonomous Agentsprototype→scalingtransformativeMediumSakanaAI (peer review), Ramp (finance agents)2026-03-30
031-Bit Quantization at ScaleprototypetransformativeMediumMicrosoft Research2026-03-19
04World Modelsresearchparadigm-shiftFarAMI Labs ($1.03B)2026-03-20
05Mechanistic InterpretabilityresearchtransformativeMedium-farAISI (scheming 5x), Science journal sycophancy2026-03-30
06Optical/Photonic AI ComputeprototypetransformativeMediumNVIDIA+Marvell ($2B), Neurophos2026-03-31
07Humanoid General DexterityscalingtransformativeMediumAgibot (10K units), Waymo (500K rides)2026-03-30
08AI-Designed Biology to Trialsscalingparadigm-shiftCloseEli Lilly + Insilico $2.75B2026-03-30
09Decentralized Trainingresearch→prototypetransformativeMediumCovenant-72B, Bittensor2026-03-20
10Formal Verification of AI CoderesearchtransformativeMedium-farMistral, MCP formal semantics2026-03-27
11Test-Time Compute ScalingscalingtransformativeCloseOpenAI, Anthropic2026-03-27
12Agent Security / Safe ExecutionprototypetransformativeMediumAISI (scheming 5x), Intercom (vertical safety)2026-03-30
13Parametric Memory / Continual Learningresearchparadigm-shiftFarIn-Place TTT (ICLR), Letta, mem0, AlphaEvolve2026-04-22

Edge Lifecycle

Edges move through stages and eventually exit:

  • Graduated (breakthrough) β€” The problem was cracked. Moves to the relevant node as a breakthrough signal.
  • Stalled β€” No meaningful progress in 60+ days. Kept but flagged.
  • Absorbed β€” The problem was solved incrementally (no single breakthrough moment) and became standard practice.
  • Abandoned β€” Major players pulled out. Archived with notes.

Graduated Edges

(None yet β€” tracking begins 2026-03-19)

Stalled Edges

(None yet)


Source: nodes/frontier-edges.md

Raw markdown Β· Eigen AI Terminal