Layer researchAgent data engineering
Vendor landscape
As of 2026-08-19. Vendor capability claims are vendor-published unless third-party sourced. Re-verify quarterly.
- Vendor / product
- Docling (LF AI & Data)
- Category
- Parsing, open source
- Maturity (Aug 2026)
- ~61k stars; MIT
- Notes
- Neutral local option; provenance-preserving; table/layout fidelity
- Vendor / product
- LlamaIndex/LlamaCloud (Parse, Extract, Classify), Unstructured
- Category
- Parsing/ingestion APIs
- Maturity (Aug 2026)
- Active [vendor]
- Notes
- Vendor benchmarks self-reported; strong table extraction (Unstructured per third-party roundups)
- Vendor / product
- Anthropic contextual retrieval (recipe)
- Category
- Enrichment pattern
- Maturity (Aug 2026)
- Published Sep 2024 [vendor]
- Notes
- The best-evidenced chunk upgrade; $1.02/M tokens floor with caching
- Vendor / product
- Mem0, Zep (Graphiti), Letta, LangMem
- Category
- Memory services
- Maturity (Aug 2026)
- Active; benchmarks vendor-contested
- Notes
- Bitemporal facts (Zep) and sleep-time consolidation (Letta) are the durable ideas
- Vendor / product
- AWS AgentCore Memory; Vertex Memory Bank
- Category
- Platform memory
- Maturity (Aug 2026)
- GA Oct 2025; preview Jul 2025 [vendor]
- Notes
- Managed extraction strategies; check erasure mechanics
- Vendor / product
- S3 Vectors; platform vector stores
- Category
- Index substrate
- Maturity (Aug 2026)
- GA Dec 2025 [vendor]
- Notes
- Economics favor purpose-scoped indexes
- Vendor / product
- Azure AI Search document-level ACLs; SpiceDB
- Category
- Permission propagation
- Maturity (Aug 2026)
- 2025
- Notes
- The shipped pre-filter patterns
- Vendor / product
- Debezium/Flink CDC; Tableflow
- Category
- Freshness
- Maturity (Aug 2026)
- Mature; GA Mar 2025
- Notes
- CDC-fed incremental re-embedding
- Vendor / product
- Databricks Agent Bricks; kapa.ai-class answer engines
- Category
- Managed curation loops
- Maturity (Aug 2026)
- Jun 2025; production [vendor]
- Notes
- Automated curation with eval generation; the CD's automation side
- Vendor / product
- Glean; Microsoft 365 semantic index
- Category
- Universal indexes
- Maturity (Aug 2026)
- Mature [vendor]
- Notes
- The CD-11 discovery layer
Agent-washing watch: "memory" without deletion or provenance; parsers benchmarked only on clean PDFs; universal-index pitches that never mention permission-sync lag or oversharing remediation.
Source: research/R14-agent-data-engineering/vendors.md in the evidence repository behind this site.