Tooling / orchestration
Orchestration
The layer above the model, where a single call becomes a retrieval step, a tool invocation and a loop. It is the least settled part of the stack and the most opinionated software in it, which is why the entries here spend as much time on when not to use something as on what it does.
5 entries.
Entries
09.03.1—09.03.2—09.03.3—09.03.4—09.03.5O(log n)
Agent Frameworkscommon
Loops with tools: what the frameworks add, and how little of it is the hard part.
LangChaincommon
The composition framework everyone starts with, and the argument about whether to keep it.
LlamaIndexcommon
A retrieval framework: ingestion, chunking, indexing and query pipelines.
Model Context Protocolcommon
A standard interface between a model host and the tools it can call.
Vector Databasescommon
Approximate nearest-neighbour search, and whether you need a separate system for it.