Found at “Emerging Architectures for LLM Applications | Andreessen Horowitz” on 2023-06-21 17:20:23 +02:00.

we’re sharing a reference architecture for the emerging LLM app stack. It shows the most common systems, tools, and design patterns we’ve seen used by AI startups and sophisticated tech companies. This stack is still very early and may change substantially as the underlying technology advances, but we hope it will be a useful reference for developers working with LLMs now.

Emerging LLM App Stack by a16z. This diagram represents what a16z sees as the architecture for AI applications.