场景系列

Langfuse 工作坊 - 端到端的 AI 工程循环

端到端的 AI 工程循环。

这是一个基于小型 TypeScript 示例应用的分步 Langfuse 工作坊:Dad IT 支持代理。工作坊涵盖使用 Langfuse 的完整 AI 工程循环:追踪、提示词管理、监控、数据集、实验和评估。

一次坐下中级9 modules
Langfuse追踪提示词管理评估

What you will do

9 modules, in order

  1. 00

    Have the workshop app running locally with both OpenAI and Langfuse credentials in place. From here you can skim 01-base-app, then start building in 02-tracing.

  2. 01

    You can customize your experience by changing the phone specs in support-data.ts file. Adding your dad's phone information means, you will get replies for the right type of phone.

  3. 02

    This is the blank slate for the tracing step — same code as checkpoint/01-base-app, with no Langfuse wiring yet. The Langfuse packages are already in package.json — run npm inst...

  4. 03

    You have a working traced app. The system prompt lives as a constant called SYSTEMPROMPT in src/server/support-agent.ts and is used directly as the system message.

  5. 04

    You have a traced app with optional Langfuse-managed prompts. Every chat turn lands in Langfuse as a nested trace.

  6. 05

    You have a traced, attributed, monitored app. data/seed-dataset.json and scripts/seed-dataset.ts are already in the repo at this checkpoint.

  7. 06

    Your dataset is seeded in Langfuse. scripts/run-dataset.ts is already in the repo.

  8. 07

    Your app is traced, monitored, has a hosted dataset, and at least one experiment run with both keywordoverlap and correctness scores. Now you make a change to the app and rerun ...

  9. 08

    You have walked through every loop step.

ZH