WeaveYourPath

WeaveYourPath

Applied AI Engineering

  1. Module 1: AI Foundations and Responsible Use
  2. Module 2: Prompt Systems and Structured Output
  3. Module 3: Python for AI and Model APIs
  4. Module 4: Production Wrapper: retries, cost, logging
  5. Module 5: Tool Calling and Multi-Step Workflows
  6. Module 6: RAG I: chunk, embed, retrieve, cite
  7. Module 7: RAG II: rerank, filter, rewrite, evaluate
  8. Module 8: Agents: loops, tools, stop conditions
  9. Module 9: Evaluation: golden sets, baselines, regression
  10. Module 10: Deploy and Capstone
  1. 1Your responsible-use charter
  2. 2Mini-build 1: reliable prompt system
  3. 3Mini-build 2: validated streaming model client
  4. 4Mini-build 3: resilient AI service
  5. 5Tool-using workflow
  6. 6Major project, part 1: grounded knowledge assistant
  7. 7Retrieval evaluation report
  8. 8Supervised agent workflow
  9. 9Evaluation harness and report
  10. 10Capstone: build, deploy, defend in writing
GradesNotesCourse Info Go back to Student Dashboard

Evaluation: golden sets, baselines, regression

42 min of videos left

Evaluation you can defendVideo · 16 minStartLLM-as-judge: when it is legitimateVideo · 14 minRegression testing in CIVideo · 12 minBuild and label your golden setLab · 80 minWire the harness into CILab · 70 minEvaluation harness and reportProject · 88 minEvaluation checkQuiz · 20 min