Design-Round Drills

1. What is the first step in the five-beat design skeleton?

The pipeline, in phases. Restate + classify. Measurement. Alignment close.

2. What should be ensured to prevent the assistant from leaking documents that the user is not cleared for?

Enforce permissions in prompt instructions. Use the ACL filter in retrieval queries. Allow the model to generate freely. Permit users to see all documents for transparency.

3. What happens when HR publishes a revised policy?

The index automatically updates without intervention. A re-index trigger must be invoked to update the index. The old policy is served until a manual update is made. Users are notified to manually check for updates.

4. What is an important aspect of proving the assistant's functionality before rollout?

Providing unrestricted access to the data. Shadow-running the new assistant alongside the existing process. Allowing users to test the assistant without oversight. Focusing only on performance metrics post-launch.

Continue: "Vocabulary: How Models Work" → Review this lesson Retake quiz