AI judgment · Difficulty 4/5

Smart routing between AI models

A PM interview practice question for SENIOR, STAFF, AI-PM candidates.

The prompt

Your product is paying $0.18 per AI request on the frontier model. You want to route easy queries to a cheaper model. Walk through how you would design the router and the eval to validate it.

How to practice it in PrepOS

PrepOS's adaptive queue surfaces this question when you calibrate to a matching target level and your weakest concepts overlap with what it tests. Open the practice simulator and select the round type to start a rep with this prompt.

Practice this rep →

Round: AI judgment
Target levels: SENIOR, STAFF, AI-PM
Source: original · Reviewed by PrepOS seed