ml/serving: FastAPI scorer + RemotePolicy in recommender #24

Closed
opened 2026-04-13 14:23:20 +00:00 by alvis · 0 comments
Owner

FastAPI endpoint POST /score that takes (candidates, context) and returns scored candidates. Recommender wraps it as RemotePolicy. p99 < 50ms for top-20 candidates.

FastAPI endpoint `POST /score` that takes `(candidates, context)` and returns scored candidates. Recommender wraps it as `RemotePolicy`. p99 < 50ms for top-20 candidates.
alvis added this to the M1 — Real signal milestone 2026-04-13 14:23:20 +00:00
alvis added the ml label 2026-04-13 14:23:20 +00:00
alvis closed this issue 2026-04-16 03:28:53 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: alvis/oO#24