ml/serving: FastAPI scorer + RemotePolicy in recommender #24
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
FastAPI endpoint
POST /scorethat takes(candidates, context)and returns scored candidates. Recommender wraps it asRemotePolicy. p99 < 50ms for top-20 candidates.