alvis/adolf
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add run_routing_benchmark.py — routing-only benchmark #19

Merged
alvis merged 1 commits from feat/routing-benchmark into main 2026-03-24 07:26:31 +00:00
Conversation 0 Commits 1 Files Changed 1 +217
alvis commented 2026-03-24 07:25:35 +00:00
Owner
Copy Link

Add dedicated routing benchmark that always uses no_inference=True. Tests routing accuracy for all tiers without LLM inference — fast (30s timeout), no GPU needed, shares benchmark.json dataset.

Add dedicated routing benchmark that always uses no_inference=True. Tests routing accuracy for all tiers without LLM inference — fast (30s timeout), no GPU needed, shares benchmark.json dataset.
alvis added 1 commit 2026-03-24 07:25:35 +00:00
Add run_routing_benchmark.py — dedicated routing-only benchmark 0fbdbf3a5e 
Tests routing accuracy for all tiers with no_inference=True hardcoded.
Fast (QUERY_TIMEOUT=30s), no GPU check, shares benchmark.json dataset.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
alvis merged commit 74e5b1758d into main 2026-03-24 07:26:31 +00:00
alvis deleted branch feat/routing-benchmark 2026-03-24 07:26:54 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
alvis
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: alvis/adolf#19
Delete Branch "feat/routing-benchmark"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?