alvis/oO

Files

alvis aa4bdd8f09 feat(admin): LLM tip quality dashboard — per-model/prompt/kind breakdowns

/admin/reward-analytics now surfaces served count, reaction rate, and avg
reward grouped by llm_model, prompt_version, and tip_kind — closing the
loop so model/prompt iterations in M2 are legible next to the bandit
policy view. Data comes from the tip_scores columns added in ffdf707 and
tip_feedback.reward_milli; bandit-only tips show as "(bandit-only)".

Closes #92.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

2026-04-24 15:24:52 +00:00

1.5 KiB

Raw Blame History

apps/admin — oO Admin Console

Next.js 15 app. Deployed at admin.o.alogins.net (dev: http://localhost:3080).

Contract

All routes are admin-only. The Next.js middleware calls GET /api/user/me on every request and checks role === 'admin'. First admin is seeded via ADMIN_SEED_EMAIL env var at API startup.
Admin write actions are appended to the admin_actions audit log in the DB.

Pages

Route	Description
`/`	Overview: DAU/WAU KPI cards, tips served, reaction breakdown, activation funnel
`/users`	User list (paginated)
`/users/:id`	User detail: identity, consents, integrations, tip stats, reward history; revoke-integration + reset-bandit actions
`/audit`	Admin action audit log
`/events`	Event stream viewer (stub — pending API history endpoint)
`/reward-analytics`	Reaction distribution + per-policy / per-model / per-prompt-version / per-tip-kind breakdowns with avg reward

Dev

pnpm --filter @oo/admin dev   # starts on :3080
# also run the API: pnpm --filter @oo/api dev  (port 3078)

Extraction criteria

Stays as a Next.js app in the monorepo permanently — it's not a candidate for extraction. It gets richer (more pages, embedded MLflow/Grafana) but not split.

Known issues

@tremor/react 3.x declares a peer dep on React 18; the workspace uses React 19. Works in practice. Will resolve naturally when Tremor ships React 19 support or when we switch to Tremor v4 (which targets React 18+).

1.5 KiB Raw Blame History