alvis
aa4bdd8f09
/admin/reward-analytics now surfaces served count, reaction rate, and avg
reward grouped by llm_model, prompt_version, and tip_kind — closing the
loop so model/prompt iterations in M2 are legible next to the bandit
policy view. Data comes from the tip_scores columns added in ffdf707 and
tip_feedback.reward_milli; bandit-only tips show as "(bandit-only)".
Closes #92.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
39 lines
1.5 KiB
Markdown
39 lines
1.5 KiB
Markdown
# apps/admin — oO Admin Console
|
|
|
|
Next.js 15 app. Deployed at `admin.o.alogins.net` (dev: `http://localhost:3080`).
|
|
|
|
## Contract
|
|
|
|
- All routes are admin-only. The Next.js middleware calls `GET /api/user/me` on every request
|
|
and checks `role === 'admin'`. First admin is seeded via `ADMIN_SEED_EMAIL` env var at API startup.
|
|
- Admin write actions are appended to the `admin_actions` audit log in the DB.
|
|
|
|
## Pages
|
|
|
|
| Route | Description |
|
|
|-------|-------------|
|
|
| `/` | Overview: DAU/WAU KPI cards, tips served, reaction breakdown, activation funnel |
|
|
| `/users` | User list (paginated) |
|
|
| `/users/:id` | User detail: identity, consents, integrations, tip stats, reward history; revoke-integration + reset-bandit actions |
|
|
| `/audit` | Admin action audit log |
|
|
| `/events` | Event stream viewer (stub — pending API history endpoint) |
|
|
| `/reward-analytics` | Reaction distribution + per-policy / per-model / per-prompt-version / per-tip-kind breakdowns with avg reward |
|
|
|
|
## Dev
|
|
|
|
```bash
|
|
pnpm --filter @oo/admin dev # starts on :3080
|
|
# also run the API: pnpm --filter @oo/api dev (port 3078)
|
|
```
|
|
|
|
## Extraction criteria
|
|
|
|
Stays as a Next.js app in the monorepo permanently — it's not a candidate for extraction.
|
|
It gets richer (more pages, embedded MLflow/Grafana) but not split.
|
|
|
|
## Known issues
|
|
|
|
- `@tremor/react 3.x` declares a peer dep on React 18; the workspace uses React 19.
|
|
Works in practice. Will resolve naturally when Tremor ships React 19 support or when
|
|
we switch to Tremor v4 (which targets React 18+).
|