Phase 1 Manual Testing Checklist

Prerequisites

Local PostgreSQL and Redis running (docker compose up -d postgres redis)
Run bun db:migrate to apply schema changes
Run bun db:generate to regenerate Prisma client
All apps running (bun dev)

A. Enhanced Twitch Notifications

A1. Per-Channel Notification Overrides

Open /dashboard/discord — verify "Monitored Channels" card appears below Test Notification
Each monitored Twitch channel shows display name, avatar, and live/offline status
Channels with overrides show "(overrides active)" indicator
Click "Configure" on a channel — dialog opens with correct current values

A2. Channel Settings Dialog

Notification Channel Override dropdown loads guild text/announcement channels
Notification Role Override dropdown loads guild roles + @everyone option
"Use guild default" option works (sets override to null)
Toggle: "Update message while live" defaults to on
Toggle: "Delete when offline" defaults to off
Toggle: "Auto-publish in announcement channels" defaults to off
Toggle: "Use custom embed message" defaults to off
Save button saves settings and shows success toast
Audit log records discord.channel-settings action

A3. Custom Embed JSON

Enabling "Use custom embed message" reveals online/offline JSON textareas
Embed preview renders below each textarea in real-time
Preview shows title, description, fields, author, footer, color bar
Template variables display with sample data: {streamer}, {title}, {game}, {viewers}, {url}, {thumbnail}, {duration}
Invalid JSON shows "Invalid JSON — preview unavailable" message
Empty textarea shows "Enter embed JSON to see preview"

A4. Notification Behavior (requires live Twitch stream or test notification)

Per-channel override: Configure a channel with a different notification channel — verify notification goes to the override channel, not the guild default
Per-channel role override: Configure a channel with a different role — verify the correct role is mentioned
Update message while live = OFF: Verify the "Still Live" embed update is skipped (title/game/viewer count stay at initial values)
Delete when offline: When stream goes offline, the notification message is deleted (not edited to offline embed)
Auto-publish: Send notification to an announcement channel with auto-publish on — verify the message is crossposted
Custom online embed: Set custom JSON for online notification — verify custom embed is used instead of default
Custom offline embed: Set custom JSON for offline notification — verify custom embed is used when stream goes offline
Invalid custom JSON fallback: Set invalid JSON with custom message enabled — verify default embed is used as fallback
Guild default fallback: Leave channel overrides blank — verify guild-level channel/role settings are used

A5. Test Notification with Overrides

Send test notification with per-channel overrides configured — verify it respects the channel-level settings

B. Inactive Account Cleanup

B1. Job Scheduling

Verify cleanup-inactive-accounts job appears in worker logs on startup
Job is scheduled with cron pattern 0 3 * * * (daily at 3 AM)

B2. Cleanup Logic (manual trigger or wait for cron)

Create a test user with role USER, no sessions, created > 1 year ago — verify deleted
Verify ADMIN users are NOT deleted regardless of inactivity
Verify MODERATOR users are NOT deleted regardless of inactivity
Verify LEAD_MODERATOR users are NOT deleted regardless of inactivity
Verify the broadcaster account is NOT deleted regardless of inactivity
Verify users with recent sessions (within 365 days) are NOT deleted
Verify users created within 365 days (even with no sessions) are NOT deleted
Check logs for deletion count message

C. Discord Welcome Messages (Phase 2)

Prerequisites

Enable Server Members Intent in Discord Developer Portal → Bot → Privileged Gateway Intents
Bot is running and connected to your Discord server
Web dashboard is running and Discord guild is linked

C1. Welcome Message

Enable welcome message in dashboard → Discord → Welcome & Leave Messages
Select a channel and enter a plain text message (e.g., Welcome {displayName} to {server}! We now have {memberCount} members.)
Save settings
Join the guild with an alt account — verify message appears in the selected channel with variables replaced
Switch to embed mode, paste custom embed JSON, verify preview renders
Save and rejoin — verify embed appears in channel

C2. Leave Message

Enable leave message in dashboard
Select a channel and enter a plain text message (e.g., {displayName} has left {server}. ({memberCount} members))
Save settings
Leave the guild with the alt account — verify leave message appears
Test embed mode similarly

C3. Auto-Role

Enable auto-role in dashboard
Select a role from the dropdown
Save settings
Join the guild with an alt account — verify the role is assigned automatically
Verify error is logged (not crashed) if bot lacks Manage Roles permission or role is higher than bot's role

C4. DM Welcome

Enable DM welcome in dashboard
Enter a plain text DM message (e.g., Welcome to {server}, {displayName}! Check out the rules channel.)
Save settings
Join the guild with an alt account (with DMs enabled) — verify DM is received
Join with DMs disabled — verify bot logs error but doesn't crash
Test embed mode for DM

C5. Test Buttons

Click Test Welcome — verify welcome message appears in the configured channel (uses bot's own member as stand-in)
Click Test Leave — verify leave message appears in the configured channel
Click Test DM — verify DM is sent to the bot (check logs for success/failure)
Verify buttons are disabled when corresponding features are not enabled or channels not set

C6. Edge Cases

Verify all three actions (welcome, DM, auto-role) fire independently — failure in one does not block others
Verify partial guild member (leave event for uncached member) doesn't crash — uses "Unknown" for missing fields
Verify settings persist after page reload
Verify audit log entries appear for discord.welcome-settings and discord.test-welcome actions
Verify embed preview updates in real-time as JSON is typed
Verify template variables ({user}, {username}, {displayName}, {server}, {memberCount}, {tag}) all resolve correctly

D. Visual Embed Builder UI (Phase 3)

D1. Channel Settings Dialog (Twitch Notifications)

D2. Welcome Settings — Welcome Message

Navigate to Dashboard > Discord > Welcome & Leave Messages
Enable Welcome Message → switch to "Embed" mode
Embed Builder appears with full two-column layout (desktop)
Variable pills show: {user}, {username}, {displayName}, {server}, {memberCount}, {tag}
All form sections work (Basic, Author, Fields, Images, Footer)
Preview updates live with sample variable substitutions
JSON Import/Export works
Save Welcome Settings → reload page → form repopulates correctly
Switch back to "Plain Text" mode — VariableHint shows, builder hides

D3. Welcome Settings — Leave Message

Enable Leave Message → switch to "Embed" mode
Embed Builder appears with same functionality as welcome
All form sections, preview, variables, JSON import/export work
Save → reload → form repopulates

D4. Welcome Settings — DM Welcome

Enable DM Welcome → switch to "Embed" mode
Embed Builder appears (no channel selector for DM)
All form sections, preview, variables, JSON import/export work
Save → reload → form repopulates

D5. Responsive / Layout

Desktop (≥768px): two-column layout — form left, sticky preview right
Mobile (<768px): single column — form on top, preview below
Channel settings dialog: always compact (single column) since inside dialog
Collapsible sections toggle open/close correctly
Fields section auto-opens when fields exist

D6. Edge Cases

Empty initial value — form starts blank, preview shows "Enter embed JSON to see preview"
Existing JSON from Phase 1/2 — form correctly parses and populates all fields
Max 25 fields — "Add Field" button disables at 25, counter shows (25/25)
Color input accepts only valid hex patterns
Fields with empty name/value are omitted from JSON output

E. Public Pages Polish (Phase 4)

E1. Layout & Sidebar

Visit /p — banner + sidebar + content renders correctly
Visit /p/commands — sidebar shows with Commands link active
Visit /p/queue — sidebar shows with Queue link active
Navigate between /p, /p/commands, /p/queue — sidebar active state updates without full page reload
Sidebar nav only shows Commands link if commands exist
Sidebar nav only shows Queue link if queue is not CLOSED
Banner height and avatar size are consistent across all 3 pages

E2. Entrance Animations

/p — sidebar card fades in, each content card staggers in sequence
/p/commands — header and tabs fade in with stagger
/p/queue — header and queue entries fade in with stagger

E3. Responsive / Mobile

Resize to mobile (<640px) — sidebar becomes horizontal row with avatar + name inline
/p/commands on mobile — commands display as cards (not a table)
/p/commands on desktop (≥640px) — commands display as a table
Queue page looks correct on mobile

E4. SEO Metadata

/p — page has <title> like "{username}'s Community" and a meta description
/p/commands — page has <title> like "Commands — {username}" and a meta description
/p/queue — page has <title> like "Viewer Queue — {username}" and a meta description

E5. Landing Page

"Visit Channel" button visible in hero section when broadcaster has a Twitch username
"Visit Channel" button links to https://twitch.tv/{username}
Button does not render when no broadcaster is configured

F. Auth, Permissions & User Management (Phase 5)

F1. Schema Migration

bun db:migrate runs cleanly (renames ADMIN→BROADCASTER, adds ban fields)
Existing ADMIN users in the database are now BROADCASTER after migration
bun check-types — no type errors

F2. USER Role

Can log in and view dashboard
Can view commands page (read-only — no create/edit/delete buttons)
Can view regulars page (read-only — no add/remove buttons)
Can view Discord settings (read-only — no mutation controls)
Cannot see Users page in sidebar
Cannot access /dashboard/users directly (tRPC rejects)
Bot controls card is visible but enable/disable/mute are hidden
Can view own profile in Settings page
Can export data

F3. MODERATOR Role

All USER permissions plus:
Can create, edit, delete, and toggle commands
Can add and remove regulars
Can import from StreamElements
Cannot enable/disable/mute the bot
Cannot modify Discord settings
Cannot see Users page in sidebar

F4. LEAD_MODERATOR Role

All MODERATOR permissions plus:
Can enable/disable the bot
Can mute/unmute the bot
Can update default command toggles and access levels
Can modify all Discord settings (link guild, set channel/role, enable/disable, welcome, test notifications)
Cannot see Users page in sidebar

F5. BROADCASTER Role

F6. Ban System

Banned user can still log in
Banned user sees "Account Suspended" page with ban reason when accessing /dashboard
Banned user's tRPC mutations are rejected with FORBIDDEN
Unbanning restores dashboard access immediately
Ban reason displays correctly (or gracefully hidden if none)

F7. Setup Wizard

First user completing setup is promoted to BROADCASTER (not ADMIN)
Setup wizard text says "Sign in to become the broadcaster."

F8. Audit Log

Role change logged as user.role-change with previous/new role
Ban logged as user.ban with target name and reason
Unban logged as user.unban with target name
BROADCASTER sees all audit entries
LEAD_MODERATOR sees entries from their level and below
MODERATOR sees entries from their level and below
USER sees only USER-level entries

F9. Auto-Link Twitch from Discord (On Login)

Discord OAuth now requests connections scope (check consent screen)
After Discord login, if user has verified Twitch connection and no Twitch account linked, Account entry is auto-created
No duplicate created if Twitch already linked
No error if no Twitch connection on Discord

F10. Auto-Link Twitch from Discord (Background Sync)

sync-twitch-links job scheduled daily at 4 AM
Job processes users with Discord OAuth tokens
Skips users who already have Twitch linked
Creates Twitch Account entries for users with verified Twitch connections
Handles expired/invalid tokens gracefully (skips, no crash)
Logs summary (linked, skipped, errors)

F11. Regression

Commands CRUD still works for MODERATOR+ roles
Regulars add/remove still works for MODERATOR+ roles
Bot enable/disable/mute still works for LEAD_MODERATOR+ roles
Discord settings still work for LEAD_MODERATOR+ roles
Cleanup inactive accounts job still only targets USER role
Role display badges show correctly (Owner, Lead Mod, Moderator, User)
Channel owner USER still shows "Owner" badge via getRoleDisplay

G. Dashboard UI Role Guards (Phase 5b)

G1. Bot Controls Card (`/dashboard`)

USER: Join/Leave/Mute/Unmute buttons hidden, "managed by lead moderators" message shown
MODERATOR: Same as USER — buttons hidden, read-only message shown
LEAD_MODERATOR: All bot control buttons visible and functional
BROADCASTER: All bot control buttons visible and functional
Bot status text (active/muted/not joined) visible to all roles

G2. Custom Commands (`/dashboard/commands` — Custom tab)

USER: Command list visible, search works, Create/Edit/Delete/Toggle all hidden
MODERATOR: All controls visible — Create, Edit, Delete, Toggle per row
LEAD_MODERATOR: Same as MODERATOR
BROADCASTER: Same as MODERATOR
Empty state "Create your first command" button hidden for USER

G3. Default Commands (`/dashboard/commands` — Default tab)

USER: Command list visible, toggle switches replaced with static "On"/"Off" text, access level shows as plain text
MODERATOR: Same as USER — toggles and dropdowns hidden (these are botChannel mutations)
LEAD_MODERATOR: Interactive toggle switches and access level dropdowns visible
BROADCASTER: Same as LEAD_MODERATOR

G4. Regulars (`/dashboard/regulars`)

USER: Regulars list visible, search works, Refresh Names visible, Add/Remove hidden
MODERATOR: Add Regular button visible, Remove buttons visible per row
LEAD_MODERATOR: Same as MODERATOR
BROADCASTER: Same as MODERATOR
Empty state "Add your first regular" button hidden for USER

G5. Discord Settings (`/dashboard/discord`)

USER: Guild info visible, all mutation controls hidden (enable/disable, save buttons, test notification, configure buttons)
USER (unlinked): Shows "No Discord server linked yet. A lead moderator can link one."
MODERATOR: Same as USER
LEAD_MODERATOR: All controls visible — Link Server, Enable/Disable, Save Channel/Role, Send Test, Configure per channel, all Welcome settings
BROADCASTER: Same as LEAD_MODERATOR
Read-only notification channel shows "# channel-name" or "Not set"
Read-only notification role shows "@role-name", "@everyone", or "Not set"

G6. Welcome & Leave Settings (within Discord Settings)

USER/MODERATOR: Enable/Disable buttons hidden, form sections hidden when enabled, Test Messages section hidden
LEAD_MODERATOR+: All toggles, editors, save buttons, and test buttons visible and functional

G7. Settings Page (`/dashboard/settings` — Data tab)

USER: Export Data button visible, StreamElements Import section hidden
MODERATOR: Export Data + StreamElements Import both visible
LEAD_MODERATOR: Same as MODERATOR
BROADCASTER: Same as MODERATOR

G8. No Silent Failures

Verify that no hidden mutation buttons means no FORBIDDEN toast errors appear during normal navigation
Read-only views display all data correctly — no missing information

H. Viewer Queue Dashboard Management (Phase 6)

H1. Queue Status Controls

Open /dashboard/queue — page loads, shows current queue state
Status badge shows correct color: green (OPEN), amber (PAUSED), grey (CLOSED)
Click Open → status changes to OPEN, success toast, audit log entry created
Click Pause → status changes to PAUSED, success toast
Click Close → status changes to CLOSED, success toast
Active status button is disabled (can't set status to current status)

H2. Queue Entry Management

With entries in queue: table shows position, username, joined time
Pick Next removes the lowest position entry, returns username in toast
Pick Random removes a random entry, returns username in toast
Remove button on individual entry shows confirm/cancel before deleting
After removing an entry, remaining entries reorder positions correctly
Clear Queue shows confirm step, then removes all entries

H3. Empty / Disabled States

"Queue is empty" message shown when no entries exist
"Enable the bot for your channel first" shown when bot is not enabled
Pick Next / Pick Random / Clear Queue buttons hidden when queue is empty

H4. Role Guards

USER: Can see queue status and entry list (read-only), no control buttons
MODERATOR: Can see and use all controls (Open/Close/Pause, Pick, Remove, Clear)
LEAD_MODERATOR: Same as MODERATOR
BROADCASTER: Same as MODERATOR

H5. Sidebar & Quick Stats

Sidebar shows "Queue" link with ListOrdered icon under Twitch section
Queue link active state highlights when on /dashboard/queue
Quick Stats card shows queue status (OPEN/PAUSED/CLOSED) with correct color
Quick Stats card shows queue entry count

H6. Audit Logging

queue.open logged when opening queue
queue.close logged when closing queue
queue.pause logged when pausing queue
queue.pick logged when picking entry (includes mode and username)
queue.remove-entry logged when removing entry (includes username)
queue.clear logged when clearing queue (includes count)

H7. EventBus (Twitch Bot)

Queue mutations from Twitch chat (!queue join/leave/pick/remove/clear/open/close/pause) publish queue:updated event
Verify no crash if EventBus is not initialized (graceful catch in bot startup)

I. Documentation Updates (Phase 7)

I1. New Pages Exist and Render

/docs/web-dashboard/welcome-messages — page loads with correct content
/docs/web-dashboard/user-management — page loads with correct content
/docs/web-dashboard/queue-management — page loads with correct content

I2. Sidebar Navigation

All 3 new pages appear in the sidebar under "Web Dashboard" section
Order is: Overview, Public Pages, Audit Log, Discord Settings, Welcome & Leave Messages, User Management, Queue Management

I3. No ADMIN Role References

grep -r "ADMIN" apps/docs/content/docs/ returns no results
Setup wizard page says "BROADCASTER" not "ADMIN"
Audit log page role hierarchy ends with BROADCASTER
Web dashboard overview says BROADCASTER not ADMIN

I4. Audit Log Action Table

Audit log page lists all 28 actions across 7 sections (Bot Controls, Commands, Regulars, Discord, User Management, Queue, Imports)
Includes Phase 2 actions: discord.welcome-settings, discord.test-welcome
Includes Phase 1 action: discord.channel-settings
Includes Phase 5 actions: user.role-change, user.ban, user.unban
Includes Phase 6 actions: queue.open, queue.close, queue.pause, queue.pick, queue.remove-entry, queue.clear
Includes bot.mute and bot.unmute actions

I5. Queue System Page Accuracy

Queue system page describes position-based model (not WAITING/PICKED/REMOVED statuses)
Queue state table shows OPEN/CLOSED/PAUSED
Entries are described as being deleted on pick/leave (not status changes)
Dashboard management section exists with cross-link to /docs/web-dashboard/queue-management
EventBus sync note is present

I6. Discord Settings Page Updates

Per-channel notification overrides section exists
Lists all override options: custom channel, role, embed, update-while-live, delete-when-offline, auto-publish
Welcome & Leave Messages section exists with cross-link
Audit logging table includes discord.channel-settings, discord.welcome-settings, discord.test-welcome

I7. Discord Bot Pages

Discord bot overview lists welcome messages, auto-role, and DM welcome features
Twitch notifications page has per-channel overrides section

I8. Event Bus Page

discord:test-welcome event listed in Discord Settings table with { guildId, type } payload
Queue section lists publisher as "Twitch, Web" (not "Any")
Event Flow Summary ASCII table includes queue:updated and discord:test-welcome rows

I9. Cross-Links

Welcome messages page links work (from discord-settings, web-dashboard index)
Queue management page links work (from queue-system, web-dashboard index)
User management page link works (from web-dashboard index)

I10. Build Verification

bun run --filter docs build succeeds with no errors
All 40 pages generate successfully (34 original + 3 new + base paths)

J. Automated Tests (Existing)

Run bun test — all tests pass
Run bun check-types — all packages pass (verified for Phase 6)
Run bun turbo build --filter="!web" — all builds succeed

K. Phase 8 — EventBus & tRPC API Unit Tests

K1. Test Infrastructure

vitest.workspace.ts includes packages/events and packages/api
packages/events/vitest.config.ts exists with name: "events"
packages/api/vitest.config.ts exists with name: "api"
packages/api/src/test-helpers.ts exports mockSession, mockUser, createMockPrisma

K2. EventBus Tests (`packages/events/src/bus.test.ts` — 11 tests)

K3. Audit Utility Tests (`packages/api/src/utils/audit.test.ts` — 5 tests)

Looks up user role and creates audit log entry
Defaults to USER role when user not found
Stores optional metadata and ipAddress
Stores userImage when provided
Omits undefined optional fields

K4. Bot Channel Router Tests (`packages/api/src/routers/botChannel.test.ts` — 17 tests)

K5. Chat Command Router Tests (`packages/api/src/routers/chatCommand.test.ts` — 18 tests)

K6. User Management Router Tests (`packages/api/src/routers/userManagement.test.ts` — 16 tests)

K7. Queue Router Tests (`packages/api/src/routers/queue.test.ts` — 14 tests)

K8. Regular Router Tests (`packages/api/src/routers/regular.test.ts` — 12 tests)

list returns all regulars
add adds regular and publishes regular:created
add throws NOT_FOUND when Twitch user doesn't exist
add throws CONFLICT when already a regular
add rejects USER role
remove removes regular and publishes regular:deleted
remove throws NOT_FOUND for missing regular
refreshUsernames updates display names from Twitch

K9. Discord Guild Router Tests (`packages/api/src/routers/discordGuild.test.ts` — 24 tests)

K10. User Router Tests (`packages/api/src/routers/user.test.ts` — 10 tests)

K11. Audit Log Router Tests (`packages/api/src/routers/auditLog.test.ts` — 7 tests)

BROADCASTER sees all logs without role filter
MODERATOR only sees USER and MODERATOR logs
USER only sees USER logs
Supports action and resourceType filters
Returns isChannelOwner flag for each item
Paginates results
Throws UNAUTHORIZED without session

K12. Setup Router Tests (`packages/api/src/routers/setup.test.ts` — 12 tests)

K13. Full Suite Verification

Run bun test — all 523 tests pass across 52 test files
No test file has import/mock errors
All new tests use vi.hoisted() pattern for mock factories

Phase 9: Integration Tests — Bot Services & tRPC API with Real Database

Prerequisites

Local PostgreSQL running (docker compose up -d postgres)
Create test database: createdb -U postgres community_bot_test
Or set TEST_DATABASE_URL env var to your test database

L1. Infrastructure

packages/db/src/test-client.ts — exports testPrisma, cleanDatabase(), seed helpers
packages/db/src/integration-setup.ts — runs prisma migrate deploy against test DB
packages/api/vitest.integration.config.ts — includes *.integration.test.ts, sequential, 30s timeout
apps/twitch/vitest.integration.config.ts — same pattern for Twitch bot
apps/discord/vitest.integration.config.ts — same pattern for Discord bot
vitest.config.ts (root) — excludes *.integration.test.ts from unit runs
bun test runs only unit tests (395 tests, 35 files — no integration tests)
bun test:integration runs all integration tests sequentially

L2. tRPC Queue Router Integration (12 tests)

L3. tRPC ChatCommand Router Integration (12 tests)

create creates command with correct botChannelId
create duplicate → CONFLICT error (compound unique constraint)
create rejects built-in command names
create lowercases name and aliases
list returns only commands for user's bot channel
update updates command fields in DB
update throws NOT_FOUND for command from different channel
delete removes command from DB
toggleEnabled flips enabled flag

L4. tRPC BotChannel Router Integration (8 tests)

getStatus returns null when not enabled
getStatus returns bot channel when enabled
enable creates BotChannel record
enable re-enables previously disabled channel
disable sets enabled to false
updateCommandToggles updates disabledCommands array
updateCommandAccessLevel creates DefaultCommandOverride
updateCommandAccessLevel deletes override when reverting to default

L5. tRPC Regular Router Integration (6 tests)

add creates TwitchRegular in DB
add duplicate → CONFLICT (unique constraint)
add throws NOT_FOUND for unknown Twitch user
remove deletes regular from DB
list returns all regulars ordered by createdAt desc

L6. tRPC UserManagement Router Integration (6 tests)

updateRole changes role in DB
updateRole rejects self-change
updateRole rejects changing broadcaster role
ban sets banned flag and reason in DB
ban rejects self-ban
unban clears all ban fields

L7. tRPC AuditLog Router Integration (5 tests)

Broadcaster sees all audit entries
Moderator only sees entries at their level and below
Pagination works with real data
Enriches entries with isChannelOwner flag
Filters by action prefix

L8. tRPC Setup Router Integration (4 tests)

status returns false when no config exists
status returns true when setupComplete configured
complete with valid token finalizes setup (sets broadcaster, promotes user, deletes token)
complete with invalid token throws FORBIDDEN

L9. Twitch QueueManager Integration (15 tests)

L10. Twitch CommandCache Integration (8 tests)

load loads enabled commands from DB
load skips disabled commands
getByNameOrAlias finds by name (case-insensitive)
getByNameOrAlias finds by alias
getByNameOrAlias returns undefined for non-existent
getRegexCommands returns regex-type commands with compiled RegExp
reload refreshes cache after DB changes
Multi-channel isolation: commands separated per channel

L11. Twitch AccessControl Integration (6 tests)

loadRegulars loads from real DB
loadRegulars refreshes when new regulars added
loadRegulars removes deleted regulars
meetsAccessLevel — EVERYONE/EVERYONE → true
meetsAccessLevel — REGULAR/MODERATOR → false
meetsAccessLevel — BROADCASTER meets all levels

L12. Discord GuildCreate/Delete Integration (5 tests)

guildCreateEvent creates DiscordGuild record
guildCreateEvent handles duplicate guild gracefully
guildDeleteEvent removes DiscordGuild record
guildDeleteEvent handles non-existent guild gracefully
Round-trip: create → delete → re-create works

L13. Discord CheckTwitchStreams Integration (8 tests)

L14. Full Integration Suite Verification

docker compose up -d postgres — PostgreSQL running
bun test:integration — all ~95 integration tests pass
bun test — all 523 unit tests still pass (no regression)
Integration tests properly excluded from bun test via root vitest.config.ts

Phase 10: Quotes, Counters & New Built-in Commands

M1. Title Command (`apps/twitch/src/commands/title.test.ts` — 2 tests)

Shows current stream title
Shows "offline or unavailable" when no title

M2. Game Command (`apps/twitch/src/commands/game.test.ts` — 2 tests)

Shows current game/category
Shows "offline or unavailable" when no game

M3. Followage Command (`apps/twitch/src/commands/followage.test.ts` — 3 tests)

Shows how long user has followed
Shows "not following" when user doesn't follow
Shows error when API fails

M4. Shoutout Command (`apps/twitch/src/commands/shoutout.test.ts` — 9 tests)

Does nothing if user is not a mod
Shows usage when no args
Shouts out a user with game info
Shouts out without game when none set
Shows error when user not found
Strips @ from username
Sends AI shoutout when enabled for channel
Does not send AI shoutout when disabled for channel
Still sends standard shoutout when AI fails

M5. Quote Command (`apps/twitch/src/commands/quote.test.ts` — 8 tests)

Shows random quote
Shows specific quote by number
Shows "no quotes" when empty
Shows "not found" for missing number
Adds a new quote (mod only)
Removes a quote by number (mod only)
Non-mods cannot add quotes
Searches quotes by keyword

M6. Counter Command (`apps/twitch/src/commands/counter.test.ts` — 8 tests)

M7. Quote tRPC Router (`packages/api/src/routers/quote.test.ts` — 10 tests)

list returns quotes for user's bot channel
list throws PRECONDITION_FAILED when bot not enabled
add creates quote with auto-incrementing number
add rejects USER role
remove deletes quote by number
remove throws NOT_FOUND for missing quote
get returns specific quote by number
search finds quotes by keyword

M8. Counter tRPC Router (`packages/api/src/routers/counter.test.ts` — 8 tests)

list returns all counters for bot channel
create creates a new counter
create rejects duplicate names
update updates counter value
update throws NOT_FOUND for missing counter
delete deletes a counter
delete throws NOT_FOUND for missing counter

Phase 11: Timers

N1. Timer Manager (`apps/twitch/src/services/timerManager.test.ts` — 10 tests)

N2. Timer tRPC Router (`packages/api/src/routers/timer.test.ts` — 10 tests)

Phase 12: Spam Filters & Moderation Commands

O1. Spam Filter Service (`apps/twitch/src/services/spamFilter.test.ts` — 22 tests)

O2. Permit Command (`apps/twitch/src/commands/permit.test.ts` — 5 tests)

Creates a permit with default duration
Creates a permit with custom duration
Caps duration at 3600 seconds
Shows usage when no username given
Does nothing if user is not a mod

O3. Nuke Command (`apps/twitch/src/commands/nuke.test.ts` — 5 tests)

Timeouts users matching phrase
Uses custom timeout duration from last arg
Excludes the issuing mod from timeout
Shows usage when no phrase given
Does nothing if user is not a mod

O4. Vanish Command (`apps/twitch/src/commands/vanish.test.ts` — 2 tests)

Self-timeouts for 1 second
Works for any user

O5. Clip Command (`apps/twitch/src/commands/clip.test.ts` — 3 tests)

Creates a clip and returns URL
Shows error when clip creation fails
Shows error on API error

O6. Spam Filter tRPC Router (`packages/api/src/routers/spamFilter.test.ts` — 6 tests)

get returns filter config or defaults
get throws PRECONDITION_FAILED when bot not enabled
update upserts filter config
update publishes spam-filter:updated event
update logs audit action
update rejects USER role

Phase 13: AI-Enhanced Shoutouts

P1. AI Shoutout Service (`apps/twitch/src/services/aiShoutout.test.ts` — 5 tests)

Returns AI-generated message on success
Returns null when streamer not found
Returns null when Gemini API fails
Returns null when GEMINI_API_KEY is not set
Uses cache for repeated calls

P2. Full Suite Verification

Run bun test — all 523 tests pass across 52 test files
No test file has import/mock errors

Phase 14: Song Requests

P1. Database Schema

SongRequest model with position, title, requestedBy, botChannelId
SongRequestSettings model with enabled, maxQueueSize, maxPerUser, minAccessLevel
bun db:generate succeeds

P2. EventBus Events

song-request:updated event type defined
song-request:settings-updated event type defined

P3. Default Command

sr command registered with aliases songrequest, song

P4. Song Request Manager Service

loadSettings / reloadSettings / clearCache — settings cache management
addRequest — validates enabled, queue size, per-user limit, access level
removeRequest — removes by position, reorders
removeByUser — removes all of a user's requests
skipRequest — removes position 1, reorders
listRequests — returns ordered entries
currentRequest — returns position 1 entry
clearRequests — deletes all for channel

P5. Chat Command (`!sr`)

!sr <title> — request a song
!sr list / !sr queue — show next 5 songs
!sr current — show current song
!sr remove — viewer removes own requests
!sr remove <position> — mod removes by position
!sr skip — mod skips current song
!sr clear — mod clears queue
Non-mod rejected for mod-only subcommands

P6. tRPC Router

list — returns queue ordered by position
current — returns first entry
skip — removes first entry, publishes event, logs audit
remove — removes by id, publishes event, logs audit
clear — deletes all, publishes event, logs audit
getSettings — returns settings (with defaults)
updateSettings — upserts settings, publishes event, logs audit

P7. Dashboard Page

Settings card with enable toggle, max queue size, max per user, access level
Queue table with position, title, requester, time, actions
Skip/remove/clear actions work
Bot-not-enabled guard shown

P8. Full Suite Verification

Run bun test — all 564 tests pass across 55 test files
bun turbo build --filter="!web" succeeds
bun run --filter docs build succeeds

FilesExpand file tree

tests.md

Latest commit

History

tests.md

File metadata and controls

Phase 1 Manual Testing Checklist

Prerequisites

A. Enhanced Twitch Notifications

A1. Per-Channel Notification Overrides

A2. Channel Settings Dialog

A3. Custom Embed JSON

A4. Notification Behavior (requires live Twitch stream or test notification)

A5. Test Notification with Overrides

B. Inactive Account Cleanup

B1. Job Scheduling

B2. Cleanup Logic (manual trigger or wait for cron)

C. Discord Welcome Messages (Phase 2)

Prerequisites

C1. Welcome Message

C2. Leave Message

C3. Auto-Role

C4. DM Welcome

C5. Test Buttons

C6. Edge Cases

D. Visual Embed Builder UI (Phase 3)

D1. Channel Settings Dialog (Twitch Notifications)

D2. Welcome Settings — Welcome Message

D3. Welcome Settings — Leave Message

D4. Welcome Settings — DM Welcome

D5. Responsive / Layout

D6. Edge Cases

E. Public Pages Polish (Phase 4)

E1. Layout & Sidebar

E2. Entrance Animations

E3. Responsive / Mobile

E4. SEO Metadata

E5. Landing Page

F. Auth, Permissions & User Management (Phase 5)

F1. Schema Migration

F2. USER Role

F3. MODERATOR Role

F4. LEAD_MODERATOR Role

F5. BROADCASTER Role

F6. Ban System

F7. Setup Wizard

F8. Audit Log

F9. Auto-Link Twitch from Discord (On Login)

F10. Auto-Link Twitch from Discord (Background Sync)

F11. Regression

G. Dashboard UI Role Guards (Phase 5b)

G1. Bot Controls Card (/dashboard)

G2. Custom Commands (/dashboard/commands — Custom tab)

G3. Default Commands (/dashboard/commands — Default tab)

G4. Regulars (/dashboard/regulars)

G5. Discord Settings (/dashboard/discord)

G6. Welcome & Leave Settings (within Discord Settings)

G7. Settings Page (/dashboard/settings — Data tab)

G8. No Silent Failures

H. Viewer Queue Dashboard Management (Phase 6)

H1. Queue Status Controls

H2. Queue Entry Management

H3. Empty / Disabled States

H4. Role Guards

H5. Sidebar & Quick Stats

H6. Audit Logging

H7. EventBus (Twitch Bot)

I. Documentation Updates (Phase 7)

I1. New Pages Exist and Render

I2. Sidebar Navigation

I3. No ADMIN Role References

I4. Audit Log Action Table

I5. Queue System Page Accuracy

I6. Discord Settings Page Updates

I7. Discord Bot Pages

I8. Event Bus Page

I9. Cross-Links

I10. Build Verification

J. Automated Tests (Existing)

K. Phase 8 — EventBus & tRPC API Unit Tests

G1. Bot Controls Card (`/dashboard`)

G2. Custom Commands (`/dashboard/commands` — Custom tab)

G3. Default Commands (`/dashboard/commands` — Default tab)

G4. Regulars (`/dashboard/regulars`)

G5. Discord Settings (`/dashboard/discord`)

G7. Settings Page (`/dashboard/settings` — Data tab)

K2. EventBus Tests (`packages/events/src/bus.test.ts` — 11 tests)

K3. Audit Utility Tests (`packages/api/src/utils/audit.test.ts` — 5 tests)

K4. Bot Channel Router Tests (`packages/api/src/routers/botChannel.test.ts` — 17 tests)

K5. Chat Command Router Tests (`packages/api/src/routers/chatCommand.test.ts` — 18 tests)

K6. User Management Router Tests (`packages/api/src/routers/userManagement.test.ts` — 16 tests)

K7. Queue Router Tests (`packages/api/src/routers/queue.test.ts` — 14 tests)

K8. Regular Router Tests (`packages/api/src/routers/regular.test.ts` — 12 tests)

K9. Discord Guild Router Tests (`packages/api/src/routers/discordGuild.test.ts` — 24 tests)

K10. User Router Tests (`packages/api/src/routers/user.test.ts` — 10 tests)

K11. Audit Log Router Tests (`packages/api/src/routers/auditLog.test.ts` — 7 tests)

K12. Setup Router Tests (`packages/api/src/routers/setup.test.ts` — 12 tests)

M1. Title Command (`apps/twitch/src/commands/title.test.ts` — 2 tests)

M2. Game Command (`apps/twitch/src/commands/game.test.ts` — 2 tests)

M3. Followage Command (`apps/twitch/src/commands/followage.test.ts` — 3 tests)

M4. Shoutout Command (`apps/twitch/src/commands/shoutout.test.ts` — 9 tests)

M5. Quote Command (`apps/twitch/src/commands/quote.test.ts` — 8 tests)

M6. Counter Command (`apps/twitch/src/commands/counter.test.ts` — 8 tests)

M7. Quote tRPC Router (`packages/api/src/routers/quote.test.ts` — 10 tests)

M8. Counter tRPC Router (`packages/api/src/routers/counter.test.ts` — 8 tests)

N1. Timer Manager (`apps/twitch/src/services/timerManager.test.ts` — 10 tests)

N2. Timer tRPC Router (`packages/api/src/routers/timer.test.ts` — 10 tests)

O1. Spam Filter Service (`apps/twitch/src/services/spamFilter.test.ts` — 22 tests)

O2. Permit Command (`apps/twitch/src/commands/permit.test.ts` — 5 tests)

O3. Nuke Command (`apps/twitch/src/commands/nuke.test.ts` — 5 tests)

O4. Vanish Command (`apps/twitch/src/commands/vanish.test.ts` — 2 tests)

O5. Clip Command (`apps/twitch/src/commands/clip.test.ts` — 3 tests)

O6. Spam Filter tRPC Router (`packages/api/src/routers/spamFilter.test.ts` — 6 tests)

P1. AI Shoutout Service (`apps/twitch/src/services/aiShoutout.test.ts` — 5 tests)

P5. Chat Command (`!sr`)