Skip to content

Latest commit

 

History

History
198 lines (154 loc) · 5.77 KB

File metadata and controls

198 lines (154 loc) · 5.77 KB

Penny Feature TODO

This document tracks potential new features and enhancements for Penny.

New Agent Types

ReminderAgent

  • Parse user requests like "remind me about X in 2 hours"
  • Store reminders in database with scheduled execution time
  • Send proactive reminders via channel
  • Could use natural language parsing for time expressions

TrendingAgent

  • Monitor topics from recent conversations
  • Search for breaking news related to discussed topics
  • Send updates when significant developments occur
  • Configurable frequency and relevance threshold

DigestAgent

  • Daily/weekly summary of conversations
  • Highlights interesting discoveries or shared links
  • Aggregates topics discussed across all users
  • Scheduled delivery time (e.g., "morning digest")

FactCheckAgent

  • Background verification of claims made in conversations
  • Uses multiple search sources for cross-referencing
  • Gentle corrections if information appears outdated/incorrect
  • Stores verified facts for future reference

Enhanced Search & Information

Multi-Source Search

  • Add specialized search tools beyond Perplexity
  • Wikipedia for encyclopedic content
  • arXiv for academic papers
  • GitHub for code examples
  • YouTube for video content
  • News-specific APIs for current events

Media Handling

  • Download and analyze images/PDFs shared by users
  • OCR for text extraction from images
  • Summarize linked articles/videos
  • Generate image descriptions for accessibility

Location Awareness

  • Optional user location tracking
  • Local search results (restaurants, events, weather)
  • Time-zone aware scheduling
  • Regional news and content

User Interaction Features

Multi-Turn Clarification

  • Ask follow-up questions when requests are ambiguous
  • Store clarification preferences per user
  • Learn from past interactions to reduce questions

Reaction-Based Feedback

  • Users react to messages (👍/👎) for quality feedback
  • Adjust response style based on reaction patterns
  • Store feedback for future model fine-tuning
  • Use reactions to prioritize topics for FollowupAgent

Command System

  • Special commands for power users: /search, /summarize, /profile, /remind
  • Toggle features on/off per conversation
  • Configure personal preferences inline

Content Management

Bookmark System

  • Users can "save" interesting responses or links
  • Retrieve saved content with search or tags
  • Export bookmarks to other formats
  • Share collections with other users

Knowledge Base

  • Build persistent knowledge from conversations
  • Extract facts and store in structured format
  • Reference past conversations: "What did we discuss about X?"
  • Entity tracking (people, places, concepts mentioned)

Quote Library

  • Save interesting quotes or snippets from conversations
  • Random quote sharing as discovery content
  • Tag and categorize quotes by topic

Platform Integrations

Slack Support

  • New SlackChannel implementation
  • Thread-based conversations
  • Workspace-aware context

Telegram Support

  • TelegramChannel via python-telegram-bot
  • Group chat support with @mentions

Matrix Support

  • Open protocol alternative to proprietary platforms
  • Self-hosted federation support

Email Channel

  • Long-form email responses
  • Digest mode for batch processing
  • Rich HTML formatting

Intelligence & Memory

Conversation Analytics

  • Track topics of interest per user
  • Identify conversation patterns
  • Suggest related topics to explore
  • Visualize discussion trends over time

Cross-User Learning

  • Share knowledge between users (with privacy controls)
  • "User A also asked about this topic"
  • Collaborative discovery (what's trending across all users)

Semantic Search

  • Vector embeddings for message history
  • Find similar past conversations
  • Recommend related threads

Memory Layers

  • Short-term: recent conversation context
  • Medium-term: weekly/monthly themes
  • Long-term: enduring interests and preferences
  • Episodic: specific events or milestones

Coordination & Scheduling

Group Features

  • Multi-user conversation support
  • Coordinate responses when multiple people are active
  • Mention/tag specific users
  • Group profiles and shared interests

Quiet Hours

  • User-configurable do-not-disturb schedules
  • Suppress background agents during quiet hours
  • Queue messages for delivery at appropriate times

Priority System

  • Urgent vs. casual message classification
  • Fast-track time-sensitive requests
  • Deprioritize background tasks when user is active

Developer & Debug Features

Explain Mode

  • Show reasoning steps and tool calls to users
  • Transparency mode for debugging responses
  • Display which sources were used and why

A/B Testing Framework

  • Test different prompts or models
  • Compare response quality
  • User preference collection
  • Gradual rollout of new features

Performance Metrics

  • Response time tracking
  • Token usage monitoring
  • Search API quota management
  • Alert on degraded performance

Fun & Engagement

Personality Modes

  • Switch between different response styles
  • Technical/casual/humorous/professional modes
  • Per-user or per-conversation preferences

Game/Quiz Features

  • Spontaneous trivia based on conversation topics
  • Daily challenges or brain teasers
  • Track scores and streaks

Easter Eggs

  • Hidden features triggered by specific phrases
  • Seasonal variations in responses
  • Special responses for milestones (100th message, etc.)

Most Impactful Quick Wins

These features would provide the highest value with reasonable implementation effort:

  1. ReminderAgent - high utility, straightforward implementation
  2. Multi-Source Search - immediate quality improvement
  3. Reaction-Based Feedback - better learning without explicit user effort
  4. Bookmark System - useful content organization
  5. Quiet Hours - better respect for user preferences