Skip to content

GITHUB_MCP_SYNC_GUIDE.md

Latest commit

 

History

History
362 lines (316 loc) · 8.78 KB

GITHUB_MCP_SYNC_GUIDE.md

File metadata and controls

362 lines (316 loc) · 8.78 KB

🚀 GitHub MCP Real-time Sync Implementation

Overview

Complete implementation for syncing your 63 GitHub repositories with Supabase, Notion, and Cloze CRM using GitHub MCP tools.

Architecture

GitHub MCP Tools
     ↓
Real-time Sync Engine
     ↓
Supabase Database
     ↓
┌─────────────┬──────────────┬────────────┐
│   Notion    │    Cloze     │    N8N     │
│   (Docs)    │    (CRM)     │ (Workflow) │
└─────────────┴──────────────┴────────────┘

Quick Start

1. Set Up Database

# Copy the SQL schema to Supabase
cd /Users/jamesbrady/Desktop/ai_trinity_workspace/data_extraction_project
# Run github_sync_schema.sql in Supabase SQL editor

2. Configure Environment

# Create .env file
cat > .env << EOF
SUPABASE_URL=your-supabase-url
SUPABASE_ANON_KEY=your-supabase-key
GITHUB_TOKEN=your-github-token
NOTION_TOKEN=your-notion-token
CLOZE_API_KEY=your-cloze-key
EOF

3. Install Dependencies

npm init -y
npm install @supabase/supabase-js

4. Run Initial Sync

node github_realtime_sync.js

Integration Mappings

GitHub → Notion

const notionMappings = {
  // Background Check Platform
  'Vuplicity': {
    databaseId: 'notion-db-id',
    pageId: 'notion-page-id',
    syncPRs: true,
    syncIssues: true,
    syncCommits: false
  },
  'fcra-compliance-system': {
    databaseId: 'notion-db-id',
    pageId: 'notion-page-id',
    syncPRs: true,
    syncIssues: true,
    syncCommits: true
  },
  // AI Projects
  'ai-trinity-data-extraction': {
    databaseId: 'notion-db-id',
    pageId: 'notion-page-id',
    syncPRs: true,
    syncIssues: true,
    syncCommits: false
  }
};

GitHub → Cloze

const clozeMappings = {
  'Vuplicity': {
    projectId: 'cloze-project-id',
    opportunityId: 'cloze-opportunity-id',
    trackMilestones: true
  },
  'fcra-compliance-system': {
    projectId: 'cloze-project-id',
    trackMilestones: true
  }
};

N8N Workflow Configuration

Webhook Receiver

{
  "nodes": [
    {
      "name": "GitHub Webhook",
      "type": "n8n-nodes-base.webhook",
      "typeVersion": 1,
      "position": [250, 300],
      "webhookId": "github-sync",
      "parameters": {
        "path": "github-sync",
        "method": "POST"
      }
    },
    {
      "name": "Process Event",
      "type": "n8n-nodes-base.switch",
      "typeVersion": 1,
      "position": [450, 300],
      "parameters": {
        "dataPropertyName": "headers.x-github-event"
      }
    },
    {
      "name": "Update Supabase",
      "type": "n8n-nodes-base.supabase",
      "typeVersion": 1,
      "position": [650, 300]
    },
    {
      "name": "Sync to Notion",
      "type": "n8n-nodes-base.notion",
      "typeVersion": 1,
      "position": [850, 200]
    },
    {
      "name": "Update Cloze",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 1,
      "position": [850, 400]
    }
  ]
}

Real-time Sync Features

1. Automatic Categorization

// Repositories are automatically categorized
const categories = {
  'background-check': ['Vuplicity', 'fcra-compliance-system', ...],
  'ai-automation': ['ai-trinity-data-extraction', 'Overseer', ...],
  'crypto-web3': ['fishrewards-nft', 'royal-rwa', ...],
  'tools-utilities': ['RoyalCalcV2', 'FlashCardsofPOWER', ...],
  'personal': ['birthday', 'cats', 'games', ...]
};

2. Activity Timeline

  • Unified view of all repository activities
  • Commits, PRs, issues in chronological order
  • Filterable by repository, author, or type

3. Analytics Dashboard

-- Development velocity by week
SELECT 
  DATE_TRUNC('week', occurred_at) as week,
  category,
  COUNT(*) as activities,
  COUNT(DISTINCT author_login) as contributors
FROM github_activity_timeline
JOIN github_repositories USING (repo_id)
WHERE occurred_at >= NOW() - INTERVAL '3 months'
GROUP BY week, category
ORDER BY week DESC;

-- Most active repositories
SELECT 
  name,
  category,
  COUNT(DISTINCT sha) as commits_30d,
  COUNT(DISTINCT pr_number) as prs_30d,
  MAX(pushed_at) as last_activity
FROM github_repositories r
LEFT JOIN github_commits c ON r.repo_id = c.repo_id
  AND c.committer_date >= NOW() - INTERVAL '30 days'
LEFT JOIN github_pull_requests pr ON r.repo_id = pr.repo_id
  AND pr.created_at >= NOW() - INTERVAL '30 days'
GROUP BY r.repo_id, name, category
ORDER BY commits_30d DESC, prs_30d DESC
LIMIT 10;

Monitoring & Alerts

Slack Notifications

// Send alerts for important events
const sendSlackAlert = async (event) => {
  if (event.type === 'pr_merged' && event.repo.category === 'background-check') {
    await slack.send({
      text: `🎉 PR Merged: ${event.title} in ${event.repo.name}`,
      channel: '#dev-updates'
    });
  }
};

Health Checks

// Monitor sync health
const checkSyncHealth = async () => {
  const { data } = await supabase
    .from('github_sync_status')
    .select('*')
    .order('started_at', { ascending: false })
    .limit(1)
    .single();
  
  if (data.status === 'failed' || 
      new Date() - new Date(data.started_at) > 3600000) {
    // Alert if sync failed or taking too long
    await sendAlert('GitHub sync issue detected');
  }
};

Repository Insights

Your Top Categories

  1. Background Check (7 repos) - Core business
  2. AI/Automation (8 repos) - Innovation projects
  3. Crypto/Web3 (15+ repos) - Fish rewards ecosystem
  4. Tools (10+ repos) - Productivity applications
  5. Personal (5+ repos) - Fun projects

Recent Activity (Last 7 days)

  • ai-trinity-data-extraction - Created today!
  • fcra-compliance-system - 5 commits today
  • Vuplicity - PR merged: "Modernize website design"

Integration Benefits

  • Unified View: See all dev activity in one place
  • Automated Updates: PRs auto-create Notion tasks
  • Customer Tracking: Link commits to Cloze opportunities
  • Team Insights: Track contributor patterns
  • Milestone Tracking: Auto-update project progress

Advanced Features

1. Smart PR → Task Creation

// Auto-create Notion tasks from PRs
if (pr.labels.includes('feature')) {
  await notion.createTask({
    title: `Review: ${pr.title}`,
    assignee: pr.assignee,
    dueDate: addDays(new Date(), 3),
    project: notionMappings[repo.name].pageId
  });
}

2. Commit → Customer Update

// Link commits to customer features
if (commit.message.includes('fixes #')) {
  const issueNumber = extractIssueNumber(commit.message);
  await cloze.updateOpportunity({
    id: clozeMappings[repo.name].opportunityId,
    note: `Feature completed: ${commit.message}`,
    stage: 'delivered'
  });
}

3. Release Automation

// Auto-generate release notes
const generateReleaseNotes = async (repo, fromTag, toTag) => {
  const commits = await getCommitsBetweenTags(repo, fromTag, toTag);
  const prs = commits.filter(c => c.pr_number);
  
  return {
    features: prs.filter(pr => pr.labels.includes('feature')),
    fixes: prs.filter(pr => pr.labels.includes('bug')),
    breaking: prs.filter(pr => pr.labels.includes('breaking'))
  };
};

Security Considerations

Access Control

-- Row Level Security policies
CREATE POLICY "Users can view public repos"
  ON github_repositories FOR SELECT
  USING (private = false OR auth.uid() IS NOT NULL);

CREATE POLICY "Authenticated users can view all"
  ON github_repositories FOR ALL
  USING (auth.uid() IS NOT NULL);

Sensitive Data

  • Store tokens in environment variables
  • Use Supabase vault for API keys
  • Implement webhook signature verification
  • Audit trail for all syncs

Performance Optimization

Batch Processing

// Process updates in batches
const BATCH_SIZE = 100;
const updates = [];

for (const item of items) {
  updates.push(processItem(item));
  
  if (updates.length >= BATCH_SIZE) {
    await supabase.from('table').insert(updates);
    updates.length = 0;
  }
}

Caching Strategy

// Cache frequently accessed data
const cache = new Map();
const CACHE_TTL = 5 * 60 * 1000; // 5 minutes

const getCachedRepo = (repoId) => {
  const cached = cache.get(repoId);
  if (cached && Date.now() - cached.timestamp < CACHE_TTL) {
    return cached.data;
  }
  return null;
};

Next Steps

  1. Today: Run initial sync with node github_realtime_sync.js
  2. Tomorrow: Set up N8N workflows
  3. This Week: Configure Notion integrations
  4. Next Week: Build analytics dashboard

Support

  • Schema: github_sync_schema.sql
  • Sync Engine: github_realtime_sync.js
  • Integration Guide: This document
  • Analytics: Check Supabase dashboard

Your GitHub ecosystem is now ready for real-time synchronization! 🎉