A Chrome Extension experiment for collecting public Twitter / X page content for AI-assisted research workflows.
This repository is a browser-extension prototype. It is designed to explore how a user-controlled Chrome extension can collect structured page information and prepare it for downstream analysis, content research, or AI workflow experiments.
For creator tools and content-operation systems, public social content is often useful for research:
- discovering topic patterns
- collecting examples for writing style analysis
- saving public posts for later review
- building small datasets for AI-assisted content research
This extension is an experiment around that workflow.
The current manifest targets Twitter / X pages:
https://twitter.com/*
https://x.com/*
The extension uses:
manifest.jsonfor extension configurationpopup.html/popup.jsfor the extension UIbackground.jsfor background service-worker logiccontent.jsfor page-level extraction logicdb.jsfor local data handling
- Clone this repository.
- Open Chrome and go to
chrome://extensions/. - Enable Developer mode.
- Click Load unpacked.
- Select this project directory.
- Open a supported Twitter / X page.
- Click the extension icon in the Chrome toolbar.
- Start the crawler from the popup UI.
- Review or export collected data depending on the current implementation.
Use this only for pages you are allowed to access. Respect platform terms, rate limits, robots rules where applicable, and privacy boundaries. This project is intended for controlled personal research and prototyping, not aggressive scraping.
This is an experimental prototype. It needs more documentation before being treated as a polished product:
- Add screenshots of the extension UI.
- Document the extracted data schema.
- Add an example export file.
- Connect the output to a creator-research or AI-analysis pipeline.
- Clarify limitations and safe-use boundaries.
- GitHub profile: XingMXTeam
- Personal site: maoxunxing.com