Skip to content

About

Python tool to extract data from https://www.loot-drop.io/ [THE STARTUP GRAVEYARD] and organize it into different formats

Resources

Stars

2 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

Repository files navigation

Company Information Extractor

A Python tool to extract company information, failure reasons, and related data from loot-drop.io by interacting with the website using Selenium.

Features

  • Interactive extraction: Uses Selenium to actually click on company cards and extract data from popups
  • Smart card detection: Finds cards by locating the <!-- Cards Grid --> section and identifying cards with card-year class
  • Robust popup handling: Automatically opens and closes popups for each card
  • Extracts all detailed information including:
    • Company name
    • Value Proposition
    • Opportunity Score
    • Cause of Death
    • The Loot
    • Key People & Investors
    • Market Today
    • New Business Idea & Product Name
    • Execution Plan
    • Monetization Strategy
    • Funding Burned
    • Category
    • Year Closed
  • Exports data to multiple formats (JSON, CSV, Excel)
  • Handles 500+ company cards automatically

Installation

  1. Install required dependencies:
pip install -r requirements.txt
  1. Install ChromeDriver:

    Or use webdriver-manager:

pip install webdriver-manager

Usage

Basic Usage

Run the extractor directly:

python company_extractor.py

Or use the example script:

python example_usage.py

Programmatic Usage

from company_extractor import CompanyExtractor

# Create extractor (headless=False to see browser, True to run in background)
extractor = CompanyExtractor(headless=False)

# Extract companies
companies = extractor.extract_all_companies()

# Save to files
extractor.save_to_json("output.json")
extractor.save_to_csv("output.csv")
extractor.save_to_excel("output.xlsx")  # Requires openpyxl

The script will:

  1. Launch a Chrome browser (or run headless)
  2. Navigate to https://www.loot-drop.io/
  3. Find the Cards Grid section
  4. Identify all cards with card-year class
  5. Click each card to open its popup
  6. Extract detailed information from the popup
  7. Close the popup and move to the next card
  8. Save results to:
    • companies_data.json (JSON format)
    • companies_data.csv (CSV format)
    • companies_data.xlsx (Excel format, if openpyxl is installed)

Output Format

Each company entry includes:

  • company_name: Company name
  • value_proposition: The Value Proposition
  • opportunity_score: Opportunity Score
  • cause_of_death: Cause of Death (why they failed)
  • the_loot: The Loot
  • key_people_investors: Key People & Investors
  • market_today: Market Today
  • new_business_idea_product_name: The New Business Idea & Product Name
  • execution_plan: Execution Plan
  • monetization_strategy: 💰 Monetization Strategy
  • funding_burned: Funding amount burned (e.g., "$50M BURNED")
  • category: Company category (HARDWARE, SOFTWARE, etc.)
  • year_closed: Year the company closed

How It Works

  1. Card Detection: The script locates the <!-- Cards Grid --> HTML comment and finds all cards containing a <span class="card-year" data--h-bstatus="0OBSERVED"> element
  2. Card Interaction: For each card, the script:
    • Scrolls the card into view
    • Clicks the card to trigger the popup
    • Waits for the popup to appear
  3. Data Extraction: Extracts all relevant information from the popup content using BeautifulSoup and regex patterns
  4. Popup Management: Closes the popup before moving to the next card

Customization

You can modify the CompanyExtractor class to:

  • Adjust wait times for slower connections
  • Change popup detection selectors
  • Add custom data extraction logic
  • Change output formats
  • Add filtering or data processing

Notes

  • The script uses Selenium WebDriver to interact with the website
  • Runs in visible browser mode by default (set headless=True for background operation)
  • Includes delays between actions to ensure proper page loading
  • Handles errors gracefully and continues with next card if one fails
  • Respects website structure and includes appropriate wait times

Troubleshooting

  • ChromeDriver not found: Make sure ChromeDriver is installed and in your PATH
  • Cards not found: The website structure might have changed. Check the HTML structure
  • Popup not opening: Try increasing wait times in the code
  • Import errors: Make sure all dependencies are installed: pip install -r requirements.txt

About

Python tool to extract data from https://www.loot-drop.io/ [THE STARTUP GRAVEYARD] and organize it into different formats

Resources

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages