Skip to content

Jdorman1289/sql_interface

Repository files navigation

SQL Interface for Parquet Files

A web interface for querying and exploring Parquet files using DuckDB with an object-oriented design.

Core Components

  • Config: Manages configuration from config.yaml
  • Database: Handles DuckDB connections and query execution
  • SQLInterface: Main application with Flask routes and business logic

Features

  • Filter and query Parquet files via SQL
  • Interactive web interface with dynamic filtering
  • Export results to CSV
  • Memory-efficient processing with DuckDB

Setup

pip install -r requirements.txt
python sql_interface.py

Then open client.html in a browser.

Configuration

Edit config.yaml to customize column display names and other settings.

About

This project demonstrates a SQL query client that uses DuckDB to query data stored across Parquet files. It consists of a Python backend and an HTML/JavaScript frontend.

Resources

Stars

Watchers

Forks

Contributors