Installation progressive enhancement

.github/instructions/coding.instructions.md

@@ -73,6 +73,53 @@ known-first-party = ["vector_inspector"]
 
 If you update these settings in `pyproject.toml`, please mirror the change here.
 
+## Code Cleanup & Refactoring Practice
+
+**After solving a problem or completing a refactor, always do a cleanup pass to remove or update redundant code.**
+
+When debugging or implementing features, it's common to:
+- Try multiple approaches before finding the solution
+- Add temporary workarounds or debugging code
+- Create helper methods that become obsolete when a better solution is found
+- Leave behind commented-out code or unused imports
+
+**Before considering the work complete:**
+
+1. **Search for related code** that may now be redundant:
+   - Old helper methods that the new solution replaces
+   - Temporary workarounds that are no longer needed
+   - Duplicate logic that could be consolidated
+   - Commented-out debugging code or failed attempts
+
+2. **Remove or update:**
+   - Unused methods and functions
+   - Dead code paths (if statements that can never be true)
+   - Redundant error handling after centralizing it
+   - Overly complex logic that can now be simplified
+   - Debugging print statements or temporary logging
+
+3. **Update documentation:**
+   - Remove comments explaining workarounds that no longer exist
+   - Update docstrings if method signatures or behavior changed
+   - Remove TODOs that were addressed during the refactor
+
+4. **Check for consistency:**
+   - Ensure naming conventions are consistent
+   - Verify similar patterns are handled the same way
+   - Look for opportunities to use the new pattern elsewhere
+
+**Example:** When fixing the provider connection type field visibility issue:
+- Original attempt: complex `_set_field_and_label_visible()` method with 80+ lines
+- Solution: configuration-driven approach with simpler `_set_form_row_visible()` method
+- Cleanup pass: removed the old 80-line method and redundant field-hiding code
+
+**Why this matters:**
+- Keeps the codebase maintainable and easy to understand
+- Reduces confusion for future developers (including yourself)
+- Prevents bugs from old code paths being accidentally invoked
+- Makes code reviews faster and clearer
+- Improves performance by removing unnecessary operations
+
 ## Error Handling Convention
 
 Follow these layer-specific rules so errors surface cleanly without leaking implementation details into the UI or swallowing failures silently.

.github/workflows/ci-tests.yml

@@ -58,7 +58,7 @@ jobs:
       # LanceDB compatibility: tested against lancedb>=0.27.0 + pyarrow>=14.0.0 (pinned in pyproject.toml).
       # If tests fail after a lancedb/pyarrow bump, check delete_items native API detection in lancedb_connection.py.
       - name: Install dependencies (dev)
-        run: pdm install -d
+        run: pdm install -G dev -G all
 
       - name: Run tests
         continue-on-error: true

README.md

@@ -61,11 +61,64 @@ This is the easiest and most reliable way to get started.
 
 ## From PyPI
 
+### Fast Install (Minimal)
+Start with just the core app, then add database providers as needed:
+
 ```bash
+# Install core app only (fast, ~30 seconds)
 pip install vector-inspector
+
+# Launch the app
 vector-inspector
 ```
 
+When you connect to a database, the app will prompt you to install the needed provider.
+
+### Recommended Install
+Install with commonly used databases and features:
+
+```bash
+pip install vector-inspector[recommended]
+# Includes: ChromaDB, Qdrant, embeddings, and visualization tools
+```
+
+### Full Install
+Install everything (all database providers and features):
+
+```bash
+pip install vector-inspector[all]
+# Same as previous versions - includes all providers
+```
+
+### Individual Providers
+Install specific database providers:
+
+```bash
+pip install vector-inspector[chromadb]    # ChromaDB only
+pip install vector-inspector[qdrant]      # Qdrant only
+pip install vector-inspector[pinecone]    # Pinecone only
+pip install vector-inspector[pgvector]    # PostgreSQL/pgvector
+pip install vector-inspector[weaviate]    # Weaviate
+pip install vector-inspector[lancedb]     # LanceDB
+pip install vector-inspector[milvus]      # Milvus
+```
+
+### Optional Features
+Add embedding models, visualization, or document processing:
+
+```bash
+pip install vector-inspector[embeddings]  # Text embedding models
+pip install vector-inspector[clip]        # Image/text embeddings
+pip install vector-inspector[viz]         # UMAP, t-SNE, clustering
+pip install vector-inspector[documents]   # PDF, DOCX support
+```
+
+You can combine multiple extras:
+
+```bash
+pip install vector-inspector[chromadb,qdrant,embeddings,viz]
+```
+
 ## From a Downloaded Wheel or Tarball (e.g., GitHub Release)
 
 Download the `.whl` or `.tar.gz` file from the [GitHub Releases](https://github.com/anthonypdawson/vector-inspector/releases) page, then install with:
@@ -84,20 +137,28 @@ vector-inspector
 Note: pip install does **not** create a desktop shortcut.  
 Use the bootstrap installer for the full experience.
 
-### From Source
+### From Source (PDM)
 
 ```bash
 # Clone the repository
 git clone https://github.com/anthonypdawson/vector-inspector.git
 cd vector-inspector
 
-# Install dependencies using PDM
+# Install core dependencies only (fast)
 pdm install
 
+# OR install with recommended providers
+pdm install -G recommended
+
+# OR install everything (all providers and features)
+pdm install -G all
+
 # Launch application
 scripts/run.sh     # Linux/macOS
 scripts/run.bat    # Windows
 ```
+
+**Note for developers**: The dependency groups in `pyproject.toml` can be installed with PDM using `-G <group>`. Available groups: `chromadb`, `qdrant`, `pinecone`, `lancedb`, `pgvector`, `weaviate`, `milvus`, `embeddings`, `clip`, `viz`, `documents`, `llm`, `recommended`, `all`.
 ---
 
 # 🟩 Running Vector Inspector
@@ -111,7 +172,7 @@ vector-inspector
 ### Optional LLM runtime (llama-cpp-python)
 llama-cpp-python is optional and only needed for the in-process LLM provider (`llama-cpp`).
 
-- Install via PDM optional-dependency group (developer / recommended):
+- Install via PDM dependency group (developer / recommended):
 
 ```bash
 pdm install -G llm