Skip to content

Support provider/capability shorthand in firecrawl scrape - #254

Merged
developersdigest merged 4 commits into
mainfrom
feat/scrape-tool-shorthand
Sep 18, 2026
Merged

developersdigest merged 4 commits into
mainfrom
feat/scrape-tool-shorthand

Conversation

@developersdigest

@developersdigest developersdigest commented Sep 18, 2026 •

Copy link
Copy Markdown
Member

Summary

Allow firecrawl scrape benzinga/news/search --options '{"pageSize":10}' alongside the existing --alexandria benzinga/news/search syntax. Both forms use the same Alexandria execution path and make no extra catalog lookup.

URL-shaped inputs stay on website scraping, including explicit HTTP(S) URLs, domains, localhost and IP addresses. Bare names such as firecrawl scrape amazon fail before authentication with a suggested website URL, firecrawl list, and tool syntax. Suggestions are never executed. Unknown provider/capability paths retain the server error and nonzero exit status; they never fall back to a URL scrape.

Preserve multi-URL scraping and positional formats. Reject mixed URL/tool requests and mixed positional/explicit tool addressing instead of silently ignoring inputs. Update scrape help and README with both forms.

Validation

  • pnpm build passes.
  • All 562 tests pass across 34 files.
  • Built CLI tested against a local HTTP server: shorthand and explicit requests match, bare inputs make no request, and unknown tools preserve errors without a URL fallback.
  • Formatting and diff checks pass.

Summary by cubic

Adds provider/capability shorthand to firecrawl scrape, alongside --alexandria, with no extra catalog lookup. Both forms use the same Alexandria execution path.

  • HTTP(S) URLs, domains, localhost, and IP addresses still scrape websites; multi-URL scraping and positional formats are unchanged.
  • Bare or malformed inputs fail locally before authentication in positional and --url forms, with a suggested URL and pointer to firecrawl list; suggestions are never executed.
  • Unknown provider/capability paths preserve the server error and nonzero exit status and never fall back to URL scraping.
  • Mixed URL/tool requests and mixed positional/--alexandria tool addresses are rejected.
  • Help and README document both forms.

Written for commit 0f51406. Summary will update on new commits.

Review in cubic

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 8 files

Shadow auto-approve: would not auto-approve because issues were found.

Fix all with cubic | Re-trigger cubic

Comment thread src/utils/scrape-target.ts Outdated
Comment thread src/utils/scrape-target.ts Outdated
Comment thread src/__tests__/scrape-shorthand.test.ts
@developersdigest
developersdigest merged commit 2408659 into main Sep 18, 2026
8 checks passed
@developersdigest
developersdigest deleted the feat/scrape-tool-shorthand branch September 18, 2026 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant