Repository navigation
chore(connectors): sync manifest with url_discovery regex filters - #877
Merged
Merged
Conversation
Adds the matchRegex/filterRegex config keys of the katana, gau, ffuf, dirsearch and arjun connectors, and picks up nessus 0.2.0 already on oasm-connectors main.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Syncs
core-api/resources/connectors/manifest.jsonwith oasm-platform/oasm-connectors#37, which addsmatchRegex/filterRegexURL filters to the katana, gau, ffuf, dirsearch and arjun connectors. Users can now target specific pages (login, admin, …) from a tool config profile or a workflow step's inline config.Related: #746.
matchRegex— report only URLs matching at least one patternfilterRegex— drop URLs matching any pattern (wins overmatchRegex)Patterns are Go RE2, matched against the full URL.
The sync also picks up nessus 0.2.0 (
disableTlsChecks), which is already on oasm-connectorsmain;task sync-connectorsfrommainproduces the same change.No core-api / console code changes
Everything is schema-driven:
configSchema(maxItems: 20,minLength: 1,maxLength: 512) and ships the config to the worker unchanged.SchemaFormseeds array fields with[""], andnormalizeValuesdrops empty strings on submit, so saving a config without patterns still passesminLength: 1.Merge order
Merge oasm-connectors#37 first and publish the connector images. Until then, the new keys reach connector images that ignore them (no error, no filtering).
Testing
Connector registry loaded 15 connector(s), worker connected.workflows.content) carriesmatchRegex/filterRegexfor all five jobs.