Skip to content

As a data provider, I want --prefix to be inferred automatically when --weblogs is used #378

Description

@jordanpadams

Summary

As a data provider uploading weblogs, I want --prefix to be inferred automatically when --weblogs is used, so that I don't have to specify the same directory path twice on the command line.

Motivation

When using --weblogs, the --prefix argument is required and its value must be a leading substring of the upload path argument. In practice this means users must type essentially the same path twice:

pds-ingress-client --weblogs apache --prefix /data/weblogs -- /data/weblogs/

The --prefix argument is a general-purpose path-trimming mechanism that --weblogs repurposes to determine what to replace in the S3 destination path. When --weblogs is specified alongside a single upload path, the prefix could be inferred as the upload directory itself (or its parent), eliminating the redundancy.

Proposed Behavior

When --weblogs is specified and --prefix is not explicitly provided, automatically infer --prefix from the upload path (e.g., default to the upload directory). --prefix should remain overridable for cases where finer control is needed.

Additional Context

This redundancy was surfaced by an external data provider as confusing. Documenting it as a known limitation for now (see usage docs), but a proper fix would improve the UX meaningfully for all weblog uploaders.

Metadata

Metadata

Assignees

Labels

Projects

Status
ToDo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions