Skip to content

Dataset Retrieval Limited to Single Column and 20 Rows Instead of Full Data #1

Description

@architkannan

When retrieving sample datasets (e.g., "Item", "Customer", "Quotation") from FPOHub using client.get_dataset(), the resulting DataFrame only contains an index and a single column. Additionally, the dataset retrieval is limited to 20 rows by default.

Expected Behavior:

  • The API should return all relevant fields from the dataset, not just one column.
  • The API should either return all records or allow fetching the full dataset through pagination or multiple calls.

Observed Behavior:

  • Only the index and a single (first) column are retrieved.
  • By default, only 20 rows are returned.
  • Calling client.get_dataset_schema() shows a schema with many expected fields that are missing from the actual dataset retrieval.

Possible Causes & Suggestions:

  1. Field Selection Issue: The API might default to retrieving only a subset of fields unless explicitly specified. A workaround may involve modifying the API request to request all fields.
  2. Pagination Limitation: The API may enforce a default row limit (20 rows), requiring explicit pagination to fetch more data.
  3. Permissions or API Response Structure: There could be a mismatch between the schema and actual returned fields, potentially due to permission restrictions or API defaults.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions