Skip to content
This repository was archived by the owner on Apr 8, 2024. It is now read-only.
This repository was archived by the owner on Apr 8, 2024. It is now read-only.

Write specifications for all inferencing modules and align #187

Description

@jfomhover

There's a trade-off between aligning all inferencing modules, and providing flexibility to implement framework-specific arguments.

The inferencing pipeline should be able to rely on a standard set of parameters (ex: data type, batch size, num threads...) while providing flexibility for experiments requiring framework params (ex: using custom binaries).

Writing down a specification in our documentation, and decide which params should be the core "contract" of inferencing modules, then align on each of them, would put us in a better place before expanding to more frameworks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions