Skip to content

Make model listing faster #250

Description

@nlathia

another nice to have -> some performance (latency) improvements around methods like list_models i haven't had the chance to take an in depth look but at first guess, probably adding async / multithreading for the IO blocking parts or using ujson instead of json for loading the jsons?

https://mlops-community.slack.com/archives/C0227QJCDS8/p1687856991359489?thread_ts=1687777412.934619&cid=C0227QJCDS8

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions