Skip to content

Please support stella_en_400M_v5 and stella_en_1.5B_v5 models in openvino! #1234

@prb26

Description

@prb26

It would be great to test the speed and performance with openvino-qint8 for these models. Thanks!

I’m getting following error while trying to convert to OpenVINO:

ValueError: Trying to export a new model, that is a custom or unsupported architecture, but no custom export configuration was passed as custom_export_configs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions