Skip to content

[Feature Request] Add models from file path and allow adapters #6

@jameshgrn

Description

@jameshgrn

Hi,

great work on this project, the MLX community deserves a nice chat interface like this. So thank you!

A couple ideas just to consider:

  1. As the title says, it would be great to be able to point ChatMLX to already downloaded models. For instance, I have downloaded a bunch of models for other projects, so would be nice to re use those models instead of downloading new ones. When I press the folder button on the models page, nothing happens, so maybe this functionality already exists and the button just doesnt route to anywhere.

  2. Similarly, would be nice to be able to supply an adapters folder for these models. When I'm finetuning, I'd like to be able to test out different adapters without fusing the model to test it out.

Again, these are quality of life features, and I'm sure your priority list is large right now!

Thanks for this again, great project.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions