Instructions to use mlx-community/OpenELM-270M-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/OpenELM-270M-Instruct with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/OpenELM-270M-Instruct --local-dir OpenELM-270M-Instruct
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
|
Download README.md from mlx-community/OpenELM-270M-Instruct: direct link, hf CLI and curl.
- Browser
- Download file 594 Bytes
-
https://huggingface.co/mlx-community/OpenELM-270M-Instruct/resolve/main/README.md
- Command line
-
hf download hf://mlx-community/OpenELM-270M-Instruct/README.md
-
curl -L -o README.md https://huggingface.co/mlx-community/OpenELM-270M-Instruct/resolve/main/README.md
594 Bytes
metadata
license: other
tags:
- mlx
license_name: apple-sample-code-license
license_link: LICENSE
mlx-community/OpenELM-270M-instruct
This model was converted to MLX format from apple/OpenELM-270M-instruct using mlx-lm version 0.10.0.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/OpenELM-270M-instruct")
response = generate(model, tokenizer, prompt="hello", verbose=True)