Instructions to use BAAI/llm-embedder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BAAI/llm-embedder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="BAAI/llm-embedder")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("BAAI/llm-embedder") model = AutoModel.from_pretrained("BAAI/llm-embedder") - Inference
- Notebooks
- Google Colab
- Kaggle
用llm当passage encoder
#9
by turtlejiang - opened
你好, 我看全部BAAI模型都是bert based。有没有考虑过使用llama2来做passage encoding还有query encoding?
你好,bert模型比较轻便,效率高。使用llama等大模型作为编码器我们也在实验中。