Custom Embedding #29
-
|
How can I utilize embedding models other than Hugging Face? For example, how can I use OpenAI embeddings? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
The adaptive classifier technique works on open models since we need access to the weights to add on an adapter and neural memory. You can see this with some the adaptive classifiers released on HF - https://huggingface.co/adaptive-classifier They will have a small model.safetensors file and a config. The model.safetensors file corresponds to the adapter which is added to the base classifier that is mentioned in the config.json. The examples.json file contains the embeddings corresponding to the neural memory. |
Beta Was this translation helpful? Give feedback.
The adaptive classifier technique works on open models since we need access to the weights to add on an adapter and neural memory. You can see this with some the adaptive classifiers released on HF - https://huggingface.co/adaptive-classifier
They will have a small model.safetensors file and a config. The model.safetensors file corresponds to the adapter which is added to the base classifier that is mentioned in the config.json. The examples.json file contains the embeddings corresponding to the neural memory.