Is colpali/colqwen also "Multimodal Embedding Model"?

[groklab]

Hello! I am reading the section "Multimodal Embedding Models" in Chapter 9.

May I ask is colpali/colqwen also "Multimodal Embedding Model"?

https://huggingface.co/vidore/colpali-v1.3

[MaartenGr]

This is indeed a multimodal embedding model but do note that this is trained for primarily retrieval purposes. I am not sure how this will perform for general embedding tasks but it is an interesting architecture nonetheless. Here's something I quickly threw together:

The paper does a great job of explaining it in further detail.