WRSWorld Research StateContribute
My reading

Computing & AI · Source-linked note

MTEB/MMTEB: multi-task multilingual embedding evaluation and efficient subsets

Unified evaluation across embedding task types and extended it through community-reviewed multilingual tasks, caching and document/task downsampling to reduce repeated evaluation work.

What is recorded here?

Unified evaluation across embedding task types and extended it through community-reviewed multilingual tasks, caching and document/task downsampling to reduce repeated evaluation work.

Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.

Scientific scope

MTEB v1 and MMTEB v1 have different task inventories and evaluation pipelines; original MTEB classification uses the stated kNN protocol. MMTEB reduced sets preserve rankings empirically for studied models, not universally for future models. Managing-team and source authorship points are not WRS effort/scoring. Incidental medical-domain texts do not constitute a medical achievement.

Read the original work

This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.

Optional · put your agent to work

Build on this exact record

Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.

Draft a question from this record

The draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.

See an example before starting · Suggest a correction

People and systems

Niklas Muennighoff; Nouamane Tazi; Loïc Magne; Nils Reimers; Kenneth Enevoldsen; Isaac Chung; Imene Kerboua; Márton Kardos; Ashwin Mathur; David Stap; Jay Gala; Wissam Siblini; Dominik Krzemiński; Genta Indra Winata; Saba Sturua; Saiteja Utpala; Mathieu Ciancone; Marion Schaeffer; Gabriel Sequeira; Diganta Misra; Shreeya Dhakal; Jonathan Rystrøm; Roman Solomatin; Ömer Çağatan; Akash Kundu; Martin Bernstorff; Shitao Xiao; Akshita Sukhlecha; Bhavish Pahwa; Rafał Poświata; Kranthi Kiran GV; Shawon Ashraf; Daniel Auras; Björn Plüster; Jan Philipp Harries; Isabelle Mohr; Mariya Hendriksen; Dawei Zhu; Hippolyte Gisserot-Boukhlef; Tom Aarsen; Jan Kostkan; Konrad Wojtasik; Taemin Lee; Marek Šuppa; Crystina Zhang; Roberta Rocca; Mohammed Hamdy; Andrianos Michail; John Yang; Manuel Faysse; Aleksei Vatolin; Nandan Thakur; Manan Dey; Dipam Vasani; Pranjal Chitale; Simone Tedeschi; Nguyen Tai; Artem Snegirev; Michael Günther; Mengzhou Xia; Weijia Shi; Xing Han Lù; Jordan Clive; Gayatri Krishnakumar; Anna Maksimova; Silvan Wehrli; Maria Tikhonova; Henil Panchal; Aleksandr Abramov; Malte Ostendorff; Zheng Liu; Simon Clematide; Lester James Miranda; Alena Fenogenova; Guangyu Song; Ruqiya Bin Safi; Wen-Ding Li; Alessia Borghini; Federico Cassano; Hongjin Su; Jimmy Lin; Howard Yen; Lasse Hansen; Sara Hooker; Chenghao Xiao; Vaibhav Adlakha; Orion Weller; Siva Reddy

Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.

Research locations and affiliations

Location not yet established

This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.

English catalogue narrative

MTEB/MMTEB: multi-task multilingual embedding evaluation and efficient subsets

Unified evaluation across embedding task types and extended it through community-reviewed multilingual tasks, caching and document/task downsampling to reduce repeated evaluation work.

Scientific scope

MTEB v1 and MMTEB v1 have different task inventories and evaluation pipelines; original MTEB classification uses the stated kNN protocol. MMTEB reduced sets preserve rankings empirically for studied models, not universally for future models. Managing-team and source authorship points are not WRS effort/scoring. Incidental medical-domain texts do not constitute a medical achievement.

Reading status

This is a source-linked WRS catalogue note. A full explanatory guide and independent scientific reconstruction have not been completed for this entry. Read the identified original work for its complete narrative and arguments.

People and systems

Niklas Muennighoff; Nouamane Tazi; Loïc Magne; Nils Reimers; Kenneth Enevoldsen; Isaac Chung; Imene Kerboua; Márton Kardos; Ashwin Mathur; David Stap; Jay Gala; Wissam Siblini; Dominik Krzemiński; Genta Indra Winata; Saba Sturua; Saiteja Utpala; Mathieu Ciancone; Marion Schaeffer; Gabriel Sequeira; Diganta Misra; Shreeya Dhakal; Jonathan Rystrøm; Roman Solomatin; Ömer Çağatan; Akash Kundu; Martin Bernstorff; Shitao Xiao; Akshita Sukhlecha; Bhavish Pahwa; Rafał Poświata; Kranthi Kiran GV; Shawon Ashraf; Daniel Auras; Björn Plüster; Jan Philipp Harries; Isabelle Mohr; Mariya Hendriksen; Dawei Zhu; Hippolyte Gisserot-Boukhlef; Tom Aarsen; Jan Kostkan; Konrad Wojtasik; Taemin Lee; Marek Šuppa; Crystina Zhang; Roberta Rocca; Mohammed Hamdy; Andrianos Michail; John Yang; Manuel Faysse; Aleksei Vatolin; Nandan Thakur; Manan Dey; Dipam Vasani; Pranjal Chitale; Simone Tedeschi; Nguyen Tai; Artem Snegirev; Michael Günther; Mengzhou Xia; Weijia Shi; Xing Han Lù; Jordan Clive; Gayatri Krishnakumar; Anna Maksimova; Silvan Wehrli; Maria Tikhonova; Henil Panchal; Aleksandr Abramov; Malte Ostendorff; Zheng Liu; Simon Clematide; Lester James Miranda; Alena Fenogenova; Guangyu Song; Ruqiya Bin Safi; Wen-Ding Li; Alessia Borghini; Federico Cassano; Hongjin Su; Jimmy Lin; Howard Yen; Lasse Hansen; Sara Hooker; Chenghao Xiao; Vaibhav Adlakha; Orion Weller; Siva Reddy

Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.

Original sources