WRSWorld Research StateContribute
My reading

Computing & AI · Source-linked note

Jiang and colleagues: Mixtral 8x7B sparse mixture-of-experts model

Released and evaluated Mixtral 8x7B, routing each token through two of eight feed-forward experts per layer with a reduced active-parameter count.

What is recorded here?

Released and evaluated Mixtral 8x7B, routing each token through two of eight feed-forward experts per layer with a reduced active-parameter count.

Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.

Scientific scope

The company announced the model in December 2023; this record uses the January 2024 paper year. Reported benchmark comparisons are setup-specific.

Read the original work

This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.

Optional · put your agent to work

Build on this exact record

Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.

Draft a question from this record

The draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.

See an example before starting · Suggest a correction

People and systems

Albert Q. Jiang; Alexandre Sablayrolles; Antoine Roux; Arthur Mensch; Blanche Savary; Chris Bamford; Devendra Singh Chaplot; Diego de las Casas; Emma Bou Hanna; Florian Bressand; Gianna Lengyel; Guillaume Bour; Guillaume Lample; Lélio Renard Lavaud; Lucile Saulnier; Marie-Anne Lachaux; Pierre Stock; Sandeep Subramanian; Sophia Yang; Szymon Antoniak; Teven Le Scao; Théophile Gervet; Thibaut Lavril; Thomas Wang; Timothée Lacroix; William El Sayed

Complete named paper byline. Human research, source-reported system execution and experimental validation are distinct; individual effort shares are not measured.

Research locations and affiliations

Location not yet established

This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.

English catalogue narrative

Jiang and colleagues: Mixtral 8x7B sparse mixture-of-experts model

Released and evaluated Mixtral 8x7B, routing each token through two of eight feed-forward experts per layer with a reduced active-parameter count.

Scientific scope

The company announced the model in December 2023; this record uses the January 2024 paper year. Reported benchmark comparisons are setup-specific.

Reading status

This is a source-linked WRS catalogue note. A full explanatory guide and independent scientific reconstruction have not been completed for this entry. Read the identified original work for its complete narrative and arguments.

People and systems

Albert Q. Jiang; Alexandre Sablayrolles; Antoine Roux; Arthur Mensch; Blanche Savary; Chris Bamford; Devendra Singh Chaplot; Diego de las Casas; Emma Bou Hanna; Florian Bressand; Gianna Lengyel; Guillaume Bour; Guillaume Lample; Lélio Renard Lavaud; Lucile Saulnier; Marie-Anne Lachaux; Pierre Stock; Sandeep Subramanian; Sophia Yang; Szymon Antoniak; Teven Le Scao; Théophile Gervet; Thibaut Lavril; Thomas Wang; Timothée Lacroix; William El Sayed

Complete named paper byline. Human research, source-reported system execution and experimental validation are distinct; individual effort shares are not measured.

Original sources