LES Leaderboard – Slovene Embedding Benchmark

Lestvica embeddingov za slovenščino

Comparing embedding models on Slovene NLP tasks

Rank	Model	Parameters	Context Window	Score	Classification	Clustering	Retrieval
🥇	google/gemini-embedding-001	-	2,048	58.12	58.97	22.61	92.77
🥈	Qwen/Qwen3-Embedding-8B🤗	8B	32,768	55.72	53.33	23.53	90.30
🥉	Snowflake/snowflake-arctic-embed-l-v2.0🤗	0.6B	8,192	55.63	52.35	23.94	90.59
4	openai/text-embedding-3-large	-	8,192	55.58	55.71	24.37	86.66
5	BAAI/bge-m3🤗	560M	8,192	55.08	52.45	22.65	90.15
6	Qwen/Qwen3-Embedding-4B🤗	4B	32,768	55.05	51.96	24.48	88.73
7	intfloat/multilingual-e5-large-instruct🤗	0.6B	512	54.08	52.76	23.93	85.55
8	Alibaba-NLP/gte-multilingual-base🤗	0.3B	8192	53.52	50.64	24.27	85.63
9	openai/text-embedding-3-small	-	8,192	53.37	52.07	23.80	84.24
10	google/text-multilingual-embedding-002	–	–	52.49	50.80	18.67	88.01
11	google/embeddinggemma-300m🤗	0.3B	2,048	51.56	49.34	23.04	82.31
12	Lajavaness/bilingual-embedding-small🤗	0.1B	512	50.95	48.49	23.08	81.26
13	intfloat/multilingual-e5-small🤗	0.1B	512	50.41	47.64	20.85	82.72
14	Qwen/Qwen3-Embedding-0.6B🤗	0.6B	32,768	50.11	46.61	21.16	82.55
15	sentence-transformers/paraphrase-multilingual-mpnet-base-v2🤗	0.3B	512	46.27	51.15	21.28	66.40
16	sentence-transformers/LaBSE🤗	0.5B	512	44.71	48.85	19.86	65.43
17	cjvt/GaMS-1B🤗	1B	2,048	43.30	55.29	27.83	46.78
18	google/text-embedding-005	–	–	41.91	39.52	15.41	70.80
19	intfloat/e5-large-v2🤗	0.3B	512	39.79	39.85	15.49	64.03
20	Snowflake/snowflake-arctic-embed-l🤗	0.3B	8,192	37.55	38.25	13.62	60.77
21	NovaSearch/stella/en/400M/v5🤗	0.4B	8,192	35.43	41.60	17.92	46.78
22	intfloat/e5-small-v2🤗	~33M	512	33.93	35.95	14.15	51.70
23	cjvt/GaMS-2B🤗	2B	-	29.87	50.13	21.39	18.08
24	EMBEDDIA/sloberta🤗	~110M	512	28.29	49.81	18.55	16.52
25	sentence-transformers/all-MiniLM-L6-v2🤗	22.7M	512	25.67	32.66	14.60	29.76

🥇 1st🥈 2nd🥉 3rdBold = best in column

Scores are shown as percentages

About the Overall score

The overall score is the mean of the main Classification, Retrieval, and Clustering scores.

📝Read the Blog Post

Lestvica embeddingov za slovenščino

Thanks to Our Data Providers