CMIR-2025

Code Mixed Information Retrieval

Results

Results

NOTE: The results displayed below are not sorted based on final ranking. Some teams submitted their prediction files in an incorrect format. We have requested them to resend their files in the proper format. Once all valid submissions are received, we will prepare and publish the final ranked list.

Team Name

Submission file

MAP Score

ndcg Score

p@5 Score

p@10 Score

AiNauts

Run 1

0.043466

0.105056

0.12

0.08

AiNauts

Run 2

0.034908

0.10227

0.086667

0.076667

AiNauts

Run 3

0.054379

0.152751

0.173333

0.13

AiNauts

Run 4

0.008905

0.035781

0.013333

0.06

AiNauts

Run 5

0.026915

0.077313

0.086667

0.066667

Defense_NLP

Run 1

0.178594

0.366472

0.373333

0.29

Defense_NLP

Run 2

0.187175

0.376756

0.393333

0.276667

NITA_CMIR

Run 1

0.151773

0.415057

0.3

0.236667

MUCS

Run 1

0.081828

0.292136

0.213333

0.156667

MUCS

Run 2

0.211792

0.485517

0.42

0.3

MUCS

Run 3

0.211792

0.485517

0.42

0.3

MixMatch IR

Run 1

0.123289

0.37562

0.293333

0.21

MixMatch IR

Run 2

0.110594

0.318225

0.233333

0.166667

IRSolver

Run 1

0.063702

0.147071

0.226667

0.156667

IRSolver

Run 2

0.05711

0.139316

0.206667

0.156667

CodeWeavers

Run 1

0.15627

0.341038

0.28

0.23

CodeWeavers

Run 2

0.154625

0.276684

0.38

0.283333

NLPFusion

Run 1

0.136089

0.319129

0.286667

0.233333

NLPFusion

Run 2

0.136089

0.319129

0.286667

0.233333

NLPFusion

Run 3

0.136089

0.319129

0.286667

0.233333

NLPFusion

Run 4

0.092505

0.246699

0.233333

0.17

NLPFusion

Run 5

0.092505

0.246699

0.233333

0.17

Contact us

For any queries write to us at cmir.iitbhu@gmail.com