| Vol-4173 urn:nbn:de:0074-4173-x Copyright © 2025 for the individual papers by the papers' authors. Copyright © 2025 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).

# FIRE 2025
FIRE 2025 Working Notes

## Working Notes of FIRE 2025 - Forum for Information Retrieval Evaluation
co-located with 17th Forum for Information Retrieval Evaluation (FIRE)

## Varanasi, India, December 17-20, 2025

Edited by

### Kripabandhu Ghosh1
Thomas Mandl2
Sukomal Pal3
Srijoni Majumdar4
Anirban Chakraborty5

1 Indian Institute of Science Education and Research, Kolkata, India
2 Universität Hildesheim, Hildesheim, Germany
3 Indian Institute of Technology (BHU), Varanasi, India
4 University of Leeds, Leeds, UK
5 University of Wolverhampton, Wolverhampton, UK

## Table of Contents

- Preface

  There are 12 tracks co located with FIRE 2025. These 12 tracks are PROMID, MUSIA, CMIR, DravidianCodeMix, SqCLIR, IRSE, SciHigh, CLMIR, HASOC, CryptOQA, WILD and VATIKA. A total of 92 teams participated and had their papers accepted across these tracks. Each track includes an overview paper prepared by the program committee, which highlights the details of the shared tasks, the participating teams, and their results and analysis. In addition, every team submitted a working notes paper presenting its results for the respective shared task. Accordingly, this volume contains a total of 104 papers, comprising 12 overview papers and 92 working notes papers that have been accepted as part of the tasks.

### PROMID

Program Committee: Gautam Kishore Shahi, Asha Hegde, Shrey Satapara, Parth Mehta, Sandip Modha, Debasis Ganguly, Durgesh Nandini, H L Shashirekha, Amit Kumar Jaiswal, Gabriella Pasi, Thomas Mandl
Track Overview Paper: Overview of the First Shared Task on Prompt Recovery for Misinformation Detection (PROMID 2025)

- Overview of the First Shared Task on Prompt Recovery for Misinformation Detection (PROMID 2025) 1-14
  Gautam Kishore Shahi, Asha Hegde, Shrey Satapara, Parth Mehta, Sandip Modha, Debasis Ganguly, Durgesh Nandini, H L Shashirekha, Amit Kumar Jaiswal, Gabriella Pasi, Thomas Mandl
- Misinformation Detection in Social Media Texts and LLM Generated Text using Auxiliary Text Supervised Learning 15-25
  Kongqiang Wang, Peng Zhang, Qingli Tan
- Misinformation Detection in Multilingual Social Media Texts Using LLM-Based Translation Augmentation and DeBERTa Fine-Tuning 26-31
  Avinash Trivedi, Chindukuri Mallikarjuna
- A Social Media Misinformation Detection Model Integrating Semantic and Twitter Features 32-39
  Junwei Peng, Zijie Lin, Zhongyuan Han
- IndicBERTv2-MLM-only for Fine-Grained Misinformation Analysis in South Indian Languages 40-47
  N.V. Gokul, J. JeswinJoel, S. Gautham, J. Rajeswari
- A Lightweight Contrastive System for Misinformation Detection in Social Media Tweets 48-54
  Priyam Saha
- AURORA: Automated Understanding and Recognition of Omnilingual Misinformation Artefacts 55-62
  Kailasa Sai Charan, Utkrisht Suman, Roshan Jain, Jasneet Kaur, Shakshi Sharma
- Misinformation Detection in Russo-Ukrainian Conflict Tweets 63-70
  Thibault Ehrhart, Raphaël Troncy, Grégoire Burel, Harith Alani
- Misinformation Detection using ML 71-77
  Deepish Sharma, Yashvardhan Sharma
- Detecting 2022 Russo–Ukrainian Conflict Misinformation Using a Hybrid Transformer Approach 78-84
  Pratik Priyanshu
- Automated Detection of Misinformation on Twitter During the 2022 Russo–Ukrainian Conflict 85-88
  Sushma Kumari
- From Misrepresentation to Quantities: Labeling Misinformation Types in South Indian Language Summaries 89-100
  Rachana Nagaraju, Hosahalli Lakshmaiah Shashirekha

### MUSIA

Program Committee: Krishna Tewari, Anshita Malviya, Supriya Chanda, Arjun Mukherjee, Sukomal Pal
Track Overview Paper: Findings of the Shared Task on Multilingual Story Illustration: Bridging Cultures through AI Artistry (MUSIA)

- Findings of the Shared Task on Multilingual Story Illustration: Bridging Cultures through AI Artistry (MUSIA) 101-112
  Krishna Tewari, Anshita Malviya, Supriya Chanda, Arjun Mukherjee, Sukomal Pal
- Leveraging Large Language Model(LLM) and V-LLM for Zero-Shot Multilingual Story Illustration 113-120
  Kishan Kachhadiya, Parth Patel
- Multilingual Story Illustration for MUSIA 2025 using One-Prompt-One-Story Image Generation 121-129
  Sharma Nandini Surendra, Divya
- NarrArt: Multilingual Story Illustration with AI for English and Hindi Narratives 130-138
  Mrinmoy Sadhukhan, Indrajit Bhattacharya, Paramartha Dutta
- Bridging Cultures through AI: The Art of Multilingual Storytelling 139-143
  Shazia Mannan, Asha Hegde, Sharal Coelho

### CMIR

Program Committee: Supriya Chanda, Krishna Tewari, Sukomal Pal
Track Overview Paper: Findings of the Code-Mixed Information Retrieval from Social Media Data (CMIR) Shared Task at FIRE 2025

- Findings of the Code-Mixed Information Retrieval from Social Media Data (CMIR) Shared Task at FIRE 2025 144-152
  Supriya Chanda, Krishna Tewari, Sukomal Pal
- Model Fusion for Bridging Linguistic Variability in Bengali-English Code-Mixed Information Retrieval 153-160
  Rachana Nagaraju, Hosahalli Lakshmaiah Shashirekha
- From Romanised to Relevant: Multistage Information Retrieval for Code-Mixed Multilingual Queries 161-175
  Lakshay Sawhney, Sumit Goswami
- LexiSemIR: A Two-Stage Re-ranking Framework with BM25 and Zero-Shot Bi-Encoder 176-185
  Swati Gupta, Tanusree Nath, Vedika Gupta, Manjari Gupta
- A Multi-Model Lexical Fusion Approach for English–Bengali Code-Mixed Information Retrieval 186-193
  Kunal Chakma, Subhajit Datta
- Code-Mixed IR: An Ensemble Approach to Robust Ranking Models 194-198
  Amrithkala M Shetty, Asha Hegde, Sharal Coelho
- Reciprocal Rank Fusion Based Hybrid Dense–Sparse Information Retrieval on Code-Mixed Banglish Social Media Text 199-207
  Burhanuddin Merchant, Ashwaq Khazi, Sheetal S. Sonawane
- CoLIR: Late Interaction based Code-Mixed Information Retrieval for English-Bengali language pair 208-214
  Devansh Shroff
- Decoding Benglish: Scalable Information Retrieval for Transliterated Code-Mixed Conversations 215-224
  Harsh Mishra, Ramya Sharma, Naina Yadav

### Dravidian Code Mix

Program Committee: Sripriya N, Bharathi Raja Chakravarthi, Thenmozhi Durairaj, Bharathi B, Prasanna Kumar Kumaresan, Subalalitha C N, Anusha M D, Parameshwar R Hegde, Deepthi Vikram
Track Overview Paper: Overview of the shared task on Offensive Language Identification in Dravidian code-Mixed Languages

- Overview of the shared task on Offensive Language Identification in Dravidian code-Mixed Languages 225-233
  Sripriya N, Bharathi Raja Chakravarthi, Thenmozhi Durairaj, Bharathi B, Prasanna Kumar Kumaresan, Subalalitha C N, Anusha M D, Parameshwar R Hegde, Deepthi Vikram
- A TriFusion Model for Offensive Language Detection in Dravidian Code-Mixed Text 234-240
  Raksha Adyanthaya, Rathnakara Shetty P
- DravidianCodeMix 2025: Comparative Study of Transformer-based Models for Offensive Content Detection in Tamil Malayalam Kannada and Tulu Code-Mixed Texts 241-248
  Santhiya P, Akshitha A V, Arul Murugan, Chandran T
- DravidianCodeMix 2025: Empirical Analysis of Classical Machine Learning Approaches in Tamil Malayalam and Tulu Code-Mixed Offensive Content Classification 249-256
  Shudapreyaa R S, Surya U S, Swetha M, Sandeep P S
- Multilingual Pretrained Models for Offensive Language Identification in Dravidian Code-Mixed Text 257-262
  Asha Hegde, Amrithkala M Shetty, Shazia Mannan, Sharal Coelho
- DravidianCodeMix 2025: Offensive Content Classification in Kannada–Tulu Code-Mixed Texts Using Classical Machine Learning 263-271
  Santhiya P, Anand S, Archna V, Debehaa J
- Exploring Classical Machine Learning and Deep Learning Approaches for Offensive Language Identification in Dravidian Code-Mixed Text 272-285
  Rachana Nagaraju, Hosahalli Lakshmaiah Shashirekha
- OffenSwitch: Decoding Toxicity in Dravidian Code-Mixing with Transformers 286-292
  Krishna Tewari, Supriya Chanda, K Abhinay Paul

### SqCLIR

Program Committee: Bhargav Dave, Prasenjit Majumder, Debasis Ganguly, Evangelos Kanoulas
Track Overview Paper: Overview of the Second Shared Task on Spoken Query Cross-Lingual Information Retrieval for Indic Languages SqCLIR at FIRE 2025

- Overview of the Second Shared Task on Spoken Query Cross-Lingual Information Retrieval for Indic Languages SqCLIR at FIRE 2025 293-298
  Bhargav Dave, Prasenjit Majumder, Debasis Ganguly, Evangelos Kanoulas
- Spoken-Query Cross-Lingual Information Retrieval for the Indic Languages (SqCLIR) using BM25 and Indic-BERT 299-306
  Pranesh TT, Thamizhmathi KK, Bharathi B

### IRSE

Program Committee: Adwita Deshpande, Aritra Maji, Diganta Mondal, Partha Pratrim Das, Paul D. Clough, Srijoni Majumdar
Track Overview Paper: Overview of the IRSE track at FIRE 2025: Information Retrieval in Software Engineering

- Overview of the IRSE track at FIRE 2025: Information Retrieval in Software Engineering 307-311
  Adwita Deshpande, Aritra Maji, Diganta Mondal, Partha Pratim Das, Paul D. Clough, Srijoni Majumdar
- Automated Classification of C Code Comment Quality with SVM and Naïve Bayes 312-318
  Kumar Shresth
- Enhanced Code Comment Relevance Classification Using Domain-Adaptive CodeBERT with Masked Language Modeling 319-325
  L. Simiyon Vinscent Samuel, Sundareswaran Rajaguru, Vijayaraaghavan K. S, A. Vijayalakshmi
- Identification of the Relevance of Comments in Codes Using Graph Neural Networks 326-331
  Durairaj Thenmozhi, Aadit P, Adithya S, Harshil Malisetty, Rohan R
- Applications of LLMs for Code Analysis 332-337
  Adwita Deshpande
- Investigating the Impact of Synthetic Data on Code Comment Quality Prediction: A Logistic Regression Study 338-344
  Subhajit Dutta
- An Empirical Study on Synthetic Data Augmentation for Code Comment Quality Classification 345-350
  Lakshay Khurana
- Automated Assessment of Code Comment Quality 351-356
  Hard Kapadia
- Categorizing Code Comments based on its Relevance for Code Readability 357-361
  Kashvi Aggarwal
- Using Silver-Standard Machine Learning Models to Determine Usefulness of C Comments 362-367
  Aritra Mitra
- Learning to Judge Code Comments: Machine Learning for Documentation Utility 368-374
  Diganta Mandal
- Scoring with Intelligence: Prompting GPT-3.5 Turbo for Better Code Retrieval 375-380
  Ritabrata Bharati
- Using SVM and Naïve Bayes Classifier to Assess the Utility of C Comments 381-386
  Anamitra Mukhopadhyay
- Leveraging Artificial Intelligence for Automated Software Documentation Assessment: A Machine Learning Approach to Code Comment Evaluation 387-397
  Aritra Maji
- Evaluating the Efficacy of Synthetic Data for Source Code Comment Classification 398-403
  Lakshya Yadav

### SciHigh

Program Committee: Tohida Rehman, Debarshi Kumar Sanyal, Samiran Chattopadhyay
Track Overview Paper: Generating Research Highlights from Scientific Literature: Findings from the FIRE 2025 SciHigh Track

- Generating Research Highlights from Scientific Literature: Findings from the FIRE 2025 SciHigh Track 404-413
  Tohida Rehman, Debarshi Kumar Sanyal, Samiran Chattopadhyay
- Leveraging Transformers for Structured Highlight Generation in Scientific Literature 414-421
  Rachana Nagaraju, Hosahalli Lakshmaiah Shashirekha
- Hybrid Transformer-Based Summarization for Scientific Highlight Generation Using the MixSub-SciHigh Dataset 422-435
  Harsh Mishra, Rama Kant Kumar, Naina Yadav
- Automatic Scientific Summarization: A Neural Approach to Research Highlight Generation 436-444
  Ayanika Samanta, Tohida Rehman
- Entity and Keyword Guided Highlight Generation from Scientific Abstracts Using Large Language Models 445-458
  Nishalini K, Sreenath K A, Anand Kumar M, Navya Binu
- Automating Scientific Highlight Generation with Transformer Models 459-468
  Sangita Singh, Navya Sinha, Jyoti Prakash Singh
- Highlight Generation from Scientific Papers Using XGBoost Regressor Model 469-479
  Papun Roy, Kamal Sarkar
- Transformer-based models for generating research highlights from scientific articles 480-488
  Gowni Bhavishya, Siba Sankar Sahu
- Knowledge Extraction: Pegasus-driven Summarization for Research Dissemination 489-494
  Asha Hegde, Sharal Coelho, Joiesmary D’Souza
- From Abstract to Highlight: Automatic Research Highlight Generation 495-503
  Anindita Bhattacharya, Tohida Rehman

### CLMIR

Program Committee: Ayushi Malik, Pankaj Dadure, Sahinur Rahman Laskar
Track Overview Paper: Overview of Cross-Lingual Mathematical Information Retrieval at FIRE 2025

- Overview of Cross-Lingual Mathematical Information Retrieval at FIRE 2025 504-510
  Ayushi Malik, Pankaj Dadure, Sahinur Rahman Laskar
- Enhancing Multilingual Mathematical Document Retrieval: A Hindi-to-English Translation and ColBERT-based Approach 511-517
  Ayush Sur, Venkatesh Shukla, Aditya Rai, Lucky Garg
- Math Beyond Language Barriers: Retrieving Mathematical Content using Sentence Transformers 518-523
  Sharal Coelho, Asha Hegde, Mohammed Zaher Taljeh, Amaan Ahmad
- MIRaCLE: Multilingual Information Retrieval with Cross-Lingual Embeddings for Mathematical Expressions 524-534
  Krishna Tewari, Supriya Chanda, Riti Tripathi
- Cross-Lingual Mathematical Information Retrieval with BM25 and LLM-based Pointwise Re-ranking 535-542
  Kishan Kachhadiya, Parth Patel

### HASOC

Program Committee: Koyel Ghosh, Mithun Das, Shubhankar Barman, Mwnthai Narzary, Saptarshi Saha, Animesh Mukherjee, Sandip Modha, Debasis Ganguly, Utpal Garain, Sylvia Jaki, Thomas Mandl
Track Overview Paper: Overview of the HASOC Track at FIRE 2025: Abusive Meme Identification — Shadows Behind the Laughter

- Overview of the HASOC Track at FIRE 2025: Abusive Meme Identification — Shadows Behind the Laughter 543-557
  Koyel Ghosh, Mithun Das, Shubhankar Barman, Mwnthai Narzary, Saptarshi Saha, Animesh Mukherjee, Sandip Modha, Debasis Ganguly, Utpal Garain, Sylvia Jaki, Thomas Mandl
- Hate Speech and Offensive Content Identification in Memes in Bangla Hindi and Gujarati using Auxiliary Text Supervised Learning 558-573
  Kongqiang Wang, Qingli Tan
- Hate Speech and Offensive Content Identification in Memes in Hindi and Gujarati using BERT-Based Approach 574-585
  Peng Zhang, Gehao Lu
- Bodo Meme Classification using Multimodal Fusion and Oversampling in HASOC-2025 586-595
  Pankaj Dadure, Sourav Ghosh
- Hateful and Offensive Meme Detection in Multimodal Memes Dataset for Indo-Aryan Languages 596-607
  Aarsh Sarvaiya, Tripti Kumari, Ayan Das
- FusionGuard: Visual-Linguistic Representations for Multilingual Harmful Content Detection 608-617
  Arunabha Basak, Samujjal Choudhury, Anshita Malviya, Bidyut Kr. Patra, Pratik Chattopadhyay
- HASOC-Meme: Enhancing Hate Speech Recognition in Bengali Hindi Gujarati and Bodo Memes Using Multimodal Multitask Transformers 618-624
  Asha Hegde, Sharal Coelho, Amrithkala M Shetty
- FAST-HASOC 2025: Multimodal and Multilingual Approaches for Hate Speech and Offensive Content Detection in Hindi Memes 625-631
  Muhammad Rafi, Saif Ur Rehman Awan, Ramsha Jat, Aiman Falak, Fatimah Ansari, Ahmed Raza, Sagar Chabbriya
- Bridging Modalities for Hate Speech Detection in Memes 632-641
  Fadi Hassan, Evgenii Migaev, Md Saroar Jahan, Frank Mtumbuka
- Hate Speech and Offensive Content Identification in Memes in Bangla Hindi and Bodo 642-653
  Tanmoy Paul, Anupam Jamatia
- A Multi-Modal Ensemble Approach for Hate Speech and Offensive Content Detection in Indic Memes 654-665
  Radhika Bohra, Yashvardhan Sharma
- Multilingual Hate Speech Classification in Memes Using OCR-Extracted Text and Visual Features 666-677
  Subham Kumar Rai, Kunal Goswami, Gunjan Kumar, Sangita Singh, J.P. Singh
- A Transformer-based approach to Multimodal Hateful Meme Classification 678-687
  Sharad Prakash, Upkar Kumar Kedia, Kirti Kumari, Kushagra Prakash, Trishant Kumar
- Multimodal Hate Speech and Offensive Content Classification in Code-Mixed Indian Language Memes 688-694
  Sai Saketh Nandam, Anand Kumar Madasamy
- Towards Safer Social Media: Multimodal Hate Speech Detection in Memes across Diverse Indian Languages 695-707
  Rachana Nagaraju, Hosahalli Lakshmaiah Shashirekha
- SAViOR: Sentiment Sarcasm Abuse and Vulgarity in Online Realities (Memes) 708-717
  Krishna Tewari, Supriya Chanda, Aditya Namdeo, Sukomal Pal
- A Transformer-based model for hate speech detection in low resource Indian languages 718-729
  Jaimin Damor, Siba Sankar Sahu

### CryptOQA

Program Committee: Dhruv Kumar, Somrupa Sarkar, Koustav Rudra, Kripabandhu Ghosh
Track Overview Paper: Overview of CryptOQA: Opinion Extraction and Question Answering from CryptoCurrency-Related Tweets Reddit and Youtube Posts

- Overview of CryptOQA: Opinion Extraction and Question Answering from CryptoCurrency-Related Tweets Reddit and Youtube Posts 730-738
  Dhruv Kumar, Somrupa Sarkar, Koustav Rudra, Kripabandhu Ghosh
- Transformer-Based Multi-Task Text Classification of Cryptocurrency Social Media Text with DeBERTaV3-Small 739-752
  V. T. Rushi Kannan, Sara Renjit
- Hierarchical Opinion Classification using Large Language Models 753-772
  Shuvam Banerji Seal, Alok Mishra, Utkarsha Ghosh
- Transformer based Opinion Classification of Cryptocurrency Posts 773-778
  C.Jerin Mahibha, Wordson Robert, Gersome Shimi, Durairaj Thenmozhi
- Exploring Crypto Narratives: Developing Approaches for Opinion Extraction and Question Answering in Social Media Text 779-787
  Asha Hegde, Sharal Coelho, Krishna Tewari
- Crypto social media analysis: Deep learning framework for Text Classification and Question Answering 788-798
  Jay Vaghela, Siba Sankar Sahu

### WILD

Program Committee: Asha Hegde, Fazlourrahman Balouchzahi, Sabur Butt, Sharal Coelho, Sudha V, Shashirekha Hosahalli Lakshmaiah, Ameeta Agrawal
Track Overview Paper: Overview of CoLI-Dravidian 2025: Word-level Code-Mixed Language Identification in Dravidian Languages

- Overview of CoLI-Dravidian 2025: Word-level Code-Mixed Language Identification in Dravidian Languages 799-805
  Asha Hegde, Fazlourrahman Balouchzahi, Sabur Butt, Sharal Coelho, Sudha V, Shashirekha Hosahalli Lakshmaiah, Ameeta Agrawal
- Dravidian Language Identification Model 806-813
  Sruthi Santhanam, Yashvardhan Sharma
- Exploring Language-Specific Characteristics for Word-level Language Identification in Dravidian Languages 814-825
  Rachana Nagaraju, H L Shashirekha
- Transformer Driven Word Level Classification of Dravidian Languages 826-834
  C.Jerin Mahibha, Wordson Robert, Gersome Shimi, Durairaj Thenmozhi
- Word-level Language Identification using Character-level Features 835-839
  Amaan Ahmad, Asha Hegde, Sharal Coelho
- GraMLID: GRU-Assisted Multilingual BERT for Word-Level Language Identification in Low-Resource Dravidian Texts 840-849
  Krishna Tewari, Supriya Chanda, Suhani Verma

### VATIKA

Program Committee: Praveen Gatla, Anushka, Nabanita Sadhukhan, Rajesh Kumar Mundotiya
Track Overview Paper: Towards Indian Intelligent Tourism Assistance: Design and Evaluation of the VATIKA QA Dataset

- Towards Indian Intelligent Tourism Assistance: Design and Evaluation of the VATIKA QA Dataset 850-855
  Praveen Gatla, Anushka, Nabanita Sadhukhan, Rajesh Kumar Mundotiya
- VA-BO-INTERN: Adapting Small Language Models to Low-Resource Domains: A Case Study in Hindi Tourism QA 856-862
  Sandipan Majhi, Paheli Bhattacharya
- TIRTHA: Tourism Information Retrieval and Text-based Hindi Answering 863-870
  Krishna Tewari, Supriya Chanda, Aarya Chaturvedi
- VATIKA-QA: A Hybrid BERT-IndicBART Approach for Hindi Question Answering in Tourism Domain 871-879
  Prudvi Kumar Reddy Narreddi Subbannagari, Avanish S Velidi, Anand Kumar Madasamy
- VATIKA: A Hindi Machine Reading Comprehension Approach for Varanasi Tourism Question Answering using mT5 880-888
  Harsh Mishra, Naina Yadav, Nirbhay Kumar Tagore, Ramakant Kumar
- SVNIT_CSE: Building a question answering system for Hindi using word-embedding 889-899
  Ankur Jariwala, Siba Sankar Sahu
- Hindi Tourism QA System: Low-Resource Question Answering using MT5-small 900-905
  Asha Hegde, Sharal Coelho, Amrithkala M Shetty, Mohammed Zaher Taljeh
- MUCS@ - Question Answering in Hindi for Tourism: Evaluation of Transformer-Based Approaches on VATIKA 906-913
  Rachana Nagaraju, Hosahalli Lakshmaiah Shashirekha
- Varanasi Tourism in Question Answer System Track:IIIT SURAT @ FIRE’25 Shared Task 914-917
  Ritesh Kumar, Sumit Chand Jaiswal, Dhiraj Bhatia

2026-01-15: submitted by Srijoni Majumdar, metadata incl. bibliographic data published under Creative Commons CC0
2026-02-24: published on CEUR Workshop Proceedings (CEUR-WS.org, ISSN 1613-0073) |valid HTML5|