is a group of researchers who study, analyze, and build various aspects of AI (including social) systems. Our work spans several areas - Applied Machine Learning, Responsible and Safe AI, Natural Language Processing, and Social Network Analysis. By understanding and measuring AI systems, we aim to develop solutions that contribute to the greater good of society.
LLMs have shown promise in legal NLP, but generating legal reasoning that is factually grounded, faithful to precedent, and consistent with judicial analysis remains difficult. Retrieval-augmented generation is often used to improve grounding, yet standard legal RAG faces two limitations: retrieved materials are hard to synthesize, and retrieval is driven by surface similarity rather than the latent legal issues and factual considerations that govern the analysis. We address these limitations with SCALE (Structured Case-law-guided Anticipatory Legal rEasoning), a framework for precedent-grounded legal reasoning. SCALE converts article-specific Case Law Guides into an Issue-Factor Hierarchy, identifies the issues and factors implicated by a case, retrieves the linked guide passages, and generates the final legal analysis. Across Llama-3.1 and Qwen3 models, expert evaluation shows that SCALE consistently outperforms prompt-only and retrieval-based baselines, with the largest gains in legal issue identification and precedent use. These gains are especially strong for smaller models, suggesting that explicit legal structure can compensate for weaker implicit reasoning capacity. We also compare expert assessment with an LLM-as-a-Judge framework and find only weak-to-moderate agreement, underscoring the limits of automated evaluation for high-stakes legal reasoning.
@inproceedings{khatri2026scalestructuredcaselawguided,title={SCALE: Structured Case-law-guided Anticipatory Legal Reasoning},author={Khatri, Mann and T.Y.S.S., Santosh and Ichim, Oana and Shah, Rajiv Ratn and Kumaraguru, Ponnurangam},year={2026},url={https://precog.iiit.ac.in/pubs/Mann_SCALE_Structured_Case_law.pdf},booktitle={The 2026 Conference on Empirical Methods in Natural Language Processing},saral={https://www.youtube.com/watch?v=n2YNF0hGhTU},}
EMNLP
PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues
Mohammad Rifqi
Farhansyah, Hanif Muhammad
Zhafran, Farid
Adilazuarda, Shamsuddeen Hassan
Muhammad, Maryam Ibrahim
Mukhtar, Nedjma
Ousidhoum, Sathwik
Reddy, Prashant
Kodali, Sunayana
Sitaram, Ponnurangam
Kumaraguru, Genta Indra
Winata, Ayu
Purwarianti, and Alham Fikri
Aji
In The 2026 Conference on Empirical Methods in Natural Language Processing, 2026
Code-switching is a widespread practice among the world’s multilingual majority, yet few benchmarks accurately reflect its complexity in everyday communication. We present PingPong, a benchmark for natural multi-party code-switching dialogues covering five language-combination variations, some of which are trilingual. Our dataset consists of human-authored conversations among 2 to 4 participants covering authentic, multi-threaded structures where replies frequently reference much earlier points in the dialogue. We demonstrate that our data is significantly more natural and structurally diverse than machine-generated alternatives, offering greater variation in message length, speaker dominance, and reply distance. Based on these dialogues, we define three downstream tasks: Question Answering, Dialogue Summarization, and Topic Classification. Evaluations of several state-of-the-art language models on PingPong reveal that performance remains limited on code-switched inputs, underscoring the urgent need for more robust NLP systems capable of addressing the intricacies of real-world multilingual discourse.
@inproceedings{farhansyah2026pingpongnaturalbenchmarkmultiturn,title={PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues},author={Farhansyah, Mohammad Rifqi and Zhafran, Hanif Muhammad and Adilazuarda, Farid and Muhammad, Shamsuddeen Hassan and Mukhtar, Maryam Ibrahim and Ousidhoum, Nedjma and Reddy, Sathwik and Kodali, Prashant and Sitaram, Sunayana and Kumaraguru, Ponnurangam and Winata, Genta Indra and Purwarianti, Ayu and Aji, Alham Fikri},year={2026},eprint={2601.17277},archiveprefix={arXiv},primaryclass={cs.CL},url={https://openreview.net/forum?id=ZJiYrAC6L3},booktitle={The 2026 Conference on Empirical Methods in Natural Language Processing},saral={https://youtu.be/09BIgv4LPvk},}
U&ME @ ECCV
MapRoute++: Surrogate-Guided Semantic Routing for Visual Concept Unlearning
Ashok
Urlana, L. D. M. S. Sai
Teja, Vivek Hruday
Kavuri, and Ponnurangam
Kumaraguru
In Unlearning and Model Editing (U&ME) Workshop at the 19th European Conference on Computer Vision (ECCV 2026), 2026
Secured 1st place in the Visual Concept Unlearning Challenge (Task 3 of the Genμ2.0 Challenge), outperforming the FADE baseline by 12.1% on average Erasing-Retention-Robustness score.
We present our submission to Task 3 of the Genμ2.0 Challenge on visual concept unlearning. Building on MapRoute, we introduce task-specific training objectives, richer concept representations, and semantic routing for concept-specific mapper selection. Our approach improves robust concept removal while preserving unrelated and semantically adjacent concepts. On the official benchmark, evaluated using the Erasing-Retention-Robustness (ERR) metric on Stable Diffusion v1.4, our method outperforms the state-of-the-art baseline by 12.1% on average across the five concept categories, achieving substantial gains.
@inproceedings{urlana2026maproutesurrogateguidedsemanticrouting,title={MapRoute++: Surrogate-Guided Semantic Routing for Visual Concept Unlearning},author={Urlana, Ashok and Teja, L. D. M. S. Sai and Kavuri, Vivek Hruday and Kumaraguru, Ponnurangam},year={2026},eprint={2608.13478},archiveprefix={arXiv},primaryclass={cs.CV},url={https://arxiv.org/abs/2608.13478},booktitle={Unlearning and Model Editing (U&ME) Workshop at the 19th European Conference on Computer Vision (ECCV 2026)},saral={https://youtu.be/2vFmIiW_90w},}
IEEE BigData
Labeling Copilot: A Deep Research Agent for Automated Data Curation in Computer Vision
Curating high-quality, domain-specific datasets is a major bottleneck for deploying robust vision systems, requiring complex trade-offs between data quality, diversity, and cost when researching vast, unlabeled data lakes. We introduce Labeling Copilot, the first data curation deep research agent for computer vision. A central orchestrator agent, powered by a large multimodal language model, uses multi-step reasoning to execute specialized tools across three core capabilities: (1) Calibrated Discovery sources relevant, in-distribution data from large repositories; (2) Controllable Synthesis generates novel data for rare scenarios with robust filtering; and (3) Consensus Annotation produces accurate labels by orchestrating multiple foundation models via a novel consensus mechanism incorporating non-maximum suppression and voting. Our large-scale validation proves the effectiveness of Labeling Copilot’s components. The Consensus Annotation module excels at object discovery: on the dense COCO dataset, it averages 14.2 candidate proposals per image-nearly double the 7.4 ground-truth objects-achieving a final annotation mAP of 37.1%. On the web-scale Open Images dataset, it navigated extreme class imbalance to discover 903 new bounding box categories, expanding its capability to over 1500 total. Concurrently, our Calibrated Discovery tool, tested at a 10-million sample scale, features an active learning strategy that is up to 40x more computationally efficient than alternatives with equivalent sample efficiency. These experiments validate that an agentic workflow with optimized, scalable tools provides a robust foundation for curating industrial-scale datasets.
@inproceedings{ganguly2025labelingcopilotdeepresearchagent,title={Labeling Copilot: A Deep Research Agent for Automated Data Curation in Computer Vision},author={Ganguly, Debargha and Kumar, Sumit and Balappanawar, Ishwar and Chen, Weicong and Kambhatla, Shashank and Iyengar, Srinivasan and Kalyanaraman, Shivkumar and Kumaraguru, Ponnurangam and Chaudhary, Vipin},year={2025},eprint={2509.22631},archiveprefix={arXiv},primaryclass={cs.CV},url={https://arxiv.org/abs/2509.22631},booktitle={2025 IEEE International Conference on Big Data (IEEE BigData 2025)},pages={142--151},}
ECCV
GridVQA-X: A Framework for Evaluating Multimodal Explainability Methods
With the increasing development of Vision-Language Models, it becomes imperative that their predictions are readily explainable to relevant stakeholders. However, the field of explainability has not kept pace with the multimodal surge. While recent Multimodal Explainable AI (MxAI) methods generate explanations to attribute the interaction between different modalities, current evaluation protocols lack the ground truth required to distinguish between true cross-modal reasoning (e.g., spatial composition) and shallow cross-modal shortcuts (e.g., Bag-of-Words attribute matching). It remains unknown whether MxAI methods faithfully capture synergistic interactions or merely hallucinate reasoning on models acting as simple feature detectors. In this paper, we introduce GridVQA-X, the first diagnostic framework specifically designed to evaluate cross-modal explainability. Unlike natural datasets, GridVQA-X leverages a closed-world synthesis logic to generate unique, mathematically guaranteed explanations. We utilize this controlled environment to train paired ground-truth models on identical architectures: Mpure, which learns robust spatial-relational reasoning and Mspur, which is structurally forced to rely on cross-modal shortcuts. This behavioral divergence creates a rigorous testbed: a faithful explainer must report distinct reasoning pathways for each model. Our findings reveal that widely used methods fail to distinguish between models relying on genuine spatial-relational reasoning and those exploiting cross-modal shortcuts, highlighting a critical gap in capturing true cross-modal synergy and misrepresenting how multimodal models actually make decisions.
@inproceedings{belsare2026gridvqaxframeworkevaluatingmultimodal,title={GridVQA-X: A Framework for Evaluating Multimodal Explainability Methods},author={Belsare, Sujay and Nikhil, Sudarshan and Kumar, Sushant and Kumaraguru, Ponnurangam and Agarwal, Chirag},year={2026},eprint={2606.14740},archiveprefix={arXiv},primaryclass={cs.CV},url={https://arxiv.org/abs/2606.14740},booktitle={The 19th European Conference on Computer Vision, ECCV 2026},saral={https://youtu.be/tMvj0xCeeis},}
Thank you for your interest in joining our team! We are always looking for talented and motivated individuals to join our team. If you are interested in working with us, please
apply here.