Preprints

Bias Testing and Mitigation in Black Box LLMs using Metamorphic Relations

Sina Salimian, Gias Uddin, Sumon Biswas, Henry Leung

ACM Transactions on Software Engineering and Methodology (Preprint) 2026

Conference and Journal Papers

2026

What Breaks When LLMs Code? Characterizing Operational Safety Failures of Agentic Code Assistants

Alif Al Hasan, Sumon Biswas

41st IEEE/ACM International Conference on Automated Software Engineering (ASE) 2026

ReShift: Aha-Moment-Driven Reasoning-Level Backdoor Attacks on Vision–Language Models

Zhihao Dou, Qinjian Zhao, Zhiqiang Gao, Sumon Biswas

European Conference on Computer Vision (ECCV) 2026

Plan Then Action: High-Level Planning Guidance Reinforcement Learning for LLM Reasoning

Zhihao Dou, Qinjian Zhao, Zhongwei Wan, Dinggen Zhang, Weida Wang, Towsif Raiyan, Benteng Chen, Qingtao Pan, Yang Ouyang, Zhiqiang Gao, Shufei Zhang, Sumon Biswas

43rd International Conference on Machine Learning (ICML) 2026

2025

FairSense: Long-Term Fairness Analysis of ML-Enabled Systems

Yining She, Sumon Biswas, Christian Kästner, Eunsuk Kang

47th IEEE/ACM International Conference on Software Engineering (ICSE) 2025

2024

Are Prompt Engineering and TODO Comments Friends or Foes? An Evaluation on GitHub Copilot

David O’Brien, Sumon Biswas, Sayem Imtiaz, Rabe Abdalkareem, Emad Shihab, Hridesh Rajan

46th IEEE/ACM International Conference on Software Engineering (ICSE) 2024

2023

Towards Safe ML-Based Systems in Presence of Feedback Loops

Sumon Biswas, Yining She, Eunsuk Kang

International Workshop on Dependability and Trustworthiness of Safety-Critical Systems with Machine Learned Components, ESEC/FSE (SE4SafeML) 2023

Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoML

Giang Nguyen, Sumon Biswas, Hridesh Rajan

31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE) 2023

Fairify: Fairness Verification of Neural Networks

Sumon Biswas, Hridesh Rajan

45th IEEE/ACM International Conference on Software Engineering (ICSE) 2023

Towards Understanding Fairness and its Composition in Ensemble Machine Learning

Usman Gohar, Sumon Biswas, Hridesh Rajan

45th IEEE/ACM International Conference on Software Engineering (ICSE) 2023

2022

23 Shades of Self-Admitted Technical Debt: An Empirical Study on Machine Learning Software

David O’Brien, Sumon Biswas, Sayem Imtiaz, Rabe Abdalkareem, Emad Shihab, Hridesh Rajan

30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE) 2022

The Art and Practice of Data Science Pipelines: A Comprehensive Study of Data Science Pipelines In Theory, In-The-Small, and In-The-Large

Sumon Biswas, Mohammad Wardat, Hridesh Rajan

44th IEEE/ACM International Conference on Software Engineering (ICSE) 2022

2021

Fair Preprocessing: Towards Understanding Compositional Fairness of Data Transformers in Machine Learning Pipeline

Sumon Biswas, Hridesh Rajan

29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE) 2021

2020

Do the Machine Learning Models on a Crowd Sourced Platform Exhibit Bias? An Empirical Study on Model Fairness

Sumon Biswas, Hridesh Rajan

28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE) 2020

2019

Boa Meets Python: A Boa Dataset of Data Science Software in Python Language

Sumon Biswas, Md Johirul Islam, Yijia Huang, Hridesh Rajan

16th IEEE/ACM International Conference on Mining Software Repositories (MSR) 2019