Abstract:

Recent advances in deep learning have significantly enhanced the capabilities of Natural Language Processing (NLP) and Vision-Language Models (VLMs). However, these advancements come with increased vulnerabilities, notably through backdoor attacks that pose severe security threats. This thesis addresses two critical dimensions of Trustworthy AI and Efficient Multimodal Representation Learning: (1) security through analyzing, detecting, and designing backdoor attacks in NLP and VLMs, and (2) efficiency through advanced multimodal representation methods tailored for clinical and medical imaging applications.

In the first dimension, we explore the internal mechanisms exploited by backdoor attacks, identifying the distinctive phenomenon of attention focus drifting in compromised transformer models, where trigger tokens consistently hijack attention. Leveraging these insights, we propose robust detection frameworks, including the attention-based Trojan detector (AttenTD) and a task-agnostic logit-based detection method (TABDet), achieving effective identification of backdoored NLP models across diverse tasks. We further introduce novel backdoor attack methodologies: the Trojan Attention Loss (TAL), enhancing attack efficiency and stealth through direct attention manipulation, and BadCLM, demonstrating critical vulnerabilities in clinical decision-support systems by effectively compromising clinical language models.

Extending our security exploration to multimodal settings, we investigate backdoor attacks on Vision-Language Models (VLMs), particularly in complex image-to-text generation tasks, proposing innovative techniques (TrojVLM, VLOOD) capable of embedding backdoors without direct access to original training data, thus showcasing practical risks in real-world scenarios.

In the second dimension, we address efficiency and interpretability challenges in clinical and pathology applications. We introduce TCP-LLaVA, the first multimodal large language model (MLLM) designed explicitly for Whole Slide Image (WSI) Visual Question Answering (VQA). Utilizing a novel token compression mechanism inspired by transformer-based models, TCP-LLaVA substantially reduces computational resource consumption while maintaining superior VQA performance across multiple tumor subtypes. Additionally, we present a multimodal transformer model integrating structured Electronic Health Records (EHR) with clinical notes, demonstrating enhanced predictive accuracy and interpretability for in-hospital mortality prediction through integrated gradient-based interpretability methods.

Together, these contributions present a comprehensive approach to ensuring AI models are not only secure against malicious manipulation but also efficient and interpretable for critical clinical applications, underscoring the essential need for trustworthy and effective AI systems.

Speaker: Weimin Lyu

Zoom: https://stonybrook.zoom.us/j/2392326575?pwd=SVQ2VkFXTnZZYmJUMXgvTXBuZWM3UT09

Meeting ID: 239 232 6575
Passcode: 436192




Time: 04/28 Wed 3pm-4pm

Remote Access
Join Zoom Meeting https://stonybrook.zoom.us/j/95617197636?pwd=KytzZ2pVRG9SZGpKZUtpNXJISjNjZz09 
Meeting ID: 956 1719 7636 Passcode: 924293

Title: Brain imaging genetics for Alzheimer's disease: integrated analysis and machine learning

Li Shen, Ph.D.
Professor of Informatics
Department of Biostatistics, Epidemiology and Informatics 
Perelman School of Medicine
University of Pennsylvania

Bio: Li Shen, Ph.D., is a Professor of Informatics in the Department of Biostatistics, Epidemiology and Informatics at the Perelman School of Medicine in the University of Pennsylvania. He is an elected fellow of the American Institute for Medical and Biological Engineering (AIMBE). He obtained his Ph.D. degree in Computer Science from Dartmouth College. The central theme of his lab is focused on developing computational and informatics methods for integrative analysis of multimodal imaging data, high throughput omics data, cognitive and other biomarker data, electronic health record (EHR) data, and rich biological knowledge such as pathways and networks, with applications to complex disorders. His research interests include medical image computing, biomedical informatics, machine learning, network science, imaging genomics, Alzheimer's disease, and big data science in biomedicine. He has authored over 280 peer-reviewed articles (h-index 57) in these fields. Dr. Shen's work has been continuously supported by the NIH and NSF, and he is presently the PI of multiple NIH and NSF grants on developing computational methods for various biomedical applications including brain imaging genomics, genetics of Alzheimer's disease, genetics of human connectome, mining drug effects from the EHR data, and big data mining in brain science. He is co-leading the NIA Alzheimer's Disease Sequencing Project AI4AD Consortium and oversees the imaging genomics aspect of this landmark project. Dr. Shen served as the Executive Director of the Medical Image Computing and Computer Assisted Intervention (MICCAI) Society Board of Directors during 2016-2019. He has chaired and co-chaired various professional meetings in medical image computing and bioinformatics. He is an Associate Editor of BioData Mining and Frontiers in Radiology (Section of AI in Radiology), and serves on the Editorial Board of Medical Image Analysis and Brain Imaging and Behavior.

Abstract: Brain imaging genetics is an emerging data science field, where integrated analysis of brain imaging and genetics data, often combined with other biomarker, clinical and environmental data, is performed to gain new insights into the genetic, molecular and phenotypic characteristics of the brain as well as their impact on normal and disordered brain function and behavior. Many methodological advances in brain imaging genetics are attributed to large-scale landmark biobank projects such as the Alzheimer's Disease Sequencing Project, the Alzheimer's Disease Neuroimaging Initiative, and the UK Biobank. Using the study of Alzheimer's disease as an example, we will discuss fundamental concepts, state-of-the-art statistical and machine learning methods, and innovative applications in this rapidly evolving field. We show that the wide availability of brain imaging genetics data from various large-scale biobanks, coupled with advances in biomedical statistics, informatics and computing, provides enormous opportunities to contribute significantly to biomedical discoveries in brain science and to impact the development of new diagnostic, therapeutic and preventative approaches for complex brain disorders such as Alzheimer's disease.

More details:
https://bmi.stonybrookmedicine.edu/sites/default/files/shen_li_04_28_flyer.pdf
Fall 2025, Mondays 2 to 3:20 pm, NCS 220 and Zoom link to be announced soon.

The seminar will be jointly taught by Prof. Dimitris Samaras samaras@cs.stonybrook.edu.

The overall purpose of this seminar is to bring together people with interests in Computer Vision theory and techniques and to examine current research issues. This course will be appropriate for people who already took a Computer Vision graduate course or already had research experience in Computer Vision.

To enroll in this course, you must either: (1) be in the Ph.D. program or (2) receive permission from the instructors.

Each seminar will consist of multiple short talks (around 15 minutes) by multiple students. Students can register for 1 credit for CSE656. Registered students must attend and present a minimum of 2 talks. Registered students must attend in person. Up to 3 absences will be excused. Everyone else is welcome to attend.
The North East AI Agents Day Organizing Committee invites you to '2026 AI Agents Day.'

The goal of this workshop is to offer a comprehensive overview of AI agents, bring ML, Systems, and HCI research communities together to share progress, discuss common problems and evaluation setups, and identify opportunities for collaboration. We aim to bring together attendees from diverse disciplines to foster interdisciplinary collaboration and discuss open research questions.

Location: Jane Street Offices, New York

Register here.
The Natural Language Processing Reading Group at Stony Brook University meets weekly to discuss recent research papers in NLP and related fields.
Join the Google Group here.


Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets

Abstract: Recent advancements in large language models (LLMs) have underscored their vulnerability to safety alignment jailbreaks, particularly when subjected to downstream fine-tuning. However, existing mitigation strategies primarily focus on reactively addressing jailbreak incidents after safety guardrails have been compromised, removing harmful gradients during fine-tuning, or continuously reinforcing safety alignment throughout fine-tuning. As such, they tend to overlook a critical upstream factor: the role of the original safety-alignment data. This paper therefore investigates the degradation of safety guardrails through the lens of representation similarity between upstream alignment datasets and downstream fine-tuning tasks. Our experiments demonstrate that high similarity between these datasets significantly weakens safety guardrails, making models more susceptible to jailbreaks. Conversely, low similarity between these two types of datasets yields substantially more robust models and thus reduces harmfulness score by up to 10.33%. By highlighting the importance of upstream dataset design in the building of durable safety guardrails and reducing real-world vulnerability to jailbreak attacks, these findings offer actionable insights for fine-tuning service providers to prioritize upstream models with low jailbreak risk.

Location: NCS 220

Zoom Link: https://stonybrook.zoom.us/j/92942833294?pwd=927683
AI Seminar: Computational Pathology: Deep Learning, Classification and
Predicting the Future  - Joel Saltz

Abstract:  Pathologists have been looking at tissue through microscopes since the 1800s.  During each pathologist's career,  he or she views slides having  roughly 1,000,000,000,000 cells. Deep learning methods are rapidly being developed to assimilate the huge amount of information walked inside of tissue images and to use this information to predict outcomes and responses to treatments.

Stony Brook is a leader in this type of multi-disciplinary work. I will provide an overview of Stony Brook computational Pathology efforts and articulate how these have the potential to create biomedical advances as well as to drive development of new computer science. 


Bio: Dr. Joel Saltz is a leader in research on advanced information technologies for large scale data science and biomedical/scientific research. He has developed innovative pathology informatics methods, including: the first published whole slide virtual microscope system; pioneering pathology computer-aided diagnosis techniques; and methods for decomposing pathology images into features and linking those features to cancer omics, response to treatment and outcome. He has broken new ground in big data through development of the filter-stream based DataCutter system, the map-reduce style Active Data Repository and the inspector-executor runtime compiler framework. He has also been an active contributor in clinical informatics, having developed
predictive models for hospital readmissions, point of care laboratory testing quality assurance systems, decision support systems for electrophoresis interpretation and graphical user interfaces to support clinical data warehouse queries. Dr. Saltz has been a pioneer in establishing the field of biomedical informatics; he founded and built two highly successful departments of biomedical informatics, one at Ohio State University and one at Emory University. In 2013, he came to Stony Brook as Vice President for Clinical Informatics and Founding Department Chair of Biomedical Informatics - to create a living laboratory for biomedical informatics and to create a third unique biomedical informatics department dually housed in the School of Medicine and the College of Engineering. Dr. Saltz is trained both as a computer scientist and as a physician through the MSTP program at Duke University. He has deep experience in computer science, having served on the computer science faculties at Yale University and the University of Maryland. He completed his residency in clinical
pathology at Johns Hopkins University and he is a practicing, board-certified clinical pathologist. 
Abstract: Machine learning (ML) systems fueled by neural networks have entered our daily lives and led to scientific breakthroughs, but many open questions remain. After a nod toward the question of rigor with ML and recent progress, I'll turn to the theory of neural networks. I will argue that understanding neural networks inevitably leads to ideas from field theory (FT), which was already realized in the simplest case in the 1990s, and I will review some essential FT-for-NN results. I will then propose that the connection might be more general, an NN-FT correspondence of sorts, with neural networks providing a way to define a field theory. I'll end with comments on known results including the origin of interactions and various symmetries, but I will also list some open questions. The apparent non-sequitur in the title will be used as a rhetorical device to explore where we are and where we'd like to go.

https://scgp.stonybrook.edu/calendar/full-calendar
Presented by the Stony Brook University Hospital Institutional Ethics Committee and co-sponsored by the Center for Medical Humanities, Compassionate Care and Bioethics, Stony Brook University

9th Annual Medical Ethics Symposium

Friday, August 7, 2026: MART Auditorium live and via Webinar

Artificial intelligence (AI) is transforming healthcare by improving diagnosis, streamlining administrative tasks, supporting personalized treatment plans, and aiding medical research. However, the growing use of AI in medicine also raises important ethical concerns. While AI has the potential to enhance patient care and efficiency, healthcare providers and patients must approach these technologies with caution and critical oversight.

This event invites professionals and students from all healthcare, legal, and other associated disciplines to bring their work, challenges, and solutions to the table at 'Trust but Verify: Ethical Challenges of AI in Healthcare.'

Agenda:

8am Registration/Light Breakfast
Provided by The Center for Medical Humanities, Compassionate Care and Bioethics

8:30am Welcome
Jean Mueller, MPS, BS, RN, CPHQ Ethics Symposium Coordinator

Opening Remarks
Carolyn Santora, MS, RN, NEA-BC, CPHQ, Chief Nursing Officer; Chief Nursing Officer; Chief of Regulatory Affairs, Patient Safety and Ethics, Stony Brook University Hospital; Chair/Institutional Ethics Committee, Stony Brook Medicine

KEYNOTE
9- 10:30am Trust, Communication, and Consent in AI-Mediated Healthcare
Kellie Owens, PhD
Assistant Professor, Medical Ethics, Department of Population Health, NYU Grossman School of Medicine

KEYNOTE
10:45- 12:15pm AI That Measures, AI that Speaks: A Decade of Surgical AI and the Problem of Verification
Alexander Winkler- Schwartz, MDCM, PhD, FRCSC, FAANS
Neurosurgeon, Neuroscientist, AI and Surgical Education Researcher
Assistant Professor, Adult and Pediatric Neurosurgery, Stony Brook University

12:30- 1:15pm Lunch
Provided by the Stony Brook University Hospital Institutional Ethics Committee

Panel Discussion and Interactive Ethics Case Presentations
1:30- 3pm Healthcare AI: Designed to Assist, Not Resist Human Judgment
Moderator: David N. Hoffman, JD

Distinguished Panelists
Leah Gancz, MD
Julie Luengas, DNP, MBA, RN, NI-BC, FHIMSS
Tauhid Mahmud, MD, MPH
Pons Materum III, MD
Neil J. Patel, MD, MBA, MS
Carolyn Santora, RN, NEA-BC, CPHQ
Caitlyn Tabor, JD, MBE
Mathew Tharakan, MD, MBA
Alexander Winkler-Schwartz, MDCM, PhD, FRCSC, FAANS
Zhi Wu, MD

3- 3:45pm Poster Awards and Rapid-Fire Sessions

Carolyn Santora, MS, RN, NEA-BC, CPHQ
1st, 2nd and 3rd Place Posters and Colleagues Choice Award

3:45- 4pm Summary and Closing Remarks
Carolyn Santora, MS, RN, NEA-BC, CPHQ

Register here.
Over the past decade, Artificial Intelligence (AI) has made stunning advances, from mastering language to solving the structure of proteins. These breakthroughs arise from more than forty years of work in neural networks, where ideas from neuroscience have inspired solutions in AI. In this lecture, Anthony Zador, MD, PhD, will explore how reverse engineering the brain's computations has driven progress in both fields, and how this back-and-forth between neuroscience and AI is set to grow even stronger -- with brain-inspired designs driving new AI advances while AI tools transform our understanding of how the brain works.

Speaker:
Dr. Zador works at the intersection of neuroscience and artificial intelligence. He is the Alle Davis Harris Professor of Biology at Cold Spring Harbor Laboratory, where he served as Chair of Neuroscience. He was named one of Foreign Policy's 100 Leading Global Thinkers and is a recipient of the Brain Research Foundation Fellowship, the Gill Symposium Transformative Investigator Award, and the Allen Distinguished Investigator Award.

Watch online at stonybrook.edu/live