Abstract: Jailbreak attacks circumvent LLMs' built-in safeguards by concealing harmful queries within adversarial prompts. While most existing defenses attempt to mitigate the effects of adversarial prompts, they often prove inadequate as adversarial prompts can take arbitrary, adaptive forms. This paper introduces RobustKV, a novel jailbreak defense that takes a fundamentally different approach by selectively removing critical tokens of harmful queries from key-value (KV) caches. Intuitively, for an adversarial prompt to be effective, its tokens must achieve sufficient `importance' (measured by attention scores), which consequently lowers the importance of tokens in the concealed harmful query. Therefore, by carefully evicting the KVs of low-ranked tokens, RobustKV minimizes the harmful query's presence in the KV cache, thus preventing the LLM from generating informative responses. Extensive evaluation using benchmark datasets and models demonstrates that RobustKV effectively counters state-of-the-art jailbreak attacks while maintaining the LLM's performance on benign queries. Notably, RobustKV creates an interesting effectiveness-evasiveness dilemma for the adversary, leading to its robustness against adaptive attacks.

Speaker: Tanqiu Jiang

Where: NCS 220 and Zoom (https://stonybrook.zoom.us/j/6406956411)

The University at Albany will host a national gathering of professionals and academics that will focus on the transformative potential of AI while addressing the ethical, technical and institutional challenges posed by AI in education.

The Symposium will feature dynamic keynotes, hands-on workshops and engaging conversations with other participants and subject matter experts.

Topics

  • Teaching, Learning and Workforce Development
  • Research, Creative Arts, and Practice
  • Ethics, Governance and Academic Administration

For event information and registration, visit Events@Albany.
Abstract: Drawing on group-theoretic and information-theoretic foundations, we propose information lattice learning (ILL) as a general framework to learn rules of a signal (e.g., an image or a probability distribution). In our definition, a rule is a coarsened signal used to help us gain one interpretable insight about the original signal. To make full sense of what might govern the signal's intrinsic structure, we seek multiple disentangled rules arranged in a hierarchy, called a lattice. Compared to representation/rule-learning models optimized for a specific task (e.g., classification), ILL focuses on explainability: it is designed to mimic human experiential learning and discover rules akin to those humans can distill and comprehend. We will detail the mathematical foundations and algorithms of ILL, and illustrate how it addresses the fundamental question what makes X an X by creating rule-based explanations designed to help humans understand. Our focus is on explaining X rather than (re)generating it. We show ILL's efficacy and interpretability on benchmarks and assessments, as well as a demonstration of ILL-enhanced classifiers achieving human-level digit recognition using only one or a few MNIST training examples (1-10 per class). We present applications in knowledge discovery, using ILL to distill music theory from scores and chemical laws from molecules and further revealing connections between them. We close with some early work on understanding the principles that govern scattering amplitudes in Super Yang-Mills theory, rather than just predicting them.

Biography: Lav R. Varshney is the Della Pietra Infinity Professor and inaugural director of the AI Innovation Institute at Stony Brook University. He is co-founder and CEO of Kocree, Inc., a startup company building novel human-controllable AI for discovery and creativity, and chief scientist of Ensaras, Inc., a startup company focused on AI and wastewater treatment. He holds appointments at RAND Corporation and at Brookhaven National Laboratory. He was previously on the faculty of the University of Illinois Urbana-Champaign, a visiting scholar at Northwestern's Kellogg School of Management, a principal research scientist at Salesforce Research AI, and a research staff member at IBM Research. He is a former White House staffer, having served on the National Security Council staff as a White House Fellow, where he contributed to national AI and wireless communications policy. His research interests include information theory and artificial intelligence. He received his B.S. degree from Cornell University and his S.M. and Ph.D. degrees from the Massachusetts Institute of Technology.

Location: Room 102

Abstract: The remarkable success of large foundational models, such as LLMs and diffusion models, is built on their learning over vast amounts of static data from the Internet. However, human learning and problem-solving are fundamentally interactive processes--humans learn by engaging with their environment, tools, search engine, and feedback loops, iteratively refining their understanding and decisions. This gap between the interactivity of human learning and the static nature of model training raises a critical question: how can we imbue foundational models with the capacity for meaningful interaction?

In this talk, I will explore methods to enhance foundational models by incorporating interaction with the external environment. I will discuss strategies such as leveraging external tools, compilers, function calls to provide dynamic feedback to enhance foundation models. By drawing inspiration from human's interactive learning processes, I demonstrate how interaction-driven learning can lead to models that are not only more accurate but also more adaptable to real-world applications.

This work bridges the gap between static training paradigms and the dynamic, iterative nature of human intelligence, paving the way for a new generation of interactive AI systems.

Bio: Wenhu Chen has been an assistant professor at the Computer Science Department in University of Waterloo and Vector Institute since 2022. He obtained the Canada CIFAR AI Chair Award in 2022 and CIFAR Catalyst Award in 2024. He has worked for Google Deepmind as a part-time research scientist since 2021. Before that, he obtained his PhD from the University of California, Santa Barbara under the supervision of William Wang and Xifeng Yan. His research interest lies in natural language processing, deep learning and multimodal learning. He aims to design models to handle complex reasoning scenarios like math problem-solving, structure knowledge grounding, etc. He is also interested in building more powerful multimodal models to bridge different modalities. He received the Area Chair Award in AACL 2023, the Best Paper Honorable Mention in WACV 2021, the Best Paper Finalist in CVPR 2024, and the UCSB CS Outstanding Dissertation Award in 2021.


Abstract:
Large language models (LLMs) have transformed the way humans write code, bringing unprecedented automation to software development. In this talk, I will first provide an overview of my research on enhancing LLMs' code intelligence, optimizing each step of the development pipeline towards more complex software engineering tasks. I will then delve into my key contributions, focusing on how to equip LLMs with a deeper, more comprehensive understanding of software programs. Finally, I will discuss the future of AI-driven software engineering, envisioning a new era of automation that is more reliable, intelligent, and cost-efficient.

Bio:
Yangruibo (Robin) Ding is a Ph.D. candidate in the Department of Computer Science at Columbia University. His research is at the intersection of Software Engineering and Machine Learning, focusing on developing large language models (LLMs) for code. He trains LLMs to generate, analyze, and refine software programs and constructs benchmarks to systematically evaluate LLMs in solving software engineering tasks. He also studies how to improve LLMs' reasoning capability to tackle complex programming tasks, such as debugging and patching. His interdisciplinary research has been published in top-tier conferences of software engineering, programming languages, natural language processing, and machine learning. He won an ACM SIGSOFT Distinguished Paper Award, an IEEE TSE Best Paper Runner-up, and received an IBM Ph.D. Fellowship.
Location:
NCS 120

Get hands-on with data cleaning techniques using Python and AI tools. Join SBU Libraries' Data Literacies Lead, Ahmad Pratama, to learn how to identify and rectify errors, handle missing data, and prepare your dataset for analysis. This workshop introduces you to powerful yet easy-to-use tools and techniques that make data cleaning efficient and effective, turning chaotic data into valuable insights.

Please register for the Data Cleaning with Python and AI here.

From Discovery to Impact

An Interdisciplinary Conference on the Science of Science and Entrepreneurship

March 26-27, 2027 · Charles B. Wang Center, Stony Brook University


Stony Brook University invites paper and poster submissions for From Discovery to Impact, a focused, high-engagement conference at the nexus of the Science of Science and Entrepreneurship. The two fields share a common object of study -- the lifecycle of an idea -- yet have largely developed in isolation. The Science of Science (SoS) uses large-scale data and computational models to understand how knowledge is produced; entrepreneurship research explains how that knowledge is commercialized.

By convening scholars from both traditions, the conference takes up questions that neither field can answer alone:

  • What makes a discovery translatable?
  • Which patterns in knowledge production predict societal or commercial value?
  • How should institutions design the pathways between research and the market?
The program moves deliberately from theory to action. Day 1 centers on the creation of knowledge, with keynote addresses, paper sessions, an interdisciplinary panel, and a poster session. Day 2 shifts to the commercialization of knowledge, culminating in a grant-incubation workshop where participants form multi-PI teams and map proposals to specific funding mechanisms.

Two Days, Two Tracks

Day 1 · March 26

The Creation of Knowledge
Science of Science. Keynotes, paper sessions, an interdisciplinary panel, and a poster session.

Day 2 · March 27

The Commercialization of Knowledge
Entrepreneurship. Paper sessions and a grant-incubation workshop where participants form multi-PI teams.

Read more and register.

This workshop synthesizes the latest research on the impact of AI usage in education so that you could make informed decisions on whether and how to use AI to facilitate your learning. You might have seen conflicting reports on whether the use of AI is good for learning. In this workshop, we are going to tease out, drawing on the latest research, which types of AI usage are beneficial or harmful for different kinds of learning. At the end of the workshop, you should walk away with more clarity on when and how to use AI for your own learning. Join PRODIG+ fellow on critical AI, Zheng Fu, in this informative workshop.

Register for this Zoom workshop.

You are cordially invited to attend the biweekly Brookhaven AI Mixer (BAM). BAM includes three short talks on AI research happening at BNL, followed by an open mixer over coffee and snacks for everyone to network and discuss all things AI. The first half hour will consist of presentations that will be available via ZOOM, and the second half hour will be for in person only networking.

Join us every other Tuesday at noon in CDSD's Training Room (building 725, 2nd floor) to learn about interesting AI methods and applications, engage with potential collaborators, prepare for pending FASST funding calls, and build a community of AI for Science at BNL.

Tuesday, January 7, 2025, 12:00 pm -- CDS, Bldg. 725, Training Room

Speakers

Jianda Chen, EBNN - Improving the stability and accuracy of PDE-ML hybrid AGCMs

Boyang Li, CDS - Accelerating Materials Discovery using Machine Learning

Jaehye on Do, NPP Isotopes - Using LLMs for Isotopes Research and Production

Join ZoomGov Meeting: https://bnl.zoomgov.com/j/1615289117?pwd=Hqkbj9itxWrFnkhZ8rQXHPInO2gxdF.1

Meeting ID: 161 528 9117
Passcode: 991382

Join the Collaborative for the Earth, the Department of Political Science, and the AI Innovation Institute as we welcome Lav Varshney, Ph.D., Della Pietra Infinity Professor and Inaugural Director of the AI Innovation Institute.

The Physical Economy of Intelligence: Marketcraft, Data Centers, and Climate

Artificial intelligence is often described as immaterial, yet it is a rapidly growing physical industry built from memory chips, servers, concrete, land, electricity, water, and capital. This talk develops a marketcraft perspective on AI and climate, treating memory, compute, and intelligence as interdependent goods shaped by supply constraints, demand shocks, long investment cycles, environmental externalities, and the design of markets and institutions. This framing helps explain why sustainable AI cannot be achieved through more efficient algorithms alone: it also requires better lifecycle accounting, procurement standards, flexible computing, and contracts that shift computational activity toward environmentally favorable times and places. The talk will connect these system-level ideas to work on generative design and experimental validation of low-carbon concrete for data-center construction, as well as AI-enabled optimization of wastewater operations that have each reduced energy/carbon by 30 percent or more. Together, these examples show how the co-design of algorithms, physical infrastructure, markets, and public policy can reduce AI's environmental footprint while using AI to accelerate climate solutions.

Date & Time: Wednesday, September 23, 2026 | 12:30 PM - 1:50 PM

Location: Laufer Center

Registration is compulsory

For any questions and accessibility requests or accommodations, please contact Jennifer Gilday at c4e@stonybrook.edu or call 631-632-4625.