Reception to follow.

Abstract:
In this talk, I will present our journey of developing diverse, adaptive, uncertainty-calibrated AI planning agents that can robustly communicate and collaborate for multi-agent reasoning (on math, commonsense, coding, etc.) as well as for interpretable, controllable multimodal generation (across text, images, videos, audio, layouts, etc.). In the first part, we will discuss improving reasoning via multi-agent discussion among diverse LLMs and structured distillation of these discussion graphs (ReConcile, MAGDi), adaptively learning to balance abstraction, decomposition, refinement, and fast+slow thinking in LLM-agent reasoning (ReGAL, ADaPT, MAgICoRe, System-1.x), as well as confidence calibration in LLMs via speaker-listener pragmatic reasoning and making LLMs better teammates via multi-agent positive-negative persuasion balancing (LACIE, PBT). In the second part, we will discuss interpretable and control-lable multimodal generation via LLM-agents based planning and programming, such as layout-controllable image generation (and evaluation) via visual programming (VPGen+VPEval), consistent multi-scene video generation via LLM-guided planning (VideoDirectorGPT), interactive and composable any-to-any multimodal generation (CoDi, CoDi-2), as well as feedback-driven multi-agent interaction for adaptive environment/data generation via weakness discovery (EnvGen, DataEnvGym).
Bio:
Dr. Mohit Bansal is the John R. & Louise S. Parker Distinguished Professor and the Director of the MURGe-Lab (UNC-NLP Group) in the Computer Science department at UNC Chapel Hill. He received his PhD from UC Berkeley in 2013 and his BTech from IIT Kanpur in 2008. His research expertise is in natural language processing and multimodal machine learning, with a particular focus on multimodal generative models, grounded and embodied semantics, faithful language generation, and interpretable, efficient, and generalizable deep learning.
Abstract: Recent studies have highlighted the vulnerability of Natural Language Processing (NLP) and Vision-Language Models (VLMs) to backdoor attacks, posing significant security risks. Understanding these attack strategies is crucial for assessing model robustness and developing effective defenses. This thesis proposal aims to investigate the vulnerability of language and vision-language models, analyze abnormal behaviors in backdoor-attacked models, and develop defense methods to enhance safety of modern machine learning models at deployment.


We investigate the internal mechanisms of backdoored NLP models, identifying a distinct attention focus drifting phenomenon, where trigger tokens hijack attention regardless of the input context. Through comprehensive qualitative and quantitative analysis, we provide insights into the underlying mechanisms that enable backdoor attacks. Building on these insights, we propose detection methods to differentiate backdoored models from clean ones, through inspecting both the attention distribution and the model predictions. To better understand the vulnerability, we develop advanced backdoor attack strategies targeting language models in classification tasks. For BERT variants, we introduce Trojan Attention Loss (TAL), a novel method that directly manipulates attention patterns to enhance backdoor effectiveness, ensuring stealth and robustness. Vision-Language Models have demonstrated strong performance in recent years. Yet their vulnerability is largely underexplored. We investigate advanced backdoor attack strategies on Vision-Language Models, focusing on image-to-text generation tasks. We demonstrate how backdoors can be embedded in complex multimodal tasks while maintaining semantic integrity under poisoned inputs. Additionally, we propose innovative techniques for injecting backdoors without requiring access to the original training data, expanding the feasibility of real-world attacks.

This proposal provides novel insights into the internal mechanisms of backdoored models, propose effective detection strategies, and develop advanced attack techniques that expose critical vulnerabilities. These findings underscore the urgent need for robust security measures to defend against emerging backdoor threats in deep learning models. The results have been published in top venues including ICLR, ECCV, NAACL, EMNLP, etc.

Speaker: Weimin Lyu


Zoom link: https://stonybrook.zoom.us/j/99880605139?pwd=cfWbRG6n9v3GXEa7OqvXa5cOp5eLBv.1
Meeting ID: 998 8060 5139
Passcode: 843302
Please join us on Friday for a CSE 600 talk by CS Faculty, Stanley Bak. During this semester, please periodically check the CSE 600 schedule for the latest talk updates.

Title:  Formal Verification Methods for Cyber-Physical Systems and Neural Networks

Time: Friday 4/1, 2:40 PM

Location:  NCS 120

Abstract: Formal verification methods in Computer Science strive to prove properties about all possible executions of a system, and are an alternative development approach to testing when correctness is paramount. Traditionally these have been applied to hardware circuits, state-machine protocols, or software source code. Prof. Stanley Bak will discuss his research on extending formal verification approaches to more complex areas including cyber-physical systems and neural networks.


Speaker Bio: Stanley Bak is an assistant professor in the Department of Computer Science at Stony Brook University investigating the verification of autonomy, cyber-physical systems, and neural networks. He received a PhD from the University of Illinois at Urbana-Champaign (UIUC) in 2013, and worked for four years in the Verification and Validation (V&V) group in the Aerospace Systems Directorate at the Air Force Research Laboratory (AFRL). He received the AFOSR Young Investigator Research Program (YIP) award in 2020.

https://stonybrook.zoom.us/j/99820812332?pwd=c05BSTVLNmw3L04yZjdEcG5pem1OZz09 Speaker: Alexei Koulakov of Cold Spring Harbor Laboratory Brain evolution as a machine learning problem We have entered a golden age of artificial intelligence research, driven mainly by the advances in ANNs over the last decade or so. Applications of these techniques--to machine vision, speech recognition, autonomous vehicles, machine translation and many other domains--are coming so quickly that many observers predict that the long-elusive goal of Artificial General Intelligence (AGI) is within our grasp. However, we still cannot build a machine capable of building a nest, stalking prey, or loading a dishwasher. I will describe several projects, ranging from theories of evolution of neural development to the perception of smells, in which we are attempting to understand the algorithms that the nervous system is using to solve some of these challenging problems.

The AI Community will be hosting our very first Datathon💡📊

Ready to turn data into groundbreaking insights? 🧠

Compete in our Datathon, where you'll analyze real-world data 📈 and share innovate solutions in these tracks:

🏫 Student Life

🌱 Environment & Sustainability

💉 Health & Wellness

💰 Finance & Economics

Whether you're a data pro or just starting out, this is your chance to network, learn, and win exciting prizes! 🏆🎉 Bring your creativity 🧩 collaborate with fellow students 🧑‍🤝‍🧑 and gain hands-on experience showcasing your analytical skills 💻

Submissions will be judged by professors 🧑‍🏫 so take this chance to impress them!

There will be free food ☕ and games 🎲 to fuel your brain and imagination! Don't miss out--register now and unleash the power of data! 🔥✨

Registration Form: https://forms.gle/6XYMfmhyAByzFpxz5

Time: Friday (4/4) 10:30am - 5pm ⏰

Location: Bauman Center 📍

Join us for an engaging panel discussion featuring researchers who participated in our inaugural AI JAM session on February 26th. Our panelists will share their firsthand experiences using large language models to tackle complex scientific problems, with a special focus on prompt engineering strategies, discussing both breakthroughs and challenges encountered during this collaborative initiative. Learn how these cutting-edge AI tools are being applied to real-world research questions and discover insights that could inform your own scientific endeavors. Attendees are encouraged to come prepared with questions about prompt engineering for the panel discussion.

Moderator: Adolfy Hoisie, Deputy Director, Computing and Data Sciences

Kevin Yager, Group Leader, AI-Accelerated Nanoscience, Center for Functional Nanomaterials
Lingda Li, Associate Computational Scientist, Systems, Architecture and Computing Technologies, Computing and Data Sciences
Liguo Wang, Director of Scientific Operations, Laboratory for BioMolecular Structure (LBMS), National Synchrotron Light Source II
Weiguo Yin, Physicist, Condensed Matter Theory, Condensed Matter Physics and Materials Science Department

Location: CDS, Bldg. 725, Training Room

Join ZoomGov Meeting: https://bnl.zoomgov.com/j/1606837837?pwd=Tc0mwQqLXpDfYOIaoaurmpLD2mMlzS.1 (Meeting ID)

Passcode: 822553

Developing research questions & effective search strategies can be challenging, and the growing use of generative AI adds a new layer of complexity to the research process. This workshop will explore how generative AI can complement traditional research methods while navigating important considerations around accuracy, transparency, privacy, and reliability. No prior AI experience is required.

Location: Health Sciences Center, Room 2-154 or Online

Register to attend.

Fantastic Futures is an international conference series organized by AI4LAM as one of the most important global events at the intersection of AI and cultural heritage, shaping how memory institutions adapt to rapidly evolving technologies while maintaining public trust.

The conference brings together professionals, researchers, technologists, and cultural‑heritage institutions to explore how AI can support organizational workflows, users services and data preservation, access, discovery, as well as innovation in the cultural‑heritage sector:

  • Librarians, archivists, museum professionals and all other GLAM enthusiasts
  • Technologists working on cultural‑heritage applications, AI researchers and developers
  • Digital humanists, researchers of cultural heritage
  • University professors, students, and librarians
  • Policy and ethics experts, governmental employees
  • Strategic leaders and innovation managers

To register, visit AI4LAM's official website.