Abstract: Recent progress in large language and vision models demonstrates how far we can go by scaling with vast internet-scale data. In contrast, physical AI, agents that perceive and act in the real world, still lags far behind. Today, both academia and industry primarily pursue generalizable physical AI by scaling up: collecting large-scale action-video datasets or training world models that enable interaction through learned environments. However, this paradigm is inherently inefficient and will soon reach a data ceiling. In this talk, I argue for a shift from scaling up to scaling out. I introduce reality world simulators, a new paradigm that converts real-world videos into diverse, interactive simulation environments. Instead of relying on more data collection, this approach expands data through structured reconstruction and recomposition, enabling both higher data efficiency and physically grounded interaction. I will present a three-pronged approach: 1) Scaling out via Digital Twins: reconstructing controllable, interactive environments from monocular videos to support diverse agent exploration. 2) Scaling out via Digital Cousins: disentangling scene structure into compositional elements to generate large-scale variations of real-world environments. 3) Scaling out via Embodied Humans: incorporating realistic human dynamics to improve safety and social compliance in robot learning. Finally, I will outline a roadmap toward building generalizable and safe physical AI systems for open-world deployment.

Bio: Dr. Wayne Wu is a postdoctoral researcher at UCLA Computer Science, working closely with Bolei Zhou, and collaborating with Trevor Darrell (UC Berkeley EECS) and Jiaqi Ma (UCLA CEE). He received his Ph.D. in Computer Science and Technology from Tsinghua University in June 2022 and was previously a visiting Ph.D. student at Nanyang Technological University. He also spent seven years in industry, where he led the research and development of products that reached more than 10 million end users worldwide. His research lies at the intersection of computer vision, robotics, and computer graphics. He focuses on developing infrastructure and methods to scale physical AI, enabling robots to work reliably and safely in the open world. He has published over 50 papers at top-tier venues including CVPR, ICCV, ICLR, NeurIPS, and ICRA, with over 9,500 citations and 10,000 GitHub stars. His work has received a CVPR Best Paper Candidate and multiple Oral, Spotlight, and Highlight presentations. He was also honored with the 2025 UCLA Chancellor's Award for Postdoctoral Research, recognizing the best postdocs at UCLA, and he was the only awardee from the School of Engineering. He serves as an Area Chair at CVPR 2026.

Location: NCS 120

Abstract: This talk shows how machine learning can address challenges in Astrophysics. We specifically focus on black hole simulations and supernova observations. First, we present a super-resolution technique for black hole simulations that avoids the need for high-resolution labels by leveraging the Hamiltonian and momentum constraints from general relativity. This method reduces constraint violations by one to two orders of magnitude. Next, we introduce Maven, a multimodal foundation model for supernova science. Using contrastive learning to align photometric and spectroscopic data, Maven achieves state-of-the-art results in classification and redshift estimation by pre-training on synthetic data and fine-tuning on real observations.

Bio: Thomas Helfer is a computational physicist specializing in deep learning and physics. Currently based at the Institute for Advanced Computational Science at Stony Brook University, Thomas was previously a postdoctoral fellow at Johns Hopkins and did his PhD with Eugene Lim at King's College in London. In his work, he looks to bridge topics; in his PhD, he bridged theoretical particle physics and gravitational waves. Now, in his postdoctoral work, he aims to find novel applications of deep learning in astrophysics.

*please note: this seminar will be held in a hybrid format*


Location: IACS Seminar Room OR Join Zoom Meeting
https://stonybrook.zoom.us/j/98617630652?pwd=tb4hplPgb3bTTifPCJTCcsn3P9vX8y.1

Meeting ID: 986 1763 0652
Passcode: 882994


Abstract: BNL is uniquely positioned to do science by leveraging user facilities. However, there are limits on the degree of automated lab science. We have a keen interest to automate not only existing science automation but facilities operation automation and beyond using physical AI. For this effort, we are developing framework, UNAGI (UNified data management and visualization through AGI) and DART (DOE AI Robotics Testbed). I'll introduce the focus of those projects and collaboration opportunities.

Speaker Bio: Dr. Shinjae Yoo is a computational scientist at Brookhaven National Laboratory, where he serves as Interim Lead of the Computational Research Division and Chair of the Artificial Intelligence Department. His research interests span the development of foundational artificial intelligence and machine learning algorithms and their application to scientific problems using supercomputers, quantum computers, and edge devices. Dr. Yoo earned his PhD from Carnegie Mellon University.

Location: IACS Seminar Room

Please RSVP here.

The University's Main Commencement Ceremony will take place on Friday, May 23, 2025 at 11 am at Kenneth P. LaValle Stadium. Gates open at 10 am.

All guests need a valid ticket to enter LaValle Stadium - no exceptions. Children age 1 and older require a ticket. Seating is first-come, first-served.

Register here.

Talk Title: Knowledge-enhanced LLMs and Human-AI Collaboration Frameworks for Creativity Support


Abstract:

Large language models (LLMs) constitute a paradigm shift in Natural Language Processing and Artificial Intelligence. To build AI systems that are human-centered, I propose we need knowledge-aware models and human-AI collaboration frameworks to help them solve tasks ultimately aligning these models better with human values. In this talk, I will discuss my research agenda for human-centered AI with a case study on creativity that focuses on how to augment LMs with external knowledge, build effective human-AI collaboration frameworks as well as theoretically grounded robust evaluation protocols for measuring capabilities of NLG systems. I will begin by describing knowledge-enhanced methods for creative text generation such as metaphors. Next, I will describe how content creators can collaborate and benefit from the creative capabilities of text-to-image-based AI models. Finally, I will focus on the design and development of theoretically grounded evaluation protocols to benchmark the creative capabilities of Large Language Models in both producing as well as assessing creative text. I will end this talk by highlighting the current limitations of existing models and future directions toward building better models that will enable efficient and trustworthy human-AI collaboration systems.


Bio:

Tuhin Chakrabarty is a final-year Ph.D. candidate in the Natural Language Processing group within the Computer Science department at Columbia University. His research is supported by the Columbia Center of Artificial Intelligence & Technology (CAIT) & an Amazon Science Ph.D. Fellowship. He was also a Computational Journalism fellow at NYTimes R&D and an intern at the Allen Institute of Artificial Intelligence, Salesforce Research, and Deepmind. His research interests are broadly in Natural Language Processing, Computer Vision, and Human-Computer Interaction with a special focus on Human-Centered Methods for Understanding, Generation, and Evaluation of Creativity. His work has been recognized at top natural language processing and human-computer interaction conferences and journals such as ACL, NAACL, EMNLP, TACL, and CHI. He has been involved in organizing several workshops and tutorials at NLP conferences such Figurative Language Processing workshop at EMNLP 2022, NAACL 2024, and the tutorial on Creative Text Generation at EMNLP 2023. His work on AI and creativity has been mentioned in mainstream news media such as The Hollywood Reporter and more recently The Washington Post.

Join Zoom Meeting https://stonybrook.zoom.us/j/97103601583?pwd=TnpGMXdpeEd1N0hZcXppS1BLNFJhZz09 (ID: 97103601583, passcode: 004031) Join by phone (US) +1 646-931-3860 (passcode: 004031) Joining instructions: https://www.google.com/url?q=https://applications.zoom.us/addon/invitation/detail?meetingUuid%3DILacj94mRvSXgTYt0Cqs1w%253D%253D%26signature%3D9f2f1e7e603bbcb9034724d084eea8846c19a38b7436180170dfc3f1d718b425%26v%3D1&sa=D&source=calendar&usg=AOvVaw3MsNgLSPMRl8L5i6BosYrB Meeting host: H.Andrew.Schwartz@stonybrook.edu

Join Zoom Meeting:
https://stonybrook.zoom.us/j/97103601583?pwd=TnpGMXdpeEd1N0hZcXppS1BLNFJhZz09

You are cordially invited to attend the biweekly Brookhaven AI Mixer (BAM). BAM includes one short talk on AI research happening at BNL, followed by an open mixer over coffee and snacks for everyone to network and discuss all things AI. The first half hour will consist of presentations that will be available via ZOOM, and the second half hour will be for in person only networking.

Abstract: Two-dimensional (2D) materials such as graphene, hBN, and TMDs offer atomically sharp interfaces and unprecedented tunability when vertically assembled into van der Waals heterostructures. These stacks have enabled discoveries ranging from moiré superconductivity and correlated insulators to quantum emitters and next-generation nanoelectronic devices. Yet constructing high-quality heterostructures remains largely artisanal: researchers manually identify exfoliated flakes, align a polymer stamp by eye, and finely adjust temperature and contact geometry through tacit skill. This manual workflow is difficult to reproduce, scales poorly, and prevents systematic exploration of the enormous combinatorial space of materials, twist angles, and interfacial conditions. AutoLab is an autonomous platform that translates this tacit human expertise into programmable, feedback-driven control. Instead of pressing flakes with predefined trajectories, AutoLab uses machine vision to detect polymer-wafer contact, dynamically regulates contact evolution through closed-loop actuation and temperature control, and captures high-quality flakes with the cleanliness and precision of expert manual fabrication. The system integrates perception, decision making, and motion planning into a single robotic framework, enabling reproducible stacking, wafer-level coverage, and accelerated discovery. Beyond 2D materials, AutoLab illustrates a broader paradigm for AI-native scientific automation: codifying human experimental reasoning into algorithms that interrogate data in real time, adaptively adjust instrumentation, and generate scalable, high-fidelity datasets. Such platforms could generalize to diverse research domains--quantum device fabrication, optical alignment, surface science, autonomous microscopy, and other workflows where expert intuition currently limits throughput and reproducibility. By bridging artisanal manipulation and robotic autonomy, AutoLab points toward a future where scientific discovery is accelerated by machines that not only execute instructions, but learn, respond, and collaborate with human scientists.

Biography: Dr. Yutao Li is a research associate from Department of Condensed Matter Physics and Material Science, Brookhaven National Laboratory. He has 8 years of experience in 2D material sample fabrication, and investigation in their electronic transport, optical and mechanical properties.

Join us every other Tuesday at noon in CDSD's Training Room (building 725, 2nd floor) to learn about interesting AI methods and applications, engage with potential collaborators, prepare for pending FASST funding calls, and build a community of AI for Science at BNL.

Location: CDS, Bldg. 725, Training Room

Join ZoomGov Meeting: https://bnl.zoomgov.com/j/1604383624?pwd=ffQ5cUPNxTI7nzClKQO6cnsNbhF9Vf.1

Meeting ID: 160 438 3624
Passcode: 558449




Abstract: The current approach to materials design, driven by strategic experimentation and supported by physics-based simulation across relevant scales, has been the standard for decades. While the theoretical component in this workflow provides valuable understanding of material behavior, it often fails to deliver actionable guidance for implementation. Advances in artificial intelligence and machine learning (AI/ML), together with high-performance computing (HPC), now offer a viable pathway to close this gap and accelerate both discovery and process optimization. This presentation will outline practical approaches for integrating AI/ML with HPC-enabled, high-throughput computation to explore high-dimensional search spaces. Examples will include the development of engineering alloys for extreme environments, the use of neural networks to rapidly improve computational thermodynamic models, and vapor processing optimization for the manufacturing of ultra-high-temperature ceramics. I will highlight how scientific insight and domain expertise remain essential for translating surrogate model predictions into impactful outcomes. Finally, I will conclude with current challenges and future opportunities for AI/HPC-driven materials research.

Speaker: Dongwon Shin
This seminar will be held in person and online

Join Zoom Meeting: https://stonybrook.zoom.us/j/93730374357?pwd=YDLJ7ELqOQnTZEQhlN8Pa4TuhaiFK8.1
I will be holding an informal 2-week short optimization course, to try
to cover a few important proofs in the field. The goal will be depth
over breadth, with focus on:

 - convergence proofs for gradient descent and stochastic gradient descent
 - energy functions and continuous time optimization
 - estimate sequences and Nesterov acceleration

and, time permitting, additional topics like variance reduction,
quasi-Newton methods, and Frank-Wolfe methods. If we go super fast, we
can spend a few days at the end brainstorming interesting research
project ideas.

Details: NCS 220 6:15pm-7:45pm, Monday-Friday, Feb 7-Feb 18.

In person only, since I plan to use the whiteboard (but may be recorded)

More details will be uploaded here (notes, specific schedule):
https://sites.google.com/view/optimization-short-course/home
Virtual Talk: Contextual Modeling for Natural Language Understanding, Generation and Grounding by Rui Zhang

Zoom link to come.

Abstract: Natural language is a fundamental form of information and communication. In both human-human and human-computer communication, people reason about the context of text and world state to understand language and produce language response. In this talk, I present 
several deep-neural-network-based systems that first understand the meaning of language grounded in various contexts where the language is used, and then generate effective language responses in different forms for information access and human-computer communication. First, 
I will introduce Speaker Interaction RNNs for addressee and response selection in multi-party conversations based on explicit representations for different discourse participants. Then, I will 
present a text summarization approach for generating email subject lines by optimizing quality scores in a reinforcement learning framework. Finally, I will show an editing-based multi-turn SQL query generation system towards intelligent natural language interfaces to databases. 

Bio: Rui Zhang is a final-year PhD student at Yale University advised by Professor Dragomir Radev. His research interest lies in various natural language processing problems in understanding, generation, and grounding. He has been working on (1) End-to-End Neural Modeling for Entities, Sentences, Documents and Multi-party Multi-turn Dialogues, (2) Text Summarization for Emails, News and Scientific Articles, (3) Cross-lingual Information Retrieval for Low-Resource Languages, (4) Context-Dependent Text-to-SQL Semantic Parsing in Human-Computer Interaction. Rui Zhang has published papers and served as Program Committee members at top-tier NLP and AI conferences including ACL, NAACL, EMNLP, AAAI and CoNLL. During his PhD, he has done research internships at IBM Thomas J. Watson Research Center, Grammarly Research and Google AI. He was a graduate student at the University of Michigan and got his Bachelor's degrees at both the University of Michigan and Shanghai Jiao Tong University from the UM-SJTU Joint Institute.
Abstract: Olfaction plays an essential role in everyday life. Anosmia, the loss of the sense of smell, affects approximately 20% of adults globally and its prevalence rises with age. This can lead to malnutrition, reduced ability to detect environmental hazards, and high rates of depression. The olfactory epithelium (OE) is a specialized tissue deep within the nasal cavity that primarily contains olfactory sensory neurons (OSNs), which are crucial cells that detect odorants and relay information to the olfactory neural pathway. Current clinical assessments for anosmia cannot discern whether the cause lies within the OSNs (sensorineural) or further down the pathway (central). The ability to image the OE would help assess the health of OSNs, distinguish between sensorineural and central causes of anosmia, and inform treatments. However, the OE is a small region of tissue that is non-uniform and difficult to distinguish from its surrounding respiratory epithelia (RE). This work explores the use of an FDA-approved dye, Indocyanine Green (ICG), to highlight tissue structure differences and help distinguish between OE and RE. We found that machine learning models using texture analysis information were able to classify images of the two tissue types correctly with ~80% accuracy, while a convolutional neural network was able to classify the images directly with ~90% accuracy. This advancement will enable accurate identification and mapping of the spatial distribution of OSNs within the nasal cavity, enhancing studies on olfactory degeneration and regeneration.


Bio: Skylar Suarez has a Bachelor of Science degree in Computer Science and Engineering from the University of South Florida. She spent nearly a decade as a software and hardware engineer, then decided to follow my dream of being involved in medicine and becoming a professor. She is a PhD Candidate at the Department of Biomedical Engineering at the University of Colorado Anschutz Medical Campus, where she also teaches courses in biological data analysis and machine learning. She specializes in neural engineering, particularly in the development and design of neurosurgical tools for assessing neurodegenerative disorders.


Location: New Computer Science, Room 220 OR Join by Zoom