AI/ML Working Group Seminar

Time/Date: 12:00 PM ET, Tuesday, March 1st, 2022

Seminar Speaker: Yen-Chi (Sam) Chen, CSI, Brookhaven National Laboratory

Title: When reinforcement learning meets quantum computing

Abstract: Recently, reinforcement learning (RL) has demonstrated
various applications with superhuman performance such as mastering the
game of Go.  Meanwhile, the development of quantum computing hardware
shed light on building practical quantum applications to tackle
previously unsolved problems. What will happen if we combine these two
fascinating techniques? In this talk, I will present the recent
progress in quantum RL as well as using classical RL to help certain
tasks in quantum computing.



Host: Meifeng Lin, Computational Science Initiative

_______________________________________________

Nicole Medaglia is inviting you to a scheduled ZoomGov meeting.

Join ZoomGov Meeting
https://bnl.zoomgov.com/j/1619877909?pwd=T041dGl4SURUK0Mwbmp0b1QvVjVtZz09

Meeting ID: 161 987 7909
Passcode: 338057
One tap mobile
+16692545252,,1619877909#,,,,*338057# US (San Jose)
+16468287666,,1619877909#,,,,*338057# US (New York)

Dial by your location
        +1 669 254 5252 US (San Jose)
        +1 646 828 7666 US (New York)
        +1 669 216 1590 US (San Jose)
        +1 551 285 1373 US
Meeting ID: 161 987 7909
Passcode: 338057
Find your local number: https://bnl.zoomgov.com/u/abMDS0zjuq

Join by SIP
1619877909@sip.zoomgov.com

Join by H.323
161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 161 987 7909
Passcode: 338057

Zoom Link: https://stonybrook.zoom.us/j/98533029054?pwd=5FXO6lWGTJssCADEYkYbA7sjaacPRX.1

Meeting ID: 985 3302 9054

Passcode: 436997

Abstract:

Semantic segmentation, the task of assigning a semantic label to each pixel in an image, is a fundamental problem in the field of Computer Vision. with crucial applications in domains like autonomous driving, drone imagery and medical image analysis. Despite advancements in deep learning architectures, state-of-the-art models still heavily depend on large-scale pixel-level annotations, which are costly and time-consuming to acquire. To address this issue, Semi-Supervised Segmentation (SSS) has emerged as a promising solution, leveraging a small set of labeled images alongside a larger corpus of unlabeled data to reduce the annotation burden. In this proposal, I aim to investigate the challenges of SSS and propose approaches to address them. Existing SSS methods rely on a teacher-student framework to generate pseudo-labels for unlabeled images, which are then used for model training. However, this approach presents two major challenges. Pixel-level consistency fails to effectively capture contextual information, and pseudo-labels are noisy, especially in the early stages of training. To address the challenge of noisy pseudo-labels, existing methods rely on confidence-based thresholding to identify reliable pseudo-labels. However, during early training phases, when the model is poorly calibrated, this approach can select high-confidence but noisy pseudo-labels. To address this, we propose a novel approach that reduces reliance on model confidence to select reliable pseudo-labels. Our method employs an ensemble of a segmentation model and an object detection model to select more reliable pseudo-labels, which are then used to weight pseudo-labels using rank statistics, reducing the influence of noisy labels in training. Next, to address both the challenge of capturing contextual information and noisy pseudo-labels I introduce a novel Multi-scale Patch-based Multi-label Classifier (MPMC), which incorporates patch-level contextual information and reduces the impact of noisy pixel pseudo-labels by using the predictions of the patch-level Multi-label classifier to detect noisy labels, enhancing overall segmentation performance. While my work so far has focused on effectively utilizing unlabeled data to improve segmentation performance, as part of our future work, I will explore the use of textual information, such as category descriptions, for segmentation tasks. In limited labeled data scenarios it is more challenging to align visual features with textual features from large language models (LLMs).

You are cordially invited to attend the biweekly Brookhaven AI Mixer (BAM). BAM includes three short talks on AI research happening at BNL, followed by an open mixer over coffee and snacks for everyone to network and discuss all things AI. The first half hour will consist of presentations that will be available via ZOOM, and the second half hour will be for in person only networking.

Join us every other Tuesday at noon in CDSD's Training Room (building 725, 2nd floor) to learn about interesting AI methods and applications, engage with potential collaborators, prepare for pending FASST funding calls, and build a community of AI for Science at BNL.

Tuesday, January 7, 2025, 12:00 pm -- CDS, Bldg. 725, Training Room

Speakers

Maria Zawadowicz, EBNN--ML for Atmospheric Aerosol Research

Mohammad Atif, CDS--An Extensible Digital Twin Framework

Guang Zhao, CDS--Pareto Prompt Optimization

Join ZoomGov Meeting: https://bnl.zoomgov.com/j/1615289117?pwd=Hqkbj9itxWrFnkhZ8rQXHPInO2gxdF.1

Meeting ID: 161 528 9117
Passcode: 991382

Abstract: Molecular learning has become an emerging field of AI, driving breakthroughs in drug discovery, protein design, and materials design. For high-stakes scientific tasks, however, predictive accuracy alone is not sufficient: models must also be interpretable and trustworthy. Our work aims to study molecular learning under a unified explainability perspective across two major model families: Graph Neural Networks (GNNs) and Large Language Models (LLMs).

GNNs are natural choices for molecular graphs and achieve strong performance on many molecular tasks. To enhance explainability, many GNN explanation methods have been proposed and work well for 2D GNNs. However, 3D GNNs introduce two key challenges: producing chemically meaningful substructures and reducing fidelity loss caused by dense geometric graphs. To address these challenges, I present two methods. 3DGraphX decomposes dense 3D graphs into chemically meaningful 3D motifs, enabling compact explanations that align with chemical intuition. EDMA introduces an energy-based discrete mask approximation approach to reduce the discrepancy between the soft mask optimized during training and the hard mask used for explanation, improving explanation fidelity.

LLMs present different characteristics and challenges compared with GNNs. LLMs can provide a certain level of explanation through step-by-step reasoning, and their natural-language outputs are easy for humans to understand and interpret. However, because LLMs are trained for general-purpose tasks, their performance on scientific tasks often lags behind specialized GNNs. To improve performance, existing methods guide LLMs by providing suggestions through brief feedback, retrieval-augmented generation (RAG), or planner agents. However, these approaches face several limitations, such as vague guidance, introduced bias problems, and high computational cost. To fill the gap, I propose RL-Guider, a lightweight reinforcement-learning agent that converts evaluation feedback into input-specific guidance for molecular optimization. RL-Guider improves over time by accumulating historical experience and transfers efficiently across different LLMs while preserving interpretability.

Together, these efforts aim to provide explanations that are scientifically meaningful and faithful, while also preserving or improving performance on molecular tasks to better meet real scientific needs.

Speaker: Xufeng Liu

Location: New Computer Science-1-Room 115

The University at Albany will host a national gathering of professionals and academics that will focus on the transformative potential of AI while addressing the ethical, technical and institutional challenges posed by AI in education.

The Symposium will feature dynamic keynotes, hands-on workshops and engaging conversations with other participants and subject matter experts.

Topics

  • Teaching, Learning and Workforce Development
  • Research, Creative Arts, and Practice
  • Ethics, Governance and Academic Administration

For event information and registration, visit Events@Albany.
Stony Brook Radiology Department Invites you to the AI Research Seminar


Abstract: This talk traces the evolution of AI in neuroradiology through three connected stages: Precision Care, General Medical Intelligence, and Discovery. It moves from multimodal deep learning for stroke outcome prediction, to large-scale foundation models and agent-based medical AI, to imaging biomarkers such as brain aging derived from routine scans. It closes with early-stage work on Galen, a framework for reproducible, scalable, and transparent biomedical imaging AI development and analysis.

Speaker: Yongkai Liu, PhD, Instructor, Department of Radiology (Neuroimaging & Neurointervention), Stanford University

Join Microsoft Teams: https://teams.microsoft.com/meet/221225483255320?p=Anban9lwgOgAq3jaHj
Meeting ID: 221 225 483 255 320
Passcode: kJ7fF3ou
Abstract: Many foundation models for digital pathology have been released recently. Benchmarking available methods then becomes paramount to get a clearer view of the research landscape. For this reason, we introduce THUNDER, a tile-level benchmark for digital pathology foundation models, allowing for efficient comparison of many models on diverse datasets with a series of downstream tasks, studying their feature spaces and assessing the robustness and uncertainty of predictions informed by their embeddings. Such foundation models are often used as feature extractors and combined with Multiple Instance Learning (MIL) aggregators at downstream time. Such aggregation must be efficient and reliable. We will focus on two specific examples of this: (I) HistAug, a fast and efficient generative model for controllable augmentations in the latent space of foundation models to perform data augmentation for MIL, and (ii) CAR-MIL, a method based on counterfactual attention regularisation to improve the reliability of attention maps of MIL methods.

Short-bio: Pierre Marza is a Postdoctoral Researcher at CentraleSupelec in the Biomathematics team of the MICS lab, studying Computer Vision and Deep Learning for Medical Imaging, with a focus on Digital Pathology. Prior to this, he was a PhD student at INSA Lyon, in the LIRIS and CITI labs, advised by Christian Wolf, and co-advised by Laetita Matignon and Olivier Simonin. He studied Visual Navigation, Embodied AI, Spatial Reasoning, more specifically how to learn to represent 3D space, generalize to new environments and master diverse tasks from light supervision.

Location: NCS 220

Zoom: https://stonybrook.zoom.us/j/94798224254?pwd=CFraer25qnpORbJ14aAVHRwaSJOjJM.1

ChatGPT for Developing Interactional Competence: Affordances and Constraints
MIC Distinguished Lecture Series

Abstract: The advent of ChatGPT has redrawn the boundary of pedagogical discourse, where the dyadic configuration of teacher-student has, for many, become triadic -- one that includes AI as an relevant third party, not to be missed or dismissed. Within applied linguistics, AI-focused research has predominantly targeted the teaching and learning of writing (Fang & Han, 2025). The work on AI and speaking, on the other hand, has largely involved perception studies documenting its positive impact on learners' willingness to communicate (Goh & Aryadoust, 2025). In this talk, I explore the role of AI in the teaching and learning of speaking, and in particular, the development of interactional competence. Based on a corpus of learner-AI interactions, I demonstrate the ways in which ChatGPT excels and fails at acting as a useful conversation partner, with a view towards furthering our ongoing deliberation on the affordances and constraints of AI in language education.

Speaker: Hansun Zhang Waring is Professor of Linguistics and Education at Columbia University and founder The Language and Social Interaction Working Group (LANSI). As an applied linguist and a conversation analyst, Hansun is interested in all things interaction -- (second language) pedagogical interaction, communication with the public, parent-child interaction, and human-AI interaction (HAI). Her work has appeared in leading journals in applied linguistics and discourse analysis as well as numerous book volumes, some of which she (co-)authored or co-edited. She is on the editorial boards of Chinese Language and Discourse (CLD), Classroom Discourse (CD), and International Review of Applied Linguistics (IRAL).

Location: HUM 1006