AI Innovation Institute

Abstract: Spectroscopy and imaging are two primary tools for probing material structures. However, the discovery of trends that guide the design of improved materials is often hindered by intertwined physical interactions or significant experimental noise. In this talk, I will present machine learning approaches that address both challenges. The first part focuses on the interpretation of X-ray absorption spectroscopy (XAS). We developed a controlled projection algorithm, RankAAE, which disentangles coupled structural descriptors in complex datasets and reveals analysis rules for inferring new structural information visually from spectra. The second part targets transmission electron microscopy (TEM) imaging of material structures. We developed a machine learning model capable of denoising extremely noisy images, while demonstrating strong out-of-distribution generalization. I will describe the construction of these models and demonstrate their effectiveness through representative scientific case studies.

Bio: Dr. Xiaohui Qu is a Staff Scientist in the Theory and Computation Group at the Center for Functional Nanomaterials (CFN), Brookhaven National Laboratory. His research focuses on developing interpretable machine learning and data analytics methods for materials science, with an emphasis on extracting structural insights from X-ray absorption spectroscopy and transmission electron microscopy. Dr. Qu earned his B.S. in Environmental Engineering and Ph.D. in Environmental Science from Shandong University, China, followed by postdoctoral research in Physics at Nanyang Technological University, Singapore, in Chemistry at Universidade Nova de Lisboa, Portugal, and in Materials at Lawrence Berkeley National Laboratory.

Location: IACS Seminar Room


Event Details & Calendar Link (includes zoom info): https://calendar.stonybrook.edu/site/iacs/event/iacs-seminar-speaker--xiaohui-qu-brookhaven-national-lab/

Abstract: The landscape of machine learning evolves rapidly and the complexity of the networks and their architectures defies easy comprehension. AI is touted as the next scientific revolution by allowing the processing and pattern-finding in increasingly massive data sets. One potential end results could be AI enhanced measurement technologies, but what does that mean? This talk will give examples of how classical tools indicate the technical obstacles to this vision in terms of understanding training processes, model comparisons, and feature embeddings. While the results in this talk are largely empirical, they point to interesting directions for (infomation?) theoretical investigation.

Bio: Anand D. Sarwate is an Associate Professor in the Electrical and Computer Engineering Department at Rutgers, The State University of New Jersey. He received B.S. degrees in math and electrical engineering from MIT and a Ph.D. in electrical engineering from UC Berkeley. Prior to joining Rutgers he was a Research Assistant Professor at TTI-Chicago and a postdoc at the ITA Center at UC San Diego. His research interests include information theory, machine learning, signal processing, optimization, and privacy and security.
Location: Light Engineering 250

A talk by Jerome Zhengrong Liang entitled, Machine Learning from Original Images to Texture Patterns: A Paradigm Shift from Non-Medical Application to Medical Diagnosis. Abstract: Artificial intelligence (AI) research for medical diagnosis started soon after human began to use computer, initially called artificial neural network (ANN) and now convolutional neural network (CNN). ANN has been mainly explored to classify the experts' handcrafted features from the original (or raw) images, while CNN has been mainly explored directly on the raw images for both tasks of extracting abstract features and classifying the features. Experimental evidences have been shown that CNN can be trained by a large number of the raw images with experts' scores (or labels) to match or even surpass the experts' performance for both non-medical and medical diagnosis applications. However, the performances of the CNN models as well as the experts on medical diagnosis dropped dramatically when the labels of the raw images were replaced by the corresponding medical pathological reports. Accumulated medical knowledge reveals that the lesion heterogeneity is a footprint of lesion evolution and ecology, and the heterogeneity is an indicator of lesion progress and response to medical intervention. The heterogeneity can be reflected by the image contrast distribution (or texture patterns) across the lesion volume. Image textures have been shown as an effective descriptor of the lesion heterogeneity for computer-aided diagnosis. Can we map the raw images into texture patterns (or images) and train CNN to learn from the texture images? This question is the central theme of this presentation with application to CT Colonography or virtual colonoscopy, a game from AlphaGo to PolypGo. Bio: Jerome Zhengrong Liang, PhD, IEEE Fellow Imaging Research and Informatics Laboratory Department of Radiology, Stony Brook University

Abstract: AI has achieved remarkable advancements in image recognition and natural language processing. However, its applications in Earth and environmental sciences are still emerging. Unprecedented data from satellites, sensors, and in-situ measurements oIers new opportunities to improve physics-based models and forecasts of environmental systems with AI and to gain deeper insights into these phenomena. Extreme systems, such as weather and climate events, pose distinct challenges for AI, such as limited sampling of rare events, non-trivial data augmentation, errors-in-variables, and complexities of transfer learning across diverse tasks. In this talk, we will explore some of these challenges and showcase AI architectures designed to address them. We will use specific examples of forecasting dust storms, precipitation extremes, flash floods, and drought events in the Middle East. Finally, we will discuss a different AI approach for studying sinkhole formation in the Dead Sea.

Speaker: Prof. Yinon Rudich, Department of Earth and Planetary Sciences, Weizmann Institute, Israel


Join Zoom Meeting
ID: 98731258879
Passcode: cJjGQJqP

The next AI Institute seminar speaker will be Chao Chen of Biomedical Informatics, on Monday November 29 at noon via zoom:

https://stonybrook.zoom.us/j/96233844681?pwd=aVVsUnIzMWJDMHRqVXcrQU5HMjFVQT09

He will be talking on the Detection of Trojan Attacks to Deep Neural Networks - A Topological Perspective, with his abstract and bio below.


Abstract: Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, i.e., samples with special trigger injected and labels altered. To identify a Trojaned model at deployment is challenging, due to limited access to the training data. We propose to identify Trojaned neural networks using methods from topological data analysis. In particular, we propose to (1) inspect high-order topological features of the neuron interactions and (2) reverse engineer the injected triggers using a topological loss. These approaches take different angles and reveal insights into the behavior of neural networks when their strong memorialization power is exploited maliciously. The work has been accepted to NeurIPS'21. I will also briefly mention other research directions from my group, including incorporating topological information into deep image analysis, topology-inspired graph neural networks, and robust training of neural networks with label noise. These works have been published in ICLR, ICML, NeurIPS, ECCV, ICCV and AAAI in recent years.
Bio: Dr. Chao Chen is an assistant professor of Biomedical Informatics at Stony Brook University. His research interests span topological data analysis (TDA), machine learning and biomedical image analysis. He develops principled learning methods inspired by the theory from TDA, such as persistent homology and discrete Morse theory. These methods address problems in biomedical image analysis, robust machine learning, and graph neural networks from a unique topological view. His research results have been published in major machine learning, computer vision, and medical image analysis conferences. He is serving as an area chair for MICCAI, AAAI, CVPR and NeurIPS.

A new virtual seminar series on Games, Decisions, and Networks will start this Friday. The series aims at bringing together researchers working on foundations and applications of games theory, decision theory, and networks from computer science, control, economics and operation research. 





The advisory board for the series comprises Asu Ozdaglar (MIT), Christos Papadimitriou (Columbia), Drew Fudenberg (MIT), Eva Tardos (Cornell), Matthew O. Jackson (Stanford), Ramesh Johari (Stanford), and Tamer Başar (UIUC). 
The first talk will be given by Costantinos Daskalakis (MIT) on January 22nd at noon ET, titled Equilibrium Computation and the Foundations of Deep Learning. Upcoming speakers include


- Rakesh Vohra (Upenn)
- Sanjeev Goyal (Cambridge)
- Aaron Roth (Upenn)
- Aislinn Bohren (Upenn)
- Jason Marden (UCSB)

and more to be added!

CSE 656 Seminars in Computer Vision - Wednesdays 11:30am-12:50pm, Room NCS 120

The overall purpose of this seminar is to bring together people with interests in Computer Vision theory and techniques and to examine current research issues. This course will be appropriate for people who already took a Computer Vision graduate course or already had research experience in Computer Vision. To enroll in this course, you must either: (1) be in the PhD program or (2) receive permission from the instructors.

Each seminar will consist of multiple short talks (around 10 minutes) by multiple people. Students can register for 1 credit for CSE656. Registered students must attend and present a minimum of 2 or 3 talks. Everyone else is welcome to attend. Fill in https://forms.gle/pCVXovgfMfQwGqG38 to subscribe to our mailing list for further announcement.

The first meeting will be Wed Jan 29 at 11.30am, room 120 New CS. The meeting will deal with organizational matters and we will start right away with some presentations. Send David Paredes Merino <dparedesmeri@cs.stonybrook.edu> an email if you are interested but cannot attend the first meeting. Please forward to people outside the CS department that you think might be interested.

Learn about how to ask AI question of Notebook LM and the new interactive features.

Notebook LM allows you to interact with multiple sources of information. You can chat or ask follow up questions. Learn how you can gain more insights through these interactions.

Register here.