Zoom Link: https://github.com/giorgianb/spdhackspring2021/blob/main/bit.ly/spdhack2021

ΣΦΔ Hack Spring 2021 is ΣΦΔ's first annual machine learning hackathon. ΣΦΔ Hack Spring 2021 aims to introduce Stony Brook students to the rich and challenging field of machine learning, and develop the skills necessary to build sophisticated machine learning models on their own.
 
More info here: https://github.com/giorgianb/spdhackspring2021/blob/main/README.md
Abstract: This dissertation addresses the methodological disconnect between Natural Language Processing (NLP) and human-centric analysis by shifting the unit of analysis from document to human behavior in two broad respects: (i) time-ordering: modeling documents as sequential person-indexed behavioral observations, and (ii) person-level semantics: evaluation and explainability of models by their latent structure of psychological constructs rather than just its predictive accuracy against narrow proxy measures. First, we consider the most basic implication of language as a person's behaviors when measuring their psychological constructs: relationship between language sample size and model's predictive performance. We empirically show that the state-of-the-art transformers are often over-parameterized for typical NLP dataset sizes and can be reduced in dimensionality without performance loss. Establishing the author as the unit of analysis naturally allows us to treat their behavior as a time-ordered sequence. Second, we introduce a longitudinal evaluation framework that establishes ecologically valid evaluation settings, namely, cross-sectional and prospective generalization, and separates error measurement of the model into within-person dynamics and between-person differences. We demonstrate that traditional NLP evaluations based on random document splits can yield reversed conclusions under ecologically valid generalization settings. To address this, we develop models that capture the trajectory of mental states (e.g., mood shifts) rather than static traits. Third, moving into person-level semantics, we evaluate the latent structure of large language models using a novel machine behavior analytic framework. We find that while GPT-4 achieves high predictive correlation with self-reports, its latent symptoms structure diverges from clinical understanding. Finally, we propose a method for modeling multidimensional behaviors, embedding concurrent behavioral signals alongside language to predict future states. Taken together, this work suggests that operationalizing language as behavior advances NLP methods into a rigorous instrument for valid psychological inquiry.

Speaker: Adithya Ganesan

Location: Join Zoom Meeting (ID: 99021939129, Passcode: 569493)

You are cordially invited to attend the biweekly Brookhaven AI Mixer (BAM). BAM includes one short talk on AI research happening at BNL, followed by an open mixer over coffee and snacks for everyone to network and discuss all things AI. The first half hour will consist of presentations that will be available via ZOOM, and the second half hour will be for in person only networking.

Join us every other Tuesday at noon in CDSD's Training Room (building 725, 2nd floor) to learn about interesting AI methods and applications, engage with potential collaborators, prepare for pending FASST funding calls, and build a community of AI for Science at BNL.

AI and Edge Processing Co-Design for Radiation Detectors

Abstract: Artificial Intelligence (AI) offers exciting new opportunities for enhancing the performance of radiation detectors, ultimately leading to improved physics outcomes. Furthermore, with the explosive growth in data rates being seen by next-generation radiation detectors, deployment of AI algorithms at the edge by embedding intelligence within or near the detector front-end can be transformative. Such integration enables real-time data filtering, noise suppression, feature extraction, and adaptive control, while reducing downstream bandwidth and power consumption. This talk will cover three efforts that bring AI to the forefront of detector technology. First, we demonstrate how AI-based algorithms can be used for position reconstruction in virtual Frisch-grid (VFG) detectors by compensating for charge transport distortions and detector non- uniformities, leading to significantly enhanced fidelity in imaging of gamma-ray interactions. Second, we present a smart readout application specific integrated circuit (ASIC) that combines digital signal processing with co-designed artificial neural networks to enable on-chip regression and classification of detector signals, while meeting stringent constraints on accuracy, speed, and area. Finally, we introduce our recent efforts related to the development of electro-photonic processing architectures that integrate CMOS electronics and silicon photonics for near-sensor AI acceleration. These architectures aim to leverage cross-disciplinary co-design from algorithms to hardware, to achieve low latency and energy-efficient processing of detector data.

Biography: Dr. Prashansa Mukim is an early-career researcher in the Instrumentation Department at BNL, where she works on the design of front-end electronics for extreme environments and the development of co-design methodologies for novel processing modalities and beyond-CMOS technologies. Prior to joining BNL, she was a post-doctoral researcher at the National Institute of Standards and Technology (NIST) in Maryland, where she focused on characterizing the properties of CMOS circuits at cryogenic temperatures and applications of spintronic devices for neuromorphic computing. She received her Ph.D. in Electrical and Computer Engineering from the University of California, Santa Barbara, in 2021.

Location: CDS, Bldg. 725, Training Room

Join ZoomGov Meeting: https://bnl.zoomgov.com/j/1608585935?pwd=UemgEkqijfNf3vIJIGuOa2MdjsunaT.1

Meeting ID: 160 858 5935
Passcode: 076033

Abstract: Artificial intelligence (AI) is rapidly transforming scientific discovery, enabling breakthroughs in areas ranging from drug discovery to modeling complex physical systems. In the life sciences, AI has traditionally been applied to prediction tasks such as classifying molecules as toxic or non-toxic, estimating drug properties, or solving partial differential equations. These discriminative models have proven powerful, but they are inherently limited to mapping existing inputs to deterministic outputs. A new wave of methods is shifting the paradigm from discrimination to generation: creating new possibilities, such as generating novel molecules or designing new drugs. By reframing AI as both a predictive and generative engine, this shift offers new pathways for accelerating discovery and innovation in life sciences at an unprecedented scale. This talk will cover several aspects of AI for Science (AI4Sci), beginning with advances in discriminative models for molecular systems and solving PDEs, and then turning to generative approaches, including diffusion models for 3D molecular generation and large language models for drug editing. Together, these developments illustrate how moving from prediction to creation is redefining what AI can contribute to science.

Bio: Wenhan Gao is a fourth-year Ph.D. student in Applied Mathematics under the supervision of Professor Yi Liu. He was also a Staff Research Scientist Intern at VISA Research, where he worked on large language models (LLMs) and multi-agent systems for commerce. Wenhan's research focuses on AI for Science (AI4Sci), with a particular emphasis on generative AI. His work looks deep into the fundamental mechanisms of AI models when applied to scientific tasks, and he strives to incorporate established scientific priors, such as symmetry, into model design. He has published papers as a first or corresponding author in leading AI and computational venues, including ICLR, ICML, NeurIPS, TMLR, ACL, and the Journal of Computational Physics. In addition to his research, Wenhan has served as a reviewer and oral session chair for top AI conferences and as a lecturer for both undergraduate and graduate courses at Stony Brook University.

Location: IACS Seminar Room or Zoom

This seminar will take place in person and online*

Join Zoom Meeting: https://stonybrook.zoom.us/j/91670093552?pwd=2EcniXqPZLTpa4ZBKRs1zAjYqs1LS0.1

Meeting ID: 916 7009 3552
Passcode: 434045
Abstract: Making large language models usable requires post-training methods that align models to human values, robustly handle underspecified inputs, and generalize to diverse instructions. This talk addresses the challenge of developing responsible AI through post-training from the following angles. First, I address contextual robustness. Preference data, for example, is often underspecified, and I show how underspecification in preference data can lead to diverging preferences. Standard reward models fail to properly handle these disagreements, often making decisive choices even when human annotators are split. I argue that more consequential outputs demand more context, and propose clarification question generation as one solution. Second, I will discuss how we can train models to be better instruction followers. I will show that most models severely overfit on a small set of instruction-following constraints and are not able to generalize well to unseen output constraints. I propose to train models with reinforcement learning from verifiable rewards for verifiable instruction following, and show how this leads to improved generalization on constraint following. Throughout the presentation, I will outline how I have applied these insights into developing open generative models, like Tülu and OLMo, and I will conclude with my research agenda for responsible post-training: critical AI evaluation, broader generalization, and expanding what models can reliably do.


Bio: Valentina Pyatkin is a postdoctoral researcher at the Allen Institute for AI and the University of Washington, advised by Prof. Hanna Hajishirzi and Prof. Yejin Choi. Additionally, she is part- time affiliated with the ETH AI Center, where she mentors students and works on post-training for the Swiss AI Initiative. She obtained her PhD in Computer Science from Bar Ilan University. Her work has been awarded an ACL Outstanding Paper Award and the ACL Best Theme Paper Award, and has been supported by a Schmidt Sciences Postdoctoral Award. During her doctoral studies, she conducted research internships at Google and the Allen Institute for AI, where she received the AI2 Outstanding Intern of the Year Award.

Location: NCS 120


Abstract:
Large language models (LLMs) have transformed the way humans write code, bringing unprecedented automation to software development. In this talk, I will first provide an overview of my research on enhancing LLMs' code intelligence, optimizing each step of the development pipeline towards more complex software engineering tasks. I will then delve into my key contributions, focusing on how to equip LLMs with a deeper, more comprehensive understanding of software programs. Finally, I will discuss the future of AI-driven software engineering, envisioning a new era of automation that is more reliable, intelligent, and cost-efficient.

Bio:
Yangruibo (Robin) Ding is a Ph.D. candidate in the Department of Computer Science at Columbia University. His research is at the intersection of Software Engineering and Machine Learning, focusing on developing large language models (LLMs) for code. He trains LLMs to generate, analyze, and refine software programs and constructs benchmarks to systematically evaluate LLMs in solving software engineering tasks. He also studies how to improve LLMs' reasoning capability to tackle complex programming tasks, such as debugging and patching. His interdisciplinary research has been published in top-tier conferences of software engineering, programming languages, natural language processing, and machine learning. He won an ACM SIGSOFT Distinguished Paper Award, an IEEE TSE Best Paper Runner-up, and received an IBM Ph.D. Fellowship.
Location:
NCS 120