You are cordially invited to attend the biweekly Brookhaven AI Mixer (BAM). BAM includes one short talk on AI research happening at BNL, followed by an open mixer over coffee and snacks for everyone to network and discuss all things AI. The first half hour will consist of presentations that will be available via ZOOM, and the second half hour will be for in person only networking.

Join us every other Tuesday at noon in CDSD's Training Room (building 725, 2nd floor) to learn about interesting AI methods and applications, engage with potential collaborators, prepare for pending FASST funding calls, and build a community of AI for Science at BNL.

Learning Generalizable Program and Architecture Representations for Performance Modeling

Abstract: Performance modeling is an essential tool in many areas of computer science and engineering. However, existing performance modeling approaches have limitations, such as high computational cost, narrow flexibility, or restricted accuracy/generality. To address these limitations, this talk introduces PerfVec, a novel deep learning-based performance modeling framework that learns high-dimensional and independent/orthogonal program and microarchitecture representations. Once learned, a program representation can be used to predict its performance on any microarchitecture, and likewise, a microarchitecture representation can be applied in the performance prediction of any program. Additionally, PerfVec yields a foundation model that captures the performance essence of instructions, which can be directly used by developers in numerous performance modeling-related tasks without incurring its training cost. The evaluation demonstrates that PerfVec is more general and efficient than previous approaches. This talk will also introduce how PerfVec's design principles can benefit broader research areas.

Biography: Lingda Li is a computer scientist at Brookhaven National Laboratory. He is generally interested in computer architecture and programming model research, with focus on simulation/modeling, memory systems, and machine learning. Before joining BNL, he worked at the Department of Computer Science of Rutgers University as a postdoc to carry out GPGPU research. He obtained a PhD in computer architecture from the Microprocessor Research and Development Center at Peking University.

Location: CDS, Bldg. 725, Training Room

Join ZoomGov Meeting: https://bnl.zoomgov.com/j/1605837856?pwd=kYqJs4bVBt4E0cMCWR6GXH3wxzOoiw.1

Meeting ID: 160 583 7856
Passcode: 161580

Abstract: Capturing the spatio-temporal (4D) dynamics of humans has been a long standing research problem in computer vision and graphics. Synthesizing photorealistic human avatars has broad applications, ranging from immersive telepresence in AR/VR and the movie industry, to enriching the education and healthcare systems. Earlier approaches relied on hand-engineered models that use a small amount of data from one or more subjects. With the advent of neural networks, training on large datasets enhanced the output visual quality. Currently, the combination of neural networks with graphics techniques has achieved natural-looking human animation. However, most approaches are identity-specific, trained only on a single identity, and use only one modality.

In this dissertation, we address the problem of learning neural representations of humans in a holistic way. Given that the video data in the real world include multiple modalities (e.g., audio and video) and multiple identities, we develop multi-modal and multi-identity representations. First, we propose to reconstruct the 4D face geometry of humans by leveraging both audio and video information. In this way, the network produces accurate lip shapes and is robust to cases when either modality is insufficient. Next, we introduce a NeRF-based representation for audio-driven human face animation that achieves high-quality lip synchronization for cinematic content. Since humans communicate with their full body, combining body pose, hand gestures, and facial expressions, we extend the network to capture full-body human motion for multiple identities simultaneously. In order to better disentangle identity and non-identity specific information, we subsequently study non-linear interactions between latent factors of variation, and propose a specific multiplicative module. In this way, we learn a multi-identity NeRF that robustly animates human faces under novel expressions and achieves a significant decrease in the total training time. Similarly, we propose a multi-identity Gaussian splatting representation for human bodies, by constructing a high-order tensor. Assuming a low-rank structure, we learn a tensor decomposition that leads to a significant decrease in the total number of learnable parameters, as well as to a robust animation under novel poses. Last but not least, we propose to jointly synthesize audio and visual outputs from just text input. Given the recent rise of large language models, coupling text with natural-looking avatars can enhance the overall interaction between a human and an AI system.

Location: NCS 220 or Zoom

This is Stony Brook's quantum moment. Join us for a spotlight on the core achievements and research excellence of faculty across the Colleges of Arts and Sciences (CAS), and Engineering and Applied Sciences (CEAS) - and their collaborative advancements in quantum science and technology. Learn about the real world impact of their enduring work, their leadership in translating foundational science into entrepreneurial opportunities, and their impetus for making connections to next generation innovation.

Presented by: Catherine Chen, Ph.D., Research Development Associate

Welcome remarks: President Andrea Goldsmith

Panel moderators: Dean David Wrobel, CAS, and Dean Andrew Singer, CEAS

Presentations and panel featuring our faculty:

  • Jennifer Cano, CAS, Physics and Astronomy

  • P. Scott Carney, CEAS, Mechanical Engineering

  • Hyeongrak Chuck Choi, CEAS, Electrical and Computer Engineering

  • Eden Figueroa, CAS, Physics and Astronomy

  • Humanshu Gupta, CEAS, Computer Science

  • Angela Kelly, CAS, Physics and Astronomy

Location: Theatre at the Charles B. Wang Center, Stony Brook University

Reserve your tickets by March 26!

OVERVIEW


This workshop, Expanding Horizons in AI with HPC, aims to explore the dynamic intersection of AI and HPC, focusing on how advanced computing can accelerate AI research and applications. As AI models become more complex and data-intensive, traditional computing systems struggle to meet the demand for scalability, efficiency, and speed. HPC offers a solution by providing the necessary infrastructure for training large-scale models, enhancing AI algorithms, and enabling breakthroughs in fields such as deep learning, natural language processing, and autonomous systems.

Through a combination of expert presentations and panel discussions, participants will gain insights into the latest developments in AI-HPC integration. Attendees will also engage in discussions on the future trends, challenges, and ethical considerations surrounding the use of HPC in AI.

The workshop is designed for AI researchers, data scientists, engineers, and HPC professionals seeking to enhance their understanding of how high-performance computing can drive innovation and expand the potential of AI in solving complex, real-world problems.

The workshop will be held at the Wang Center at Stony Brook University.

https://you.stonybrook.edu/hpcai/

PROGRAM

The program features sessions on HPC Architectures for AI, AI Applications in HPC, LLM's in HPC, and AI in HPC Workflows, and open student presentations. The tentative program and list of confirmed speakers is available at https://you.stonybrook.edu/hpcai/program/.

CALL FOR STUDENT PRESENTATIONS & PARTICIPATION

We are excited to offer students the opportunity to present their work in the area of high-performance scientific computing and artificial intelligence at the workshop. We are calling for students to submit their talk proposals (Name + Title) by April 15 to hpc_ai_workshop@stonybrook.edu. The committee will select the best submission to be presented at the workshop. Accepted speakers will be notified by April 22, 2025.

All students, regardless of whether they are presenting, may reach out to hpc_ai_workshop@stonybrook.edu for financial support to cover travel and lodging costs.

REGISTRATION

Registration is available at https://www.eventbrite.com/e/expanding-horizons-in-ai-with-hpc-tickets-1256469978529?aff=oddtdtcreator until May 2nd. The registration fee covers the workshop participation and the social event in the evening of May 9.

Regular registration: $200
Student registration: $100


IMPORTANT NOTE

The registration fee was meant to cover the room rent, catering, and dinner. Thanks to an RF seed grant, we are able to drop the registration fees for SBU students and staff/faculty. We still ask for an informal registration via email to hpc_ai_workshop@stonybrook.edu until April 27, so we can plan for catering and dinner.
Please get in touch with us if you have already registered as an SBU student/faculty/staff member for the workshop so we can handle any reimbursement.

The program is now online at https://you.stonybrook.edu/hpcai/program/.
Abstract: Large language models (LLMs) may exhibit unintended or undesirable behaviors. Recent works have concentrated on aligning LLMs to mitigate harmful outputs. Despite these efforts, some anomalies indicate that even a well-conducted alignment process can be easily circumvented, whether intentionally or accidentally. Does alignment fine-tuning yield have robust effects on models, or are its impacts merely superficial? In this work, we make the first exploration of this phenomenon from both theoretical and empirical perspectives. Empirically, we demonstrate the elasticity of post-alignment models, i.e., the tendency to revert to the behavior distribution formed during the pre-training phase upon further fine-tuning. Leveraging compression theory, we formally deduce that fine-tuning disproportionately undermines alignment relative to pre-training, potentially by orders of magnitude. We validate the presence of elasticity through experiments on models of varying types and scales. Specifically, we find that model performance declines rapidly before reverting to the pre-training distribution, after which the rate of decline drops significantly. Furthermore, we further reveal that elasticity positively correlates with the increased model size and the expansion of pre-training data. Our findings underscore the need to address the inherent elasticity of LLMs to mitigate their resistance to alignment.

Speaker: Huajian Zhang

Location: CS2311

Join the Office of Educational Effectiveness' upcoming workshop on the transformative potential of AI tools to enhance program assessment. Learn how to leverage AI to create targeted learning objectives, detailed rubrics, and precise benchmarks that will elevate the quality and effectiveness of your program assessment process. Join in-person on Oct. 17 at 10:30 am or virtually on Oct. 21 at 12 pm.

Register in advance: https://calendar.stonybrook.edu/site/office-educational-effectiveness/event/leveraging-ai-in-assessment-zoom/
Mind Brain Lecture: Constructing the World of Taste in Your Head You fork the morsel into your mouth and say yum...chocolate cake. The appreciation of your dessert's taste seems to follow directly, quickly and simply from the placement of the food on your tongue. The truth, however, is far more interesting and complex: your brain actually begins determining whether you will enjoy a bite of food even before the fork approaches your mouth and continues to work the problem well after. Information about your food's color, smell, texture and taste activates multiple parts of your brain, where that information collides with your pre-mouthful beliefs about how it should taste. The coming-together and shuffling of that information around the brain takes time, as networks of neurons work together to help you decide whether the morsel in your mouth is worth swallowing. Referring to work from psychology, biology and computational neuroscience, Professor Katz will de-mystify and reveal the beauty of these complexities of the neuroscience of taste. Donald Katz, Professor of Psychology, Departments of Neuroscience, Psychology, and the Volen National Center for Complex Systems, Brandeis University Free presentation intended for a general audience. Reception to follow. https://www.stonybrook.edu/commcms/mind/

The Department of AI and Society (AIS) at the University at Buffalo is hosting a two-day AI and Society Workshop focused on building AI systems by society, for society. This workshop brings together researchers and community organizers to explore how AI systems can be developed through meaningful collaboration across disciplines.

Topics include:

  • Labor and AI
  • Public services and AI
  • Community-centered AI systems
  • Intersections of humanities, social sciences, arts, and computing

The vision of UB's Department of AI and Society is to create a future where AI systems are built by society, for society. AIS centers community engagement at every stage of AI development through collaboration across disciplines and sectors. AIS was established with a $5 million grant from SUNY, and this workshop is made possible through that support.

Who Should Attend?

  • Researchers
  • Students
  • Community organizers
  • Practitioners interested in AI's societal impact

More about the event

Register here

This symposium will highlight how artificial intelligence (AI) can assist in dementia detection, research and clinical care. For example, the use of robotics to assist with dementia care therapy is truly inspirational and cutting-edge for clinicians, trainees and the community at large, including assisted living facilities. The symposium will also focus on the role of AI in early detection of dementia and in identifying characteristics associated with future cognitive decline.

Learn more and register at https://cme.stonybrookmedicine.edu/continuing-medical-education/conferences/233/alzheimers-symposium-ai-the-future-of-dementia-care-2024/11/15/2024