Title: Sustainable NLP

Time: Friday 4/29, 2:40 PM

Location: NCS 120

Abstract:


Natural language processing (NLP) technology has supercharged many real-world applications ranging from intelligent personal assistants (like Alexa, Siri, and Google Assistant) to commercial search engines such as Google and Bing. But current NLP applications use extremely large neural models, making them (i) expensive to deploy on servers, requiring large amounts of compute resources and power, and (ii) impossible to run on mobile devices, making on-device, privacy-preserving applications impractical.

In the first part of the talk, I will describe systems optimizations we have developed that significantly reduce the compute and memory requirement of NLP models. The optimizations we developed can be applied broadly and results in over 10x reduction in latency when deployed on mobile devices. In the second part of the talk, I will describe our recent work on predicting energy consumption of NLP models. Existing energy prediction approaches are not accurate, making it difficult for developers and practitioners to reason about their models in terms of power. We use a multi-level regression approach that produces highly accurate and interpretable energy predictions.



Bio:
Aruna Balasubramanian is an Associate Professor at Stony Brook University. She received her Ph.D from the University of Massachusetts Amherst, where her dissertation won the UMass outstanding dissertation award and was the SIGCOMM dissertation award runner up. She works in the area of networked systems. Her current work consists of two threads: (1) significantly improving Quality of Experience of Internet applications, and (2) improving the usability, accessibility, and privacy of mobile systems. She is the recipient of the SIGMobile Rockstar award, a Ubicomp best paper award, a Computing Innovation Fellowship, a VMWare Early Career award, several Google research awards, an
Abstract: Jailbreak attacks circumvent LLMs' built-in safeguards by concealing harmful queries within adversarial prompts. While most existing defenses attempt to mitigate the effects of adversarial prompts, they often prove inadequate as adversarial prompts can take arbitrary, adaptive forms. This paper introduces RobustKV, a novel jailbreak defense that takes a fundamentally different approach by selectively removing critical tokens of harmful queries from key-value (KV) caches. Intuitively, for an adversarial prompt to be effective, its tokens must achieve sufficient `importance' (measured by attention scores), which consequently lowers the importance of tokens in the concealed harmful query. Therefore, by carefully evicting the KVs of low-ranked tokens, RobustKV minimizes the harmful query's presence in the KV cache, thus preventing the LLM from generating informative responses. Extensive evaluation using benchmark datasets and models demonstrates that RobustKV effectively counters state-of-the-art jailbreak attacks while maintaining the LLM's performance on benign queries. Notably, RobustKV creates an interesting effectiveness-evasiveness dilemma for the adversary, leading to its robustness against adaptive attacks.

Speaker: Tanqiu Jiang

Where: NCS 220 and Zoom (https://stonybrook.zoom.us/j/6406956411)
We live in a new scientific paradigm: the Big Data era, in which a lot of data is available for almost anything. In this new paradigm, the driving force is to use data directly to learn about chemical and physics systems employing artificial intelligence. This paradigm has proven helpful in simulating realistic physical, biological, and chemical models, yielding impressive results. Similarly, the insight gained in these situations can be used to improve our understanding of fundamental processes. In that regard, we want to answer the question: Can a machine learn chemistry? The answer to this question is still debatable, but we will show our ideas and methods to find the answer. We will also discuss our results on predicting atom-diatom reactions and other avenues and work in progress in our group.

Please register for the STEM Speaker Series: Can a Machine learn Chemistry here.

Google Docs has been updated to integration Gemini AI. Learn about the integrations that gives you more features within Google Docs. There are also AI Automations that will keep you updated when things happen with documents.

In this session, you will:

  1. Learn about the AI features within Google Docs
  2. Learn about workflow to be notified of changes to Docs
  3. Understand the features that allow AI to work

Register here.

Abstract:
Deep learning models have achieved remarkable success across a wide range of computer vision tasks, including image classification, semantic segmentation, etc. However, such success highly relies on a large amount of annotated data, which are expensive to obtain. Moreover, their performance often degrades when there exist distribution shifts between training and test data. Domain Adaptation overcomes these issues by transferring knowledge from a label-rich source domain to a related but different target domain. Despite its popularity, domain adaptation is still a challenging task, especially when the data distribution shifts are severe, while the target domain has no or few labeled data.

In this thesis, I develop four efficient domain adaptation approaches to improve model performance on the target domain. Firstly, inspired by the large-scale pretraining of Vision Transformers, I explore Transformer-based domain adaptation for stronger feature representation and design a safe training mechanism to avoid model collapse in the situation of a large domain gap. Secondly, I observe that source models have low confidences on the target data. To address this, I focus on the penultimate activations of target data and propose an adversarial training strategy to enhance model prediction confidences. Thirdly, I study using weak supervision from prior knowledge about target domain label distribution. A novel Knowledge-guided Unsupervised Domain Adaptation paradigm is devised, and a plug-in module is designed to rectify pseudo labels. Lastly, I step into the task of Active Domain Adaptation, where the labels of a small portion of target data can be inquired. I propose a novel active selection criterion based on the local context and devise a progressive augmentation module to better utilize queried target data. The robustness of domain adaptation approaches, in addition to accuracy, is critical yet under-explored. To conclude the thesis, I empirically study set prediction in domain adaptation using the tool of conformal prediction and conformal training.


Location: New Computer Science Bldg., Room 120
Zoom Link: https://stonybrook.zoom.us/j/92736258273?pwd=ipDdh1CTG6dRYmqa3ltUvooei8OfaT.1Meeting ID: 927 3625 8273
Passcode: 466399

Donghee Yvette Wohn, Ph.D.

Inaugural chair of the Department of Technology, AI, and Society, Stony Brook University

Short bio: Dr. Wohn (she/her) is a Professor at the State University of New York at Stony Brook (Stony Brook University), where she is the inaugural chair of the Department of Technology, AI, and Society and director of the Social Interaction Lab (socialinteractionlab.com). Her research is in the area of Human-Computer Interaction (HCI), where she studies the characteristics and consequences of social interactions in online environments. Funded by the National Science Foundation, Mozilla Foundation, and Yahoo, her main projects examine 1) content moderation, online harassment and the creation/maintenance of online safe spaces, 2) social exchange in digital economies & digital patronage (creator-supporter dynamics), and 3) identity and online self-presentation.

Location: NCS 120

CSE 600 Talk: Securing Software-Defined Networking Infrastructure by Dr. Guofei Gu

ABSTRACT: Today's network and computing infrastructure rests on inadequate  foundations. An emerging, promising new foundation for computing is software-defined infrastructure (SDI), which offers a range of  
technologies including: compute, storage and network virtualization;  novel separation of concerns at the systems level; and new approaches to system and device management. As a representative example of SDI,  
software-defined networking (SDN) is a new networking paradigm that decouples the control logic from the closed and proprietary implementations of traditional network data plane infrastructure. SDN is now becoming the networking foundation for data-center/cloud, future Internet and 5G infrastructures.  

We believe that SDN is an impactful technology to drive a variety of innovations in network management and security. It is now clear that security will be a top concern, as well as a new killer app, for SDN. In this talk, I will discuss some new opportunities, as well as challenges, in this new direction and demonstrate with our recent  
research results. I will discuss how SDN can enhance network security. And I will also discuss some unique new security problems inside SDN and introduce some of our work to enhance the security of SDN. Finally, I will share my vision on programmable system security in a software-defined world.  

BIO: Dr. Guofei Gu is a professor in the Department of Computer Science & Engineering at Texas A&M University (TAMU). Before coming to Texas A&M, he received his PhD degree in Computer Science from the College  
of Computing, Georgia Institute of Technology. His research interests are in network and systems security.  
Dr. Gu is a recipient of 2010 NSF CAREER Award, 2013 AFOSR Young  Investigator Award, 2010 IEEE S&P Best Student Paper Award, 2015 ICDCS Best Paper Award, Texas A&M Dean of Engineering Excellence Award,  
Presidential Impact Fellow, Charles H. Barclay Jr. '45 Faculty Fellow and the Google Faculty Research Award. He is an active member of the security research community and has pioneered several new research directions such as botnet detection/defense and SDN security. Dr. Gu has served on the program committees of top-tier security conferences such as IEEE S&P, ACM CCS, USENIX Security and NDSS. He is an ACM Distinguished Member, an Associate Editor for IEEE Transactions on Information Forensics and Security (T-IFS), and the Steering Committee co-chair for SecureComm. He is currently directing the SUCCESS Lab at TAMU.

The Future Histories Studio at Stony Brook University and Guggenheim New York are collaborating to present a day-long symposium on October 24 at the Simons Center for Geometry and Physics. This conference will explore urgent questions at the intersection of artificial intelligence, machine learning, and the human, and is co-organized by Noam Segal, LG Electronics Associate Curator at Guggenheim New York. In this role, Noam plays an important part in researching these topics, promoting a deeper understanding of the ways in which contemporary artists use new technologies, and developing and supporting the Guggenheim's engagement with technology-based art under the LG Guggenheim Art and Technology Initiative.

The event examines the profound transformations brought by automation--how AI compels us to rethink cognition, agency, and the conditions of reason itself. As these systems become ever more embedded in daily life--largely invisible yet deeply consequential--they challenge the very foundations of subjectivity and governance. We are surrounded by logics we cannot fully access, yet which shape our realities, while new forms of alterity arise--distinct modes of reasoning that propose collective unknowns beyond established frameworks of knowledge.

This emerging terrain invites us to consider cognitive plurality, where biological and technological intelligences generate new categories, concepts, and understandings. Once unique to humans--art, authorship, judgment, invention--are now co-articulated with systems of computation and planetary-scale infrastructure. The symposium brings together artists, scholars, and technologists to probe the cultural, philosophical, and ecological implications of this entanglement.

The concept of neurodiversity has shown that neurological differences such as autism, ADHD, and dyslexia are not deficits but variations that enrich collective life. Extending this to machines can be provocative: just as neurodivergence unsettles fixed definitions of intelligence, so too AI challenges anthropocentric assumptions about cognition. Yet the analogy is limited. Neurodiversity is rooted in the lived struggles of human communities, while machines neither think nor struggle. Human cognition involves perception, learning, memory, and reasoning through embodied experience. Machine cognition, by contrast, is computational pattern recognition and statistical modeling, without consciousness or lived context, and with only narrow forms of sensing.

For this reason, the symposium advances a broader framework of cognitive diversity or technodiversity--a recognition of proliferating intelligences, human, machinic, and hybrid, as part of a shared ecology. This shift calls for new models of creativity, responsibility, and collaboration that honor the irreducibility of human thought while engaging the radical alterity of machine logics.

Location: Stony Brook Simons Center for Geometry and Physics, Della Pietra Family Auditorium

This event is co organized by the Guggenheim New York

Educational objectives:
  1. Techniques involving data driven inferences from multi-omics data
  2. Interdisciplinary approaches to uncover aspects of tumor biology
  3. Computational genomics method development, benchmarking, and validation


Speaker: Dr. Subhajyoti De, PhDProfessor, Cancer SystemsBiology and Pathology,Rutgers Cancer Institute,The State University of New Jersey

Location: MART Building, Room 7M-0602 (7th Floor)

Remote Access: https://stonybrook.zoom.us/j/95617197636?pwd=KytzZ2pVRG9SZGpKZUtpNXJISjNjZz09
Meeting ID: 95617197636 | Passcode: 924293