The overall purpose of this seminar is to bring together people with interests in Computer Vision theory and techniques and to examine current research issues. This course will be appropriate for people who already took a Computer Vision graduate course or already had research experience in Computer Vision.
To enroll in this course, you must either: (1) be in the PhD program or (2) receive permission from the instructors.
Each seminar will consist of multiple short talks (around 15 minutes) by multiple students. Students can register for 1 credit for CSE656. Registered students must attend and present a minimum of 2 talks. Everyone else is welcome to attend. Fill in https://forms.gle/q6UG9ygauLp2a8Po8 to subscribe to our mailing list for further announcement.
Abstract: Jailbreak attacks circumvent LLMs' built-in safeguards by concealing harmful queries within adversarial prompts. While most existing defenses attempt to mitigate the effects of adversarial prompts, they often prove inadequate as adversarial prompts can take arbitrary, adaptive forms. This paper introduces RobustKV, a novel jailbreak defense that takes a fundamentally different approach by selectively removing critical tokens of harmful queries from key-value (KV) caches. Intuitively, for an adversarial prompt to be effective, its tokens must achieve sufficient `importance' (measured by attention scores), which consequently lowers the importance of tokens in the concealed harmful query. Therefore, by carefully evicting the KVs of low-ranked tokens, RobustKV minimizes the harmful query's presence in the KV cache, thus preventing the LLM from generating informative responses. Extensive evaluation using benchmark datasets and models demonstrates that RobustKV effectively counters state-of-the-art jailbreak attacks while maintaining the LLM's performance on benign queries. Notably, RobustKV creates an interesting effectiveness-evasiveness dilemma for the adversary, leading to its robustness against adaptive attacks.
Speaker: Tanqiu Jiang
Where: NCS 220 and Zoom (https://stonybrook.zoom.us/j/
Speaker: Tanqiu Jiang
Where: NCS 220 and Zoom (https://stonybrook.zoom.us/j/
The International Neuroethics Society (INS) Speaker Series on AI & Consciousness
Abstract: Colln Allen and I noted in our 2008 book Moral Machines: Teaching Robots Right From Wrong, that consciousness, a theory of mind, sociability, situational awareness and embodiment are all supra-rational (beyond reason) capabilities that contribute to making ethical decision Whether any of these can be fully instantiated in machines remains an open question. Nevertheless, moral decision making in the digital age will require an evolution in and refinement of specific skills for both humans and for AI. I call one of these evolutions in moral decision making capabilities tradeoff ethics and another a silent ethics. Aspects of this social, and not just technological evolution, will require research by neuroscientists.
Speaker Bio: Wendell Wallach has an international reputation as an expert on the ethics and governance of emerging technologies, particularly artificial intelligence and biotechnologies. He is also senior advisor to The Hastings Center and a scholar at the Yale University Interdisciplinary Center for Bioethics where he chaired Technology and Ethics studies for eleven years. Wallach's latest book, a primer on emerging technologies, is entitled, A Dangerous Master: How to keep technology from slipping beyond our control. He co-authored (with Colin Allen) Moral Machines: Teaching Robots Right From Wrong. Wallach has been referred to as, a Godfather of AI Ethics.
Pre-register here (required): https://umaryland.zoom.us/
Abstract: Colln Allen and I noted in our 2008 book Moral Machines: Teaching Robots Right From Wrong, that consciousness, a theory of mind, sociability, situational awareness and embodiment are all supra-rational (beyond reason) capabilities that contribute to making ethical decision Whether any of these can be fully instantiated in machines remains an open question. Nevertheless, moral decision making in the digital age will require an evolution in and refinement of specific skills for both humans and for AI. I call one of these evolutions in moral decision making capabilities tradeoff ethics and another a silent ethics. Aspects of this social, and not just technological evolution, will require research by neuroscientists.
Speaker Bio: Wendell Wallach has an international reputation as an expert on the ethics and governance of emerging technologies, particularly artificial intelligence and biotechnologies. He is also senior advisor to The Hastings Center and a scholar at the Yale University Interdisciplinary Center for Bioethics where he chaired Technology and Ethics studies for eleven years. Wallach's latest book, a primer on emerging technologies, is entitled, A Dangerous Master: How to keep technology from slipping beyond our control. He co-authored (with Colin Allen) Moral Machines: Teaching Robots Right From Wrong. Wallach has been referred to as, a Godfather of AI Ethics.
Pre-register here (required): https://umaryland.zoom.us/
Jerome Liang, PhD
Professor of Radiology, Biomedical Engineering, Electric and Computer Engineering, and Computer Science
Co-Director of Research
Department of Radiology
Artificial intelligence, machine learning and computer-aided diagnosis in cancer Imaging
February 11, 2021
12:00pm - 1:00pm
Virtual Seminar - Zoom
https://stonybrook.zoom.us/j/
Meeting ID: 981 5562 9970
Passcode: 950410
Host:
Wei Zhao, PhD
Professor of Radiology and Biomedical Engineering
Educational Objectives
Upon completion, participants should be able to:
(1) Learn different medical image representations of cancer attributes, such as heterogeneity, high tendency to grow, etc.
(2) Learn how computer (machine) can be trained (or programmed) to recognize the image representations.
(3) Learn how artificial intelligence can drive the machine learning to maximize the performance of computer-aided diagnosis (CADx).
Disclosure Statement
In compliance with the ACCME Standards for Commercial Support, everyone who is in a position to control the content of an educational activity provided by the School of Medicine is expected to disclose to the audience any relevant financial relationships with any commercial interest that relates to the content of his/her presentation.
The speaker, Jerome Liang, PhD, the planners; and the CME provider have no relevant financial relationship with a commercial interest (defined as any entity producing, marketing, re-selling, or distributing health care goods or services consumed by, or used on, patients), that relates to the content that will be discussed in the educational activity.
CONTINUING MEDICAL EDUCATION CREDITS
The School of Medicine, State University of New York at Stony Brook, is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians.
The School of Medicine, State University of New York at Stony Brook designates this live activity for a maximum of 1.0 AMA PRA Category 1 Credits™. Physicians should only claim credit commensurate with the extent of their participation in the activity.
Should you be logging in Zoom by using your tablet or mobile device, please be sure to add your Full Name and/or Email for CME credit.
CSE 600 Talk: Haibin Ling - Computer Vision Research and Applications
Abstract: Having been intensively studied over half a decade, computer vision has evolved as a broad research area and become mature in many applications. In this talk, we will summarize our work in computer vision in both core vision topics and application-oriented ones. In particular, for core vision problems, we will report studies on visual tracking, visual matching and visual detection; for applications, we will describe our work on medical image analysis, intelligent transportation, smart projector systems and preliminary work on material property prediction.
Bio: Haibin Ling received the BS and MS degrees from Peking University in 1997 and 2000, respectively, and the PhD degree from the University of Maryland, College Park, in 2006. From 2000 to 2001, he was an assistant researcher at Microsoft Research Asia. From 2006 to 2007, he worked as a postdoctoral scientist at the University of California Los Angeles. In 2007, he joined Siemens Corporate Research as a research scientist. From 2008 to 2019, he worked as a faculty member of Temple University. In fall 2019, he joined the Department of Computer Science of Stony Brook University where he is currently a SUNY Empire Innovation Professor. His research interests include computer vision, augmented reality, medical image analysis, and human computer interaction. He received the Best Student Paper Award at the ACM UIST in 2003, and the NSF CAREER Award in 2014. He serves as Associate Editor for several journals including IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), Pattern Recognition (PR), and Computer Vision and Image Understanding (CVIU). He has served or will serve as Area Chair for CVPR 2014, 2016, 2019 and 2020.
Abstract: Having been intensively studied over half a decade, computer vision has evolved as a broad research area and become mature in many applications. In this talk, we will summarize our work in computer vision in both core vision topics and application-oriented ones. In particular, for core vision problems, we will report studies on visual tracking, visual matching and visual detection; for applications, we will describe our work on medical image analysis, intelligent transportation, smart projector systems and preliminary work on material property prediction.
Bio: Haibin Ling received the BS and MS degrees from Peking University in 1997 and 2000, respectively, and the PhD degree from the University of Maryland, College Park, in 2006. From 2000 to 2001, he was an assistant researcher at Microsoft Research Asia. From 2006 to 2007, he worked as a postdoctoral scientist at the University of California Los Angeles. In 2007, he joined Siemens Corporate Research as a research scientist. From 2008 to 2019, he worked as a faculty member of Temple University. In fall 2019, he joined the Department of Computer Science of Stony Brook University where he is currently a SUNY Empire Innovation Professor. His research interests include computer vision, augmented reality, medical image analysis, and human computer interaction. He received the Best Student Paper Award at the ACM UIST in 2003, and the NSF CAREER Award in 2014. He serves as Associate Editor for several journals including IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), Pattern Recognition (PR), and Computer Vision and Image Understanding (CVIU). He has served or will serve as Area Chair for CVPR 2014, 2016, 2019 and 2020.
Join us to share your thoughts about teaching, learning, and AI!
The landscape of higher education is rapidly evolving with the integration of Artificial Intelligence (AI). Through the Institute on AI, Pedagogy, and the Curriculum with AAC&U, we are exploring ways that we can better address AI in teaching and learning. We want to hear your experiences, your concerns, and your ideas.
This is an open discussion for all faculty and staff to share their perspectives on the opportunities and challenges AI presents in our academic environment.
We'll be exploring critical questions like:
Time: 12:30pm-1:45pm
Location: West Campus - Melville Library, Special Collections Seminar Room (the room is to the left at the top of the first flight of stairs from the Melville lobby)
or
Date: Wednesday, December 3rd
Time: 10:30am-11:45am
Location: East Campus - HSC 2-154
Please register in advance so we can confirm the room.
Note: Videos will not be shared publicly and comments will only be shared in aggregate.
Your input is vital. From pedagogy to assessment, your insights will be critical. We look forward to a thoughtful and productive conversation!
The landscape of higher education is rapidly evolving with the integration of Artificial Intelligence (AI). Through the Institute on AI, Pedagogy, and the Curriculum with AAC&U, we are exploring ways that we can better address AI in teaching and learning. We want to hear your experiences, your concerns, and your ideas.
This is an open discussion for all faculty and staff to share their perspectives on the opportunities and challenges AI presents in our academic environment.
We'll be exploring critical questions like:
- In the age of AI, what are the opportunities you see for enriching the classroom and curriculum? How can it enhance student learning or your professional practice?
- What are the most significant challenges and concerns that AI raises for you regarding academics, student integrity, or your workload?
- What resources (tools, training, technical support, policy guidance, etc.) do you need to feel confident and successful in the age of AI?
Time: 12:30pm-1:45pm
Location: West Campus - Melville Library, Special Collections Seminar Room (the room is to the left at the top of the first flight of stairs from the Melville lobby)
or
Date: Wednesday, December 3rd
Time: 10:30am-11:45am
Location: East Campus - HSC 2-154
Please register in advance so we can confirm the room.
Note: Videos will not be shared publicly and comments will only be shared in aggregate.
Your input is vital. From pedagogy to assessment, your insights will be critical. We look forward to a thoughtful and productive conversation!
- Dr. Rose Tirotta-Esposito (Assistant Provost; Director of CELT)
- Dr. Elizabeth Hewitt (Associate Professor in the Department of Technology and Society (DTS) in the College of Engineering and Applied Sciences)
- Chris Kretz (Associate Librarian and Head of Academic Engagement at SBU Libraries)
- Prof. Rajiv Lajmi (Assistant Professor in the School of Health Professions and Chair of Applied Health Informatics)
- Dr. Matthew Salzano (Assistant Professor in the Department of Communication in the School of Communication and Journalism)
Abstract: How do humans learn the sound patterns of their language? Despite a variety of methods and advances in phonotactic learning, there is still a paucity of computational research, methods and data for languages with tones. In this talk, I will explore this question specifically in light of tone languages, where pitch plays a crucial role in distinguishing words' meaning. I provide an implementation of the Bottom-Up Factor Inference Algorithm over Autosegmental Representations (BUFIA-AR), which learns the rules governing possible tone patterns. Using a dataset of Hausa, a West African tone language, the algorithm successfully identifies patterns that are not permitted in the language. These results (i) confirm long-standing linguistic generalizations, (ii) make more specific predictions about exceptional cases, and (iii) reveal previously unnoticed patterns. The results show how mathematical models of sound structure can be brought into dialogue with both linguistic theory and computational learning, highlighting the broader potential of formal approaches to capture human linguistic knowledge.
Bio: Han Li is a fifth-year Ph.D. student in Linguistics department, specializing in computational linguistics under the supervision of Professor Jeff Heinz. Her research focuses on how sound patterns in language can be formally represented and computationally learned, bridging theoretical linguistics and computer science.
Location: Institute for Advanced Computational Science, Seminar Room
Zoom Meeting: https://stonybrook.zoom.us/j/94043459206?pwd=3ra47h8HghOFRfobRBjZaDMyTwialr.1
Meeting ID: 940 4345 9206
Passcode: 332717
The Challenges of Machine Learning in Adversarial Settings by Patrick McDaniel, Pennsylvania State University
Abstract: Advances in AI and machine learning have enabled new applications and services to interpret and process inputs in previously unthinkable complex environments. Autonomous cars, data analytics, adaptive communication and self-aware software systems are now revolutionizing markets by achieving or exceeding human performance. In this talk, I consider the evolving use of machine learning in security-sensitive contexts and explore why many systems are vulnerable to nonobvious and potentially dangerous manipulation. Here, we examine sensitivity in any application whose misuse might lead to harm--for instance, forcing adaptive network in an unstable state, crashing an autonomous vehicle or bypassing an adult content filter. I explore the use of machine learning in this area particularly in light of recent discoveries in the creation of adversarial samples and defenses against them and posit on future attacks on machine learning. The talk is concluded with a discussion of the technological and societal challenges we face as a result of current and future advances in intelligent computing.
Bio: Patrick McDaniel is the William L. Weiss Professor of Information and Communications Technology and Director of the Institute for Networking and Security Research in the School of Electrical Engineering and Computer Science at the Pennsylvania State University. Professor McDaniel is also a Fellow of the IEEE and ACM and the director of the NSF Frontier Center for Trustworthy Machine Learning. He also served as the program manager and lead scientist for the Army Research Laboratory's Cyber-Security Collaborative Research Alliance from 2013 to 2018. Patrick's research centrally focuses on a wide range of topics in computer and network security and technical public policy. Prior to joining Penn State in 2004, he was a senior research staff member at AT&T Labs-Research.
Abstract: Advances in AI and machine learning have enabled new applications and services to interpret and process inputs in previously unthinkable complex environments. Autonomous cars, data analytics, adaptive communication and self-aware software systems are now revolutionizing markets by achieving or exceeding human performance. In this talk, I consider the evolving use of machine learning in security-sensitive contexts and explore why many systems are vulnerable to nonobvious and potentially dangerous manipulation. Here, we examine sensitivity in any application whose misuse might lead to harm--for instance, forcing adaptive network in an unstable state, crashing an autonomous vehicle or bypassing an adult content filter. I explore the use of machine learning in this area particularly in light of recent discoveries in the creation of adversarial samples and defenses against them and posit on future attacks on machine learning. The talk is concluded with a discussion of the technological and societal challenges we face as a result of current and future advances in intelligent computing.
Bio: Patrick McDaniel is the William L. Weiss Professor of Information and Communications Technology and Director of the Institute for Networking and Security Research in the School of Electrical Engineering and Computer Science at the Pennsylvania State University. Professor McDaniel is also a Fellow of the IEEE and ACM and the director of the NSF Frontier Center for Trustworthy Machine Learning. He also served as the program manager and lead scientist for the Army Research Laboratory's Cyber-Security Collaborative Research Alliance from 2013 to 2018. Patrick's research centrally focuses on a wide range of topics in computer and network security and technical public policy. Prior to joining Penn State in 2004, he was a senior research staff member at AT&T Labs-Research.
Abstract: Formalization of mathematics is the process by which pen-and-paper mathematics is translated into a strict chain of logical deductions down to the axioms of mathematics. The subject has seen renewed interest in the last decades thanks to the development of computer systems called proof assistants, which make this feasible in practice.
There have now been several examples of high-profile mathematical results which have been formalized. In principle, any mathematical domain is accessible. However, existing projects are skewed towards algebra instead of analysis. Notable exceptions are a project which formalized enough of Gromov's convex integration theory to deduce Smale's sphere eversion theorem and the ongoing project to formalize Carleson's convergence theorem for Fourier series.
This workshop will bring together formalization experts and interested mathematicians to give a new impulse to formalization of analysis (in a very broad sense), and to develop abstractions and tools to deduplicate effort.
Application Information: ICERM welcomes applications from faculty, postdocs, graduate students, industry scientists, and other researchers who wish to participate. Some funding may be available for travel and lodging. Graduate students who apply must have their advisor submit a statement of support in order to be considered.
There have now been several examples of high-profile mathematical results which have been formalized. In principle, any mathematical domain is accessible. However, existing projects are skewed towards algebra instead of analysis. Notable exceptions are a project which formalized enough of Gromov's convex integration theory to deduce Smale's sphere eversion theorem and the ongoing project to formalize Carleson's convergence theorem for Fourier series.
This workshop will bring together formalization experts and interested mathematicians to give a new impulse to formalization of analysis (in a very broad sense), and to develop abstractions and tools to deduplicate effort.
Application Information: ICERM welcomes applications from faculty, postdocs, graduate students, industry scientists, and other researchers who wish to participate. Some funding may be available for travel and lodging. Graduate students who apply must have their advisor submit a statement of support in order to be considered.
The deadline to apply for this workshop is January 24, 2026.