Zoom Link: https://stonybrook.zoom.us/j/98533029054?pwd=5FXO6lWGTJssCADEYkYbA7sjaacPRX.1

Meeting ID: 985 3302 9054

Passcode: 436997

Abstract:

Semantic segmentation, the task of assigning a semantic label to each pixel in an image, is a fundamental problem in the field of Computer Vision. with crucial applications in domains like autonomous driving, drone imagery and medical image analysis. Despite advancements in deep learning architectures, state-of-the-art models still heavily depend on large-scale pixel-level annotations, which are costly and time-consuming to acquire. To address this issue, Semi-Supervised Segmentation (SSS) has emerged as a promising solution, leveraging a small set of labeled images alongside a larger corpus of unlabeled data to reduce the annotation burden. In this proposal, I aim to investigate the challenges of SSS and propose approaches to address them. Existing SSS methods rely on a teacher-student framework to generate pseudo-labels for unlabeled images, which are then used for model training. However, this approach presents two major challenges. Pixel-level consistency fails to effectively capture contextual information, and pseudo-labels are noisy, especially in the early stages of training. To address the challenge of noisy pseudo-labels, existing methods rely on confidence-based thresholding to identify reliable pseudo-labels. However, during early training phases, when the model is poorly calibrated, this approach can select high-confidence but noisy pseudo-labels. To address this, we propose a novel approach that reduces reliance on model confidence to select reliable pseudo-labels. Our method employs an ensemble of a segmentation model and an object detection model to select more reliable pseudo-labels, which are then used to weight pseudo-labels using rank statistics, reducing the influence of noisy labels in training. Next, to address both the challenge of capturing contextual information and noisy pseudo-labels I introduce a novel Multi-scale Patch-based Multi-label Classifier (MPMC), which incorporates patch-level contextual information and reduces the impact of noisy pixel pseudo-labels by using the predictions of the patch-level Multi-label classifier to detect noisy labels, enhancing overall segmentation performance. While my work so far has focused on effectively utilizing unlabeled data to improve segmentation performance, as part of our future work, I will explore the use of textual information, such as category descriptions, for segmentation tasks. In limited labeled data scenarios it is more challenging to align visual features with textual features from large language models (LLMs).

As generative AI (GenAI) continues to reshape the educational landscape, educators must critically examine its implications for course design. How can we adapt our courses to ensure meaningful learning in a post-GenAI world? How can we harness its potential while mitigating risks to student learning? This seminar explores the evolving role of GenAI in higher education, emphasizing learner-centered teaching practices--such as backward design, transparency, and active learning--as essential strategies for navigating both the opportunities and challenges posed by GenAI. We will examine how GenAI disrupts traditional models of teaching and assessment, highlighting course design choices that intentionally promote deep learning and critical thinking in this new era.

Speaker Bio: Dr. Lourdes Alemán is an Associate Director at MIT's Teaching and Learning Lab (TLL). She earned her Ph.D. in Biology from MIT, studying RNA interference (RNAi) with Professor Phil Sharp. She later completed a postdoc in curriculum innovation with Professor Graham Walker's HHMI MIT Education Group. As a postdoc and research scientist, she helped develop software tools for teaching experimental design and data analysis, including collaborations with the MIT-Haiti Initiative. Before joining TLL, she worked at MIT's Open Learning, supporting MIT faculty in blended and online education. At TLL, Lourdes trains graduate students and postdocs in college-level teaching, advises faculty on classroom innovation, and previously designed and taught a hands-on biology module on novel antibiotic discovery for first-year students. She has served on university committees focused on mentoring and advising. Drawing from her experiences as a Cuban immigrant student, she developed MIT's first curriculum on growth mindset and co-founded Flipping Failure, a campus-wide initiative for students to share their stories of academic challenges and the strategies they have used to overcome them.

Abstract: Recent work in NLP uses debates between multiple LLMs to arrive at a more accurate conclusion. Earlier chain-of-thought prompting also shows improvements in accuracy when the model is asked to provide step-by-step reasoning in its response. Many publications since have developed strategies to improve the reasoning of model output with the goal of generating a more accurate result. However, even when asked to provide problem solving steps, the content of the reasoning provided by models is not well studied for all tasks and sometimes contains errors or conflicting statements even when the final result is correct. In fact, when evaluated across reasoning tasks, evidence shows that LLMs are not learning how to reason but are instead mimicking relevant solutions from their training sets.
By studying and evaluating the argumentation that LLMs provide, we can determine factors that may benefit or hinder the model's ability to give a complete, cohesive, and thorough answer. While there are signs that LLMs pattern match, finding where, when, and why this fails is valuable, as there may be ways to help the model imitate solutions that are more relevant to the task it is attempting to solve. Determining when pattern matching is not enough could show an area of improvement for future generations of LLMs. This research may separately aid in work on human-(AI)agent and inter-agent interaction. Specifically, frameworks could be used to determine when and why other models or humans are convinced by LLM-generated responses and which argument methods cause other models to change their response. Our current research in systematic versus heuristic cues shows that large language models sometimes present systematic or heuristic reasoning patterns based on prompting. Future research aims to explore other methods of classifying argumentation.

Speaker: Kiera Gross

Joining link: https://meet.google.com/xae-ywpv-udo
University Libraries Presents: The Library AI Club is a welcoming space for students, faculty, and staff to explore AI in a supportive, low-pressure environment. Meeting every two weeks, the club features discussions, collaborative projects, guest speakers, and hands-on experiments. Join us to learn, share ideas, and engage with AI responsibly and creatively. We'd love to see you at an upcoming meeting! Location: Melville Library, Scholarly Communication Seminar Room



Abstract: The current approach to materials design, driven by strategic experimentation and supported by physics-based simulation across relevant scales, has been the standard for decades. While the theoretical component in this workflow provides valuable understanding of material behavior, it often fails to deliver actionable guidance for implementation. Advances in artificial intelligence and machine learning (AI/ML), together with high-performance computing (HPC), now offer a viable pathway to close this gap and accelerate both discovery and process optimization. This presentation will outline practical approaches for integrating AI/ML with HPC-enabled, high-throughput computation to explore high-dimensional search spaces. Examples will include the development of engineering alloys for extreme environments, the use of neural networks to rapidly improve computational thermodynamic models, and vapor processing optimization for the manufacturing of ultra-high-temperature ceramics. I will highlight how scientific insight and domain expertise remain essential for translating surrogate model predictions into impactful outcomes. Finally, I will conclude with current challenges and future opportunities for AI/HPC-driven materials research.

Speaker: Dongwon Shin
This seminar will be held in person and online

Join Zoom Meeting: https://stonybrook.zoom.us/j/93730374357?pwd=YDLJ7ELqOQnTZEQhlN8Pa4TuhaiFK8.1

When: Thu: 10/28/2021, 10 am
Where: NCS Room 220, or
Zoom: https://stonybrook.zoom.us/j/97978463739?pwd=aVJFVERQa25jYjJrOFZEcWVuSzJLdz09

Deep Surface MeshesPascal FuaEPFLGeometric Deep Learning has recently made striking progress with the advent of Deep Implicit Fields (SDFs). They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid, resulting in a learnable 3D surface parameterization that is not limited in resolution. Unfortunately, they have not yet reached their full potential for applications that require an explicit surface representation in terms of vertices and facets because converting the SDF to such a 3D mesh representation requires a marching-cube algorithm, whose output cannot be easily differentiated with respect to the SDF parameters. In this talk, I will discuss our approach to overcoming this limitation and implementing convolutional neural nets that output complex 3D surface meshes while remaining fully-differentiable and end-to-end trainable. I will also present applications to single view reconstruction, physically-driven Shape optimization, and bio-medical image segmentation.


Bio:
Pascal Fua received an engineering degree from Ecole Polytechnique, Paris, in 1984 and a Ph.D. in Computer Science from the University of Orsay in 1989. He joined EPFL (Swiss Federal Institute of Technology) in 1996 where he is a Professor in the School of Computer and Communication Science and head of the Computer Vision Lab. Before that, he worked at SRI International and at INRIA Sophia-Antipolis as a Computer Scientist. His research interests include shape modeling and motion recovery from images, analysis of microscopy images, and Augmented Reality. He has (co)authored over 300 publications in refereed journals and conferences. He has received several ERC grants. He is an IEEE Fellow and has been an Associate Editor of IEEE journal Transactions for Pattern Analysis and Machine Intelligence. He often serves as program committee member, area chair, and program chair of major vision conferences and has cofounded three spinoff companies.