The International Conference on Learning Representations (ICLR) is the premier gathering of professionals dedicated to the advancement of the branch of artificial intelligence called representation learning, but generally referred to as deep learning.
ICLR is globally renowned for presenting and publishing cutting-edge research on all aspects of deep learning used in the fields of artificial intelligence, statistics and data science, as well as important application areas such as machine vision, computational biology, speech recognition, text understanding, gaming, and robotics.
ICLR is one of the fastest growing artificial intelligence conferences in the world. Participants at ICLR span a wide range of backgrounds, from academic and industrial researchers, to entrepreneurs and engineers, to graduate students and postdocs.
The rapidly developing field of deep learning is concerned with questions surrounding how we can best learn meaningful and useful representations of data. ICLR takes a broad view of the field and includes topics such as feature learning, metric learning, compositional modeling, structured prediction, reinforcement learning, and issues regarding large-scale learning and non-convex optimization.
A non-exhaustive list of relevant topics explored at the conference include:
- Unsupervised, Semi-supervised, and Supervised Representation Learning
- Representation Learning for Planning and Reinforcement Learning
- Metric Learning and Kernel Learning
- Sparse Coding and Dimensionality Expansion
- Hierarchical Models
- Optimization for Representation Learning
- Learning Representations of Outputs or States
- Implementation Issues, Parallelization, Software Platforms, Hardware
- Applications in Vision, Audio, Speech, Natural Language Processing, Robotics, Neuroscience, or Any Other Field
For more information or registration, please visit the official website.
October 19 - 20: Workshops
October 21 - 23: Main Conference
More information can be found here.
Abstract: Large Language Models (LLMs) have revolutionized how people interact with knowledge, offering unprecedented opportunities to accelerate the pace of scientific discovery. In this talk, I will discuss my research on the synergy between LLMs and scientific knowledge--specifically how these models extract, induce, and verify knowledge to automate the research lifecycle. First, I will cover our work on improving knowledge extraction from vast scientific literature, focusing on enabling models to comprehend long documents in a cost-efficient and comprehensive manner. I will describe a novel paradigm for representing document-level structured information as question-answer pairs and how we address the challenges of long-context understanding by leveraging global context through retrieval-augmented modeling. Next, I present our pioneering work on using LLMs for new scientific hypothesis generation. We introduce a framework employing reinforcement learning with fine-grained reward modeling and adaptive controllers.
This approach balances novelty, feasibility, and effectiveness to generate inspiring and actionable research hypotheses. Finally, I will discuss work on the first LLM Scientist for machine learning research. I will demonstrate how LLMs can move beyond hypothesis generation to participate in the execution and validation of scientific hypotheses, ensuring that the discovered knowledge is not only innovative but also grounded and verified.
Bio: Xinya Du is a tenure-track assistant professor at UT Dallas Computer Science Department. He earned a Ph.D. degree from Cornell University and was a Postdoctoral Research Associate at the University of Illinois (UIUC). He has also worked at Microsoft Research, Google Research, and Allen Institute AI. His research is on large language models, deep learning, and their applications in science.His work has been published in leading NLP and ML conferences (ACL, ICLR, NeurIPS). His research has received multiple recognitions, including a Best Paper Award at AAAI AI for Research and a Best Poster Award at ICML AI for Science workshop. His work was included in the list of Most Influential ACL Papers and has been covered by major media like New Scientist. He was named a Spotlight Rising Star in Data Science by the University of Chicago and is the recipient of several prestigious awards, including the Amazon Research Award, Cisco Research Award, Open Philanthropy Award, and the NSF CAREER Award.
Location: NCS 120
Abstract: Traditional questionnaires remain the primary method for assessing psychological outcomes and beliefs, capturing individuals' and populations' inner states. This dissertation presents an alternative computational method that overcomes key limitations in current mental health monitoring, particularly in spatiotemporal resolution, responses to major events, and automatic belief identification. By analyzing ∼1 billion Tweets from 2 million geo-located users, we created a big data pipeline for estimating depression and anxiety at the county-week level. These Language-Based Mental Health Assessments (LBMHA) demonstrated higher reliability and validity than traditional survey measures. Our approach effectively captured mental health trends and highlighted significant increases in mental illness following major events. Using the LBMHA pipeline, we conducted quasi-experiments, research designs that simulate randomized control trials, to generate explanations for mental health changes due to COVID-19 incidence/death. Utilizing these time-series analyses, we conducted discontinuity forecasting for community-specific anxiety shifts using statistical learning via ensemble and contextual models. To likewise investigate individual internal states, we created a novel task and annotated dataset for self belief language identification. Our fine-tuned language model for self-belief classification, despite its relatively small scale, outperformed GPT-4o. The self belief topics identified by our model successfully predicted depression, anxiety, and stress, offering insights into the relationship between self-conceptualization and mental health. The adoption of scalable language-based assessments with modern distributed computation presents a promising avenue for advancing community and individual mental health research.
Speaker: Siddharth Mangalik
https://stonybrook.zoom.us/j/
Join us for an exciting afternoon of talks by visionaries and leaders from industry, government, and academia as we kickoff a three-part Trusted AI Challenge Series designed to Build the Vision - Formalize Challenges - Advance the Art of next generation of AI systems.
The Air Force Research Laboratory Information Directorate, The State University of New York, Innovare Advancement Center, NYSTEC, and Griffiss Institute invite you to join us for this half-day virtual event!
WHEN: Wednesday, October 14, 2020, 12:00 PM - 4:00 PM EDT
Hosted by Innovare Advancement Center, this webinar is the first of a three-part series designed to cultivate, define and fund creative solutions to a set of challenge problems in trustworthy AI with a particular focus on dynamic, autonomous systems that learn and adapt behaviors.
Keynote speakers include Dr. David Goldstein of Space X; Dr. Scott Hubbard of Stanford University; Dr. Pramod Khargonekar of UC Irvine, and more!
This event is designed for academic and government researchers, university students, and small businesses.
Would you like to understand some of the most formidable technical challenges in future autonomous systems? Would you like to sponsor some of the brightest minds in AI to work on problems of interest to you? Would you like to learn more about AI in real systems?
If so, Save the Date! Wednesday, October 14, 2020, 12:00 PM - 4:00 PM EDT.
Please see additional information on the three-part series here. Registration details to follow!
Stay tuned: https://www.innovare.org/news-
Register here.
Speaker: Prof. R Sekar
Bio: Nick Nikiforakis is affiliated with the National Security Institute. He received his PhD in Computer Science from KU Leuven in Belgium. He received his MSc, in Parallel and Distributed Systems and BSc in Computer Science from the University of Crete, Greece. His research focuses on web security and privacy, software security, and intrusion detection.
Location: NCS 120