Universiteit van Amsterdam logo

Postdoc: Symmetries and their Breaking in Deep Learning

Universiteit van Amsterdam

Amsterdam
Full-time
2-5 years experience
On-site

€3,706 - €5,760 per month

Key Skills

Deep Learning
Machine Learning
Mathematical Modeling
Symmetry and Symmetry Breaking
Theoretical Physics
Programming
PyTorch
JAX
Experimental Research
Research Leadership
Student Mentoring
Scientific Applications
Generative Models
Equivariant Neural Networks

Job Description

Are you interested in understanding the dynamics of deep learning using general mathematical principles, such as symmetry and universality? Are you interested in using deep learning to tackle difficult scientific problems? AMLab is hiring a 2-year postdoc to work with Dr. Nabil Iqbal on a project supported by the Simons Foundation grant Symmetries and their breaking in deep learning. Working at the UvA Join Us! Artificial neural networks models are made out of many individually simple constituents which assemble together into emergent entities with remarkable capabilities, including the ability to converse, reason, and accomplish difficult tasks. How can stacks of matrices and non-linearities accomplish such amazing feats? The task of developing a theoretical framework for this emergence – and to then using this understanding to construct more robust, efficient, controllable, and generally better machine learning models – is currently a focus of extremely intense study. Philosophically similar problems involving the emergence of non-trivial collective behavior from simple microscopic ingredients have been studied for decades in the neighbouring field of physics. In this project, you will take inspiration from those ideas – and in particular the general unifying principle of symmetry – to tackle these difficult problems. A good salary Your salary will be determined on the basis of your experience and seniority, in accordance with the Labour agreement. Your grading and therefore the amounts mentioned are based on full employment of 38 hours per week. 232 vacation hours We also offer parental leave, partner leave and social engagement leave. Through the Employment Conditions Menu Card, there are opportunities for even more vacation hours. Financial arrangements On top of your salary, you receive holiday allowance (8%) and a year-end bonus (8.3%). You build up a good pension with ABP. And in addition, we offer many other allowances and schemes. Career development and room for growth The UvA encourages you to continue to professionalise through training courses and open UvA lectures. Family matters Relocating to the Netherlands with your family? Find out about daycare, schooling, health insurance or employment options and support for your partner or spouse. Including the IDCN-network which provides support for your spouse through various training sessions, social activities, and networking events. All About This Vacancy This is what you will do You will build a line of research that is oriented towards understanding the dynamics of modern neural architectures in a mathematically principled manner, and further you will use this new understanding to build new deep learning architectures with an eye towards scientific applications. The precise directions will be chosen to align with your research interest but some potential ideas include: understanding the dynamics of spontaneous symmetry breaking in equivariant neural networks working towards a theoretical understanding of scaling laws in deep neural networks, either for language models or in geometric deep learning studying the dynamics of generative models using tools drawn from theoretical physics such as non-equilibrium and non-reciprocal thermodynamics, and using this approach to construct new generative paradigms applying modern generative techniques to problems of physical interest, such as new ways of sampling for many-body quantum physics This list of topics is to give you an idea of the interests of the group and is by no means exclusive. To accomplish these research goals you will: lead and co-author publications at top-tier venues and represent the lab at international meetings help shape the research agenda of the group, co-supervise PhD and MSc students, and build your own research portfolio. You will be part of a new group within AMLab that is being started by Nabil Iqbal to study neural networks from a physical point of view. What We Ask Of You a PhD (completed or near completion) in machine learning, computer science, physics, mathematics, or a related field. A strong publication record in major academic journals or international conferences Strong mathematical and programming skills (e.g. PyTorch or JAX) and ability to run experiments as well as build theoretical frameworks The ability to drive research independently and to mentor PhD and MSc students A professional command of English If you have questions we encourage you to contact Nabil at [email protected]. The start date is Fall 2027. This Is What We Offer You We offer a temporary employment contract 38 hours per week for a period of 24 months with a probationary period of two months. The preferred starting date is Fall 2027. The gross monthly salary, based on 38 hours per week and dependent on relevant experience, ranges between €3,706 to € 5,760 (scale 10). This does not include 8% holiday allowance and 8,3% year-end allowance. The UFO profile Researcher 4 is applicable. A favourable tax agreement, the ‘30% ruling’, may apply to non-Dutch applicants. The Collective Labour Agreement of Universities of the Netherlands is applicable. Curious about our extensive secondary benefits package? Read more about the benefits. Your place at the UvA You will work in this team The Faculty of Science has a student body of around 8,000, as well as 1,800 members of staff working in education, research or support services. Researchers and students at the Faculty of Science are fascinated by every aspect of how the world works, be it elementary particles, the birth of the universe or the functioning of the brain. You will be part of the Amsterdam Machine Learning Lab (AMLab). AMLab conducts research in machine learning, artificial intelligence, and its applications to large scale data domains in science and industry. This includes the development of deep generative models, methods for approximate inference, probabilistic programming, Bayesian deep learning Want to know more about our organisation? Read more about working at the University of Amsterdam. About The Faculty Of Science Researchers and students at the Faculty of Science are fascinated by every aspect of how the world works, whether it concerns elementary particles, the birth of the universe, or how the brain functions. The Faculty has a student population of approximately 8,000 students, as well as 1,800 staff members working in education, research, or support services. Important to know Your application & contact If you feel the profile fits you, and you are interested in the job, we look forward to receiving your application. You can apply online via the red button. We accept applications until and including 8 December 2026. Applications should include the following information (all files besides your cv should be submitted in one single pdf file): a detailed CV including the months (not just years) when referring to your education and work experience; a letter of motivation, including a description of what makes you a fit for the position a list of publications the names and email addresses of two references who can provide letters of recommendation. A knowledge security check can be part of the selection procedure. (for details: national knowledge security guidelines). Only complete applications received within the response period via the link below will be considered. If you have any questions or do you require additional information? Please contact: Nabil Iqbal, Associate Professor, [email protected] Acquisition in response to this vacancy is not appreciated. Diversity, Equity & Inclusion As an employer, the UvA maintains an equal opportunities policy. We value diversity and are fully committed to being a place where everyone feels at home. We nurture inquisitive minds and perseverance and allow room for persistent questioning. With us, curiosity and creativity are the prevailing culture. Studies show that women and members of underrepresented groups only apply for jobs if they meet 100% of the qualifications. Do you meet the educational requirements but not yet all of the requested experience? The UvA encourages you to apply anyway.

Core Responsibilities

Develop an independent research program using mathematical and physics-inspired principles to understand the dynamics of modern neural networks, and apply the findings to create deep learning architectures for scientific problems. Lead and co-author publications, represent the lab at international meetings, help shape the group's research agenda, and co-supervise PhD and MSc students.

Requirements

Applicants must have a completed or nearly completed PhD in machine learning, computer science, physics, mathematics, or a related field, along with a strong publication record. They should have strong mathematical and programming skills, experience with tools such as PyTorch or JAX, the ability to conduct experiments and develop theoretical frameworks, and the capacity to lead research independently and mentor students.

Benefits

  • Holiday Allowance
  • Year-End Bonus
  • Pension
  • Vacation Leave
  • Parental Leave
  • Partner Leave
  • Social Engagement Leave
  • Professional Development and Training
  • Relocation Support
  • Spouse Support Network
  • Potential 30% Tax Ruling
Added Today