Research Intern - Interactive Multimodal Futures Group (Situated, Social & Ubiquitous Computing)

Location: United States, Washington, Redmond Department: Research Sciences

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

The Interactive Multimodal Futures (IMF) group at Microsoft Research seeks a PhD-level Research Intern to work on a project at the intersection of situated interaction, social computing, ubiquitous computing, and human-centered Artificial Intelligence (AI) systems. The project will include elements of multimodal sensing (physiology, speech, gaze, gestures, olfaction/gas, etc.), signal processing, and real-time interaction.

Our group’s research spans several sub-areas

Human-centered AI for affective and social computing, and adaptive experiences.

Situated interaction between humans and AI systems such as robots deployed in the physical world.

Conversational AI Agents that are socially and context aware.

Ubiquitous sensing and ambient intelligence with unobtrusive sensing in the real world.

You will collaborate with IMF researchers to prototype systems, run user studies, develop machine learning models, and explore technical capabilities of generative AI for human-AI interaction.

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Additional Responsibilities

Design and implement research prototypes for real-time situated and adaptive interaction.

Explore the use of the latest generative AI techniques related to interpreting multimodal interaction, conversation, and behavioral signals.

Conduct user studies and analyze multimodal data.

Contribute to publications and share findings with the research community.

Qualifications

Required Qualifications

Currently enrolled in a Doctorate degree program in Human-Computer Interaction (HCI), Human-Robot Interaction (HRI), Computer Science, Cognitive Science, Robotics, Electrical Engineering, Psychology, or related STEM field.

Other Requirements

Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.

Please include a cover letter indicating which of the above research topics you are most interested in and aligned with. Be sure to indicate which of the specific preferred qualifications (listed below) you possess.

Preferred Qualifications

We are looking for some combination of the following qualifications (please address these in your cover letter):

2+ years of research experience using human-centered approaches in HCI, HRI, Machine Learning (ML), Computer Vision (CV), Ubiquitous Computing, or Affective Computing.

Experience writing peer-reviewed publications.

Experience with generative AI techniques, ML frameworks (e.g., PyTorch), and real-time interactive systems.

Proficient collaboration and communication skills.

Conducting human-subjects research.

Experience implementing research prototypes (frontend, backend, or both).

Using human-centered design & research methods.

Familiarity with reinforcement learning or time-series signal processing.

Working with large datasets (e.g., text, vision, physiology, behavioral).

Affective and Social Computing sub-area

Background in affective computing, behavioral, or physiological sensing.

Experience collecting data with wearable devices.

Hardware prototyping or wearable device experience.

Healthcare/wellbeing experience - e.g., pain assessment and modeling (nociceptive signals, stress/anxiety detection), or collaboration with clinical partners.

Olfaction & gas sensing - e.g., experience with electronic noses, breath analysis, or volatile organic compound sensing.

Situated Interaction sub-area

Demonstrated experience in programming multimodal systems that interact with real human users, e.g., robots or virtual agents, particularly by integrating multiple machine-learned components such as computer vision, speech recognition, dialogue handling, natural language generation, etc.

Demonstrated experience in conducting research outside of a controlled lab environment, e.g., field research, ethnography, in-the-wild studies, etc.

Conversational AI Agents sub-area

Experience prototyping real-time conversational AI agents using tools such as the OpenAI Realtime API, including function calling, and supporting interactions via text, voice, and other interfaces.

Designed, implemented, and evaluated different personality styles for AI agents, varying factors such as communication style, voice characteristics, and emotional tone to study their impact on user experience, engagement, and trust.

Incorporated multimodal sensory inputs (e.g., text, audio, contextual signals) to enhance interaction quality and make agent responses more adaptive and context aware.

Ubiquitous Computing and Ambient Intelligence sub-area

Leveraging the latest in AI techniques to perform sensing in the real world

Working with multimodal AI models

The base pay range for this internship is USD $6,810 - $13,480 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the b