Controllable Video Generation Research Intern

Australia-New South Wales-Sydney · Posted 2h ago

Apply

At a glance

Location: Australia-New South Wales-Sydney, Australia
Work type: Onsite
Category: Research

Controllable Video Generation Research Intern at Tencent Lightspeed Studios in Sydney, AU. Role focuses on designing multimodal controllable generation frameworks for video, researching high-fidelity generation with sparse control signals, decoupling and combining trajectory, camera, motion, and posture control, and developing low-latency video generation for multi-player collaborative control.

What they are looking for

PythonPytorchDiffusion_modelsControllable_generationVideo_generation

Location: Australia-New South Wales-Sydney, Australia

Business UnitLIGHTSPEED STUDIOS is made up of passionate players who advance the art & science of game development through great stories, great gameplay, and advanced technology. We are focused on bringing next generation experiences to gamers who want to enjoy them anywhere, anytime, across multiple genres and devices.

About the Hiring TeamLightspeed Tech Center is a R&D department under Lightspeed Studios which develop PUBG Mobile and other high-quality games. Our Tech Center leads the research, exploration, and discovery of innovative technologies and provides technical services for all games during all phases of life cycle, including engine, audio, QA, AI, next generation game, technical cooperation, etc.

What the Role Entails

Design a multimodal controllable generation framework supporting various inputs such as keyboard, controller, trajectory, and voice.

Research high-fidelity generation under sparse control signals and explore the extension of conditional control paradigms in the video domain.

Achieve the decoupling and combination of trajectory control, camera control, motion control, and posture control.

Design dedicated control modules tailored to different game genres.

Develop video generation capabilities for multi-player collaborative control, ensuring low-latency response and inter-frame state retention.

Collaborate with the Engine/Agent teams to define standardized interfaces for controllable signals.

Drive the join optimization of controllable generation and Reinforcement Learning post-training.

Who We Look For

Ph.D. in AI-related fields, focusing on Computer Vision/Deep Learning.

Proficient in conditional generation models and multi-player/multi-channel control technologies; familiar with the principles of diffusion models.

Project experience in camera control, trajectory control, or posture control.

Understanding of game engine input/output logic and frame synchronization mechanisms.

Proficient in Python/PyTorch, with publications in controllable video generation or conditional generation.

Experience in Game AI or game development is preferred.

Experience in real-time/interactive video generation projects is preferred.

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.