Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join Us
At ByteDance, our people are humble, intelligent, compassionate and creative. We create to inspire - for you, for us, and for millions of users across all of our products. We lead with curiosity and aim for the highest, never shying away from taking calculated risks and embracing ambiguity as it comes. Here, the opportunities are limitless for those who dare to pursue bold ideas that exist just beyond the boundary of possibility. Join us and make impact happen with a career at ByteDance.
The Applied Machine Learning - Machine Learning Systems team provides E2E machine learning experience and machine learning resources for the company. The team builds heterogeneous ML training and inference systems based on GPU and AI chips and advances the state-of-the-art of ML systems technology to accelerate models such as stable diffusion and LLM. The team is also responsible for research and development of hardware acceleration technologies for AI and cloud computing, via technologies such as distributed systems, compilers, HPC, and RDMA networking. The team is reinventing the ML infra for large scale language models.

• Research and develop the machine learning inference framework used throughout the company and support all the ByteDance products;
• Design the abstraction of fundamental components of the inference framework, optimize the implementation, and deploy them in production systems;
• Collaborate with ML algorithm teams and cross-optimize the performance of critical ML inference tasks.
• Familiar with the C/C and Python development in Linux environments;
• Familiar with at least one deep learning framework (TensorFlow, PyTorch, MXNet, or other);
• Know at least one of the machine learning models and their typical application scenarios, like ResNet for image classification, BERT for text understanding, etc.;
• Any knowledge of the following would be a plus: CUDA programming, compilers like TVM, XLA, TensorRT, model quantization, model compression, etc.;
• Can solve technical problems independently as well as with good teamwork;
• Good communication, self-motivation, engineering practice, documentation, etc.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at kayla.wong@bytedance.com.