All jobs
All jobs
The role makes large language models faster, cheaper and more reliable in production by profiling and optimizing the inference stack, from serving frameworks down to GPU kernels. It also involves working with customer engineering teams to tailor, launch and monitor deployments. Strong Python or C++ skills, LLM serving experience with vLLM or SGLang, and solid GPU performance knowledge are needed.