微软Principal Software Engineer
任职要求
- A bachelor’s degree or higher in computer science, engineering, or a related field, PhD is preferred- Strong programming skills in Python and C/C++- 5+ years of experience in machine learning system development and optimizationPreferred Qualifications: - 5+ years of experience in CUDA kernel development and optimization - Experience in optimizing communication layer / kernels for deep learning systems - Experience in machine learning model compression - Experience on different hardware such as both NVIDIA and AMD GPUs is a plus - A growth mindset and a passion for learning new things Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form. Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
工作职责
- Keep up to date with and utilize the latest developments in LLM system optimization.- Take the lead in designing innovative system optimization solutions for internal LLM workloads.- Optimize LLM inference workloads through innovative kernel, algorithm, scheduling, and parallelization technologies.- Continuously develop and maintain internal LLM inference infrastructure.- Discover new LLM system optimization needs and innovations.
• Own the design and implementation of core infrastructure components, ensuring scalability, security, and high performance across systems. • Lead architectural decisions, set engineering standards, and drive long-term technical strategy for complex solutions. • Produce and review high-quality, secure, and maintainable code while championing best practices and modern patterns, including AI-driven approaches. • Mentor engineers across teams, fostering growth in coding, design, testing, and operational excellence. • Define and enforce robust test strategies, integrate automation, and ensure security and reliability in all deliverables. • Oversee telemetry, incident response, and operational readiness to improve system stability and supportability. • Collaborate with stakeholders to validate requirements, incorporate feedback, and uphold compliance, privacy, and accessibility standards.
Architect, build, and optimize secure and performant AI platform services that power Microsoft Copilot and other next-generation AI scenarios. Provide technical leadership across teams to define long-term architectural direction and drive engineering excellence. Collaborate with infrastructure, platform, product, and research teams to design and deliver scalable, production-grade AI services. Write high-quality, well-tested, secure, and maintainable code and promote high standards across the team. Tackle technically ambiguous or cross-boundary problems, remove roadblocks, and drive delivery across multiple teams or organizations. Lead technical design discussions, mentor senior engineers, and foster a strong engineering culture within the team. Embody Microsoft’s Culture and Values, and help shape the direction of the engineering team and broader organization.
Architect, build, and optimize secure and performant AI platform services that power Microsoft Copilot and other next-generation AI scenarios. Provide technical leadership across teams to define long-term architectural direction and drive engineering excellence. Collaborate with infrastructure, platform, product, and research teams to design and deliver scalable, production-grade AI services. Write high-quality, well-tested, secure, and maintainable code and promote high standards across the team. Tackle technically ambiguous or cross-boundary problems, remove roadblocks, and drive delivery across multiple teams or organizations. Lead technical design discussions, mentor senior engineers, and foster a strong engineering culture within the team. Embody Microsoft’s Culture and Values, and help shape the direction of the engineering team and broader organization.
Architect and implement core infrastructure components, drive technical direction, mentor engineers, and ensure high standards for scalability, security, and performance.