微软Senior Software Engineer(M365 Copilot Inferencing)

工作描述

OverviewThe M365 Copilot Inferencing team is on a mission to build a high-performance, reliable, and compliant inference foundation that powers Microsoft 365 Copilot—optimizing model serving, GPU efficiency, routing, and global scale across commercial and restricted/sovereign cloud environments. We build and operate shared inferencing services that enable partner teams to deploy and run models at scale while meeting enterprise expectations for trust, compliance, and operational excellence, across broad M365 environments and large geographic footprints for performance-based routing and collocation patterns. 

We are looking for a Senior Software Engineer to help deliver the next generation of inference platform capabilities. You will design, develop, and ship reliable services and components; collaborate closely with partner teams; and contribute to operational excellence for large-scale production systems.  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities• Requirements & design: Partner with stakeholders to determine user requirements for a set of scenarios; lead identification of dependencies and contribute to the development of design documents for a product, application, service, or platform. 


• Build & ship: Initiate and build solutions to improve performance, maintainability, and effectiveness; deliver features through to production with quality and reliability. 


• Service and system thinking: Contribute to architecture and implementation of services that support large-scale model serving, including considerations for request serving at scale (routing, load balancing, distributed caching/storage, networking, geo/disaster recovery).  


• Operational excell…