微软Senior Applied Scientist(LLM)
任职要求
Required Qualifications: • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)• OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) • OR equivalent experience. • Hands-on experience with Large Language (LLMs), including evaluation techniques, prompt engineering, model fine-tuning. • 3+ years of experience in applied science or machine learning, natural language processing (NLP), or AI systems. • Proficiency in Python, C#, or similar languages. Other Requirements:Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and e…
工作职责
• Build benchmarks, evaluation datasets, metrics, and methods to assess and improve the performance and effectiveness of language models and prompts and drive iterative enhancements. • Deliver high-impact analyses that generate actionable insights to steer product and business decisions and improve user satisfaction. • Collaborate closely with engineering, research, product, and other teams to ensure AI-driven experiences meet quality and user experience standards. • Analyze latest AI innovations and explore opportunities to apply cutting-edge techniques for building scalable, high-impact solutions that enhance product capabilities and deliver exceptional user experiences.
The primary responsibilities will include:• Algorithm Development and Enhancement for ranking algorithms in News & Feeds- Work with cross-functional teams to design, develop, and implement recommendation algorithms to deliver product features and drive user engagement.- Optimize existing recommendation algorithms by analyzing performance metrics and user feedback, incorporating advanced machine learning techniques including generative AI techniques. • Innovation in the area of NLP, LLM, and recommender system. • Data Analysis and Modeling- Perform data analysis to identify patterns, trends, and opportunities to improve the relevance and quality of our recommendation systems.- Build systemic solutions and models to optimize user experience.
Bringing the State of the Art to Products Collaborates with and bridges the gap between researchers (in community, Microsoft Research [MSR], or in their own organizations) and development teams. Brings new technology and approaches into production by applying long-term research efforts to solve immediate product needs. With limited guidance from others, works to create product impact. Identifies approach, and applies, improves, or creates a research-backed solution (e.g., novel, data driven, scalable, extendable) to positively impact a Microsoft product or service. Solves components or aspects of a problem as assigned by a senior team member. May publish research to promote receiving new intellectual property for product impact. Participates in collaborative relationships with relevant product and business groups inside or outside of Microsoft and provides expertise or technology to create business impact. Participates in technology transfer attempts, filing patents, authoring white papers, developing or maintaining tools/services for internal Microsoft use, or consulting for product or business groups. May publish research to promote receiving new intellectual property for business impact. Capability Management and Networking Maintains ties with external network of peers and identifies prospective talent, when asked. May contribute to publications on research findings. May participate in candidate interviews. Collaborates with the academic community to develop the recruiting pipeline and establish awareness of their work. Reinforces a positive environment by applying best practices. May support mentorship by assisting with onboarding of research interns or other entry-level team members, if applicable. Documentation Performs documentation of work in progress, experimentation results, plans, etc. Documents scientific work to ensure process is captured. Participates in the creation of informal documentation and may share findings to promote innovation within group. Ethics and Privacy Understands and follows ethics and privacy policies when executing research processes and/or collecting data/information. Leveraging Applied Research Applies strategy by understanding the role in the team and applying the strategy provided by senior team members and incorporates state-of-the-art research. Asks probing questions to better understand strategy. Researches and develops an understanding of tools, technologies, and methods being used in the community that can be utilized to improve product quality, performance, or efficiency. Contributes knowledge around several specialized tools/methods to support the application of business impact or serves as an expert in a deeply specialized area. Gains deep knowledge in a service, platform, or domain and acquires knowledge of changes in industry trends and advances in applied technologies. Consults with engineers and product teams to apply advanced concepts to product needs. Learns product domain by reviewing products. Machine Learning Functionality, Insights, and Technical Tools Prepares data to be used for analysis by reviewing criteria that reflect quality and technical constraints. Reviews data and suggests data to be included and excluded. Describes actions taken to address data quality problems. Assists with the development of useable datasets for modeling purposes. Supports the scaling of feature ideation and data preparation. Helps take cleaned data and adapts for machine learning purposes, under the direction of a senior team member. Seeks guidance from senior team members when confronted with problems/challenges. Uses machine learning algorithms that structures, analyzes, and uses data in product and platforms to train algorithms for scalable artificial intelligence solutions before deploying. Begins to develop new machine learning improvements independently while under the direction of a senior team member. Collaborates to leverage data to identify pockets of opportunity to apply state-of-the-art algorithms to improve a solution to a business problem. Uses statistical analysis tools for evaluating Machine Learning models and validating assumptions about the data while also reviewing consistency against other sources. Begins to independently run basic descriptive, diagnostic, predictive, and prescriptive statistics. Assists with the communication of insights under the direction of senior team members. Supports the application and use of intelligence created during the training of algorithms for deployment. Seeks information about large-scale computing frameworks, data analysis systems, and modeling environments to improve models. Helps create a model, apply the model to real products, and then verify effects through iterations. Helps with experiments by putting multiple models in production and evaluating their performance. Sets up monitoring and implementation to track production models, under the direction of a senior team member. Addresses models when that break, under the direction of others. Leverages or designs and uses machine learning/data extraction, transformation, and loading (ETL) of pipelines (e.g., data collection, cleaning) based on data prepared.
• Design and implement advanced LLM-based architectures and agentic systems for real-world product scenarios.• Lead model training and evaluation efforts, including data preprocessing, fine-tuning, and inference optimization.• Collaborate across teams to deliver robust, scalable models aligned with product objectives and user value.• Apply and adapt research ideas to solve practical challenges in reasoning, planning, memory, and alignment.• Monitor and improve model performance post-deployment through data-driven iteration and error analysis.• Contribute to technical discussions, model reviews, and best practices within the applied science community.
• Drive data exploration and analysis by collecting initial datasets, selecting appropriate analytical techniques, and applying foundational statistical methods to extract insights. • Build and evaluate ML models by running modeling tools on prepared datasets, analyzing performance, and incorporating customer feedback to improve outcomes. • Contribute to AI development by writing production-quality code for features or models, applying debugging best practices, and staying current with industry trends and methodologies. • Champion customer-centric solutions by understanding business goals, identifying growth opportunities, and managing expectations throughout the project lifecycle. • Collaborate cross-functionally with engineering and product teams to define success metrics, improve AI quality at scale, and shape how performance is measured across Copilot technologies.