Applied Scientist II

Are you interested in solving largescale search problems and building nextgeneration of Query Understanding solutions powered by LLMs and SLMs? If yes, the Bing Orca team is for you!

The Orca team is a researchdriven applied science and engineering group building the next generation of efficient, scalable, and highly capable AI models. Our mission is to push the boundaries of model reasoning, compression, and alignment-making advanced intelligence accessible, reliable, and costeffective across Microsoft's ecosystem.

We're known for pioneering techniques that help compact models learn rich reasoning abilities from frontierscale teachers. But we don't stop at research: we also own the endtoend infrastructure, tooling, and runtime systems that bring these models to life in production.

Our work spans deep research, largescale engineering, and realworld product impact:

Advanced Model Research

• Develop novel distillation and compression methods
• Explore chainofthought, multistep reasoning, and structured supervision
• Build evaluation frameworks that measure reasoning, robustness, and safety

ProductionGrade Infrastructure & Hosting

• Own the full modelserving stack for Orca models
• Build highperformance inference pipelines optimized for latency, throughput, and cost
• Maintain high availability, stability, and reliability across global deployments
• Design scalable systems that support rapid experimentation and safe rollout of new model variants

Training & Experimentation at Scale

• Run largescale training jobs and ablation studies
• Develop internal tools that accelerate research velocity
• Collaborate with platform teams to optimize compute efficiency

RealWorld Impact

Our systems & models serve users in 100+ markets worldwide, handling 100M+ queries and interactions every day.

We are hiring anApplied Scientist IIto join our world of search retrieval, ranking, relevance optimization, driving real user impact in production systems at global scale.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.

• Develop, train, and evaluate machine learning models with guidance from senior scientists.
• Implement model improvements through experimentation, data analysis, and iterative refinement.
• Contribute to the team's core codebase, including training pipelines, evaluation tools, and automation.
• Build and maintain tooling that improves research velocity, experiment tracking, and model debugging.
• Support the development and operation of modelserving infrastructure with a focus on reliability and performance.
• Collaborate with engineers and researchers to bring models from prototype to productionready systems.
• Participate in code reviews, documentation, and bestpractice engineering processes.

Required Qualifications:

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field
  • OR equivalent experience.

Preferred Qualifications:

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 5+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience.
• Ability to collaborate effectively in a fastpaced research and engineering environment.
• Solid problemsolving skills and eagerness to learn new methods, tools, and systems.
• Experience training, finetuning, and evaluating small or efficient language models (SLMs) at scale.
• Familiarity with PyTorch or TensorFlow and common ML tooling
• Experience with Search and Query Understanding, including ranking models, retrieval pipelines, relevance evaluation, or semantic understanding of queries is a huge plus.
• Solid ability to translate research ideas into reliable, maintainable code.
• Demonstrated ability to work effectively with crossfunctional teams, including researchers, engineers, and product partners.

#MicrosoftAI #MAI #Bing #Search

Applied Sciences IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.