Senior Data and Applied Scientist

Our mission is to construct the most comprehensive, rich, clean, diverse and fresh image index, that serves as the cornerstone for all Image related search scenarios at Microsoft. We are at the forefront of Image index quality, developing AI models for Image content discovery, selection, ranking, and processing. Maintaining a comprehensive, rich, diverse, clean, and fresh index presents significant challenges that require a strategic approach. We must balance various improvement pillars while making necessary tradeoffs to ensure scalability and efficiency for billions of images. Our commitment to innovation and imagination is tempered by the need to be mindful of cost and latency. Our challenges are diverse and complex, including:

• Image Content Discovery: Efficiently and swiftly identifying a wide array of Image content by crawling the internet.
• AI Selection and Ranking Models: Training and developing SLM, LLM, Deep learning, and ML models for index selection and document understanding leveraging text and pixel information.
• Real-Time Indexing: Designing and implementing models and pipelines that support near-real-time (NRT) indexing and ensure content freshness.
• AI Integration: Innovating methods to leverage AI within platform for optimal inference.

This is a great opportunity for someone who loves to tackle deep technical challenges and strives for industry-wide impact. In this role, you will be instrumental in bringing new AI technology into production, pushing the boundaries of state-of-the-art (SOTA) both within the company and in the broader industry to fulfill Multimedia product requirements. You will play a significant role in the research, design, development, data analysis, feature creation, and implementation of applied research projects, applying scientific principles and techniques to solve real world problems. You will create Deep learning, SLM, LLM, and multimodal models to analyze and interpret various forms of content to enhance system capabilities, manage models and data at a Pentabyte scale, and address the extreme challenges posed by new generation AI systems.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.