Staff Software Engineer, Core Data ML Infrastructure

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 3 years of experience with software design and architecture.
• Experience building and developing large-scale infrastructure, distributed systems or networks, or with compute technologies, storage, or hardware architecture.
• Experience with Machine Learning Infrastructure.
• Experience working with C++, Flume and SQL.

Preferred qualifications:

• Experience with generative AI, machine learning, and vector databases.
• Experience working with Generative Artificial Intelligence (GenAI) infrastructure.
• Familiarity with Google infrastructure (Borg, Boq, Spanner, Flume).

The Information Retrieval Embeddings Platform is a hosted solution for computing and serving embeddings models at scale.

While an embeddings solution requires multiple distinct systems, such as an inference service, data processing pipeline, experimentation framework, and ScaM, Embeddings Platform integrates with all these systems for its clients, orchestrates the flow of data from one system to the next, and allows clients to monitor progress. We’re making embeddings a supported data type across the IR stack and enabling self-service journeys for prototyping, experimentation, and production.

Our systems are used by many teams within Google, including Search, News, Discover, Youtube, DeepMind and more. We continue to observe significant growth in this area.

The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

• Collaborate with client and partner teams to define and achieve product requirements/needs for launches and ongoing enhancements.
• Partner with infrastructure teams to ensure cost-effectiveness, low latency, and the development of essential features and capabilities.
• Design, prototype, experiment, and orchestrate innovative embeddings-related developer journeys.
• Integrate IR embeddings technology within client-specific GenAI/LLM applications.
• Lead the development of indexing and serving infrastructure, performance optimization, and custom solutions.