Software Dev Engineer II, Amazon OpenSearch
Posted Updated
Description
Amazon OpenSearch Service is a fully managed search and analytics service. It runs search, observability, and generative AI workloads for tens of thousands of customers, from application search and log analytics to vector and hybrid retrieval.
We're building the next generation of OpenSearch Migration Assistant: an AI-powered system that makes moving search and analytics workloads to Amazon OpenSearch far easier. Customers run these workloads today on self-managed OpenSearch and Elasticsearch, and on other search, observability, and analytics platforms.
Migration Assistant will:
• understand a customer's existing environment
• work out how its workloads, queries, and downstream applications map to OpenSearch
• automate the transformations
• orchestrate data and configuration migration
• validate correctness and performance
• help customers cut over production traffic safely
As a Software Development Engineer on the team, you'll help define and build this system from the ground up. You'll turn ambiguous customer problems into technical designs, prototype new approaches, and take them to production as reliable AWS services.
The work spans:
• AI agents: the agent harness, the tools, and the evals that keep conclusions grounded in evidence
• Workload discovery and translation: queries, mappings, query optimization, and the applications built on them
• Distributed systems: data movement, pipeline orchestration, cluster management, and multi-tenant infrastructure
• Validation: correctness and performance at production scale
You'll build with Rust, Java, Python, Go, and AWS services, on systems that must be secure, highly available, and run across AWS regions. Migration Assistant is developed in the open at github.com/opensearch-project/opensearch-migrations.
This is a greenfield opportunity on a newly formed team, with real ownership of product and architecture, at the intersection of generative AI, distributed systems, and search.
We're building the next generation of OpenSearch Migration Assistant: an AI-powered system that makes moving search and analytics workloads to Amazon OpenSearch far easier. Customers run these workloads today on self-managed OpenSearch and Elasticsearch, and on other search, observability, and analytics platforms.
Migration Assistant will:
• understand a customer's existing environment
• work out how its workloads, queries, and downstream applications map to OpenSearch
• automate the transformations
• orchestrate data and configuration migration
• validate correctness and performance
• help customers cut over production traffic safely
As a Software Development Engineer on the team, you'll help define and build this system from the ground up. You'll turn ambiguous customer problems into technical designs, prototype new approaches, and take them to production as reliable AWS services.
The work spans:
• AI agents: the agent harness, the tools, and the evals that keep conclusions grounded in evidence
• Workload discovery and translation: queries, mappings, query optimization, and the applications built on them
• Distributed systems: data movement, pipeline orchestration, cluster management, and multi-tenant infrastructure
• Validation: correctness and performance at production scale
You'll build with Rust, Java, Python, Go, and AWS services, on systems that must be secure, highly available, and run across AWS regions. Migration Assistant is developed in the open at github.com/opensearch-project/opensearch-migrations.
This is a greenfield opportunity on a newly formed team, with real ownership of product and architecture, at the intersection of generative AI, distributed systems, and search.