Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Vanguard

NewBe an early applicant

Data Engineer, Specialist

Posted Updated
Discussion

Description

The Data Engineer designs, builds, and supports scalable, secure, and reusable data solutions that enable analytics, reporting, operational workloads, and emerging AI/ML use cases. This role works across the full development lifecycle, translating business needs into production-ready data pipelines and applications using AWS, Python, Spark, and SQL. The engineer will improve data quality, reliability, performance, monitoring, and engineering standards while partnering closely with business and technology teams.


Responsibilities:

  • Design, develop, test, and maintain scalable ETL/ELT pipelines and data-processing solutions supporting analytics, reporting, operational, and AI/ML workloads.
  • Build cloud-native data solutions using AWS services including S3, Glue, EMR, Lambda, Step Functions, IAM, CloudWatch, Secrets Manager, and CloudFormation.
  • Develop high-performance data-processing applications using Python, PySpark, Apache Spark, and SQL.
  • Integrate large-scale structured and unstructured data from multiple sources while maintaining data consistency, integrity, and accessibility.
  • Translate business and technical requirements into maintainable solution designs, production code, queries, and reusable data components.
  • Design and implement data-quality validation, reconciliation, monitoring, alerting, and operational controls to improve platform reliability.
  • Troubleshoot data pipelines and applications, identify root causes, and resolve performance, reliability, and data-quality issues.
  • Lead solutions through design, development, testing, deployment, and production support while applying established software and data engineering practices.
  • Partner with business stakeholders, engineers, and technology teams to understand data needs, explain technical considerations, and provide guidance on data solutions.
  • Contribute to engineering standards, documentation, code reviews, knowledge sharing, and adoption of new technologies and platform capabilities.

Qualifications:

  • 3+ years of experience in data engineering, software development, data management, database development, or related technical work.
  • Experience designing and developing production-grade ETL/ELT pipelines and large-scale data-processing solutions.
  • Hands-on experience developing applications and data pipelines using Python and SQL.
  • Experience with distributed data-processing technologies such as Apache Spark or PySpark.
  • Experience developing cloud-based data solutions using AWS services such as S3, Glue, EMR, Lambda, Step Functions, CloudWatch, IAM, or comparable services.
  • Experience implementing data-quality, monitoring, testing, and operational controls for production data solutions.
  • Undergraduate degree or equivalent combination of education, training, and relevant professional experience.
  • Experience with infrastructure as code, including AWS CloudFormation or comparable technologies, preferred.
  • Experience supporting data platforms used for AI/ML or advanced analytics workloads, preferred.

Special Factors

Sponsorship

Vanguard is not offering visa sponsorship for this position.

About Vanguard

At Vanguard, we don't just have a mission—we're on a mission.

To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients' lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne, our mission drives us forward and inspires us to be our best.

How We Work

Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →