Senior Databricks AWS Engineer
Description
Are you looking to take the next step in your career as a Senior Databricks AWS Engineer? Let's chat and see if we are a good match!
Opportunity:
Virtual Service Operations is searching for a Senior Databricks AWS Engineer to join our team. In this role, you’ll stand up and secure Databricks in a new AWS environment, from configuring workspaces, networking, identity and storage to integrating the platform with existing data sources, pipelines and AWS services. You’ll build and harden the RHEL systems behind the platform, apply federal security controls such as STIGs and NIST 800-53, and automate deployments with Terraform, CloudFormation and scripting. You’ll also troubleshoot platform and integration issues, write documentation and train customer staff, so strong communication skills are as important as technical depth.
Responsibilities:
- Deploy and configure Databricks workspaces in a new AWS environment, including networking, identity and storage
- Connect Databricks to existing data sources and pipelines, and to AWS services (S3, IAM, VPC, KMS)
- Build, administer and harden the RHEL systems that support the platform
- Apply security controls that meet federal compliance requirements (STIGs, NIST 800-53)
- Automate deployment and configuration using infrastructure as code (Terraform, CloudFormation) and scripting
- Troubleshoot platform, performance and integration issues
- Write documentation and train customer staff
Required Qualifications:
- CompTIA Security+ certification
- At least one of: RHCSA/RHCE, AWS Certified Solutions Architect – Associate, or AWS Certified AI Practitioner
- Hands-on experience deploying and integrating Databricks
- Strong RHEL administration skills
- Experience working in AWS environments
- AWS Cloud Experience
- Experience with Unity Catalog and data governance
Preferred Qualifications:
- Experience deploying Databricks in government or other highly secure environments
- Experience with Apache Spark, Python and SQL