Technical Lead - Azure Databricks - Senior System Analyst
Posted Updated
Job Summary:
We are looking for an experienced Technical Lead with strong expertise in Azure Databricks to design and lead data engineering solutions. The candidate will be responsible for building scalable data pipelines, guiding the team, and ensuring successful delivery of data projects.
Key Responsibilities:
- Design and develop data pipelines using Azure Databricks
- Lead and mentor data engineering team members
- Work with stakeholders to understand business requirements
- Ensure high performance, scalability, and reliability of data solutions
- Optimize ETL/ELT processes and data workflows
- Collaborate with architects and cross-functional teams
- Review code and ensure best practices are followed
Required Skills:
- Strong experience in Azure Databricks
- Hands-on experience with Azure Data Factory (ADF), ADLS, Azure SQL
- Good knowledge of PySpark / Spark / SQL
- Experience in data warehousing and ETL/ELT processes
- Strong problem-solving and leadership skills
Preferred Skills:
- Experience with Power BI or reporting tools
- Knowledge of CI/CD and DevOps practices
- Azure certifications (DP-203, AZ-900, etc.)