Data Engineer - Manager

Job Description

As a Data Engineering Lead at EY, you will play a crucial role in the architectural design, development, and maintenance of enterprise data platforms on AWS. Your primary responsibilities will include leading a team of engineers, implementing scalable data pipelines using PySpark and AWS services, and ensuring timely delivery of data products through Scrum methodologies. Additionally, you will collaborate with stakeholders to translate technical concepts into actionable insights for non-technical teams.**Key Responsibilities:**- **Technical Leadership:** Lead the design and implementation of scalable, automated data pipelines using PySpark and AWS services.- **Team Management:** Manage, mentor, and upskill a team of data engineers. Conduct code reviews and ensure adherence to best practices in software engineering.- **Agile Delivery:** Act as the Scrum Lead/Manager for the data team. Organize and facilitate daily stand-ups, sprint planning, and backlog grooming within Jira.- **Stakeholder Collaboration:** Translate complex technical concepts into actionable insights for non-technical stakeholders across teams.**Qualifications:**- 8 years of experience in Data Engineering, Data Architecture, or a related field.- 8 years in a formal leadership or management role.- Bachelors or masters degree in computer science, Engineering, or a related quantitative field.- Relevant certifications (e.g., AWS Certified Data Engineer - Associate/Professional) are highly preferred.- Deep expertise in Databricks (PySpark, Delta Lake, notebooks)- Strong programming skills in Python and PySpark- Experience with GitHub, GitHub Actions, and Terraform for AWS deployments- Proficiency in Medallion Architecture and Kimball modelingIn addition to the technical skills, you are expected to possess strong leadership and soft skills, including Scrum Mastery, effective communication, and strategic thinking. Your ability to balance technical solutions with business deadlines will be crucial in this role.EY offers a competitive remuneration package, flexible working arrangements, career development opportunities, and a comprehensive Total Rewards package. By joining EY, you will have the chance to work with engaging colleagues, develop new skills, and contribute to building a better working world through innovative solutions and a commitment to EY values. As a Data Engineering Lead at EY, you will play a crucial role in the architectural design, development, and maintenance of enterprise data platforms on AWS. Your primary responsibilities will include leading a team of engineers, implementing scalable data pipelines using PySpark and AWS services, and ensuring timely delivery of data products through Scrum methodologies. Additionally, you will collaborate with stakeholders to translate technical concepts into actionable insights for non-technical teams.**Key Responsibilities:**- **Technical Leadership:** Lead the design and implementation of scalable, automated data pipelines using PySpark and AWS services.- **Team Management:** Manage, mentor, and upskill a team of data engineers. Conduct code reviews and ensure adherence to best practices in software engineering.- **Agile Delivery:** Act as the Scrum Lead/Manager for the data team. Organize and facilitate daily stand-ups, sprint planning, and backlog grooming within Jira.- **Stakeholder Collaboration:** Translate complex technical concepts into actionable insights for non-technical stakeholders across teams.**Qualifications:**- 8 years of experience in Data Engineering, Data Architecture, or a related field.- 8 years in a formal leadership or management role.- Bachelors or masters degree in computer science, Engineering, or a related quantitative field.- Relevant certifications (e.g., AWS Certified Data Engineer - Associate/Professional) are highly preferred.- Deep expertise in Databricks (PySpark, Delta Lake, notebooks)- Strong programming skills in Python and PySpark- Experience with GitHub, GitHub Actions, and Terraform for AWS deployments- Proficiency in Medallion Architecture and Kimball modelingIn addition to the technical skills, you are expected to possess strong leadership and soft skills, including Scrum Mastery, effective communication, and strategic thinking. Your ability to balance technical solutions with business deadlines will be crucial in this role.EY offers a competitive remuneration package, flexible working arrangements, career development opportunities, and a comprehensive Total Rewards package. By joining EY, you will have the chance to work with engaging colleagues, develop new skills, and contribute to building a better working world through innovative solutions and a commitment to EY values.

Keyskills :
PythonSQLDB2OracleSQL ServerData ModelingShell ScriptingDockerKafkaAWS S3AWS GlueAWS EMRAWS SNSAWS RedshiftAWS LambdaPySparkApache AirflowCICD PipelinesAWS Step FunctionsAWS Event Bridging SchedulingAWS ECSAWS EKSAWS DynamoDB