Azure Data Engineer

Job Description

Role Overview:You will be part of a vibrant community at PwC focused on leveraging data to drive insights and make informed business decisions. Your main responsibilities will involve utilising advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. This role will require skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems.Key Responsibilities:- Design, implement, and maintain reliable and scalable data infrastructure- Write, deploy, and maintain software for building, integrating, managing, and quality-assuring data- Develop and deliver large-scale data ingestion, data processing, and data transformation projects on the Azure cloud- Mentor and share knowledge with the team, provide design reviews, discussions, and prototypes- Work with customers to deploy, manage, and audit standard processes for cloud products- Adhere to and advocate for software & data engineering standard processes- Deploy secure and well-tested software meeting privacy and compliance requirements- Develop, maintain, and improve CI / CD pipeline- Ensure service reliability and follow site-reliability engineering standard processes- Design, build, deploy, and maintain infrastructure as code- Containerize server deployments- Collaborate with cross-disciplinary team members in a Scrum/Agile setupQualifications Required:- Education: Bachelor or higher degree in computer science, Engineering, Information Systems, or other quantitative fields- Experience: 6 to 9 years of relevant experience- Hands-on experience with Spark, SQL, PySpark, Azure Data Factory, Azure Data Lake, Azure SQL DB, Azure Synapse, Azure DevOps- Experience in implementing large-scale distributed systems- Customer management and leadership abilities- Strong knowledge in Synapse, ADF, Spark, SQL, PySpark, Spark-SQLAdditional Details:At PwC, you will join a purpose-led and values-driven work environment powered by technology, enabling you to make a tangible impact in the real world. The company values diversity and strives to create an environment where all individuals can bring their true selves and contribute to personal and firm growth. PwC believes in providing equal employment opportunities without discrimination on any grounds. Role Overview:You will be part of a vibrant community at PwC focused on leveraging data to drive insights and make informed business decisions. Your main responsibilities will involve utilising advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. This role will require skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems.Key Responsibilities:- Design, implement, and maintain reliable and scalable data infrastructure- Write, deploy, and maintain software for building, integrating, managing, and quality-assuring data- Develop and deliver large-scale data ingestion, data processing, and data transformation projects on the Azure cloud- Mentor and share knowledge with the team, provide design reviews, discussions, and prototypes- Work with customers to deploy, manage, and audit standard processes for cloud products- Adhere to and advocate for software & data engineering standard processes- Deploy secure and well-tested software meeting privacy and compliance requirements- Develop, maintain, and improve CI / CD pipeline- Ensure service reliability and follow site-reliability engineering standard processes- Design, build, deploy, and maintain infrastructure as code- Containerize server deployments- Collaborate with cross-disciplinary team members in a Scrum/Agile setupQualifications Required:- Education: Bachelor or higher degree in computer science, Engineering, Information Systems, or other quantitative fields- Experience: 6 to 9 years of relevant experience- Hands-on experience with Spark, SQL, PySpark, Azure Data Factory, Azure Data Lake, Azure SQL DB, Azure Synapse, Azure DevOps- Experience in implementing large-scale distributed systems- Customer management and leadership abilities- Strong knowledge in Synapse, ADF, Spark, SQL, PySpark, Spark-SQLAdditional Details:At PwC, you will join a purpose-led and values-driven work environment powered by technology, enabling you to make a tangible impact in the real world. The company values diversity and strives to create an environment where all individuals can bring their true selves and contribute to personal and firm growth. PwC believes in providing equal employment opportunities without discrimination on any grounds.

Keyskills :
ADFSparkSQLSynapsePySpark