Senior Azure Data Engineer

Job Description

As a Senior Azure Data Engineer, your role involves analyzing and understanding source systems, data flows, and data models. You will collaborate closely with the Data Architect to design new data models and views. Your responsibilities also include developing source to target mappings for data lineage, data profiling, and ensuring data quality requirements are met. Additionally, you will work on translating requirements into technical specifications and designing scalable data pipelines on Azure. It is essential to develop and optimize data storage solutions while ensuring data security and compliance with industry standards.Key Responsibilities:- Document the current list of source systems and conduct analysis.- Evaluate data formats, types, and constraints.- Examine keys and dependencies, such as identifying foreign key relationships between tables.- Analyze data to validate business domains and requirements.- Develop and optimize data storage solutions.- Ensure data security and compliance with industry standards.- Collaborate with stakeholders to gather requirements and deliver solutions.- Monitor and troubleshoot performance issues.- Maintain up-to-date documentation for data processes.Qualifications Required:- Proficiency in Azure Data Factory, Azure SQL Database, Data Lake, Power BI, SQL, Python, ETL, and Data Modelling.- Ability to independently engage with clients and onsite teams.- Experience working with extended overlap with Central Time Zone (12:30 pm CST).Please note that the job location for this role is in Chennai, Hyderabad, Bangalore, or Remote, and the shift hours are from 3-12 am. This is a full-time position, and the ideal candidate should be an immediate joiner or serving notice less than 30 days. As a Senior Azure Data Engineer, your role involves analyzing and understanding source systems, data flows, and data models. You will collaborate closely with the Data Architect to design new data models and views. Your responsibilities also include developing source to target mappings for data lineage, data profiling, and ensuring data quality requirements are met. Additionally, you will work on translating requirements into technical specifications and designing scalable data pipelines on Azure. It is essential to develop and optimize data storage solutions while ensuring data security and compliance with industry standards.Key Responsibilities:- Document the current list of source systems and conduct analysis.- Evaluate data formats, types, and constraints.- Examine keys and dependencies, such as identifying foreign key relationships between tables.- Analyze data to validate business domains and requirements.- Develop and optimize data storage solutions.- Ensure data security and compliance with industry standards.- Collaborate with stakeholders to gather requirements and deliver solutions.- Monitor and troubleshoot performance issues.- Maintain up-to-date documentation for data processes.Qualifications Required:- Proficiency in Azure Data Factory, Azure SQL Database, Data Lake, Power BI, SQL, Python, ETL, and Data Modelling.- Ability to independently engage with clients and onsite teams.- Experience working with extended overlap with Central Time Zone (12:30 pm CST).Please note that the job location for this role is in Chennai, Hyderabad, Bangalore, or Remote, and the shift hours are from 3-12 am. This is a full-time position, and the ideal candidate should be an immediate joiner or serving notice less than 30 days.

Keyskills :
Power BISQLPythonETLAzure Data FactoryAzure SQL DatabaseData Lake