Lead Data Engineer

Job Description

As a Lead Data Engineer at our company, you will be responsible for designing, developing, and implementing data systems to ensure reliability and scalability. You will also lead a team of data engineers and work closely with cross-functional teams and stakeholders to analyze business requirements and design solutions. Your key responsibilities will include:- Designing, developing, and maintaining data architecture and infrastructure for data pipelines, data lakes, and data warehouses.- Leading a team of data engineers, mentoring them in technical best practices and standards.- Collaborating with cross-functional teams to gather business requirements and translate them into technical requirements.- Implementing data security and privacy protocols to ensure compliance with industry standards and regulations.- Optimizing data systems for performance and scalability.- Ensuring the quality and accuracy of data through data validation and testing processes.- Developing and maintaining documentation for data infrastructure, processes, and workflows.- Staying up-to-date with emerging technologies and industry trends in data engineering and making recommendations for adoption.Qualifications required for this role include:- Bachelors or Masters degree in Computer Science, Data Science, or a related field.- At least 7 years of experience in data engineering or a related field, with a track record of successfully leading teams.- Strong understanding of data modeling, data warehousing, and ETL processes/data integration.- Proficiency in programming languages such as Python, Java, or Scala, and experience with data engineering tools such as Apache Spark, Hadoop, and Kafka.- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.- Excellent communication and collaboration skills with the ability to work with cross-functional teams and stakeholders.- Strong problem-solving skills and attention to detail.- Ability to manage multiple priorities in a fast-paced, deadline-driven environment.In addition to the above qualifications, you will also be expected to contribute to the teams growth by participating in interviews, providing status updates, conducting tech sessions, sharing knowledge with peers, and being innovative. Your analytical mind and problem-solving aptitude will be key in contributing to blogs, papers, and IP creation. As a Lead Data Engineer at our company, you will be responsible for designing, developing, and implementing data systems to ensure reliability and scalability. You will also lead a team of data engineers and work closely with cross-functional teams and stakeholders to analyze business requirements and design solutions. Your key responsibilities will include:- Designing, developing, and maintaining data architecture and infrastructure for data pipelines, data lakes, and data warehouses.- Leading a team of data engineers, mentoring them in technical best practices and standards.- Collaborating with cross-functional teams to gather business requirements and translate them into technical requirements.- Implementing data security and privacy protocols to ensure compliance with industry standards and regulations.- Optimizing data systems for performance and scalability.- Ensuring the quality and accuracy of data through data validation and testing processes.- Developing and maintaining documentation for data infrastructure, processes, and workflows.- Staying up-to-date with emerging technologies and industry trends in data engineering and making recommendations for adoption.Qualifications required for this role include:- Bachelors or Masters degree in Computer Science, Data Science, or a related field.- At least 7 years of experience in data engineering or a related field, with a track record of successfully leading teams.- Strong understanding of data modeling, data warehousing, and ETL processes/data integration.- Proficiency in programming languages such as Python, Java, or Scala, and experience with data engineering tools such as Apache Spark, Hadoop, and Kafka.- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.- Excellent communication and collaboration skills with the ability to work with cross-functional teams and stakeholders.- Strong problem-solving skills and attention to detail.- Ability to manage multiple priorities in a fast-paced, deadline-driven environment.In addition to the above qualifications, you will also be expected to contribute to the teams growth by participating in interviews, providing status updates, conducting tech sessions, sharing knowledge with peers, and being innovative. Your analytical mind and problem-solving aptitude will be key in contributing to blogs, papers, and IP creation.

Keyskills :
PythonJavaScalaApache SparkHadoopKafkaAWSAzure