Big Data Engineer

Job Description

About the RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and solutions. You will work closely with data scientists, analysts, and business stakeholders to extract meaningful insights from large and complex datasets.Key Responsibilities:
• Design, develop, and deploy scalable and high-performance data pipelines using Apache Spark and Scala.
• Develop and maintain data ingestion and transformation processes, including data cleaning, validation, and enrichment.
• Build and optimize data models for data warehousing, data lakes, and other data stores.
• Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions.
• Perform data analysis and troubleshooting to identify and resolve data quality issues.
• Stay abreast of the latest advancements in big data technologies and best practices.
• Contribute to the development and improvement of data engineering best practices and standards.
• Mentor junior engineers and provide guidance on data engineering principles.
Required Skills & Experience:
• 3-10 years of professional experience in big data engineering.
• Strong proficiency in Apache Spark and Scala.
• Experience with SQL, Hive, and other data warehousing technologies.
• Experience with cloud platforms such as AWS, Azure, or GCP (preferred).
• Experience with data streaming technologies such as Kafka (preferred).
• Strong understanding of data modeling, data warehousing concepts, and data quality principles.
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and as part of a team.
• No career gaps after graduation.
Benefits:
• Competitive salary (Salary Experience in years * 3)
• Comprehensive benefits package (health insurance, paid time off, etc.)
• Opportunities for professional growth and development
• Work in a challenging and rewarding environment
• Be part of a dynamic and innovative team

Keyskills :
big dataspark