Career Opportunities: Lead Data Engineer (42705)

Job Description

Company OverviewIncedo is a US-based consulting, data science and technology services firm with over 3000 people helping clients from our six offices across US, Mexico and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, Banking, Wealth Management, product engineering and life science & healthcare industries.Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.Our Mission is to enable our clients to maximize business impact from technology by:

• Harnessing the transformational impact of emerging technologies
• Bridging the gap between business and technology

Role DescriptionAs a Technical Lead - Big Data Platform at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise.Roles & Responsibilities:

• Designing, developing and maintaining large-scale big data platforms using technologies like Hadoop, Spark and Kafka
• Creating and managing data warehouses, data lakes and data marts
• Implementing and optimizing ETL processes and data pipelines
• Developing and maintaining security and access controls
• Troubleshooting and resolving big data platform issues
• Collaborating with other teams to ensure the consistency and integrity of data

Technical SkillsSkills Requirements:

• 8 Years experience Driving Delivery of Data Engineering, Data Design, Data Modeling and Data Analysis Projects
• Hands on Experience in Hadoop Stack of Technologies (Hadoop, Spark, HBase, Hive, Pig, Sqoop, Scala, Flume, HDFS, Map Reduce)
• Hands on experience with Python & Kafka
• Good understanding of Database concepts, Data Design, Data Modeling and ETL
• Hands on in analyzing, designing, and coding ETL programs which involves Data pre-processing, Data Extraction, Data Ingestion, Data Quality, Data Normalization & Data Loading
• Working experience in delivering projects in Agile Methodology and hands on in Jira
• Experience in Client Facing Roles with good communication & thought leadership skills to co-ordinate deliverables across the SDLC
• Good understanding of Machine Learning Models and Artificial Intelligence preferred
• Good understanding of Data Components, Data Processing & Data Analytics on AWS is good to have
• Experience with data modeling tools like Erwin is good to have
• Preferred Location: Cleveland or Pittsburgh
• Masters/Bachelors in computer science or equivalent fields

Nice-to-have skillsQualifications

• 7-9 years of work experience in relevant field
• B.Tech/B.E/M.Tech or MCA degree from a reputed university. Computer science background is preferred

Company ValueWe value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Keyskills :
big data technologies data integration projects cloud computing platforms etl processes optimization data modeling skillsartificial intelligence pig flume python hive scala security database data extraction program manager telecom hadoop