Lead Data Engineer

Job Description

Roles and ResponsibilitiesHow will you make an impact Enabling our internal teams at scaled,Data Delivery Leadwill join our ETO data organization responsible for working & managing a large team of Data engineers, ETL developers and team members to develop data driven applications and automations across a variety of infrastructure (both On-Prem and Cloud).Data Delivery Leadmust be able to collaboratively work multiple teams to design, develop, deploy and maintain data solutions for the Enterprise data platform.This position offers an exciting opportunity to work on processes that interface with multiple systems including AWS, Oracle, Middleware and ERPs. The candidate will lead development projects, pilots, evolve governance, standards, best practices and advance best design practices.What will you do Manage a team of data engineers, etl developers, and vendor consulting resources to ensure successful execution of BI delivery projects, provide governance and subject matter expertise support for data engineering platformLead, design, develop, deploy and maintain mission critical data applications for Enterprise data platformParticipate in all phases of the Enterprise Data platform development life cycle as appropriate; including, but not limited to gathering customer requirements, defining technical requirements, creating high level architecture diagrams, data validation and training sessionsEngage in Data solutions and Business Intelligence Projects and drive them to closureLead different aspects of data quality, machine learning, data acquisition, and some design and analysis tasksHow will you get here Have strong experience in data engineering, data transformation, big data or business intelligence productsAbility to work independently and as a member of a cross-functional teamLead and manage data engineers within the teamIs passionate about applications, data analytics, end-user productivityExceptional customer focusDesire to teach other team members about technology in the area of expertiseExperience on project management framework Agile (Jira toolset)EducationMasters degree in computer science engineering from an accredited university (desired)4-year degree with major in computer science engineering (or equivalent) from an accredited university (preferred) will substitute for minimum 5-7 years professional IT experience.ExperienceExperience in Data lake, Oracle, SQL Server or AWS Redshift type databasesExperience inETL/ELT(Data extraction, data transformation and data load processes)Strong Experience in DevOpsTool & Technology Skills8+ Years of Experience in Data Lake, Data Analytics & Business Intelligence SolutionsStrong Experience in ETL Tools preferably Informatica & Databricks6-8years of experience at Enterprise-level ETL development & architecture in Informatica Power Center9.x, 10.xand Informatica Cloud environment.Excellent experience in Data Lake using AWS Databricks, Apache Spark & Python2+ years of working experience in a DevOps environment, data integration and pipeline development.2+ years of Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystemsDemonstrated skill and ability in the development of data warehouse projects/applications (Oracle & SQL Server)Strong real-life experience in python development especially inpySparkin AWS Cloud environment.Experience in Python and common python libraries.Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.Experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.Knowledge of extract development against ERPs - SAP, Siebel, JDE, BAAN preferredExposure to data visualization tools like Power BI, Tableau etc,

Keyskills :
sqljavadata warehousinginformaticapythonuser defined functionshigh level architecturesubject matter expertisebusiness intelligence projectsbig datapower bietl toolssql serverlife cycledata qualityapache sparkdata analyticsdata solutions