hireejobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Data Engineer III - BigData

3.00 to 8.00 Years   Bangalore   31 Mar, 2023
JPMorgan
Job LocationBangalore
EducationNot Mentioned
SalaryNot Disclosed
IndustryBanking / Financial Services
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

    Commercial Banking IT is looking for a strong Big Data candidate with skills and experience with large-scale Hadoop-based data platforms who will be responsible for design, development and testing of a next generation enterprise data hub and reporting and analytic applications. This individual will work with an existing development team to create the new Hadoop-based platform , migrate the existing data platforms to Cloud and provide production support. The current platform uses many tools including Sqoop, Hive, Impala, Spark, Kafka, Streaming, SQL, Python, Java, etc. The candidate will be accountable for design, development, implementation and post-implementation maintenance and support. The candidate will develop and test new interfaces, enhancements/changes to existing interfaces, new data structures, and new reporting capabilities.Job responsibilities Develop ,enhance and test new/existing interfaces. The candidate will be part of existing agile team and will work on developing, enhancing ETL pipelines,design solutions, Handle Dev Ops effort in terms of CICD, Scanning, Code, Performance testing and Test coverage Identify, analyze, and interpret trends or patterns in complex data sets Transforming existing ETL logic into Hadoop Platform Innovate new ways of managing, transforming and validating data Establish and enforce guidelines to ensure consistency, quality and completeness of data assets 10-15% support on legacy jobs which is primarily developed using unix shell scripts and oracleRequired qualifications, capabilities, and skills Formal training, or certification on software engineering concepts and 3+ years applied experience in Data Engineering pipeline Experience in Scripting,SQL, Complex sql query Writing Haddop, Imapla, Hive Experience in Sqoop, SparkSQL Minimum 7 experience in a Big Data technology (Hadoop and Spark Architecture, Performance tuning ,Spark SQL, Streaming, HIVE, SQOOP, KAFKA, Impala, HBASE, Entitlements etc., ) Experience in real time streaming data 4+ years of Experience in Python is a must Experience in writing SQL queries and UNIX shell is a must, Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracyPreferred qualifications, capabilities, and skills Minimum 7+ Experience in BigData, Data Pipeline, SQL Services Experience in SparkSQL,Imapala and Bigdata technologiesMinimum 3+ Experience in a Big Data technology (Hadoop and Spark Architecture, Performance tuning ,Spark SQL, Streaming, HIVE, SQOOP, KAFKA, Impala, HBASE, Entitlements etc., ),

Keyskills :
pythonsqldebuggingbig datasql queriesdata structuresenterprise datadata engineeringperformance tuning

APPLY NOW

Data Engineer III - BigData Related Jobs

© 2019 Hireejobs All Rights Reserved