hireejobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Data Engineer

5.00 to 10.00 Years   Chennai   28 Jul, 2022
Arminus
Job LocationChennai
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT - Software
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

    The Vanguard Data Management Team supports data ingestion, data quality and data conformance on the Big Data platform (Cloudera). The team also manages several NoSQL data platforms and operational real-time event-based processing and compute applications as well as analytics consumption use cases including machine/deep learning.The technology team is responsible for building and maintaining a multitude of applications including: Batch ingestion using Talend and other Big data tools Real-time ingestion/stream processing and data distribution using Kafka, Java and Spark Building data caching layer on NoSQL data platforms for fast response times Build out canonical models and data conformance Implement best in class data management and data ingestion. Build and implement best in class Data Quality tools for monitoring of Critical Data Elements Working on Snowflake and other technologies on AWSCore ResponsibilitiesThis role is for a Data Engineer is to work on the Vanguard Big Data Platform. The team is responsible for the maintenance and development of leading Big Data initiatives and use cases providing business value. Interface with product teams to understand their requirements to build the ingestion pipelines and conformance layer for consumption by business. Work closely with the data ingestion team to track the requirements and drive the build out of the canonical models Participate in data analysis as part of the development lifecycle Do hands-on development as part of the development team to deliver the business requirements Manage the workload of the team and the scrum process to align it with the objectives and priorities of the product owners Participate in data management activities related to the Risk and Regulatory requirements as needed. Key Skills: The Data Engineering lead will be working very closely with and managing the work of a team of data engineers working on our Big Data Platform. The lead will need the below core skills Good understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably) Hands-on experience working with Hive, Impala and/or Hbase for data curation/conformance related work Proficiency in Spark/Scala/Java for development work related to curation/conformance. Strong Scala developer (with previous Java background) preferred. Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event-based messaging Strong data analysis skills and the ability to slice and dice the data as needed for business reporting Experience working in an agile environment with a fast-paced changing requirements. Excellent planning and organizational skills Strong Communication skills,

Keyskills :
use casesdata warehousingbig dataquality toolsinformaticasqlpython

APPLY NOW

Data Engineer Related Jobs

© 2019 Hireejobs All Rights Reserved