hireejobs
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Senior Data Engineer - Cloud Native

10.00 to 14.00 Years   Bangalore, Chennai, Hyderabad, Kolkata   17 Dec, 2021
Job LocationBangalore, Chennai, Hyderabad, Kolkata
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT - Software
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

Dear Candidate,Were Opening forSenior Data Engineer - Cloud NativeRoles & Responsibilities :-As Senior Data Engineer - Cloud Native you are expected to be functionally knowledgeable and have expertise in areas like data integration, data extraction, ingestion and loading (ETL), into Saas (Snowflake/Panoply) and Hyperscalar Paas Services on AWS, Azure and GCP platforms. Should have good knowledge on database technologies (NoSQL) and hands-on in either data management or open-source programming. As a Sr Data Engineer in our Data and AI team,you will provide technology guidance in data management for one or more projects; assist in defining scope and sizing of work; and anchor Proof of Concept development. You will provide data engineering solutions based on the business problem, data integration with third party services, designing and developing complex data pipelines for clients business needs. You will collaborate with some of the best talent in the industry to create and implement innovative high quality solutions, participate in Pre-Sales and various pursuits focused on our clients business needs.You will also contribute in a variety of roles in thought leadership, mentorship, systems analysis, architecture, design, configuration, testing, debugging, and documentation. You will challenge your leading edge solutions, consultative and business skills through the diversity of work in multiple industry domains.Responsibilities:

  • Be responsible for developing and maintaining complex data pipelines, ETL, data models and standards for various data Integration & data warehousing projects from source to sinks on Saas/Paas platforms - snowflake, databricks, Azure Synapse, Redshift, BigQuery, etc
  • Develop scalable, secure and optimized data transformation pipelines and integrate them with downstream sinks
  • Develop and maintain documentation of the data architecture, data flows and data models, integrations, pipelines etc
  • Take ownership of technical solutions from data flow design and architecture perspective, ensure the right direction and propose resolution to potential data pipeline-related problems.
  • Developing Proof of concepts (PoC) of key technology components to project stakeholders
  • Developing scalable and re-usable frameworks for ingesting of geospatial data sets
  • Develop connectors to extract data from source and use event / streaming services to persist and process data into sinks
  • Collaborate with other members of the project team (Architects, Data Engineers) to support delivery of additional project components (like API interfaces, Search, visualization)
  • Evaluate and create PoVs around the performance aspects of data integrations tools in the market against customer requirements
  • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
Required SkillsData Engineer with10+ years of experience with following skills-
  • Must have 5+ years of experience working as a Data Engineer in cloud transformation projects in the areas of data management solutions - AWS or Azure or GCP or Snowflake, Databricks etc.
  • Must have hands on experience at least two end to end implementation of data lake/warehouse projects using Paas and Saas - such as Snowflake, Databricks, Redshift, Synapse, BigQuery etc. and 3+ data warehouse/data lake implementations on-premise
  • Expertise in data pipelines development, ETL/ELT, implementing complex stored Procedures and standard DWH and ETL concepts
  • Expertise in setting up resource monitors, RBAC controls, warehouse sizing, query performance tuning, IAM policies, Cloud networking (VPC, Virtual Network etc)
  • Experience in Data Migration from on-premise RDBMS to cloud data warehouses
  • Deep understanding of relational as well as NoSQL data stores, methods and approaches(star and snowflake, dimensional modelling)
  • Hands-on experience in Python, PySpark, programming for data integration projects
  • Sound experience in Cloud data storage (Blob, S3, Object stores, Minio), data pipeline services, data integration services, data visualization
  • Provide resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface
  • Should be able to develop and maintain documentation of the data architecture, data flow and data models of the data lake/warehouse appropriate for various audiences
  • Provide direction on adoption of Cloud technologies and industry best practices in the field of data lake/warehouse architecture and modelling
Preferred Skills:
  • NoSQL/Key-value, Data Vault 2.0 concepts knowledge
  • Cloud Cerfitication - Data Engineering
  • Experience in Agile development methodologies
  • Understanding of cloud network, security, data security and data access controls and design aspects
Regards,Team HR

Keyskills :
devopsdata engineeringazurenosqlbigquerydata engineercloud nativesenior data engineer

Senior Data Engineer - Cloud Native Related Jobs

© 2019 Hireejobs All Rights Reserved