hireejobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Hiring For AWS Data Engineer

5.00 to 8.00 Years   Pune   26 Sep, 2023
HARJAI COMPUTERS PRIVATE LIMITED
Job LocationPune
EducationNot Mentioned
SalaryNot Disclosed
IndustryOthers
Functional AreaOthers
EmploymentTypeFull-time

Job Description

    Role: AWS Data EngineerYears of experience preferred:5-8 yearsBackground on Integration work
    • We are leveraging a Data Lake built on AWS infrastructure to streamline data integrations.
    • BI/Analytics built on top of MPP(Snowflake/Redshift) and subsequent data pipelines from Data lake to BI.
    • The Data Engineering workstream is currently handling data pipelines with AWS using Glue/EMR,Lambda,S3,Redshift,Airflow,Kafka,DBT.
    • There are API solutions built using API GatewayLambda
    • Data engineering team will also take ownership of AWS and discuss with relevant teams to build integration on AWS
    • The current tech stack includes native AWS services around data management on cloud, additionally real time tool stacks as kafka, ELT tools as DBT, Visualization on SAP BO Qlik
    Responsibilities
    • Practical knowledge of AWS Cloud Services related to data storage, integration and processing (e.g. S3, DMS,Glue/EMR, Athena, Lambda, Kafka,API etc.)*****
    • In depth understanding and experience on building data pipelines using PySparkPython.
    • Familiarity with AWS foundation services related to compute, network, storage, content delivery, administration,security, deployment ,management and automation technologies****
    • Good understanding of AWS Data Analytics services*
    • Build end to end data pipeline using native AWS services(S3, AWS EMR, Glue, Athena,Airflow )***
    • Experience with AirFlow for Job Orchestration
    • Understand and use existing PySpark accelerator framework provided by external consulting company.
    • Experience with Spark job tuning, cluster tuning
    • Collaborate with the Integration Architect and provide inputs around end to end data flows for data integrations based on requirements
    • Manage deployed data pipelines on AWS and enhance as and when required
    • ETL Architect knowledge
    • Knows how to design, build, scale and optimize data-driven solution
    • Excellent ability to communicate technical information via documents, diagrams or presentations
    • Lead and drive project scoping phase. Collaborate with business and informatics stakeholders to lead the business case development for new initiatives including high level solution options and resource estimates.***
    Nice to have:
    • Experience in in building data pipeline using DBT
    • AWS Solution architect certification
    • Snowflake Certifications.
    • Data modelling and Data architecture

Keyskills :
awskafkapython

APPLY NOW

Hiring For AWS Data Engineer Related Jobs

© 2019 Hireejobs All Rights Reserved