hireejobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Data Streaming (java+Spark+Pyspark+Scala) + AWS

3.00 to 6.00 Years   Chennai   21 Jun, 2023
Gharondaa Advisors Private Limited
Job LocationChennai
EducationNot Mentioned
SalaryRs 14 - 16 Lakh/Yr
IndustryIT - Software
Functional AreaEmbedded / System Software
EmploymentTypeFull-time

Job Description

    Must to have :Spark with Java/ScalaStrong SQL skillsAWS ExperienceExperience using CICI pipelines on Git & Python scriptingSpark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster.Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data.Responsibilities:Create Scala/Spark/Pyspark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesSkills:PysparkScala (with a focus on the functional programming paradigm)Apache Spark 2.x, 3.x-Apache Spark RDD API-Apache Spark SQL DataFrame API-Apache Spark Streaming APISpark query tuning and performance optimizationSQL database integration (Postgres, and/or MySQL)Experience working with HDFS, AWS ( S3, Redshift, EMR , IAM , Polices , Routing)CI-CD Pipleline, Jenkins, Gitlab /BitbucketDeep understanding of distributed systems (e.g. partitioning, replication, consistency, and consensus)

Keyskills :
javascala

APPLY NOW

Data Streaming (java+Spark+Pyspark+Scala) + AWS Related Jobs

© 2019 Hireejobs All Rights Reserved