hireejobs
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Tech Lead Big Data

5.00 to 8.00 Years   Bangalore   02 May, 2019
Job LocationBangalore
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT - Software
Functional AreaIT Operations / EDP / MIS
EmploymentTypeFull-time

Job Description

  • Experience with setting up a multi-broker architecture support multiple producers and consumers.
  • Understands details of topic partitioning, consumer groups, partition log commits and offsets, Partition re-balancing.
  • Consuming records from specific offsets. All, this will help in building replay capability. We worked on a similar design at BBG.
  • Experience with coding message de-serializers and integrating with Kafka consumer/producer Avro, protbuff
  • Understand implementing synchronous and asynchronous message consumers
  • Kafka internals on Cluster membership, replication, partition allocation, leader election, compaction. Will help in setting up a production grade Kafka setup and meet reliability guarantees
  • Use Kafka API to build data pipelines: Kafka Connect and writing connectors. For building custom integrations with external data sources
  • Knowledge on Kafka Monitoring and metrics using JMX interface
  • Stream Processing. Very important for implementing near real time data semantics
  • Kafka API for Event streams ordering
  • Kafka API for time window processing Moving averages, rolling windows, overlapping windows
  • Stream operations: Aggregations, joining two stream events, maintaining state.
  • Detect out of sequence events.
  • Build an Event stream topology
  • Rich experience on Apache Kafka, including streaming application development, integration and operations- Hands on experience with at least two of the following key languages: Java, Scala, C++, Python- Experience on application or library design and development with high quality software delivery history- Strong problem-solving and analytical skills, especially for JVM performance tuning, profiling and optimization- Knowledge of messaging and networking programming, familiar with network protocols (e.g.: TCP, mcast)
  • Experience on Kafka deployment and operations
  • Experience on other stream processing technologies such as Spark, Storm, Flink, Heron
  • Experience on middleware such as: ZeroMq, RocketMQ, Rabbitmq, Redis
  • Effective concurrent programming experience, e.g. advanced lock-free techniques, cache-friendly techniques.
  • Mandatory Skills:Apache Kafka Big Data, Data ManagementLanguage Skills:English Language
,

Keyskills :
kafkatcplanguagestatedeliverylanguagesreliabilityredisprofilingqualityavrooperationsapplicationrabbitmq

Tech Lead Big Data Related Jobs

© 2019 Hireejobs All Rights Reserved