hireejobs
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Data Engineer

6.00 to 10.00 Years   Bangalore   05 Mar, 2020
Job LocationBangalore
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT - Software
Functional AreaIT Operations / EDP / MIS
EmploymentTypeFull-time

Job Description

The Data Apps team collects all data generated internally at Qubole and publishes it for internal consumption as well as builds data driven products out of the same. You will be one of the first engineers on this team and will work closely with Product and Engineering teams and Customers to drive and implement the first ever data driven products in the emerging market segment of Big- Data- as- a- Service. Your Part Design data warehouse using Cloud Storage for data analysis using Hive/ Spark etc. Write ETL pipelines in Hive and Spark for loading data into a Cloud based Data Warehouse. Write agents in Bash/ Python/ Java to publish data from different distributed data sources Design and manage real- time data ingestion using Apache Kafka and RoR based web- service. Work with product and engineering teams on different data driven products and help drive/ implement the Data flows for the same. Perform ad- hoc data analysis to test various hypothesis using SQL/ Scala/ Python Mentor a team of engineers while maintaining a hands- on role. Must Have Hands on experience in BigData space (Kafka, Spark, Hadoop Stack like M/ R, Hive, HBase, Sqoop, etc. . NoSQL stores like HBase etc) Designing, integrating and documenting technical components for seamless data extraction and analysis on big data platform Passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source technologies and software paradigms Ensuring best practices that can be adopted in BigData stack and share across teams and BUs. Provides operational excellence through root cause analysis and continuous improvement in technologies and processes. Programming experience with Java & Python. Experience managing software projects. Bachelors Degree in Computer Science, or related discipline with minimum 6 years experience. Nice to Have Prior experience in actively contributing to open source projects like Hadoop/ Spark/ Hive/ HBase Experience in applied machine learning. Academic research experience in the area of distributed systems and query processing. Advanced Degree (MS or PhD in Computer Science) . We have a employee friendly work environment with a liberal work from home policy and expense reimbursement policy at work. We pride ourselves in lack of bureaucracy and delegate power and responsibility aggressively to employees. Self- Starters and those who thrive on complexity and independence love Qubole,

Keyskills :
java informatica sql python istributedsystems rootcauseanalysis apachekafka rootcause dataanalysis bigdata datawarehousing dataextraction academicresearch cloudstorage opensource computerscience

Data Engineer Related Jobs

© 2019 Hireejobs All Rights Reserved