hireejobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Databricks Developer

6.00 to 11.00 Years   Chennai,Bangalore, Pune   08 Mar, 2025
Ara Resources Private Limited
Job LocationChennai,Bangalore, Pune
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT Services & Consulting
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

    Location: Bangalore/Chennai/PuneRole: Databricks DeveloperQualification: Any GraduateExperience: 8 YearsARAs client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain and process expertise.The Role: We are looking for a Databricks Lead resource (with experience in AWS).Key Responsibilities:
    • Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
    • Experienced in implementing standardized pipelines with automated testing, DevOps for CI/CD, Terraform for infrastructure as code, and Ganglia for monitoring.
    • Continuously improve systems through performance enhancements and cost reductions in compute and storage
    • Develop and maintain data pipelines for effective data extraction transformation and loading.
    • Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
    • Develop and maintain Scalable Architecture database design and data pipelines.
    • Data Engineering: Develop and optimize data pipelines for ingesting, processing, and transforming large volumes of data from diverse sources using Databricks and related technologies.
    • Performance Optimization: Optimize Databricks jobs, queries, and workflows for performance, scalability, and cost-efficiency, leveraging best practices and optimization techniques.
    • Lead Data Engineering Projects to manage and implement data-driven systems.
    Skills Required:
    • 5 years of relevant experience and with overall experience of 8-10 years of experience.
    • Experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud (AWS, Azure)
    • Proven experience designing, implementing, and managing data analytics using Databricks.
    • Strong proficiency in Apache Spark, SQL, Python with hands-on experience developing data pipelines.
    • Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
    • Ability to work independently with some level of ambiguity and juggle multiple demands.
    • Understand and document data transformation requirements.
    • Provide technical guidance and mentorship to junior team members.
    • Experience working in Insurance domain.
    • Data Modeling/ Data Lineage and awareness of Canonical data model implementation
    Good to have:Experience in Airflow, Splunk, Power BI, Git, Azure DevopsQualifications & Experience:
    • Somebody who has at least 8 years of experience in Databricks Implementation / Development.
    • Good to have Power BI Architecture Experience / Exposure.
    • Experience of working in Cloud Platforms like Azure, AWS and using services like Data Factory, Databricks, Glue, S3, Athena
    • Education qualification: Any bachelors degree from a reputed college.

Keyskills :
awssqlpythonazuredatabricks

APPLY NOW

Databricks Developer Related Jobs

© 2019 Hireejobs All Rights Reserved