Software Developer - Azure Databricks & Pyspark

Job Description

We have an immediate opening for Azure Databricks with strong experience in Pyspark & SQL. Looking for the candidates who are available to join immediately or within 2 weeks. Interested candidates can share resumes to hidden_emailRole: ADB PysarkJob Type: Full-time (Client Payroll)Mode : WFO/ HybridLocation : Bengaluru/ Chennai/ Pune/ MumbaiExperience :6 yearsMust have : Azure Databricks (ADB) PysparkSQLKey Responsibilities:
• Develop and optimize ETL pipelines and data transformation workflows using Azure Databricks, PySpark, and SQL.
• Work with Azure Data Lake, Azure Synapse, and other Azure data services for data ingestion, storage, and analytics.
• Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver high-quality data solutions.
• Implement data cleansing, validation, and transformation logic in PySpark for structured and unstructured data.
• Write efficient SQL queries for data extraction, analysis, and reporting.
• Optimize Databricks jobs for performance and cost efficiency.
• Implement best practices in code management, version control (Git), and CI/CD pipelines for Databricks.
• Ensure compliance with data governance, security, and quality standards.
• Troubleshoot and resolve data processing issues in production environments.
Required Skills and Experience:
• 3 years of experience in data engineering or related roles.
• Strong hands-on experience with Azure Databricks and PySpark.
• Proficient in SQL query optimization, joins, window functions, and complex transformations.
• Experience with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Azure Synapse Analytics.
• Familiarity with Delta Lake concepts (ACID transactions, time travel, etc.).
• Understanding of data modeling and ETL concepts.
• Proficient in Python for data manipulation and automation.
• Strong analytical and problem-solving skills.
• Experience with Agile/Scrum methodology and tools like JIRA or Azure DevOps.

Keyskills :
sqldatastoragegitfactoryazuredatabricksengineer