Azure DataBricks

Job Description

• Databricks Lead
• Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL)
• Must-have skills
• 6 years of experience required for this role
• Cloud certified in one of these categories
• Azure Data Engineer
• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation
• Semantic Modelling/ Optimization of data model to work within Rahona
• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.
• Experience in Sqoop / Hadoop
• Microsoft Excel (for metadata files with requirements for ingestion)
• Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud
• Strong Programming skills with at least one of Python, Scala or Java
• Strong SQL skills ( T-SQL or PL-SQL)
• Data files movement via mailbox
• Source-code versioning/promotion tools, e.g. Git/Jenkins
• Orchestration tools, e.g. Autosys, Oozie
• Source-code versioning with Git.
• Nice-to-have skills
• Experience working with mainframe files
• Experience in Agile environment, JIRA/Confluence tools

Keyskills :
factorydatapythonscalaazuredatabricks