Software Engineer Data Engineering (GCP)

Job Description

You will be part of a data engineering team responsible for designing, developing, and maintaining data pipelines and analytics platforms. The role involves working with GCP services, modernising legacy ETL systems, and ensuring high-performance, reliable data solutions. Gather business requirements and translate them into data engineering solutionsDesign, develop, and maintain ETL/ELT pipelines and workflowsSupport migration of legacy ETL systems (e.g., DataStage/JCL) to GCP-native servicesBuild and optimise pipelines using BigQuery, Dataflow, Pub/Sub, and AirflowIntegrate data from multiple sources (Oracle, Teradata, DB2, flat files, etc.)Perform performance tuning and debugging of ETL jobsMonitor and maintain pipelines using Cloud Logging and MonitoringCollaborate with cross-functional teams to understand dependencies and requirementsSupport production issues and ensure data reliability and qualityContribute to estimation, testing, and deployment activities Technical SkillsMust-Have:3 years of experience in Data Engineering / ETL developmentHands-on experience with GCP or any cloud platform (GCP preferred)Good understanding of: BigQueryDataflow / ETL toolsAirflow / scheduling toolsStrong SQL and programming skills (Python / Java)Experience in data pipeline development and data warehousingExperience integrating multiple data sourcesGood-to-Have:Experience with IBM DataStage or legacy ETL toolsKnowledge of Terraform / Infrastructure as CodeFamiliarity with CI/CD (GitHub)Exposure to Power BI or reporting toolsGCP certification (e.g., Professional Data Engineer)Agile/Scrum experienceBehavioural SkillsStrong analytical and problem-solving skillsGood communication and teamwork abilitiesAbility to work independently and take ownershipAttention to detail and qualityEducational QualificationsBE/BTech in Computer Science, IT, or related disciplineExperience in data engineering, ETL development, or data platforms You will be part of a data engineering team responsible for designing, developing, and maintaining data pipelines and analytics platforms. The role involves working with GCP services, modernising legacy ETL systems, and ensuring high-performance, reliable data solutions. Gather business requirements and translate them into data engineering solutionsDesign, develop, and maintain ETL/ELT pipelines and workflowsSupport migration of legacy ETL systems (e.g., DataStage/JCL) to GCP-native servicesBuild and optimise pipelines using BigQuery, Dataflow, Pub/Sub, and AirflowIntegrate data from multiple sources (Oracle, Teradata, DB2, flat files, etc.)Perform performance tuning and debugging of ETL jobsMonitor and maintain pipelines using Cloud Logging and MonitoringCollaborate with cross-functional teams to understand dependencies and requirementsSupport production issues and ensure data reliability and qualityContribute to estimation, testing, and deployment activities Technical SkillsMust-Have:3 years of experience in Data Engineering / ETL developmentHands-on experience with GCP or any cloud platform (GCP preferred)Good understanding of: BigQueryDataflow / ETL toolsAirflow / scheduling toolsStrong SQL and programming skills (Python / Java)Experience in data pipeline development and data warehousingExperience integrating multiple data sourcesGood-to-Have:Experience with IBM DataStage or legacy ETL toolsKnowledge of Terraform / Infrastructure as CodeFamiliarity with CI/CD (GitHub)Exposure to Power BI or reporting toolsGCP certification (e.g., Professional Data Engineer)Agile/Scrum experienceBehavioural SkillsStrong analytical and problem-solving skillsGood communication and teamwork abilitiesAbility to work independently and take ownershipAttention to detail and qualityEducational QualificationsBE/BTech in Computer Science, IT, or related disciplineExperience in data engineering, ETL development, or data platforms

Keyskills :
Data EngineeringGCPAirflowSQLPythonJavaData WarehousingETL developmentBigQuery