Tech Specialist Software Engineering

Job Description

As a hands-on Tech Specialist Software Engineer, your role will involve leading the design and execution of core capabilities within the Enterprise Data Platform (EDP). You will be responsible for translating complex data requirements into scalable systems and contributing to code, design, and platform evolution. Your contribution will be crucial in building a platform-first ecosystem for data onboarding, processing, and consumption.**Key Responsibilities:**- **Architecture & System Design:** - Translate complex business and data requirements into scalable platform architectures - Design end-to-end data flows across ingestion, transformation, and consumption layers - Define platform patterns for ingestion, data access, and governance - Articulate trade-offs across architecture choices- **Hands-On Engineering & Execution:** - Contribute to production-grade code across ingestion frameworks and platform services - Build reusable platform components and drive data ingestion pipelines - Develop services for data access patterns and implement governance capabilities- **Platform & Developer Experience:** - Build a platform-first experience for downstream teams - Enable both low-code/no-code and code-first approaches for data processing - Improve developer productivity through standardization and automation- **Data Governance & Observability:** - Design and implement data quality frameworks and monitoring - Enable end-to-end lineage and impact analysis - Establish observability for data products and ensure secure data access- **Engineering Excellence:** - Write clean, maintainable, and scalable code following best practices - Lead code reviews and drive high-quality engineering practices - Perform root cause analysis and contribute to technical documentation- **Collaboration & Leadership:** - Partner with Product, Data Engineering, and Platform teams - Help shape technical roadmaps and mentor engineers - Act as a technical DRI for critical platform initiatives**Qualifications:**- Strong experience in building large-scale data platforms or distributed systems- Deep expertise in data ingestion patterns and data access layers- Understanding of data governance and proven ability to design and implement complex systems- Proficiency in Python and Java, and experience with GCP and related frameworks- Familiarity with CI/CD tools, metadata, governance tools, and orchestration platformsThis position offers the opportunity to work on cutting-edge technologies and play a pivotal role in shaping the future of data platforms within the organization. As a hands-on Tech Specialist Software Engineer, your role will involve leading the design and execution of core capabilities within the Enterprise Data Platform (EDP). You will be responsible for translating complex data requirements into scalable systems and contributing to code, design, and platform evolution. Your contribution will be crucial in building a platform-first ecosystem for data onboarding, processing, and consumption.**Key Responsibilities:**- **Architecture & System Design:** - Translate complex business and data requirements into scalable platform architectures - Design end-to-end data flows across ingestion, transformation, and consumption layers - Define platform patterns for ingestion, data access, and governance - Articulate trade-offs across architecture choices- **Hands-On Engineering & Execution:** - Contribute to production-grade code across ingestion frameworks and platform services - Build reusable platform components and drive data ingestion pipelines - Develop services for data access patterns and implement governance capabilities- **Platform & Developer Experience:** - Build a platform-first experience for downstream teams - Enable both low-code/no-code and code-first approaches for data processing - Improve developer productivity through standardization and automation- **Data Governance & Observability:** - Design and implement data quality frameworks and monitoring - Enable end-to-end lineage and impact analysis - Establish observability for data products and ensure secure data access- **Engineering Excellence:** - Write clean, maintainable, and scalable code following best practices - Lead code reviews and drive high-quality engineering practices - Perform root cause analysis and contribute to technical documentation- **Collaboration & Leadership:** - Partner with Product, Data Engineering, and Platform teams - Help shape technical roadmaps and mentor engineers - Act as a technical DRI for critical platform initiatives**Qualifications:**- Strong experience in building large-scale data platforms or distributed systems- Deep expertise in data ingestion patterns and data access layers- Understanding of data governance and proven ability to design and implement complex systems- Proficiency in Python and Java, and experience with GCP a

Keyskills :
PythonJavaGCPDatastreamSpring BootAirflowBigQueryDataflowDataprocPubSubTerraformGitHub Actions