Senior Data Engineer - IICS

Job Description

Job DescriptionJob Title: Senior Data Engineer IICSChennai | Hyderabad | BangaloreTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our 2800 tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, youll find our delivery centers across the globe and offices in multiple cities across India, the US, the UK, Canada, and Singapore, including a substantial remote global workforce.Were Great Place to Work-Certified. Working at Tiger Analytics, youll be at the heart of an AI revolution. Youll work with teams that push the boundaries of what is possible and build solutions that energize and inspire.Curious about the role What your typical day would look like As a Senior Data Engineer IICS, you will play a key role in the end-to-end delivery of the project as per defined. requirements to create solutions using the DWH Architecture. More specifically, you might Collaborate with the clients to understand the overall client requirements Create the robust, extensible architecture to meet the client requirements Translate the Business requirements into technical artifacts Ingest data from various sources (including APIs), perform required data transformations before loading into target Extract historical and incremental data from on-prem Databases, APIs etc and ingest to cloud storage using IICS mapping/mapping tasks Create Data Pipelines as per Business requirement Schedule the jobs as per requirement Validate and deploy components, perform Unit and Integration testing Work with DevOps team to define and establish CI/CD process Work closely with the clients during UAT Testing and ensure all client issues/concerns are addressed Proactively identify the performance bottlenecks and propose corrective actions Design and Develop reusable frameworks Work with the Project Managers to prioritize work for each sprint to meet project milestones and deadlinesGuide /mentor team members, and review code artifactsJob RequirementWhat do we expect Skills that wed love! 7 years of hands-on experience in Data Warehouse and ETL 2 years of development experience in IICS Data Integration, Application Integration services using components like mapping task, task flow, replication/synchronization task, mass ingestion etc Decent Experience in using any of the Cloud DW as target- Snowflake/Redshift/Synapse/BigQuery Decent Experience in Database and Datawarehouse concepts Real time experience in one or more RDBMS systems (such as Oracle, DB2, SQL Server) Decent experience in SQL, able to write complex SQL queries Experience in using Cloud APIs(SOAP&REST) as source in IICS Application Integration by integrating and automating Agent-based processes Real time experience in Data Analysis skills Experience of working with heterogeneous data sources - structured, semi-structured and unstructured Ability to design and develop ETL pipelines with complex transformation logics Decent understanding of versioning - have used one or more versioning tool Experience of working with scheduling tool Decent experience in Python Adept understanding of coding standards and ability to define standards for the project Experience on one or more cloud platforms (e.g. AWS, Azure, GCP) Good understanding of distributed systems and Architecture concepts Ability to work collaborate with multiple technical teams Understanding of Data Quality and Data Governance Understanding of DevOps process Good understanding of agile methodology Experience in leading the team Good Communication skillsYou are important to us, lets stay connected!Every individual comes with a different set of skills and qualities so even if you dont tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow.We are an equal opportunity employer. Our diverse and inclusive culture and values guide us to listen, trust, respect, and encourage people to grow the way they desire.Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry,

Keyskills :
ETLDatabaseSQLData AnalysisPythonAWSAzureGCPDistributed SystemsData QualityData GovernanceDevOpsAgile MethodologyCommunicationData WarehouseIICS Data IntegrationCloud DWCloud APIs