ETL Developer - Streamsets

Job Description

Dear Candidate,Greetings of the day!we have opening for ETL Developer - StreamsetsDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5) 1. Proved Experience in setting the data Pipeline in Streamsets2. Experience in ETL data flows and knowledge in applying the Transformations using the Modules(Processors/Executors) available in Streamsets3. Experience in writing the Custom Scripts in Jaya/Python for any logical changes to apply for the data4. Setup best practices/Standards/Patterns Development and automate process for onboarding6. Experience in the Multi Cloud(Azure,GCP) is a plusGood-to-Have 1.Mutli Cloud Exposure2.Experience in Kafka, JDBC and any other ETL Tool3. Proved working experience on Java , PythonSN Responsibility of / Expectations from the Role1 Experience in using streamSets Data Collector to design, test, deploy, operate, and maintain pipelines that flow streaming and batch data into Multiple Environments and Applications2 Design recommend best approach suited for data movement from different sources using Streamsets Tool3 Communicate and Work with IT partners and user community with various levels from Sr Management to detailed developer to business SME for project definition 4 Expertise in handling the Streamsets Data Collectors Jobs and implementing the best practices to maintain the cluster health and better utilization of the Streamsets5 Expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms,Google Cloud Buckets, Azure(ADLS,SQL),AWS(S3)Type Details of The Role (For Candidate Briefing)Reporting To Which Role DeveloperSize of the Team, if any Reporting to this Role 10+On-site Opportunity Down the line for NearshoreUnique Selling Proposition (USP) of The Role Details of The Project (A short Briefing on the Project may be attached with this document for candidate- briefing). It may be shared with external stakeholders like job-agencies etc. HumanaRegards, HR Team

Keyskills :
cloudpipelineetl toolazurejavapythonetlmodulekafkadatatoolstreamsets