IDQ Developer

Job Description

• The Informatica Data Quality Developer (IDQ Developer) is responsible for designing, developing, testing, deploying and documenting data quality processes and associated outputs. The IDQ Developer must document at a functional level how the process work within the data quality applications. The primary tasks associated with this role are to use Informatica Data Quality to profile source/inbound data, define or confirm the definition of the metadata, cleanse and validate data, check for duplicate or redundant records, providing data consuming parties with concrete proposals on how to proceed with solution development.

Responsibilities:

• Profile source/inbound data and determine all source data and metadata characteristics
• Design and execute a Data Quality Audit/Assessments i.e. profiling
• Design and execute the data quality mappings that will cleanse, de-duplicate, and prepare the downstream data/analytic development.
• Implement data quality processes including transliteration, parsing, analysis, standardisation and enrichment at point of entry and batch in-processing contexts; Deploy mappings that will run in a scheduled, batch, or real-time environment
• Document all mappings, mapplets, and rules in detail and hand over documentation as requested for the project team
• Collaborate with various business and technical teams to gather requirements around data quality rules and propose the optimisation of rules if/where applicable, then design and develop these rules with IDQ
• Utilise Informatica Developer and Informatica Analyst to design and develop custom objects and rules, reference data tables and create/import/export mappings
• As per business requirements perform thorough data profiling with multiple usage patterns, root cause analysis and data cleansing and develop scorecards utilising Informatica, Excel and other data quality tools
• Develop matching plans, help determine best matching algorithm, configure identity matching and analyse duplicates
• Build complex profiles and scripts to execute and test mappings and workflows to implement data stewardship and exception processing
• Run data quality specific ETL jobs (address standardisation and validation, email cleanups, name cleanup, parsing, etc.) utilising IDQ and other ETL tools
• Serve as a primary resource to team members and data stewards for training, problem resolution, data profiling etc.
• Analyse and provide data metrics to management in order to help prioritise areas for data quality improvement
• Strong SQL queries and verifying the results
• Should be familiar in migrating object from IDQ to PowerCenter
• Should be familiar in deploying and validating objects to different environments
• Good at writing Test scenario and perform Unit Test and verifying the end results with business requirements
• Perform both record-level and large-scale manual additions, adjustments and corrections to continuously ensure overall data quality and integrity
• Maintain strong working relationship between internal (team and broader organisation) and external parties (vendors, other departments etc)
• Assist with special projects or ad-hoc reviews as needed

Requirements:

• Minimum 5 years of hands-on experience with Informatica Data Quality (IDQ) toolset (Version 10.x preferred) and proficiency in IDQ development around data profiling, cleansing, parsing, standardization, verification, matching and data quality exception monitoring and handling
• Strong in SQL, IDQ, PowerCenter, Hadoop, Tableau, Unix and Autosys
• Excellent knowledge on Informatica platform as a whole and the integration among different Informatica components and services
• Excellent data analysis and data profiling skills using Informatica and Excel
• Bachelor s degree in Computer Science or Information Technology beneficial
• Strong understanding of data governance principals and strong experience on data quality development and issue management and remediation
• Experience with at least one end to end Master Data Management implementation is required
• Good communication and presentations skills and ability to lead meetings effectively
• Ability to multi-task with strong attention to detail and analytical skills
• Strong work ethic with a highly positive, hands-on, can-do attitude

,

Keyskills :
root cause analysismaster data managementroot causemaster datasql queriesdata qualitydata analysisreference datadata cleansingdata profiling