Associate Vice President

Job Description

* About Standard Chartered We are a leading international bank focused on helping people and companies prosper across Asia, Africa and the Middle East.To us, good performance is about much more than turning a profit. Its about showing how you embody our valued behaviours - do the right thing, better together and never settle - as well as our brand promise, Here for good.Were committed to promoting equality in the workplace and creating an inclusive and flexible culture - one where everyone can realise their full potential and make a positive contribution to our organisation. This in turn helps us to provide better support to our broad client base.Role Description:

• The Regression data engineer is responsible for maintaining the regression Teradata environment and Hadoop clusters
• The Regression data engineer should have wide experience of Data Warehousing and Big Data concepts generally with expert knowledge in many aspects of Teradata products as well as Hadoop stack.
• The Regression data engineer should have a broad understanding of Cloud architecture and services, Agile and DevOps delivery approaches, emerging technology and trends and the broader Analytics industry.
• The Regression data engineer will participate in the design of solution that will be based on specified business requirements.
• The Regression data engineer is responsible for setting up and managing data copy framework in Teradata Parallel Transporter, damasking techniques along with data ingestion framework in Scala
• The Regression data engineer takes the role of Teradata and Hadoop Platform maintenance and changes, to ensure architectural consistency.

Key Areas of Responsibility

• Understanding SCBs current EDM, Big Data architecture. This includes maintaining an inventory of the SCBs EDM environments and other Big Data stores, as well as their respective business functions.
• Understand SCB s business goals, information needs, application requirements, IT plans, architecture and strategy/roadmap.
• Work with project teams to understand the need of data in regression environment (Teradata/Hadoop)
• Design and execute PoC based on business requirements.
• Timely and accurate risk and obsolescence tracking and mitigation.
• Capacity planning as on when needed

Skills

• Broad technical expertise
• Strong technical analysis background.
• Technical knowledge and in depth experience of Data Warehouses, big data analytics, applications, solutions, and technologies.
• Expert technical knowledge in Teradata RDBMS.
• Expert technical knowledge in any one of the Hadoop stack and ETL
• Proven application development capabilities in relational database and/or Hadoop technologies
• Experience of PoC design, development, execution and reporting.
• should have relevant experience using UNIX, Linux and Shell Scripting
• Analytical and problem-solving skills

Tasks:

• Manage space
• Performance tuning in regression Teradata /Hadoop environments
  • Indexing
  • Partitioning
  • Stats
  • Analysis of execution plans and guidance.
• Maintain access rights to avoid cross environment access
• Perform database health checks
• Ensure systems are healthy and development is not disrupted.
• Development of TPT scripts to copy the data across the platforms
• Experience with ARC tools is highly desirable
• Refresh Regression data in Teradata /Hadoop monthly, quarterly and Adhoc basis
• Assist development teams in loading data from data sources into Teradata development/test Environments.
• Monitor systems for misbehaving requests (skewed, product join, high PI ratios etc.)
• Review and report system utilization and space by regression users/project.
• Escalate problems with actual or potential impact to problem management.
• Provide operational excellence and skills on Database.
• Analyze user problems and make suggestions for the prevention of future problems
• Data Mover job execution across the environment

In addition to the capabilities to perform the Tasks, these are required capabilities:

• Proficient in SQL (Complex)
• Very good understanding of the change and release process
• Load Utilities (TPT, Fast Load, MLOAD, etc.)
• Understanding of frameworks written in Scala
• Understanding of RDD concepts in Spark
• Understanding of capacity scheduler concepts
• Should have experience with kerberized Hadoop clusters
• Should be able to manage fine-grained access control using Apache Ranger
• Must be proactive and possess a sense of urgency during service recovery.
• Experience with ETL tool Talend for Big data is added advantage

Technical Skill

• Teradata stack (Primary Skill)
• RDBMS (Primary Skill)
• Automation (Primary Skill)
• Project Management (Secondary Skill)
• Hadoop stack(Primary Skill)
• DevOps Automation (Secondary Skill)
• Data Integration (Knowledge)
• Job Control and Scheduling (Knowledge)
• Modelling (Knowledge)
• Monitoring and Control (Knowledge)
• Operating Systems (Knowledge)
• Testing Tools (Knowledge)
• Open Source (Knowledge)

,

Keyskills :
salesmarketing business developmentmanagement accountsbig data analytics source system analysisbig data