ETL Hadoop Developer

Job Description

*Department: Wealth Management TechnologyAbout Us: Morgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities, investment management and wealth management services. We advise, originate, trade, manage and distribute capital for governments, institutions and individuals. As a market leader, the talent and passion of our people is critical to our success. Together, we share a common set of values rooted in integrity, excellence and strong team ethic. We provide you a superior foundation for building a professional career where you can learn, achieve and grow. Technology Department at Morgan Stanley:Technology is the key differentiator that ensures that we manage our global businesses and serve clients on a market leading platform that is resilient, safe, efficient, smart, fast and flexible. Technology redefines how we do business in global, complex and dynamic financial markets. We have a large number of award winning technology platforms that help to propel our Firm s businesses to be the top in the market. Our India technology teams are based in Mumbai and Bengaluru. We have built strong techno-functional teams which partner with our offices globally taking global ownership of systems and products. We have a vibrant and diverse mix of technologists working on different technologies and functional domains. There is a large focus on innovation, inclusion, giving back to the community and sharing knowledge.Department profile: Wealth Management and Investment Management Technology (WMIMT) is responsible for the design, development, delivery, and support of the technical platform behind the products and services used by the Business. Morgan Stanley Wealth Management (WM) is a product of the acquisition of Smith Barney from Citigroup, which was completed in June 13. Its core client base is individual investors, small- to medium-size businesses and institutions, and high net worth families and individuals. Position Overview: AIDT under Management Technology provides consistent, trusted and integrated business information across all platforms and delivery channels within Morgan Stanley Wealth Management (MSWM) businesses. AIDT areas of expertise include but are not limited to Enterprise Data Warehouse (EDW) and Datalake (DL), cross-business-unit Information Management, Business Intelligence and more. AIDT team synthesizes and provisions a multitude of business-critical metrics and underlying detailed information in all Core areas of MSWM. Examples of essential data domains and metrics include Assets, Revenue, Account Demographics, Financial Advisor (FA) information, Securities and Cash Transactions, and so on. As an integral part of AIDT, Data Integration & Delivery team is tasked with providing insightful and accurate business intelligence on Strategic Client Reporting (SCR), Account Performance metrics, Investment Insights, Trade Surveillance, Anti-Money Laundering and many other aspects of Wealth Management business. The candidate may be assigned to a single Legal and Compliance project or several projects. The role requires credibility, confidence and active participation with leadership teams, business units and technology groups across the project lifecycle. Specific assignments will depend on the size and complexity of the projectEducation: Bachelor s/Master s Degree in Engineering, preferably Computer Science/EngineeringRoles and Responsibilities As an ETL / Hadoop developer, the candidate is expected to Design and development of ETL and Hadoop applications. Undertaking end-to-end project delivery (from inception to post-implementation support), including review and finalization of business requirements, creation of functional specifications and/or system designs, and ensuring that end-solution meets business needs and expectations. Development of new transformation processes to load data from source to target, or performance tuning of existing ETL code (mappings, sessions) and Hadoop Platform. Analysis of existing designs and interfaces and applying design modifications or enhancements Coding and documenting data processing scripts and stored procedures. Providing business insights and analysis findings for ad-hoc data requests Testing software components and complete solutions (including debugging and troubleshooting) and preparing migration documentation. Providing reporting-line transparency through periodic updates on project or task statusJob Location: MumbaiQualificationsPrimary Skills / Must have 4+ years of experience with the technical analysis and design, development and implementation of data warehousing / Data Lake solutions; Strong SQL programming and stored procedure development skills; 4+ years of Hadoop experience and knowledge of SQL; Good understanding/experience in Hive/Impala/Spark; 4+ years relational database experience (experience with Teradata is a big plus); Strong UNIX Shell scripting experience to support data warehousing solutions; Process oriented, focused on standardization, streamlining, and implementation of best practices delivery approach; Excellent problem solving and analytical skills; Excellent verbal and written communication skills; Experience in optimizing large data loads;Secondary Skills / Desired skills Should be a good Team player; Experience in OLAP/Relational databases would be good. Exposure to an Agile Development environment would be a plus. Knowledge about TWS Scheduler would an added advantage; Strong understanding of Data warehousing domain; Ability to architect an ETL solution and data conversion strategy; Good understanding of dimensional modelling;, *QualificationsPrimary Skills / Must have 4+ years of experience with the technical analysis and design, development and implementation of data warehousing / Data Lake solutions; Strong SQL programming and stored procedure development skills; 4+ years of Hadoop experience and knowledge of SQL; Good understanding/experience in Hive/Impala/Spark; 4+ years relational database experience (experience with Teradata is a big plus); Strong UNIX Shell scripting experience to support data warehousing solutions; Process oriented, focused on standardization, streamlining, and implementation of best practices delivery approach; Excellent problem solving and analytical skills; Excellent verbal and written communication skills; Experience in optimizing large data loads;Secondary Skills / Desired skills Should be a good Team player; Experience in OLAP/Relational databases would be good. Exposure to an Agile Development environment would be a plus. Knowledge about TWS Scheduler would an added advantage; Strong understanding of Data warehousing domain; Ability to architect an ETL solution and data conversion strategy; Good understanding of dimensional modelling;

Keyskills :
hivehadoopsqooppigjavaunix shell scriptingsource system analysisbusiness unitsshell scriptingdata processingenterprise datadata warehousingdata integrationsecondary skillsanalytical skills