Hadoop Developer

Job Description

About UsMorgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities, investment management and wealth management services. We advise, originate, trade, manage and distribute capital for governments, institutions and individuals. As a market leader, the talent and passion of our people is critical to our success. Together, we share a common set of values rooted in integrity, excellence and strong team ethic. We provide you a superior foundation for building a professional career where you can learn, achieve and grow.Technology Department at Morgan StanleyTechnology is the key differentiator that ensures that we manage our global businesses and serve clients on a market leading platform that is resilient, safe, efficient, smart, fast and flexible. Technology redefines how we do business in global, complex and dynamic financial markets. We have a large number of award winning technology platforms that help to propel our Firm s businesses to be the top in the market. Our India technology teams are based in Mumbai and Bengaluru. We have built strong techno-functional teams which partner with our offices globally taking global ownership of systems and products. We have a vibrant and diverse mix of technologists working on different technologies and functional domains. There is a large focus on innovation, inclusion, giving back to the community and sharing knowledge.Wealth Management and Investment Management Technology (WMIMT) is responsible for the design, development, delivery, and support of the technical platform behind the products and services used by the Business. Morgan Stanley Wealth Management (WM) is a product of the acquisition of Smith Barney from Citigroup, which was completed in June 13. Its core client base is individual investors, small- to medium-size businesses and institutions, and high net worth families and individuals.AIDT under Management Technology provides consistent, trusted and integrated business information across all platforms and delivery channels within Morgan Stanley Wealth Management (MSWM) businesses. AIDT areas of expertise include but are not limited to Enterprise Data Warehouse (EDW) and Datalake (DL), cross-business-unit Information Management, Business Intelligence and more. AIDT team synthesizes and provisions a multitude of business-critical metrics and underlying detailed information in all Core areas of MSWM. Examples of essential data domains and metrics include Assets, Revenue, Account Demographics, Financial Advisor (FA) information, Securities and Cash Transactions, and so on.As an integral part of AIDT, Data and Services team is tasked with providing insightful and accurate business intelligence on Solium, Next Best Actions and many other aspects of Wealth Management business. Candidate will be joining AIDT-Cloud squad. This role requires credibility, confidence and active participation with technology groups, COE and leadership teams across the project lifecycle. Immuta implementation is integral part of Data governance initiative., Experience: 6-8 Years of experiencePrimary Skills / Must have 1. Experienced with the technical analysis and design, development and implementation of Data Lake and Data Warehouse solutions;2. Hands on experience in Hadoop and Big data technologies; strong RDBMS concepts and SQL skills3. Strong UNIX Shell scripting or Python experience to support data warehousing solutions;4. Process oriented, focused on standardization, streamlining, and implementation of best practices delivery approach;5. Excellent problem solving and analytical skills;6. Excellent verbal and written communication skills;7. Experience in optimizing large data loads;8. Proven teamwork in multi-site/multi-geography organizations;9. Ability to multi-task and function efficiently in a fast-paced environment;10. Self-starter with flexibility and adaptability in a dynamic work environment;11. Should have ability to perform the root cause of Issues and be able to design solution as required;12. Ability to gather user requirements, interface with business partners as required;13. Complete team accountability: deliverables, discipline, consistency14. Responsible for quantitatively mapping the success of the team.Secondary Skills / Desired skills1. Should be a good Team player;2. Experience with detailed Error/Exception handling and Data Validation issues;3. Experience in Developing, managing and maintaining data dictionary and or metadata;4. Nice to have experienced with common data science tools such as Dataiku, Tableau, Business Object, Tensor Flow and a good understanding of modelling platforms (Azure AutoML, Data bricks). 5. Strong understanding of Data warehousing domain;6. Ability to architect an ETL solution and data conversion strategy;7. Should know different ways of Hadoop processing Performance Optimization;8. Experience in Agile methodology;

Keyskills :
hivehadoopsqooppigjavaunix shell scriptingbig dataroot causedata scienceshell scriptingdata conversionproblem solvingdata validationdata governancedata dictionarystatements of work sow