Data Engineering

Job Description

Would you like to be the go-to Data Engineering Manager for a team that constantly learns new domains, tools and data sources to identify best practices from across Amazon s broad offerings and propagate them globally Risk and Compliance Analytics is looking for a Data Engineering Manager to join the team to design, manage, and continuously enhance our analytics infrastructure, with process automation/improvements, developing automated reporting solutions/tools, and improving the ability of the accounting organization to process, analyze, access and consume accurate and timely data.As a Data Engineering Manager you will be working in one of the worlds largest cloud-based data lakes. You should be an experienced manager, capable of leading and inspiring a team of excellent data engineers. You should have experience in the design, creation, management, and business use of extremely large datasets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and build data sets that answer those questions. You should be able to architect highly efficient data and reporting structures, making a tradeoff between scalability, performance and user functionality needs, using expert knowledge in software development technologies. You should be able to lead design reviews and offer feedback on design, integration, performance and scalability issues. Serve as an authority in the area of technical and domain expertise and mentor, develop, and train data engineers.In this role you will lead a team in building near real time data ingestion, calculation engines, and reporting solutions for Risk and Compliance organization. The role requires someone who loves data, understands enterprise information systems, has a strong business sense, and can lead a team to put these skills into action. The ideal candidate thrives in a fast-paced environment, relishes working with ambiguity, big data, and enjoys the challenges of highly complex business context. This role requires an individual with a strong data modeling background, deep knowledge of cloud infrastructure, optimizing data for business intelligence solutions, and the ability to quickly learn, adapt and work with a variety of technologies.Specific responsibilities include: Hire, Develop and lead DE team of data engineers supporting the Risk and Compliance organization Lead DE team in adoption of best practices in data integrity, test design, validation, and documentation Represent BI team in collaboration and partnership with business, Machine Learning and software development teams driving enterprise level projects Developing agile feedback loop mechanisms supporting the evaluation of new initiatives, measuring process effectiveness and providing recommendations for improved end state Owning the design, development, and maintenance of multiple scalable solutions supporting internal/external global stakeholders Coordinating project prioritization with multiple stakeholders, managing and executing competing priorities from end to end within defined timelines, 5+ years of experience as a Data Engineer or in a similar role Experience managing a data or BI team Experience with data modeling, data warehousing, and building ETL pipelines Experience leading and influencing the data strategy of your team or organization Experience in SQL A desire to work in a collaborative, intellectually curious environment Bachelor s degree in Computer Science, Engineering, Mathematics, or a related field 5+ Years of Data Warehouse Experience with Oracle, Redshift, PostgreSQL, etc Demonstrated strength in SQL, data modeling, ETL development, and data warehousing Experience Managing analytics team. Experience in maintaining data warehouse systems and working on large scale data transformation using EMR, Hadoop, Hive, or other Big Data technologies Coding proficiency in at least one modern programming language (Python, Ruby, Scala, Java, etc.) Experience mentoring and managing other Data Engineers, ensuring data engineering best practices are being followed Experience with hardware provisioning, forecasting hardware usage, and managing to a budget Proven track record of sharing outcomes through written communication, including an ability to effectively communicate with both business and technical teams Experience with security standards like symmetric and asymmetric encryption, virtual private clouds, IP whitelisting, LDAP authentication, and other methods Have managed a team size of 5 or more members for a period of 3 or more years. Coding proficiency in at least one modern programming language (Python, Ruby, Java, etc) Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets Experience building data products incrementally and integrating and managing datasets from multiple sources Experience hiring, developing, promoting engineers

Keyskills :
data extractiondata warehousingsqldata modelingdata transformationcommercial modelsprivate cloudsdata integritydata engineeringjavainformation systemscomputer sciencebehavioral trainingdistributed systems