Senior Data Engineer

Job Description

Maersk Line IT supplies global solutions and connectivity to more than 35,000 A.P. Moller Maersk employees in 118 countries. Some of the keywords in our work environment are: Innovation, Creativity, Challenges and Personal growth. You will build a strong international network through extensive liaising with stakeholders worldwide and access a wide range of further career opportunities within Maersk Line IT and the rest of the A.P. Moller Maersk Organisation.Show More We offerThis position offers the unique opportunity to develop and apply your cutting-edge knowledge of software and platform development related methods and tools to create results and insights that will accelerate the transformation of our business model, and to work with business specialists across Maersk Group.Maersk Technology team is committed to extracting patterns and insights from data by the application of domain expertise, tools and technology, and is specialized in machine learning and AI based digital solutions development. The team is at the forefront of developing industry leading digital solutions & applications for the organization.This is an extremely exciting time to join a fast paced, growing and dynamic team that solves some of the toughest problems in the industry and builds the future of trade & logistics.At A.P. Moller - Maersk we focus on the individual s development and the right candidate will have broad possibilities to further develop competencies in an environment characterized by change and continuous progress.Show More Key responsibilitiesJob Responsibilities Design DWH model ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model. Build optimal data pipeline for extraction, transformation, and loading of data from a wide variety of data sources. Performance tuning of complex ETL mappings for relational and non-relational workloads. Perform cleansing, manipulation and analysis of large datasets, both structured and Unstructured. Build analytics products that utilize the data pipeline to provide actionable insights as per the business requirements. Understand the relationships across business information and units of data, Reverse engineer data from various source systems. Identify, design, and roll-out internal process improvements: automating manual processes, optimizing data delivery, etc. Ensure that data transformations are well documented, follows best practices and are understood by business users and other members of scrum team. Work with stakeholders and apply critical thinking to identify the best solution for any given problem.Show More We are looking forData Engineer Job Overview We are seeking a candidate with 4-8 years of experience in building & optimizing data pipelines and transforming data to derive business insights. The hire will be responsible for managing & organizing data from ground up. Candidate must have strong communication skills & would need to collaborate regularly with business stakeholders, product lead and specialists from related fields including, Data Scientists, BI architects and Front-End Engineers. Required Technical Skill Set Working experience in MS Azure PaaS Services - Data Bricks, Data Factory, & Analysis Service. Hands-on experience in Advanced SQL programming, PL/SQL or T-SQL. Hands on knowledge of Python and Spark.Good to have Technical Skill Set Basic knowledge on Machine Learning concepts like linear regression, time series forecasting, decision trees, random forest etc. Working experience in Linear programming or other optimization techniques would be an added advantage. Experience in data heavy / analytics applications leveraging relational and NoSQL databases, data warehouse and big data. Experience with enterprise-class data modelling tools including: PowerDesigner, ER/Studio, Erwin Data Modeler, Sparx Enterprise Architect. Good knowledge of Hadoop 2.x, HDInsight, Scala, Hive, Pig, Sqoop, HDFS. Working knowledge of Power BI, Azure DevOps and ADO board.Show More,

Keyskills :
content managementemailsqlanalyticsapachestrong communication skillspower bifront endtime seriesdata modelingbusiness rulesdecision treesmodelling toolsmachine learning