Data Engineer

Job Description

Maersk is a $30bn organization with 100,000 people that move 20% of the world s trade, and it is the largest shipping and logistics company in the world. We are transforming our company into a global integrator of container logistics.We are offering you a unique opportunity to be part of that journey and to contribute by creating solutions for an industry leading organization. This is an opportunity to join Maersk Group s Technology team and help drive visible, recognizable change as a Data Engineer for this globally respected, industry leading brand.At A.P. Moller - Maersk we focus on the individual s development and the right candidate will have broad possibilities to further develop competencies in an environment characterized by change and continuous progress.As an organization with global presence, joining Maersk is a wonderful and exciting opportunity for you to work with people of diverse talents & background. We offer a fast paced, challenging and truly international atmosphere with activities and teams spread around the globe in Copenhagen, London, Charlotte, and India. The environment is dynamic with focus on high performance, results, and respect for our employees. There will be the possibility of continuous professional and personal development and for expanding a professional and social network. As a company, we are committed to growing our people. We will provide you with opportunities that broaden your knowledge and strengthen your professional & technical skills.Show More We offerJoining Maersk GDA Technology team, will embark you on a great journey with career development in a global organisation. As a Senior member on the Software Engineering team you will gain broad business knowledge of the company s activities globally, as well as understand how data products support the transport and logistics business.You will work and communicate across geographical and cultural borders that will enable you to build a strong professional network. We will provide you with opportunities to broaden your knowledge and strengthen your technical and professional foundation.We aim to be a world-class professional organisation that delivers business value through automation, standardisation and innovation. We believe in empowerment where each of us takes ownership and responsibility for developing and implementing new ways of working.Show More Key responsibilitiesProject experience using Azure cloud, data lake storage, Data factory, Hadoop 2.x, HDInsight, Spark, Scala, Hive, HDFS. Exp with Spark more relevant. Exp on creating Batch and Realtime Data pipelines on Azure Data Platform using Logic Apps, Automation Run Books, Azure Data Factory, Azure Databricks, Azure Event Hub, Kafka, Azure Stream Analytics. Experience in performance tuning of complex ETL mappings for relational and non-relational workloads Advanced SQL programming, SparkSQL, PySpark, PL/SQL or T-SQL, Hands on Unix scripting or PowerShell, experience with Azure PaaS services Hadoop Data Serialization mechanism line PARQUET, AVRO, ORC. Hands on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, data warehouse and big data. Design DWH model, ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model. Experience with enterprise-class data modelling tools (Erwin Data Modeler, Sparx Enterprise Architect etc) Facilitate data integration, data conformity, data integrity and ensure data structures are designed for flexibility to support future business needs and enhancements. Understand the relationships across business information and units of data, Reverse engineer data from various source systems. Ensure that data transformations are well documented follow best practices and understood by business users and developers. Have experience cleansing, manipulating and analysing large datasets both structured and Unstructured. Exceptional data analysis, critical thinking, communication, problem solving and cross-group collaboration skills Experience with Power BI would be an added advantageShow More We are looking forShow More,

Keyskills :
sqljavadata warehousinginformaticapythonsparx enterprise architectpower bidata analysisdata modelingbusiness rulesunix scriptingdata integritydata structures