Data Engineer

Job Description

Contract type: Full-Time, PermanentLocation: NoidaJOB OVERVIEWAs a Data Engineer, you will be responsible for the development and maintenance of Business Intelligence solutions, including the establishment and upkeep of the data infrastructure, with a focus on cloud architecture. Your tasks will encompass close collaboration with various members of the Data & Analytics team to furnish impactful and inventive management insights and information to both internal and external stakeholders. This mission will entail the processing, seamless migration, and harmonious integration of data from diverse origins into the data lake. Moreover, you will be accountable for the creation and maintenance of data pipelines designed to align with business requirements.ABOUT THE ROLE Build and optimise data pipelines. Undertake development activity including requirements gathering, analysis, design, coding/development, testing, and implementation. This will involve using Microsoft tools. including Azure and progress reports may also be required. Such development includes: Mechanisms for transferring data from source systems into the Data Lake. Definition of rules for transforming data from source systems into the Data Lake. Configuration and support of the Data Lake (and reporting software). Creation and application of data mining algorithms. Design and implementation of Kimball compliant data marts. Collaboratively deliver projects within a multi-disciplinary team, working closely with members across the Data & Analytics team alongside other relevant teams/groups across the organisation. This includes working with users to identify, analyse and systematically document and update requirements. Conduct problem analysis, investigation, and resolution.Create and maintain detailed and thorough application documentation. Play an active role in process improvement, awareness of and compliance with all relevant quality processes and procedures, including the completion of specified quality records. This includes actively supporting Data Governance initiatives and exploring ways to enhance data quality and reliability. Work to identify areas to increase efficiency and automation of processes, whilst establishing and maintaining automated data processes. Process confidential data and information according to guidelines, with a complete understanding of GDPR and the Data Protection Act and the implications for the work advising stakeholders as appropriate. Play a role in encouraging better data literacy within Study Group and help foster a data culture across the organisation. This includes advocating for better use and management of data at Study Group.ABOUT YOU Undergraduate degree from a good university with a 2:1 or above, or equivalent experience. Experience with data compliance, governance, data security, ethics and data sharing considerations with reference to GDPR. Experience of ETL/ELT and tools used and data warehousing. Experience of development using SQL to manipulate data held in a relational database. Experience of using either Azure/SQL Server or Oracle databases. Experience using Azure Data Lake and Data Factory. Experience of using Microsoft SQL Service Analysis Services (SSAS) and SQL Server Integration Services (SSIS). Experience of data modelling and logical and physical database design as part of a data lake/warehouse or management information solution. Experience ensuring appropriate QA processes are inbuilt to maximize data integrity and accuracy. Experience using Python is desirable. Knowledge of Data Warehousing concepts and design principles, including the implementation of a design conforming to the Kimball methodology. Excellent interpersonal, communication and negotiation skills with the ability to build relationships and work effectively with colleagues at all levels of the organisation.ABOUT USStudy Group is a leading international education provider that is dedicated and passionate about helping students around the world, creating a brighter future and reaching their full potential. With university partnerships and a variety of face-to-face, online, and hybrid study programmes, we can provide students with the resources and guidance they need to succeed. Our global network of offices and university partnerships ensure that students receive the best educational services available. Additionally, our Insendi platform enables us to deliver innovative, accessible, and intuitive digital learning experiences with the most advanced digital tools available.ORGANISATIONAL COMPLIANCEStudy Group is proud of its high standards in safeguardingand recognisesits importance in enabling the best possible student experience and outcomes. Forsuccessful applicants the following checks will be conducted- Criminal Background Check (country specific), x2 References, ID and Right to Work checks as well as Education Verification.We are proud to be an equal-opportunity employer and we strive to create a diverse and inclusive workplace. We are committed to providing equal opportunities for all individuals, regardless of race, gender, religion, nationality, or any other factor. We believe that the best person for the job should be selected based on skills and experience alone. Your information will be kept confidential and stored securely. Please see our Privacy Policy.We adopt a rolling recruitment process meaning that we review applications as they are submitted. To avoid disappointment, please ensure that you apply ASAP,

Keyskills :
Business IntelligenceAzureData WarehousingSQLDatabase DesignPythonInterpersonal SkillsCommunication SkillsNegotiation SkillsData EngineerCloud ArchitectureData InfrastructureData PipelinesMicrosoft ToolsProgress ReportsData Mining Algorithm