Data Sourcing Engineer

Job Description

Our mission is to break down the barriers of today to release the potential of tomorrow. Join us today and release yours.There are two things that we want to share with anyone considering joining us.Firstly, we ve got big ambitions for our colleagues and the future of the organisation. These include our vision that inclusion and accessibility drive every conversation we have and every decision we make. We want our workforce to fully represent the communities and customers we serve, because a diverse business is a better business. We value every colleague, their diversity and the contribution that they make. When we say you re welcome at BT, we really mean it.Secondly, the one thing the pandemic has taught us is that a lot of current and future colleagues, where and when possible, want to embrace hybrid working. Therefore, we are introducing smart working at BT. Smart working means having the flexibility to choose, as a team, how and where you work depending on your team s deliverables and needs; when you are at your shared core location to connect with others and when not. It may not be for every role, and, as part of the recruitment process, you ll have the chance to discuss smart working and how it might work for the job you are applying for.About this roleOur ability to deliver brilliant personalised experiences for all of our 28 Petabytes of BT wealth of data and 30m customers is fundamental to our future success. As a business we are investing extensively in the automation of our operations and networks, and in building our base management and data capabilities. This will allow us to take better decisions with data and to act on them in an automated way across all our customer interactions. Data driven automation and decision making has never been more important to BT. We re creating the best personal experiences for our customers to help them stay connected, and that mission is all underpinned by high quality, low latency data. This role will play a critical part in the creation and be part of BT Digital build data pipelines, data systems and the data products built on top. As part of a team of highly skilled data engineers, you will create and maintain our logical data models, integrating data from multiple data sources into a central cloud repository. You will apply data cleansing and data standardisation rules, providing clear documentation of the business rules embedded in the system, with the potential of solving data quality issues through your team. You will work closely with the wider team to understand what the data journey needs to look like and work closely with the Data Architect team, Data scientists and AI team to develop our products and services. You will write and maintain data engineering user documentation to provide transparency and maintain the knowledge base within the team. Youll have the following responsibilities

• Applies specialist data expertise to develop and advise approach on a range of complex, high impact and data solutions a services
• Assures data availability and quality in Digital and across all CFUs for B
• Helps to resolve technical problems
• Proactively identifies new potential data sources and assess feasibility of ingesting
• Develops tangible and ongoing standardisation, simplification and efficiency of engineering processes, reviewing and revising continuous improvement opportunities
• Assures a high quality and comprehensive data flow and manage a team that provides a consumption layer where the business has access to all the data it needs
• Ensures all data is compliant
• Ensures that all data acquired is fully described/understood and communicated using appropriate tools
• Productionise any tactical data feeds, including documentation

Youll have the following skills & experienceEssential skills & experience

• Deep technical knowledge of complex (and simple) data architectures, covering all aspects (compliance, risk, security) of our requirements
• Detailed knowledge of the concepts and principles of data engineering
• Sound awareness of Data Management best practice, including data lifecycle management
• Extensive skills in SQL, both at production grade and at analytical level, gained through intensive application in a commercial business environment
• Can deliver complex big data solutions with structured and unstructured data
• Excellent oral and written communication skills for all levels of an organisation
• Collaborate to identify how work activities across the teams are related and highlight inefficiencies. You help to remove barriers and find the resources or support needed to improve processes
• Some knowledge of Cloud Computing patterns, workflows and services; and how they relate to a big data platform.
• Advanced math skills (linear algebra, Baysesian statistics, group theory)
• Background in machine learning & software engineering frameworks such as TensorFlow or Keras

Desirable skills & experience

• Experienced in deploying data solutions and cloud infrastructure via CI/CD pipelines
• Experienced in deploying Infrastructure as Code (Terraform / Cloudformation etc)
• Knowledge of REST/Graph APIs and how they can be used in a data environment.
• Knowledge of Docker/Kubernetes, and how these can be used to simplify deployments.
• Experience of building large scale data pipelines on at least one Cloud Platform (GCP and AWS preferred)
• Solid Python data and development experience with major SDK s / packages.

About BTBT has a key role in British society, fostering change and leading technology innovation. From delivering the Olympics, to supporting the emergency services, to investing more into research than any other UK technology company, we take pride in everything we do - and in the people who work here.Were now a global company operating at the forefront of the information age, employing 90,000 people in 180 countries. And were on a mission. Guided by our core values of Personal, Simple and Brilliant our goal is to help customers, communities and businesses overcome barriers and release their potential.So, if youre interested in the power of potential, why not join us today and release yours You can read more here about what its like to work at BT How to ApplyIts easy to apply online; you just need a copy of your up-to-date CV and to follow the step-by step process. Dont worry if you need to make changes - youll have the opportunity to review and edit your work on the final page. We look forward to receiving your application, *Any B.tech or B.E.

Keyskills :
negotiationsourcingdata feedsdata qualitydata flowprocurementpurchasesmart workingbig datastatements of work sow