Cloud Data Engineer tem_55&5

Job Description

Cloud Data Engineer Job Description Design, develop, optimize, and maintain Cloud Data Platform pipelines that adhere to ETL principles and business goals Utilize conceptual knowledge of data and analytics, such as dimensional modeling, ETL, reporting tools, data governance, data warehousing, structured and unstructured data to solve complex data problems Work with business/application/solution teams to implement data strategies, build data flows, & develop conceptual/logical/physical data models Develop, and maintain conceptual, logical, and physical data models, implement of RDBMS, operational data store (ODS), data marts, and data lakes on target platforms in cloud Work with the database engineering and DBAs to create optimal physical data models (transactions, normalized and dimensional models; etc.,) Define and govern data modeling and design standards, tools, best practices, and related development for enterprise data models Hands-on experience modeling, design, configuration, installation, performance tuning, and setting up sandbox for POC Lead/Partner with business analyst and solutions architects to conduct detailed technical assessments of enterprise data architecture, define path to transform it into a modern data powered enterprise for strategic enterprise projects and initiatives Lead/Partner with different teams and provide deep technical expertise to evaluate, implement & deploy emerging tools and large scale data solutions for data engineering to improve productivity as a team Conduct full technical discovery, identifying pain points, business and technical requirements, as is and to be scenarios Compare solution alternatives across both technical and business parameters which support the define cost and service requirements Create detailed target state technical, security, data and operational architecture and design blueprints incorporating modern data technologies and cloud data services demonstrating modernization value proposition Lead scoping sessions to generate estimates and approaches for execution Solve complex data problems to deliver insights that helps our business to achieve their goals Create data products for analytics and data scientist team members to improve their productivity Stay educated on new and emerging technologies/patterns/methodologies and market offerings/Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics Develop and deliver communication & education plans on analytic data engineering capabilities, standards, and processes Advise, consult, mentor and coach other data and analytic professionals on data standards and practices Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space (Azure or GCP) Experience with tools like Azure Data Factory, Databricks, Integration Runtime Services Experience in Python or Scala Expert in T-SQL Big Data development experience using Kafka . Azure EventHub, IoT Hub Familiarity with the Linux operating system Minimum 7 years of experience integrating cloud data services for building secure data solutions Minimum 7 years of experience introducing and operationalizing self-service data preparation tools (e.g. Collibra, Alation, Babylon) Minimum 7 years of architecting and operating large production SAP/NoSQL clusters on premise or using Cloud services Minimum 1 years architecting and implementing metadata on cloud Architecting and implementing data governance and security for data platforms on cloud Designing operations architecture and conducting performance engineering for large scale data lakes a production environment Craft and lead client design workshops and provide tradeoffs and recommendations towards building a solutions Bachelors degree in Computer Science, Engineering, Technical Science or 5 years of architecture and build experience with large scale solutions Cloud Certified Professional Data Engineer Strong leadership and management skills Strong communication and interpersonal skills Strong analytical and problem-solving skills and passion for product development Strong understanding of Agile methodologies and open to working in agile environments with multiple stakeholders Professional attitude and service orientation; team player Ability to translate business needs into potential analytics solution Strong work ethic; ability to work at an abstract level and gain consensus Ability to build a sense of trust & rapport to create a comfortable & effective workplaceGlobal VISA and Relocation Specifications:K-C requires that an employee have authorization to work in the country in which the role is based. In the event an applicant does not have current work authorization, K-C will determine, in its sole discretion, whether to sponsor an individual for work authorization. However, based on immigration requirements, not all roles are suitable for sponsorship. This role is available for local candidates already authorized to work in the role s country only. K-C will not provide relocation support for this role. Primary Location IT Centre Bengaluru GDTC Additional Locations Worker Type Employee Worker Sub-Type Regular Time Type Full time,

Keyskills :
sqljavadata warehousinginformaticapythondata martsdata modelsdata sciencedata modelingdata servicesdata solutionsdata standardscloud computingproblem solving