Principal Data Engineer (GM/AP), Kolkata

Job Description

Opening: 1 Nos.Job ID: 42350Employment Type: Full TimeReference:Work Experience: 15.0 Year(s) To 20.0 Year(s)CTC Salary: 70.00 LPA TO 80.00 LPAFunction: IT Software - Project & Program Mgt / OtherIndustry: Power/Energy - Solar/Wind/Hydro/NuclearQualification: B.Tech/B.E. - Computers; M.E./M.Tech - Computers; Ph.D/Doctorate - ComputersLocation: Ahmedabad KolkataJob Title- Principal Data EngineerWe are building a rockstar team to help us push the frontiers of AI. Company AI Labs is bringing together the brightest talents in the world to integrate AI into the DNA of each business inside and outside ofCompany. With Companys presence across Energy, Airport, Port & Logistics, Cyber Security, E-Commerce, FMCG (and more!) we have the domain know-how to design, build and scale AI products in the market at lightening speeds. If you are energized by big hairy audacious goals, if you thirst for complex problems and take ownership of delivering. quality AI solutions then you would fit right into our ecosystem. With Companys vast ocean of data and industrial presence, you can watch your AI solutions come to life and experience the business impact first-hand. Company AI Lab invites your contribution to the 0 to 1 journey of the fastest growing group in the country.The OpportunityAt Company AI Labs, the Principal Data Engineer will have the opportunity to lead the Data Engineering competency. They will get to design and oversee complex data pipelines with complex datasets that will generate businessinsights and enable data-driven decision making for Company Business Units. The wide spectrum of Company Business sectors will ensure a continuous flow of exciting Data and AI Use cases for the Principal Data Engineer to solve.They will get to work alongside highly skilled and motivated individuals across AI spectrum and contribute first- hand to the ambitious growth journey of Company AI Labs by building data systems from the ground up.Principal Data Engineer at Company AI Labs would be entrusted with a high level of responsibility and freedom in mentoring a high performing team of Data Engineers.As a Principal Data Engineer, you will have an opportunity to collaborate and work with AI Champions of Company business, AI Solution Manager, Business Data Analyst, and Data Scientists for data initiatives and creation of datadelivery architecture. You will be challenged and provided with tremendous growth opportunity in a business facing, fast paced, agile environment. If you aspire to redefine state-of-the-art and create an impact on Indias future AI Based Data landscape, Company AI Lab Data Engineering space can offer you the right podium to solve challenging real-world problems and take a giant leap in your career as an expert Data Engineer.ResponsibilitiesStrategic Roles and Responsibilities Lead the design, development and management of a data platform Identify and solve issues concerning data management to improve data quality Maintain data engineering standards in data processes and solutions Drive collaborative review of design and implementation performed by the data engineering team Establish thought leadership by contributing to research-paper publishing, technical commentary and company representation at industry conferences Mentor and develop the Data Engineering teamOperational Responsibilities Guide the Data Engineering team in development of methods and tools for data validation and analysis and in planning and execution of complex projects Focus on Quality Analytics (e.g., Mean Time between Failures, Mean Time to Crash, Mean Time to Hang, and other quality metrics) Troubleshoot complex, high risk data issues and perform root cause analysis to resolve issues Identify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability Guide the building of complex ETL processes and infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources Track project data pipeline and overall data architecture stability - Monitoring the overall performance and stability of the system is important if the warehouse needs to be cleaned from time to time Prepare data for predictive and prescriptive modelling Deliver updates to stakeholders based on analyticsStakeholder Management Collaborate with AI Solution Managers to help allocate resources for different AI Solution projects Collaborate with Business Data Analyst, AI Champion, Solution Managers to define and ratify business solution requirements Collaborate with Data Engineers to guide the implementation of Statistical and DL Models and validate their business value Lead the functional documentation and sign off from key business stakeholdersPeople Management Build Capacity and capability for the Data Engineering function Nurture a high-performance culture Create a highly engaged and agile team to tackle AI solution projectsExperience, Educational Qualification and SkillsExperience: 12-15 years of relevant work experienceEducational Qualification: B.E/B.Tech and M.E./M.Tech (IT/Computer Science) Masters in data science /data engineering/Information Systems PhD in an AI discipline (preferred)Skills:Mandatory Ability to manipulate, process and extract value from large, disconnected datasets and articulate the same in business and ML context Experience managing engineers and guiding them through project planning, design, development, quality control, and deployment Hands on knowledge on building and optimizing big data data pipelines, architectures, and data sets from raw and unstructured data Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases Strong know-how on data ingestion tools and APIs to prioritize data sources, validate them, and dispatch data to ensure an effective ingestion process. Knowledge on data ingestion tools such as Apache Kafka/ Apache Storm/Apache Flume/Apache Sqoop/Wavefront, and more. Working knowledge on data mining tools such as Apache Mahout/KNIME/Rapid Miner/Weka Strong know-how on ETL tools such as Talend/Informatica PowerCenter/AWS Glue/Stitch Ability to handle various types of data in the form of text, speech, image, video, or live stream from IoT/ Sensors/ Web Ability to leverage MLOps Platforms such as Teraform, Ansible, Kubeflow, Google AI PlatformPreferred Basic Know-how on software development languages such as Python, Java, C, Scala, etc Experience with stream-processing systems such as Storm, Spark-Streaming, etc. Skilled in the use of business intelligence and visualization tools, such as PowerBI, TableauBehavioural Ability to take initiative and handle concurrent tasks with appropriate priority Ability to meet objectives and adhere to deadlines with minimal supervision Effective communication (written and oral), collaboration and technical documentation skills Ability to identify what resources are critical to solve a problemBehavioural Strategic Orientation (PL 4) Entrepreneurial Mind-set (PL 3) Stakeholder Partnering (PL 3) Outcome Orientation (PL 4) Transformation Mind-set (PL 3) Innovation Focus (PL 4) Team Orientation (PL 3) Employee Development (PL 3)People working in below domains (Preferred but not restricted to): Energy Generation (Thermal, Renewable) Transmission Distribution, City Gas Distribution Sectors, Airport, Portand Logistics, Cyber Security, E-Commerce, FMCG, Natural Resource, Healthcare, Infrastructure, DfenseKey Skills : Gcp Data Engineer Google Cloud Storage Google Cloud Sql Big Data Sql Aws Apache Mahout Teraform Ansible Kubeflow,

Keyskills :
GcpBig DataSqlAwsAnsibleData EngineerGoogle Cloud StorageGoogle Cloud SqlApache MahoutTeraform