Data Engineer III

Job Description

Flipkart is India s market leader in eCommerce with over 100 million customers, 80 million products in 80+ categories, 100,000+ sellers, generating and processing 1.2 Petabytes of data daily. Flipkart s core values are centered around audacious thinking, a bias for action and a customer-first ethos. Flipkart has built a technical team of the highest caliber drawing from the finest colleges in India and abroad such as IIT, CMU, IISC, BITS, and IIIT, and has developed a high-quality eCommerce platform customized for the Indian customer. Flipkart is an innovation leader having pioneered Cash on Demand and ingenious use of fulfillment centers in India. Flipkart has a strong Data Science team in India that is working on cutting edge problems like multi-language speech recognition and natural language understanding, search and fraud detection. Flipkart has now established an AI Center in Redmond, Washington to advance the state of the art in Natural Language Understanding, Chatbots and Computer Vision.India s eCommerce market is in its infancy and is growing very rapidly, and the level of complexity is both exhilarating and challenging. India is a country with its own version of English that is colorfully decorated with words such as chappal for slippers, and jhadu for a broom. Indian English is full of variety and complexity making it ripe for innovative natural language understanding. One of the areas of research will be creating a decision assistant bot that aims to assist our customers make purchase decisions regarding the products they are interested in. The Seattle team will be responsible for developing natural language understanding technologies using state of the art Deep Learning techniques.The AI Center will also focus on Computer Vision applications that can be used for editorial purposes, for example identifying bad returns or identifying inappropriate images uploaded to the cloud. Each project will operate with data scientists, data engineers, product and program managers working to deliver state of the art solutions that will be integrated into Flipkart web front end and back end applications. Each team will have a single-threaded leader who will have wide latitude and independence.The Flipkart Science team is looking for a passionate data engineer with machine learning experience to help build and test customer-facing, ML-powered systems. You will work with data scientists and engineers on a variety of online and offline machine learning use cases including:

• Data modeling to support machine learning model training and inference workflows and pipelines.
• Build data pipelines to feed machine learning models for real-time and large-scale offline use cases.
• Work closely with data scientists to scale model training and explore new data sources and model features.

Minimum Qualifications

• Bachelors Degree in computer science
• 5+ years of industry experience in software development, data engineering, ML, business intelligence, data science, or a related field
• Strong core computer science and problem solving skills
• Fundamentals of Data Science and proven track record ini building ML systems.
• Experience in model tracking and assessment principles with expertise in ML model lifecycle platforms like MLFlow.
• Expertise in Python and general data science frameworks and libraries
• Knowledge of data management fundamentals and data storage principles
• Expert-level SQL skills and production experience with one or more major SQL databases
• Ability to write good quality, maintainable, explainable, production level ETL
• Good communication, collaboration, analytical and problem solving skills
• Development expertise in Unix-based environments.

Preferred Qualifications

• Expertise in building and consuming RESTful services
• Experience with Spark, Hadoop, Apache Airflow and similar applications.
• Experience with Docker, Kubernetes, or any other PaaS systems
• Instrumentation of Continuous Integration and Delivery (CI/CD) pipelines
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Infrastructure deployment and automation with any public cloud provider(AWS/Azure/GCP.)

Posted On :Flipkart is India s market leader in eCommerce with over 100 million customers, 80 million products in 80+ categories, 100,000+ sellers, generating and processing 1.2 Petabytes of data daily. Flipkart s core values are centered around audacious thinking, a bias for action and a customer-first ethos. Flipkart has built a technical team of the highest caliber drawing from the finest colleges in India and abroad such as IIT, CMU, IISC, BITS, and IIIT, and has developed a high-quality eCommerce platform customized for the Indian customer. Flipkart is an innovation leader having pioneered Cash on Demand and ingenious use of fulfillment centers in India. Flipkart has a strong Data Science team in India that is working on cutting edge problems like multi-language speech recognition and natural language understanding, search and fraud detection. Flipkart has now established an AI Center in Redmond, Washington to advance the state of the art in Natural Language Understanding, Chatbots and Computer Vision.India s eCommerce market is in its infancy and is growing very rapidly, and the level of complexity is both exhilarating and challenging. India is a country with its own version of English that is colorfully decorated with words such as chappal for slippers, and jhadu for a broom. Indian English is full of variety and complexity making it ripe for innovative natural language understanding. One of the areas of research will be creating a decision assistant bot that aims to assist our customers make purchase decisions regarding the products they are interested in. The Seattle team will be responsible for developing natural language understanding technologies using state of the art Deep Learning techniques.The AI Center will also focus on Computer Vision applications that can be used for editorial purposes, for example identifying bad returns or identifying inappropriate images uploaded to the cloud. Each project will operate with data scientists, data engineers, product and program managers working to deliver state of the art solutions that will be integrated into Flipkart web front end and back end applications. Each team will have a single-threaded leader who will have wide latitude and independence.The Flipkart Science team is looking for a passionate data engineer with machine learning experience to help build and test customer-facing, ML-powered systems. You will work with data scientists and engineers on a variety of online and offline machine learning use cases including:

• Data modeling to support machine learning model training and inference workflows and pipelines.
• Build data pipelines to feed machine learning models for real-time and large-scale offline use cases.
• Work closely with data scientists to scale model training and explore new data sources and model features.

Minimum Qualifications

• Bachelors Degree in computer science
• 5+ years of industry experience in software development, data engineering, ML, business intelligence, data science, or a related field
• Strong core computer science and problem solving skills
• Fundamentals of Data Science and proven track record ini building ML systems.
• Experience in model tracking and assessment principles with expertise in ML model lifecycle platforms like MLFlow.
• Expertise in Python and general data science frameworks and libraries
• Knowledge of data management fundamentals and data storage principles
• Expert-level SQL skills and production experience with one or more major SQL databases
• Ability to write good quality, maintainable, explainable, production level ETL
• Good communication, collaboration, analytical and problem solving skills
• Development expertise in Unix-based environments.

Preferred Qualifications

• Expertise in building and consuming RESTful services
• Experience with Spark, Hadoop, Apache Airflow and similar applications.
• Experience with Docker, Kubernetes, or any other PaaS systems
• Instrumentation of Continuous Integration and Delivery (CI/CD) pipelines
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Infrastructure deployment and automation with any public cloud provider(AWS/Azure/GCP.

,

Keyskills :
pythonsqldebuggingdocumentationedwbias for actionnatural language understandingfront enduse casesdata sciencedeep learningdata managementmachine learningnatural languagedata engineering