Module Lead, Data Science

Job Description

Role Overview:You will be responsible for implementing and running Testing and Quality Assurance specifically designed for AI-driven products and Data Science workflows at BOLD. Your role will involve bridging the gap between traditional software testing and modern machine learning evaluation. You should have excellent team management and organizational skills, along with a broad mastery of capabilities, techniques, technologies, and tools in the Testing and QA domains. Additionally, you will be handling QA teams of various sizes and expertise.Key Responsibilities:- Develop and own the QA strategy for AI-driven features, focusing on model accuracy, data drift, and performance metrics (Precision, Recall, F1-score).- Implement state-of-the-art AI tools to automate test case generation, code analysis, and synthetic data creation.- Oversee the testing of Generative AI outputs, implementing frameworks to evaluate hallucination rates, toxicity, and prompt adherence.- Develop and own BOLDs quality framework from product development through to production.- Drive initiatives in your area and ensure smooth coordination across the board for timely goal achievement.- Participate in Requirement Analysis, Sprint planning, and Bug triage meetings.- Collaborate with product, development, and infrastructure teams to deliver high quality applications.- Develop quality scripts for defect-free releases.- Manage and mentor team members to maximize output and efficiency.- Evaluate and suggest new tools and technologies.Qualifications Required:- Solid understanding of the Machine Learning lifecycle (EDA, Training, Evaluation, Deployment).- Experience using LLMs and AI-coding assistants to accelerate the testing lifecycle.- Experience in a high volume, high throughput web/ecommerce environment.- Hands-on experience with UI/API automation integrated with AI-driven healing capabilities.- Experience with web service technology like XML, REST, SOAP.- Knowledge of query languages like SQL, JQL, etc.- Experience in testing complex web and mobile apps.- Strong application architecture and technical knowledge.- Strong knowledge of web concepts and web performance infrastructure.- Ability to play the role of a scrum master with strong coordination skills.- Knowledge of basic UX standards, SEO/SEM concepts, and key tracking matrices.- Strong communication skills.Company Details:BOLD is an established global organization that helps people find jobs by creating digital products to empower individuals in building stronger resumes, cover letters, and CVs. The company values diversity and promotes an inclusive work environment where hiring is based on qualifications, merit, and business needs without discrimination based on various characteristics protected by law. Role Overview:You will be responsible for implementing and running Testing and Quality Assurance specifically designed for AI-driven products and Data Science workflows at BOLD. Your role will involve bridging the gap between traditional software testing and modern machine learning evaluation. You should have excellent team management and organizational skills, along with a broad mastery of capabilities, techniques, technologies, and tools in the Testing and QA domains. Additionally, you will be handling QA teams of various sizes and expertise.Key Responsibilities:- Develop and own the QA strategy for AI-driven features, focusing on model accuracy, data drift, and performance metrics (Precision, Recall, F1-score).- Implement state-of-the-art AI tools to automate test case generation, code analysis, and synthetic data creation.- Oversee the testing of Generative AI outputs, implementing frameworks to evaluate hallucination rates, toxicity, and prompt adherence.- Develop and own BOLDs quality framework from product development through to production.- Drive initiatives in your area and ensure smooth coordination across the board for timely goal achievement.- Participate in Requirement Analysis, Sprint planning, and Bug triage meetings.- Collaborate with product, development, and infrastructure teams to deliver high quality applications.- Develop quality scripts for defect-free releases.- Manage and mentor team members to maximize output and efficiency.- Evaluate and suggest new tools and technologies.Qualifications Required:- Solid understanding of the Machine Learning lifecycle (EDA, Training, Evaluation, Deployment).- Experience using LLMs and AI-coding assistants to accelerate the testing lifecycle.- Experience in a high volume, high throughput web/ecommerce environment.- Hands-on experience with UI/API automation integrated with AI-driven healing capabilities.- Experience with web service technology like XML, REST, SOAP.- Knowledge of query languages like SQL, JQL, etc.- Experience in testing complex web and mobile apps.- Strong application architecture and technical knowledge.- Strong knowledge of web concepts and web performan

Keyskills :
Machine LearningData SciencePythonSQLSeleniumCypressXMLRESTSOAPScrum masterSEOSEMCommunication skillsUIAPI automationPlaywrightWeb service technologyQuery languageJQL