Japanese Specialist

Job Description

Role Overview:You will be joining a dynamic team as a Japanese Specialist, focusing on evaluating the quality of personalized AI interactions. Your role will involve designing and executing conversational prompts, evaluating model responses, analyzing grounding issues, assessing integration quality, stack-ranking model responses, writing clear rationales for comparisons, extracting and verifying debug info, and maintaining data hygiene.Key Responsibilities:- Design and execute multi-turn conversational prompts requiring AI to utilize personal information and experiences.- Evaluate model responses based on intent, ensuring appropriate personalization.- Analyze responses for Grounding issues, verifying claims are supported by evidence.- Assess Integration quality, ensuring natural weaving of personal data into responses.- Stack-rank model responses side-by-side to determine overall helpfulness, ease of use, and enjoyability.- Write clear rationales for comparisons, referencing issues or positive aspects in the conversation.- Extract and verify Debug Info from the model to confirm proper utilization of chat summaries and data sources.- Maintain data hygiene by deleting evaluation conversations to avoid polluting future chat history.Qualification Required:- Bachelors degree in a relevant field.- Fluent in Japanese language with excellent written and verbal communication skills.- Minimum 3 years of experience in a similar role.- Strong analytical skills with the ability to evaluate and compare complex data.- Experience in working with AI technologies and conversational AI platforms.- Detail-oriented with a focus on data accuracy and quality assurance.- Ability to work remotely and independently with a high level of self-motivation and discipline. Role Overview:You will be joining a dynamic team as a Japanese Specialist, focusing on evaluating the quality of personalized AI interactions. Your role will involve designing and executing conversational prompts, evaluating model responses, analyzing grounding issues, assessing integration quality, stack-ranking model responses, writing clear rationales for comparisons, extracting and verifying debug info, and maintaining data hygiene.Key Responsibilities:- Design and execute multi-turn conversational prompts requiring AI to utilize personal information and experiences.- Evaluate model responses based on intent, ensuring appropriate personalization.- Analyze responses for Grounding issues, verifying claims are supported by evidence.- Assess Integration quality, ensuring natural weaving of personal data into responses.- Stack-rank model responses side-by-side to determine overall helpfulness, ease of use, and enjoyability.- Write clear rationales for comparisons, referencing issues or positive aspects in the conversation.- Extract and verify Debug Info from the model to confirm proper utilization of chat summaries and data sources.- Maintain data hygiene by deleting evaluation conversations to avoid polluting future chat history.Qualification Required:- Bachelors degree in a relevant field.- Fluent in Japanese language with excellent written and verbal communication skills.- Minimum 3 years of experience in a similar role.- Strong analytical skills with the ability to evaluate and compare complex data.- Experience in working with AI technologies and conversational AI platforms.- Detail-oriented with a focus on data accuracy and quality assurance.- Ability to work remotely and independently with a high level of self-motivation and discipline.

Keyskills :
Japanese SpecialistAI interactionsConversational promptsModel responses evaluationGrounding issues analysisIntegration quality assessmentStackrankingDebug Info extraction