Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs

Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales

Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs

IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

LLM & ML Ops Engineer Job Details | Gainwell Technologies LLC

3.00 to 5.00 Years Chennai (Tamil Nadu), Bengaluru/ Bangalore (Karnataka) 29 Apr, 2025

Job Location	Chennai (Tamil Nadu), Bengaluru/ Bangalore (Karnataka)
Education	ML/ LLM (Law)Any Graduate
Salary	As per Industry Standards
Industry	IT-Hardware/Networking, Telecom
Functional Area	IT Software : Software Products & Services
EmploymentType	Full-time

Job Description

LLM & ML Ops EngineerDate: Mar 28, 2025Location: Bangalore, KA, IN, 560100; Chennai, TN, IN, 600032Req ID: 30248SummaryGainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists and DevOps.Your role in our missionCore LLM Ops Responsibilities:

Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.).
Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines.
Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines.
Manage vector databases, embedding stores, and document stores used in conjunction with LLMs.
Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments.
Continuously monitor models for their performance and ensure alert systems are in place.
Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows.

Core ML Ops Responsibilities:

Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring.
Implement version control, model registry, and reproducibility strategies for ML models.
Automate data ingestion, feature engineering, and model retraining workflows.
Monitor model performance, drift, and ensure proper alerting systems are in place.
Implement security, compliance, and governance protocols for model deployment.
Collaborate with Data Scientists to streamline model development and experimentation.

What were looking for

Bachelors/Masters degree in computer science, Engineering, or related fields.
Strong experience with ML Ops tools (Kubeflow, MLflow, TFX, SageMaker, etc.).
Experience with LLM-specific tools and frameworks (LangChain, Lang Graph, LlamaIndex, Hugging Face, OpenAI APIs, Vector DBs like Pinecone, FAISS, Weavite, Chroma DB etc.).
Solid experience in deploying models in cloud (AWS, Azure, GCP) and on-prem environments.
Proficient in containerization (Docker, Kubernetes) and CI/CD practices.
Familiarity with monitoring tools like Prometheus, Grafana, and ML observability platforms.
Strong coding skills in Python, Bash, and familiarity with infrastructure-as-code tools (Terraform, Helm, etc.). Knowledge of healthcare AI applications and regulatory compliance (HIPAA, CMS) is a plus.
Strong skills in Giskard, Deepeval etc.

What you should expect in this role

Fully Remote Opportunity Work from anywhere in India.
Minimal Travel Required Occasional travel opportunities (0-10 PERCENT ).
Opportunity to Work on Cutting-Edge AI Solutions in a mission-driven healthcare technology environment.

Keyskills :
ml ops tools large language models ci/cd pipelines performance monitoring python programming docker security devops machine learning infrastructure

APPLY NOW