AWS/Azure/GCP DevOps Engineer (IaC Kubernetes AI)

Job Description

Key ResponsibilitiesDesign build and maintain scalable and reliable cloud infrastructure across AWS Azure GCP and Alibaba Cloud to support AI Gateway and AI servicesDevelop and implement automation tools and frameworks for infrastructure deployment and governanceCollaborate with software engineering teams to ensure the infrastructure is scalable resilient and costeffectiveManage model hosting for both opensource and cloudbased LLMsCreate and maintain comprehensive documentation for systems and processesParticipate in L2 oncall rotations and incident response activitiesConduct postmortem analyses to identify root causes of outages and implement preventive measuresAdvocate for and implement best practices in infrastructure design and implementation for future AI solutionsQualificationsBachelors degree in Computer Science Engineering or a related fieldProven experience as an Infrastructure Engineer or in a similar roleStrong knowledge of cloud platforms AWS Azure GCP Alibaba Cloud etcProficiency in scripting and programming languages such as Python Go or JavaHandson experience with containerization and orchestration tools eg Docker KubernetesUnderstanding of natural language processing NLP technologies including LangChainFamiliarity with AI Gateway and API Gateway concepts preferably within the banking or financial services industrySolid understanding of networking concepts and protocolsExcellent problemsolving skills with a proactive approachStrong communication and collaboration skills with the ability to work effectively with both technical and nontechnical stakeholdersCommitment to maintaining high standards of data privacy and security

Keyskills :
devopskubernetescloudexposureai/llm