Generative AI Systems Architect

We are seeking a skilled Generative AI Platforms Architect to lead and define the architecture for our enterprise GenAI platform.The role involves creating reference architectures, guardrails, and roadmaps to deliver scalable and secure AI solutions—including LLMs, agentic applications, and tool integrations—across multiple clouds. By collaborating with engineering, security, data governance, and product teams, the Architect will translate business goals into platform designs and actionable delivery plans, while mentoring engineers and advocating for best practices in LLMOps/ModelOps. ResponsibilitiesDesign enterprise generative AI reference architectures, blueprints, and reusable patternsDefine multi-cloud platform foundations addressing networking, identity, and secrets managementLead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategiesCreate frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP)Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls appliedEstablish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniquesImprove developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniquesCollaborate with cross-functional teams to align system requirements with strategic objectives RequirementsBachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience1+ years in architecture roles involving cloud, data, or production Generative AI/LLM systemsKnowledge of cloud platforms (Azure, AWS, GCP) and IaC tools (Terraform, Bicep, CDK, CloudFormation)Competency in containerization and orchestration technologies (Docker, Kubernetes), as well as API gateways/service meshesProficiency in CI/CD and release management for ML/LLM workloads (Jenkins, GitHub Actions, GitLab CI, Azure DevOps)Understanding of Large Language Model (LLM) platforms like Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AIFamiliarity with security-by-design principles and compliance frameworks tailored to GenAI systemsAdvanced proficiency in English (B2+/C1) We offerWe connect like-minded people: Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth:  Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to LinkedIn Learning and Get AbstractFree English classes with certified teachersDiscounts in local language schools, including online courses for the Kazakh languageWe cover it all: Participation in the Employee Stock Purchase PlanMonetary bonuses for engaging in the referral programMedical & family care packageSix trust days per year (sick leave without a medical certificate)Coverage of psychology sessions of your choiceBenefits package (sports activities, a variety of stores and services) Immerse yourself in our collaborative culture by working on-site at our office in Astana, Almaty or Karaganda. Unlock the potential of remote work in Kazakhstan, giving you the flexibility to work from home or access our offices in Astana, Almaty or Karaganda. EPAM is a team of technologists and innovators united by a passion for technology. In Kazakhstan, we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. In 2023, EPAM received the Export Excellence Award at the esteemed Digital Bridge Awards, showcasing our commitment to excellence and innovation.