Artificial Intelligence Engineer

Job Title – Kong AI Gateway Engineer / Lead

Job Location - London, UK

Job Type: Full Time

Experience: 12+yrs

Key Skills: API gateway, GenAI/LLM, RestAPIs & microservices

We at Coforge are hiring for Kong AI Gateway Engineer with the following skillset:

Role Overview

We are looking for a skilled Kong AI Gateway Engineer to implement and manage an enterprise AI Gateway platform that enables secure, governed, and scalable AI adoption. The role focuses on integrating multiple LLM providers, enforcing governance, and establishing a centralized AI control plane.

Key Responsibilities

• Design and deploy Kong AI Gateway aligned to enterprise architecture
• Integrate multiple LLM providers (Azure OpenAI, AWS Bedrock, Vertex AI, etc.)
• Enable multi-LLM routing, semantic caching, and provider switching
• Implement security and governance controls (auth, RBAC, quotas, PII masking, guardrails)
• Configure rate limiting, load balancing, and failover mechanisms
• Set up observability (latency, token usage, cost tracking, audit trails)
• Build AI use cases using RAG, prompt templates, and reusable components
• Document architecture, runbooks, and production roadmap
• Support AI adoption and stakeholder enablement

Required Skills

• Strong experience in API Gateway (Kong preferred) and API management
• Hands-on experience with GenAI / LLM platforms
• Experience in cloud platforms (Azure, AWS, GCP)
• REST APIs & microservices architecture
• Docker / Kubernetes
• Security protocols (OAuth2, JWT, RBAC)
• Knowledge of observability tools (Prometheus, Grafana, OpenTelemetry)

Preferred Skills

• Understanding of AI Gateway patterns (routing, caching, orchestration)
• Experience with RAG architectures and prompt engineering
• Exposure to AI governance, compliance, and regulatory frameworks
• Prior experience in banking / financial services domain