Skip to content
Sohaib Sohail
Open to work · senior, staff or principal · UK remote or hybrid

I take AI agents from prototype to production, and build the platform they run on.

Salam, and hi, I'm Sohaib. I've spent the last few years doing platform engineering at some big firms, and I've reached the point where I'd rather build my own things than only ship other people's. Most people consume what gets built. I want to be on the other side of that, making things that work and showing other engineers how I got there.

200+
engineers on the AI platform I ran
3
clouds in production, Terraform for each
2024
Google Award, GenAI Excellence
01

Ask the agent

The trace below is scripted, not live. The real agent is deployed and free to try; the public instance replays recorded runs, so it costs nothing.

portfolio-agent Scripted walkthrough Open the live agent →
Try one
YOU

Open the live agent →

02

Selected work

Two flagships, deployed and open to anyone, with the depth behind them. Then the rest.

sre-investigation-agentLIVE

Incident agent with five SRE tools, streaming each call as it investigates.

PythonBedrock AgentCoreTerraformSSE
  • 8/8 eval scenarios passing, scored on tool choice and on the facts reaching the answer
  • One scenario has a false premise, to catch an agent inventing a cause rather than tracing the real dependency
  • Deterministic mock infrastructure so eval scoring stays reproducible
  • Public demo replays recorded runs, so anyone can try it at zero Bedrock cost
Open demo ↗ Source ↗ 2026

mcp-context-inspectorLIVE

An MCP server that makes context window usage visible for any agent loop.

PythonMCPDynamoDBFirestoreOTLP
  • 300 automated tests, run on every push, no live cloud credentials needed
  • Three storage backends behind one data-access layer: SQLite, DynamoDB, Firestore
  • Ingests OTLP telemetry from Claude Code and Copilot, with a precision-biased redaction pass
  • Full OAuth discovery (RFC 9728) plus Google sign-in, so any MCP client can connect
Open demo ↗ Source ↗ 2026

gcp-vertexai-app

Vertex AI Vector Search indexes and endpoints, with Python for embeddings and validation.

TerraformPythonGCP
source ↗ 2026
03

Case studies

Platform work is mostly invisible, so here it is written up the way I would write a postmortem.

Problem
Legitimate user queries were getting blocked in production. Everyone assumed prompt-attack detection was firing on benign input, and acting on that would have burned the week.
What I did
Built 27 test cases and 45 positive controls, ran them per region, then repeated them on identical inputs to see whether the detector was even deterministic.
Result
It was the HATE filter strength, not attack detection. PROMPT_ATTACK turned out to be non-deterministic even at LOW (83% one run, 94% the next), so it cannot gate a release. One config change across three regions fixed it.
Problem
Deployments were manual, per model and per region, and you checked quota by asking someone. If it did not fit you found out halfway through, with the estate left in a partial state.
What I did
A five stage Python pipeline (quota discovery, capacity weighting, dry run, tfvars generation, apply) with one YAML file per model family driving Terraform.
Result
50+ deployments from declarative config and 30 minutes down to 2. More moving parts than a hand written resource block, which is the trade, but failures moved to the start where they are cheap.
Problem
Agent demos are usually unfalsifiable. If the data shifts run to run you cannot score it, and if the reasoning is hidden you cannot tell competence from luck.
What I did
Deterministic mock infrastructure so eval scoring stays reproducible, five tools (services, metrics, logs, deployments, cost), and a UI that streams each tool call live instead of showing a spinner.
Result
8/8 eval scenarios passing. One has a false premise: ask which deployment broke checkout-api when none did, and a good answer traces it to the inventory-service dependency rather than inventing one.
Problem
Most agent observability re-shows you data your own interface already had. The genuinely invisible part is what entered context, and how much of it the user never sees.
What I did
A drop in MCP server over Streamable HTTP with eight tools, so any client can connect, Claude Desktop included. Token counts are labelled estimates rather than exact usage, documented as a deliberate trade.
Result
System prompt, tool specs, reasoning, results and answer, in the order they actually entered context, split by what the user sees versus overhead.
04

Experience

Four roles, all delivery-facing. The through-line is platform work other engineers depend on.

Sohaib, you are a delight to work with and you have continuously been supporting and helping us onboard onto this LLM platform. We’ve been able to automate our workflows and increase productivity by 45%.
An engineer who onboarded onto the platform, 2026
2026 Veracross Senior AI Platform Engineer. Multi-agent LLM platform on Bedrock, an eval harness gating every PR, guardrails across three regions, and Terraform across a multi-brand AWS estate.
2025–26 LSEG Senior Cloud & AI Engineer. Ran an enterprise AI platform used by 200+ engineers end to end: DevOps and deployments, the agentic layer and MCP setup, and unblocking every team onboarding onto it. Escalated to Microsoft’s AI Product team to sort out AI Foundry issues.
2023–25 PwC Senior DevOps Engineer. Led the Kubernetes workstream for an internal SaaS platform and mentored the juniors on the team. Shipped an AI compliance app into three tier-one bank environments, plus Landing Zones across AWS and Azure.
2021–22 Capgemini DevOps Engineer. Serverless and EKS workloads, with DevSecOps scanning wired into four different CI systems.
05

Work with me

I take a limited number of 1:1 sessions outside of work, for people who want a steer from someone a few steps further down the same road.

Career guidance

Breaking into platform or AI engineering, levelling up to senior, or working out your next move.

Mentoring

Ongoing 1:1 support on the engineering, the projects, and the bits nobody teaches you.

Tech consulting

Agents, MCP, LLM evaluation, guardrails, Terraform at estate scale. The things I do at work.

Book a session →
07

Background

I’m a senior cloud and AI platform engineer based in Preston, in the UK. Five and a half years in, most of it inside regulated environments where the work has to actually hold up.

Outside the terminal I follow tech news and world affairs closely, and I travel as much as I can, more than 25 countries so far. New places, new food, new context for how other people build and live.

When I’m not working I’m usually learning a new skill, building something of my own, or talking to people about what they’re working on and where it might go.

Sohaib Sohail
On a bamboo bridge in Bali
Ubud, Bali · one of 25+ countries so far
Tech I reach for
Clouds AWSAzureGCP
Infrastructure TerraformKubernetesDockerHelm
AI & agents BedrockMCPVertex AILLM eval
Languages PythonGoRubyBash
Platform GitHub ActionsDatadogCloud RunECSEKSAPIM