Medior AI Engineer

Context

A major Brussels-based public transport organization is expanding its portfolio of employee- and customer-facing AI services, ranging from retrieval-based assistants to AI agents integrated with business systems.

The first AI services are scheduled to go live in December 2026, with further deployments planned throughout 2027.

We are looking for a Medior AI Engineer to join the AI Center of Excellence within the Digital Innovation & AI delivery team and take ownership of the operational Run phase of AI services in production.

Working closely with the AI Platform Architect, Senior AI Engineers, business and content owners, and IT operations teams, you will ensure the reliability, security, quality, performance and cost efficiency of these services.

The platform combines managed Azure AI services with open-source components deployed on Azure Kubernetes Service (AKS). Its technology stack includes Microsoft Foundry, Azure OpenAI, Azure AI Search, Azure API Management, Azure AI Content Safety, Python, LangChain, MLflow, Databricks, OpenTelemetry, Terraform and Azure DevOps.

Responsibilities

Operate and monitor AI services in production, ensuring availability, performance and reliability.
Investigate incidents, service requests, latency issues and application errors.
Perform root cause analysis and implement fixes or escalate when necessary.
Maintain and execute AI evaluation datasets (golden sets) in collaboration with business content owners.
Monitor answer quality, non-answer rates, user feedback and quality regressions.
Operate document ingestion pipelines, including incremental updates, failed document processing and search index health.
Support onboarding of additional content sources and business domains within existing connectors.
Monitor AI agent integrations, tool calls, timeouts and failures involving business systems.
Review agent action logs and operational exceptions.
Manage model upgrades, model retirements, prompt changes, configuration updates and security patches.
Validate changes against evaluation datasets before production deployment.
Monitor token consumption and service-level operational costs, identifying optimization opportunities.
Maintain Terraform configurations, Helm artifacts and Azure DevOps pipelines.
Ensure consistency across DEV, TST, ACC and PROD environments.
Apply data protection requirements, including trace retention, erasure and access restrictions.
Maintain operational runbooks, technical documentation and service health reports.
Deliver minor enhancements and fixes while coordinating structural changes and new features with the Build team.

Technical skills

Must have

Intermediate practical experience with Python.
Intermediate experience with Azure OpenAI Service and Large Language Models (LLMs).
Intermediate knowledge of Retrieval-Augmented Generation (RAG).
Intermediate experience with Azure Kubernetes Service (AKS).
Intermediate experience with Azure DevOps.
Intermediate experience with Terraform.
Intermediate knowledge of vector databases.
Intermediate knowledge of LangChain.
Recent experience within the current year with Python, Azure OpenAI, LLMs, RAG, AKS, Azure DevOps, Terraform and vector databases.
Native or bilingual proficiency in French or Dutch.
Full professional proficiency in English.

Should have

Practical experience operating and troubleshooting AI applications in production.
Experience monitoring AI service performance, reliability and incidents.
Experience maintaining RAG ingestion pipelines and search indexes.
Understanding of LLM evaluation, answer quality monitoring and regression detection.
Experience with Azure-based AI services and hybrid cloud environments.
Experience maintaining automated deployment pipelines and infrastructure configurations.
Ability to investigate issues independently and collaborate with development and IT operations teams.

Nice to have

Experience with Microsoft Foundry, Azure AI Search, Azure API Management or Azure AI Content Safety.
Experience with MLflow, Databricks or OpenTelemetry.
Experience with Helm and Kubernetes-based deployments.
Knowledge of AI agent orchestration and tool integrations.
Experience optimizing LLM token consumption and operational costs.
Familiarity with data protection impact assessments, trace retention and access restrictions.

Who we are

Community Consulting goes beyond traditional consulting; it’s all about fostering connections in an atmosphere of trust and confidence.

Transparency & Honesty : We say things as they are. Clear communication for seamless collaboration.

#COMMUNITEAM : Work independently, but never alone. Collective intelligence drives us further, faster.

Total Commitment : Always present, always engaged. We find solutions and make sure everyone moves forward together.

Guaranteed Efficiency : No fluff, just results. We act fast, keep our promises, and deliver top quality.

This is our DNA. This is how we make a difference.

Type

Permanent or Freelance

Contract

Full-time

Location

Brussels

Homeworking

3 days per week

Sector

Transportation

Keywords

You Career Advisor

Alex Cuypers

Junior Talent Management Officer

a.cuypers@communityconsulting.be

Are you interested in this job offer ?

Back to all jobs