Azure Data Engineer

Context

As part of its 2027 roadmap, a major Brussels-based public transport organization is continuing to modernize and optimize its Azure Data Platform following the migration of non-SAP data to Microsoft Azure.

The organization aims to develop new reporting, analytics and Data Science use cases, strengthen data governance through Databricks Unity Catalog, expand secure self-service data capabilities, optimize Azure and Databricks consumption and costs, and continuously improve platform performance, scalability and reliability.

An experienced Azure Data Engineer is needed to support the Data & Analytics team in delivering reliable, scalable and secure data solutions while evolving the Azure Databricks architecture.

Responsibilities

Design, develop and maintain data pipelines using Azure Data Factory, Azure Databricks and other Azure services.
Implement modern data architectures including Data Lake, Delta Lake and Lakehouse.
Develop and industrialize new business data use cases.
Implement and manage Databricks Unity Catalog, including catalogs, schemas, permissions, data sharing and governance.
Support the implementation of a secure and governed self-service data strategy.
Monitor and optimize Azure and Databricks performance, resource consumption and costs.
Automate data ingestion, transformation and deployment processes.
Collaborate with Data Analysts, Data Scientists and business stakeholders.
Document data flows, architecture and technical best practices.
Maintain and continuously improve the Azure Data Platform to ensure performance, reliability, security and scalability.

Technical skills

Must have

Minimum 5 years of experience in a similar role.
Degree in Computer Science, Data Engineering or a related field.
Strong hands-on experience with Microsoft Azure services, including Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL, Key Vault and Azure DevOps.
Proven practical experience with Databricks Unity Catalog, including access management, security and data governance.
Strong understanding of Azure Databricks architecture, Lakehouse design, scalability, security and best practices.
Experience with Apache Spark, PySpark and Delta Lake.
Strong programming and querying skills in Python and SQL.
Experience with performance monitoring, tuning and cost optimization across Azure and Databricks.
Knowledge of CI/CD principles applied to Data Engineering.
Knowledge of application integration patterns, including REST API and AMQP.
Strong analytical thinking, autonomy, problem-solving abilities and team spirit.
Strong communication skills and ability to explain technical concepts clearly.
Excellent command of either French or Dutch.
Good command of the other national language (French or Dutch).
Good command of English.

Should have

Microsoft Azure or Databricks certifications.
Experience with Power BI administration and governance.
Experience with real-time data streaming.
Experience with Terraform or Infrastructure as Code.
Familiarity with Azure Monitor and Log Analytics.
Basic knowledge of SAP S/4HANA or BW/4HANA as data sources.
Experience working in Agile/Scrum environments.

Nice to have

Who we are

Community Consulting goes beyond traditional consulting; it’s all about fostering connections in an atmosphere of trust and confidence.

Transparency & Honesty : We say things as they are. Clear communication for seamless collaboration.

#COMMUNITEAM : Work independently, but never alone. Collective intelligence drives us further, faster.

Total Commitment : Always present, always engaged. We find solutions and make sure everyone moves forward together.

Guaranteed Efficiency : No fluff, just results. We act fast, keep our promises, and deliver top quality.

This is our DNA. This is how we make a difference.

Type

Permanent or Freelance

Contract

Full-time

Location

Brussels

Homeworking

2 days per week

Sector

Transportation

Keywords

You Career Advisor

Alex Cuypers

Junior Talent Management Officer

a.cuypers@communityconsulting.be

Are you interested in this job offer ?

Back to all jobs