Posted 2 weeks ago
Brainbox Consulting BV aligning great talent with clients’ needs is at the core of who we are. We are passionate about our consultants, our clients, and our Partners. Our rich IT legacy combined with our unyielding care for our people and business is the driving force behind all we do, and we deliver! On this journey, we are looking for Data Engineer who is also interested to take on a wide range of activities.
As a Data Engineer, you will design and deliver a scalable, cloud-native data engineering platform on Microsoft Azure , powered by Databricks and provisioned through Terraform infrastructure-as-code.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL/ELT processes using Databricks on Azure
- Develop and manage cloud infrastructure using Terraform, following infrastructure-as-code best practices
- Architect and implement data platform capabilities including data lakes, lakehouses, and medallion architecture patterns
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into platform features
- Implement data quality monitoring, observability, and governance frameworks
- Create reports and data products in response to specific business requests, built on the platform you help establish
- Contribute to platform documentation, engineering standards, and best practice guidelines
- Participate in Agile ceremonies — sprint planning, technical reviews, and retrospectives
Requirements
- Proven hands-on experience with Databricks — Delta Lake, Spark, and Databricks Workflows
- Strong Microsoft Azure skills — ADLS Gen2, Azure Data Factory, Azure Synapse or equivalent
- Solid Terraform proficiency for cloud infrastructure provisioning and IaC pipeline management
- Proficiency in Python or PySpark for production-grade pipeline development
- Experience designing scalable data architectures — Data Lake, Lakehouse, Medallion architecture
- Familiarity with CI/CD practices and version control using Git
- Strong written and verbal communication in English
Nice to Have
- Background in energy, utilities, or industrial IoT sector
- Experience with data build tool for transformation layer management
- Familiarity with streaming architectures — Azure Event Hubs, Apache Kafka
- Azure certification, e.g. DP-203 Data Engineer Associate
- Experience in Agile or SAFe delivery environments
Job Features
| Position | Data Engineer |
| Work location | Amsterdam |
| Experience | 7+ yrs |
| Education | Bachelor or Master's |
| Required Skills | Databricks, Microsoft Azure, Terraform, PySpark, Python, Delta Lake, Azure Data Factory, Git, CI-CD, SQL |
