Lead Data Engineer – Databricks
Contract: 12 months, renewable
Location: Hybrid, 1 day a week in the office (London or Brussels)
Rate: Competitive day rate, depending on experience
A major international travel business is looking for a Lead Data Engineer to run a team of 5-7 engineers building its Databricks data platform and data products.
The role is split evenly: half leading people, half leading the engineering. You’ll stay hands-on in code, design and review while coaching the team and acting as the main technical contact for business areas such as Commercial, Operations and Customer.
What you’ll do
- Lead, coach and develop a team of data engineers, and work with the Engineering Manager, Scrum Master and product owners on priorities and delivery
- Set and enforce coding, testing, review and CI/CD standards
- Build reusable project templates (Databricks Asset Bundles), shared libraries and CI/CD pipelines that every new data product follows
- Make data AI-ready: rich metadata, semantic definitions and curated Genie spaces
- Set standards for, and review the work of, analytics engineers in the business
What you’ll need
- 7+ years in data engineering, including at least 2 years leading or mentoring engineers
- Deep hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow / DLT), plus strong Python and SQL
- Strong data modelling skills and experience building data as a product
- A track record of building templates, libraries or CI/CD that other engineers adopted
- Working knowledge of AI data agents such as Databricks Genie
- Clear communication with both technical and business stakeholders
Nice to have: dbt, Azure, FinOps on Databricks, data contracts, AI agent architecture (LLM, RAG, MCP), and experience leading teams across the UK and Europe. French is an advantage but not required.
