Senior Data Engineer (Databricks & CRM Integration) – Zurich
We’re supporting a leading Swiss energy organisation on a major data platform transformation and are looking for a Senior Data Engineer with strong Databricks experience to take a technical ownership role in a high-impact CRM integration programme.
The Role:
The organisation currently operates across a fragmented CRM landscape (including Salesforce, Microsoft Dynamics 365, Excel and SharePoint), resulting in no unified view of customers, opportunities or sales activity.
This role sits at the centre of a strategic initiative to build a centralised B2B Sales Data Aggregation Hub on Databricks, creating a single source of truth for commercial and executive reporting.
You will be responsible for designing and building the data foundations that enable this transformation.
Day to Day responsibilities:
You will act as a technical owner for the Databricks data ingestion and transformation layer, including:
- Designing and building Databricks-native ETL pipelines
- Implementing CDC and incremental ingestion from Salesforce and Dynamics 365 APIs
- Ingesting and structuring data from Excel and SharePoint sources
- Building Bronze → Silver → Gold data models using Delta Lake
- Developing PySpark notebooks and reusable transformation frameworks
- Optimising Delta Lake performance (e.g. Z-ordering, compaction, caching)
- Creating automated data quality frameworks and monitoring
- Delivering KPI datasets and executive reporting layers
- Setting up orchestration, alerts, and production monitoring in Databricks Jobs
- Supporting UAT, performance testing and production rollout
Technical environment:
- Databricks (core platform)
- Delta Lake / Lakehouse architecture
- PySpark / Python / SQL
- Azure cloud environment
- Salesforce & Microsoft Dynamics 365 APIs
- Databricks Jobs, Workflows, Unity Catalog
- Data quality / monitoring frameworks
Ideal Background and Experience:
- 5+ years in Data Engineering roles
- 3+ years hands-on Databricks experience in production environments
- Strong PySpark and SQL skills
- Proven experience with CRM data integration (Salesforce and/or Dynamics 365)
- Experience designing incremental / CDC ingestion pipelines
- Strong understanding of data modelling and lakehouse architecture
- Experience building data quality frameworks and production monitoring
- Confident operating in a technical ownership / lead engineer capacity
Nice to have
- Experience with Unity Catalog or Databricks governance tooling
- Prior exposure to large-scale CRM consolidation or Customer 360 programmes
- Experience in regulated or enterprise-scale environments
This is a rare opportunity to step into a true technical ownership role on a greenfield-style Databricks lakehouse programme.
You won’t just be building pipelines – you’ll be shaping how a major enterprise understands and uses its sales and customer data at group level.
The outputs you build will directly support executive decision-making and business strategy.
To apply for this role, please send your CV or reach out to Ric Marshall at Oliver James for more information.
Senior Data Engineer (Databricks & CRM Integration) – Zurich
