About the Role
We are looking for an experienced Data Engineer to design, build, and optimize modern cloud-based data platforms. The role has a strong focus on Databricks and scalable data engineering solutions.
You will work on innovative data products that enable efficient processing and availability of large datasets for analytics, AI, and reporting purposes.
Responsibilities
- Design and develop scalable data pipelines
- Work with batch and streaming data solutions
- Configure and optimize Databricks environments
- Integrate data from multiple source systems
- Improve performance, security, and data governance
- Collaborate with Data Analysts, Data Scientists, and Architects
Required Skills & Tooling
- Strong experience with:
- Databricks
- Apache Spark
- Python
- SQL
- Azure Data Factory
- Microsoft Azure
- Experience with ETL/ELT processes
- Understanding of CI/CD and DevOps principles
- Experience with Delta Lake is a strong plus
- Knowledge of cloud-based data architecture
