# Senior Consultant (Databricks)

**Company:** [Unison Group](http://jobs.workable.com/companies/deKpPhPMtQZga7XoPG1tSo.md)
**Location:** Remote
**Workplace:** remote

[Apply for this job](http://jobs.workable.com/view/a82c3c7b-7a88-4149-9f65-d920ab98ebc5)

## Description

### Job Summary

We are seeking an experienced **Senior Consultant – Databricks** to design, develop, and optimize modern data platforms on Databricks. The ideal candidate will have strong expertise in data engineering, cloud technologies, ETL development, and big data processing. You will collaborate with cross-functional teams to build scalable, secure, and high-performance data solutions that support analytics, AI, and business intelligence initiatives.

### Key Responsibilities

-   Design, develop, and maintain scalable data pipelines using Databricks.
-   Build and optimize ETL/ELT workflows using PySpark and Spark SQL.
-   Develop and manage Delta Lake architecture for reliable and efficient data processing.
-   Integrate data from multiple sources including databases, APIs, streaming platforms, and cloud storage.
-   Collaborate with business stakeholders, data analysts, and data scientists to understand business requirements.
-   Optimize Spark jobs for performance, scalability, and cost efficiency.
-   Implement data quality, governance, and security best practices.
-   Monitor production workloads and troubleshoot performance issues.
-   Automate deployment processes using CI/CD pipelines.
-   Mentor junior team members and provide technical guidance during project delivery.

### Required Skills

-   Strong experience with **Databricks Platform**.
-   Hands-on expertise in **Apache Spark**, **PySpark**, and **Spark SQL**.
-   Experience with **Delta Lake**, Unity Catalog, and Databricks Workflows.
-   Strong SQL programming and data modeling skills.
-   Experience with cloud platforms such as **AWS**, **Azure**, or **Google Cloud Platform (GCP)**.
-   Experience working with data lakes, data warehouses, and modern data architectures.
-   Knowledge of orchestration tools such as **Azure Data Factory (ADF)**, **Apache Airflow**, or similar.
-   Experience with version control tools such as Git.
-   Understanding of CI/CD practices and DevOps concepts.
-   Excellent analytical, troubleshooting, and problem-solving skills.