# Data Integration Engineer (Databricks / Python / SQL)

**Company:** [Gramian Consulting Group](https://jobs.workable.com/companies/kANY7hHLXDH7fUqyifRLmf.md)
**Location:** Remote
**Workplace:** remote
**Employment type:** Contract
**Department:** Talent Solutions

[Apply for this job](https://jobs.workable.com/view/53909dcb-118e-45db-9dd2-ab03102b27f4)

## Description

### About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

### About the Role

Our client is a Big4 Consultancy group that works with leading financial institutions on **AI-driven transformation, automation, advanced analytics, and financial crime prevention**. Their are building a production-grade **AI-assisted KYC / Customer Due Diligence platform** for an international insurance environment.

We are looking for an experienced **Data / Integration Engineer** to own the data flowing into and out of the platform. The role focuses on **Databricks, Python / PySpark, SQL, data modelling, data contracts, APIs, legacy-system integration, and data quality**, replacing mocked sources with reliable production integrations.

**CONTRACT:** B2B or B2C contract

**COMMITMENT:** Full-time, 3-4 months contract with possibility of extension or getting on new projects

**LOCATIONS:** Remote, EU-based candidates

**START:** ASAP

**PROCESS:** Initial qualification followed by client interviews

### Responsibilities

-   Inventory and map all internal and external data sources.
-   Define **data contracts** and canonical data structures for client, screening, evidence, audit, and reporting data.
-   Build connectors to external screening providers, public registers, and local data sources.
-   Connect **Databricks** with SQL Server, legacy databases, and core enterprise systems.
-   Support API, database-link, batch, file, and SFTP-based integrations.
-   Design and maintain data models supporting evidence, audit trails, and reporting.
-   Implement **data quality checks, contract tests, and retention rules**.
-   Validate incoming and outgoing data flows across production services.
-   Support integration troubleshooting and production-readiness activities.
-   Contribute to a business-critical platform where data accuracy and reliability are essential.

## Requirements

-   Strong hands-on experience with **Databricks**, including Delta Lake and Unity Catalog.
-   Strong experience with **Python / PySpark**.
-   Advanced **SQL** skills.
-   Experience integrating with **SQL Server and legacy databases**.
-   Strong experience with **REST APIs, DB links, batch processing, files, and SFTP integrations**.
-   Experience with **data modelling and data-contract design**.
-   Experience implementing data-quality validation and integration testing.
-   Fluent English and ability to work remotely within the EU.