# Lead Data Engineer (Banking)

**Company:** [Unison Group](https://jobs.workable.com/companies/deKpPhPMtQZga7XoPG1tSo.md)
**Location:** Singapore, Singapore
**Workplace:** on site
**Employment type:** Full-time
**Department:** Bharat

[Apply for this job](https://jobs.workable.com/view/ac716492-d670-4fed-b43b-9cc13b394f00)

## Description

Role: **Lead Data Engineer (Banking)**

**Must-have skills**

_**Banking and domain**_

•                Production delivery of data pipelines inside banks.

•                Customer, account, transaction, payments and AML data.

•                Working within bank release, scheduling and change controls.

_**Core data engineering**_

•                Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.

•                Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.

•                Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.

•                ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.

•                Reconciliation, data quality and SLA monitoring.

•                Performance at scale: tables of 1 billion+ rows and multi-year history.

## Requirements

**Experience:**

-   Lead: 12+ years, including 6+ in banking.
-   Senior: 8+ years, including 4+ in banking ·

_**Banking and domain**_

•                Production delivery of data pipelines inside banks.

•                Customer, account, transaction, payments and AML data.

•                Working within bank release, scheduling and change controls.

_**Core data engineering**_

•                Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.

•                Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.

•                Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.

•                ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.

•                Reconciliation, data quality and SLA monitoring.

•                Performance at scale: tables of 1 billion+ rows and multi-year history.

_**Integration and platforms**_

•                Kafka, Spark Streaming, Informatica (PowerCenter, IDMC, IDL) and Talend; REST API development.

•                Denodo, Snowflake and NoSQL databases.

•                Airflow, Control-M or Autosys; Git, CI/CD, GitOps and Kubernetes.

_**Delivery and communication (Lead)**_

•                Framework design, code standards, code reviews and estimation.

•                Guiding a team of engineers and working with architects and analysts.

**Good-to-have skills**

•                Databricks: Delta Lake, Unity Catalog and Workflows.

•                Data services on Azure, Google Cloud, Huawei Cloud or Alibaba Cloud.

•                Data modelling for Qlik Sense or Power BI.

**Certifications (preferred):** Teradata Vantage; Cloudera Data Engineer; Databricks Data Engineer Associate or Professional