Data Integration Engineer (Databricks / Python / SQL)
New
G
Gramian ConsultancyFinancial services
Remote, EU-based candidatesContract
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English
- Required Skills
- PythonSQLMicrosoft SQL ServerRESTful APIsData modelingDatabricksPySpark
Requirements
- Bring strong hands-on experience with Databricks, including Delta Lake and Unity Catalog.
- Bring strong experience with Python and PySpark.
- Have advanced SQL skills.
- Have experience integrating with SQL Server and legacy databases.
- Have experience with REST APIs, DB links, batch processing, files, and SFTP integrations.
- Have experience with data modelling and data-contract design.
- Have experience implementing data-quality validation and integration testing.
- Be fluent in English.
- Be able to work remotely within the EU.
Responsibilities
- Inventory and map internal and external data sources.
- Define data contracts and canonical data structures for client, screening, evidence, audit, and reporting data.
- Build connectors to external screening providers, public registers, and local data sources.
- Connect Databricks with SQL Server, legacy databases, and core enterprise systems.
- Support API, database-link, batch, file, and SFTP-based integrations.
- Design and maintain data models supporting evidence, audit trails, and reporting.
- Implement data quality checks, contract tests, and retention rules.
- Validate incoming and outgoing data flows across production services.
- Support integration troubleshooting and production-readiness activities.
View Full Description & ApplyYou'll be redirected to the employer's site
