Data Engineer

TechShack; United Kingdom; Remoto; GBP 55.000 - 69.000; Tempo pieno

Descrizione del lavoro

TechShack is seeking an experienced Data Engineer for a fully remote 12-month contract in the UK market. The role emphasizes hands-on delivery of scalable data pipelines and production-grade ETL/ELT solutions using modern data technologies.

The ideal candidate brings strong Databricks, PySpark, Python and SQL skills, with a track record of CI/CD, monitoring and reliable data integrations. Start ASAP with UK business hours.

Competenze

• Hands-on experience designing scalable data pipelines with Databricks and PySpark.
• Strong Python and SQL skills for data transformation and analysis.
• Experience building production ETL/ELT pipelines and data quality checks.

Mansioni

• Design, develop and maintain scalable data pipelines using Databricks, PySpark, Python and SQL.
• Build, optimise and troubleshoot production-grade ETL/ELT pipelines.
• Implement workflow orchestration and dependency management.
• Develop robust retry, restart and failure-recovery mechanisms.
• Implement CI/CD pipelines, Git version control and automated deployments.
• Establish monitoring, logging and operational alerting.
• Develop integrations using APIs, file transfers and SFTP.

Conoscenze

Databricks

PySpark

Python

SQL

Strumenti

Databricks

PySpark

Python

SQL

Descrizione del lavoro

£300–£375 per day | Outside IR35 | 12-Month Contract | Fully Remote

We are looking for an experienced Data Engineer to join an exciting data transformation programme on an initial 12-month contract.

This is a fantastic opportunity for a hands‑on engineer who enjoys building scalable data solutions, optimising production pipelines and working with modern data technologies.

• Location: Fully Remote (UK)
• Start: ASAP / Early December
• Hours: Full-time, UK business hours

Key Responsibilities

• Design, develop and maintain scalable data pipelines using Databricks, PySpark, Python and SQL.
• Build, optimise and troubleshoot production-grade ETL/ELT pipelines.
• Implement workflow orchestration and dependency management.
• Develop robust retry, restart and failure-recovery mechanisms.
• Implement CI/CD pipelines, Git version control and automated deployments.
• Establish monitoring, logging and operational alerting.
• Develop integrations using APIs, file transfers and SFTP.
• Strong hands‑on Databricks experience.
• Advanced PySpark, Python and SQL.
• Production pipeline engineering and troubleshooting.
• Workflow orchestration and dependency management.
• CI/CD, Git and automated deployment.
• Data-quality controls, monitoring and logging.
• API, file and SFTP integration experience.
• Databricks Asset Bundles
• Salesforce Marketing Cloud (SFMC) or Comarch
• Customer decisioning and personalisation platforms

Interested?

If you're a Data Engineer with strong Databricks, PySpark, Python and SQL experience looking for a fully remote, Outside IR35, 12-month contract, I'd love to hear from you.

Apply today or reach out directly to discuss the opportunity!