Data Engineer

TieTalent; London; Remote; GBP 60,000 - 80,000; Full time

Job summary

Join a pioneering health tech company as a Data Engineer and make a significant impact on clinical research. In this role, you will build secure and scalable data pipelines, develop REST APIs, and ensure data security using cutting-edge technologies like Databricks and Azure Data Factory. Collaborate with a dynamic team to transform healthcare through innovative data solutions. This opportunity not only allows you to work with advanced tools but also offers career growth and the chance to contribute to meaningful projects in the health tech space.

Qualifications

• Proficiency in Databricks components like Delta Lake and ML Flow.
• Strong skills in Python (3.x) and experience with FastAPI.

Responsibilities

• Build and optimize data pipelines for AI applications using Databricks.
• Develop REST APIs for seamless external data integrations.

Skills

Databricks

Python (3.x)

SQL

Azure Data Factory

CI/CD

Data Modeling

Tools

Databricks

Azure Data Factory

PostgreSQL

FastAPI

Pydantic

Job description

Location: Remote

Salary: up to £80,000 + Bens

Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with cutting-edge technology? If so, we have an exciting new role for you!

Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare while working with some of the most advanced technologies in data engineering.

About Us

We are a pioneering health tech company dedicated to revolutionising clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high-performance data pipelines and REST APIs that drive AI applications and external data integrations.

Your Role

As a Data Engineer, you will:

Build and Optimise Data Pipelines: Implement high-performance data pipelines for AI applications using Databricks.Develop REST APIs: Create REST APIs required for seamless external data integrations.Ensure Data Security: Apply protocols and standards to secure clinical data in-motion and at-rest.Shape Data Workflows: Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable.Key Responsibilities

Data Engineering with Databricks: Utilize Databricks to design and maintain scalable data infrastructure.Integration with Azure Data Factory: Leverage Azure Data Factory for orchestrating and automating data movement and transformation.Python Development: Write clean, efficient code in Python (3.x), using frameworks like FastAPI and Pydantic.Database Management: Design and manage relational schemas and databases, with a strong focus on SQL and PostgreSQL.CI/CD and Containerisation: Implement CI/CD pipelines and manage container technologies to support a robust development environment.Data Modeling and ETL/ELT Processes: Develop and optimize data models, ETL/ELT processes, and data lakes to support data analytics and machine learning.Requirements

Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow.Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration.Clinical Data Security: Understanding of protocols and standards related to securing clinical data.Python Proficiency: Strong skills in Python (3.x), FastAPI, Pydantic, and Pytest.SQL and Relational Databases: Knowledge of SQL, relational schema design, and PostgreSQL.CI/CD and Containers: Familiarity with CI/CD practices and container technologies.Data Modeling and ETL/ELT: Experience with data modeling, ETL/ELT processes, and data lakes.Why Join Us?

Innovative Environment: Be part of a team that is pushing the boundaries of health tech and clinical research.Career Growth: Opportunities for professional development and career advancement.Cutting-Edge Technology: Work with the latest tools and platforms in data engineering.Impactful Work: Contribute to projects that have a real-world impact on healthcare and clinical research.If you are a versatile Data Engineer with a passion for health tech and innovation, we would love to hear from you. This is a unique opportunity to shape the future of clinical research with your expertise in data engineering.

Shape the Future of Health Tech with Us! Apply Today!

To find out more about Computer Futures please visit

Computer Futures, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC(phone number removed) England and Wales