Data Engineer

Computer Futures; Oxford; Remote; GBP 60,000 - 80,000; Full time

Job summary

Join a pioneering health tech company as a Data Engineer, where your expertise in data engineering will drive innovation in clinical research. You'll be instrumental in building secure and scalable data pipelines and REST APIs that enhance healthcare outcomes. Collaborate with a dynamic team utilizing cutting-edge technologies like Databricks and Azure Data Factory. This role offers the chance to make a real impact on the future of healthcare while advancing your career in a supportive environment focused on professional growth. If you're passionate about health tech and eager to innovate, this opportunity is for you!

Qualifications

• Proficiency in Databricks components like Delta Lake and ML Flow.
• Strong skills in Python and experience with REST APIs.

Responsibilities

• Build and optimize high-performance data pipelines for AI applications.
• Develop and manage REST APIs for seamless data integration.

Skills

Databricks

Python (3.x)

SQL

Data Modeling

ETL/ELT Processes

Data Security

Tools

Azure Data Factory

FastAPI

PostgreSQL

CI/CD

Job description

???? Transform Healthcare with Cutting-Edge Tech! ????

Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits

Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible opportunity for you!

Join our trailblazing team as a Data Engineer and play a pivotal role in building secure, scalable microservices that power clinical research applications. This is your chance to make a significant impact on healthcare while working with the latest advancements in data engineering.

About Us

We are a pioneering health tech company committed to transforming clinical research through innovative data solutions. Our collaborative team, which includes Frontend Developers, QA Engineers, and DevOps Engineers, creates high-performance data pipelines and REST APIs that drive AI applications and external data integrations.

Your Role

As a Data Engineer, you will:

• Build and Optimize Data Pipelines: Implement high-performance data pipelines for AI applications using Databricks.
• Develop REST APIs: Create seamless REST APIs for external data integrations.
• Ensure Data Security: Apply protocols and standards to secure clinical data both in-motion and at-rest.
• Shape Data Workflows: Utilize Databricks components like Delta Lake, Unity Catalog, and ML Flow to ensure efficient, secure, and reliable data workflows.
Key Responsibilities

• Data Engineering with Databricks: Design and maintain scalable data infrastructure using Databricks.
• Integration with Azure Data Factory: Orchestrate and automate data movement and transformation with Azure Data Factory.
• Python Development: Write clean, efficient code in Python (3.x), using frameworks like FastAPI and Pydantic.
• Database Management: Design and manage relational schemas and databases, focusing on SQL and PostgreSQL.
• CI/CD and Containerization: Implement CI/CD pipelines and manage container technologies for a robust development environment.
• Data Modeling and ETL/ELT Processes: Develop and optimize data models, ETL/ELT processes, and data lakes to support data analytics and machine learning.
Requirements

• Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow.
• Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration.
• Clinical Data Security: Understanding of protocols and standards for securing clinical data.
• Python Proficiency: Strong skills in Python (3.x), FastAPI, Pydantic, and Pytest.
• SQL and Relational Databases: Knowledge of SQL, relational schema design, and PostgreSQL.
• CI/CD and Containers: Familiarity with CI/CD practices and container technologies.
• Data Modeling and ETL/ELT: Experience with data modeling, ETL/ELT processes, and data lakes.
Why Join Us?

• Innovative Environment: Be part of a team pushing the boundaries of health tech and clinical research.
• Career Growth: Enjoy opportunities for professional development and career advancement.
• Cutting-Edge Technology: Work with the latest tools and platforms in data engineering.
• Impactful Work: Contribute to projects that make a real-world impact on healthcare and clinical research.
If you are a versatile Data Engineer with a passion for health tech and innovation, we would love to hear from you. This is a unique opportunity to shape the future of clinical research with your expertise in data engineering.

???? Shape the Future of Health Tech with Us! Apply Today! ????



To find out more about Computer Futures please visit XX XX XX XX XX

Computer Futures, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC387148 England and Wales