Senior Data Engineer

Beaconcure Inc.; Needham (MA); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Growth mindset culture

Recognition for impactful work

Use of modern tools and technologies

Job summary

Beaconcure Inc. is hiring a Senior Data Engineer in Needham, Massachusetts. This role involves designing and implementing scalable data pipelines, collaborating with cross-functional teams, and ensuring data quality. The ideal candidate has over 3 years of Python experience, proficiency with modern data engineering tools like Databricks, and strong problem-solving skills. Join a tech-forward organization that embraces innovation and values continuous learning. Competitive salary and growth opportunities are offered.

Qualifications

• 3+ years of experience in Python development.
• Strong experience with modern data engineering tools.
• Hands-on experience with Databricks or other distributed data processing frameworks.

Responsibilities

• Design and implement scalable data pipelines and workflows.
• Collaborate with Data Scientists and Analysts on data needs.
• Take ownership of data quality and architecture.

Skills

Python development

Data engineering tools (e.g., Pandas, PySpark, SQLAlchemy)

Databricks

Data modeling

Agile methodologies

Problem-solving skills

English communication skills

Collaboration abilities

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Databricks

Cloud services (AWS and/or Azure)

NoSQL databases (e.g., MongoDB)

Python testing and debugging tools (e.g., PyTest)

Job description

Beaconcure is revolutionizing the way new drugs and vaccines are approved for market by replacing manual processes with deep tech. Our company's core product, Verify, is an AI-powered statistical analysis workspace designed to improve workflows and accelerate regulatory approval processes. Accurate analysis of clinical research data is critical to helping millions of people receive safe and effective medical treatments faster. We are seeking a highly motivated and experienced Senior Data Engineer to join our team. As a Senior Data Engineer at Beaconcure, you will design and implement robust, scalable data pipelines and workflows using modern data engineering frameworks, collaborate closely with Data Scientists, Analysts, Developers, and Product Managers to support data needs and model deployment, and take ownership of data quality, data architecture, and production readiness across systems.

Role Overview As a Senior Data Engineer at Beaconcure, you will:

• Design and implement robust, scalable data pipelines and workflows using modern data engineering frameworks.
• Collaborate closely with Data Scientists, Analysts, Developers, and Product Managers to support data needs and model deployment.
• Take ownership of data quality, data architecture, and production readiness across systems.
• Build and optimize data extraction, transformation, and loading (ETL) processes across structured and unstructured datasets.
• Develop reusable data processing components and libraries.
• Troubleshoot data issues, performance bottlenecks, and maintain high data integrity across environments.
• Contribute to the evolution of our cloud-based data infrastructure.
• Document data workflows and participate in the development and execution of test strategies for data systems.

Requirements

• 3+ years of experience in Python development (or 1+ years Python + 2+ years in another language).
• 2+ years of experience in production data environments.
• Strong experience with modern data engineering tools and libraries (e.g., Pandas, PySpark, SQLAlchemy).
• Hands-on experience with Databricks, or other distributed data processing frameworks.
• Proficiency in working with structured and semi-structured data from various sources (databases, APIs, files, etc.).
• Experience with agile methodologies and tools.
• Familiarity with data modeling, data warehousing, and performance optimization.
• Excellent analytical and problem-solving skills.
• Strong English communication skills, both written and verbal.
• Team player with strong collaboration and interpersonal abilities.

Advantages

• Experience with Databricks or similar platforms for large-scale data processing and analytics as well as data orchestration tools and MLOps frameworks.
• Experience in delivering AI-ready datasets and knowledge of AI/ML frameworks.
• Proficiency with regular expressions.
• Experience with NoSQL databases (e.g., MongoDB).
• Familiarity with cloud services (AWS and/or Azure).
• Hands-on experience with Python testing and debugging tools such as PyTest.
• Experience building and maintaining CI/CD pipelines.
• Background in the pharmaceutical or life sciences industry.
• Bachelor's degree in Computer Science, Engineering, a related technical field, or equivalent experience.

Why Join Beaconcure

• We're a tech-forward organization – we don't just adopt technology; we evolve with it.
• We celebrate great engineering – elegant, efficient, and impactful code gets the recognition it deserves.
• We use modern, exciting tools – whether it's Databricks, PyTorch, or CI/CD automation, we stay at the forefront.
• We embrace AI-assisted development – tools like GitHub Copilot, Cursor, and Windsurf help us code smarter and faster.
• We value a growth mindset – curiosity, experimentation, and continuous learning are the keys to thriving here.