Senior Data Engineer

Redica; Pleasanton, Northern (CA, KY); Hybrid; USD 170,000 - 210,000; Full time

Job summary

Redica Systems is seeking an experienced Senior Data Engineer to lead and contribute hands-on to building and optimising our core data platform. You will design pipelines, APIs, and microservices for high-volume regulatory datasets while mentoring junior engineers.

The role combines technical leadership with hands-on coding in Python and SQL/NoSQL databases, with a focus on data quality, reliability, and scalable architectures. We offer a hybrid model based in Pleasanton, CA.

Qualifications

• 5+ years of senior or lead developer experience with an emphasis on technical mentorship, code/system architecture, and quality output.
• Extensive experience designing and building data pipelines, data APIs, and ETL/ELT processes.
• Deep, hands-on experience in Python.
• Hands-on experience setting up, configuring, and maintaining SQL and NoSQL databases (MySQL/MariaDB, PostgreSQL, MongoDB).
• Computer Science, Computer Engineering, or similar technical degree.
• Bonus Points: Experience with AWS data engineering stack (S3, Lake Formation, Lambda, Fargate, Kinesis Data Streams/Data Firehose, DynamoDB, Neptune DB) and ELK stack.

Responsibilities

• Guide & Mentor: Serve as the technical point of contact for junior and mid-level data engineers, conducting thorough code reviews, pair programming, and guiding them on best engineering practices.
• Architectural Oversight: Drive technical decisions across data sub-systems, translating high-level product requirements into clean, scalable, and maintainable engineering tasks for the team.
• Agile Execution: Work closely with Engineering Managers and Product Managers to prioritize technical backlog items, estimate effort, and break down complex epics into digestible work items for junior developers.
• Data Pipeline Development: Design, build, and maintain scalable ETL/ELT data pipelines, APIs, and microservices for high-volume regulatory and health agency datasets.
• Data Reliability & Integrity: Identify root causes of data quality issues and implement automated testing, monitoring, and validation frameworks to ensure data accuracy.
• System Integration & ML: Integrate data processing pipelines with downstream NLP/ML services and search engines (ELK stack).
• Production Operations: Ensure reliable system deployments to production and assist operations teams in resolving complex escalated pipeline or database incidents.

Skills

Python

Data pipelines

Mentorship

Architecture

ETL/ELT

SQL

NoSQL

Distributed systems

Education

Bachelor's in Computer Science, Computer Engineering or equivalent

Tools

Amazon S3

AWS Lake Formation

AWS Lambda

AWS Fargate

Kinesis Data Streams

Kinesis Data Firehose

DynamoDB

Neptune DB

Elasticsearch

Logstash

Kibana

MySQL

PostgreSQL

MongoDB

Job description

Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Embracing a hybrid model, our workforce is distributed globally, with headquarters in Pleasanton, CA.

Redica's data analytics platform empowers companies to improve product quality and navigate evolving regulations. Using proprietary processes, we harness one of the industry's most comprehensive datasets, sourced from hundreds of health agencies and the Freedom of Information Act.

Our customers use Redica Systems to more effectively and efficiently manage their inspection preparation, monitor their supplier quality, and perform regulatory surveillance.

More information is available at redica.com.

Job Description

We are looking for an experienced Senior Data Engineer to serve as a Hands-On Tech Lead & Individual Contributor. In this role, you will spend roughly 70% of your time in the code, designing, building, and optimizing our core data platform, and 30% mentoring and guiding junior-to-mid-level engineers.

You will set technical standards, lead code reviews, break down complex architectural requirements into actionable tasks for junior team members, and ensure the team delivers scalable, high-quality data pipelines.

Core Responsibilities

Technical Leadership & Mentorship (Lead IC)

Guide & Mentor: Serve as the technical point of contact for junior and mid-level data engineers, conducting thorough code reviews, pair programming, and guiding them on best engineering practices.

Architectural Oversight

Drive technical decisions across data sub-systems, translating high-level product requirements into clean, scalable, and maintainable engineering tasks for the team.

Agile Execution

Work closely with Engineering Managers and Product Managers to prioritize technical backlog items, estimate effort, and break down complex epics into digestible work items for junior developers.

Data Pipeline Development: Design, build, and maintain scalable ETL/ELT data pipelines, APIs, and microservices for high-volume regulatory and health agency datasets.

Data Reliability & Integrity: Identify root causes of data quality issues and implement automated testing, monitoring, and validation frameworks to ensure data accuracy.

System Integration & ML: Integrate data processing pipelines with downstream NLP/ML services and search engines (ELK stack).

Production Operations: Ensure reliable system deployments to production and assist operations teams in resolving complex escalated pipeline or database incidents.

About you

Tech Savvy

Effectively anticipates and adopts innovations in business-building technology solutions, staying up-to-date with data advancements and incorporating them into work processes

Manages Complexity

Actively synthesizes solutions from complex information by identifying patterns and developing effective problem-solving strategies to solve data-related problems effectively

Decision Quality

Consistently makes good and timely decisions that propel organizational progress and maintain data integrity

Collaborates

Actively engages in collaborative problem-solving by leveraging diverse perspectives and finding innovative solutions to achieve shared goals and data engineering initiatives

Optimizes Work Processes

Actively seeks opportunities to enhance and streamline current work processes for managing data pipelines, ETL (Extract, Transform, Load) processes, and data warehousing

Drives Results

Strives to continuously improve performance and exceed expectations to contribute to overall success and meet data-related deliverables

Strategic Mindset

Consistently demonstrates a strategic mindset by envisioning future possibilities and successfully translating them into breakthrough data strategies, contributing to the organization's long-term success

Engaged

Not only shares our values but also possesses the essential competencies needed to thrive at Redica, as outlined here

Qualifications

• 5+ years of senior or lead developer experience with an emphasis on technical mentorship, code/system architecture, and quality output

Extensive experience designing and building data pipelines, data APIs, and ETL/ELT processes

Deep, hands‑on experience in Python

Hands‑on experience setting up, configuring, and maintaining SQL and no‑SQL databases (MySQL/MariaDB, PostgreSQL, MongoDB)

Computer Science, Computer Engineering, or similar technical degree

Bonus Points

Experience with the data engineering stack within AWS is a major plus (S3, Lake Formation, Lambda, Fargate, Kinesis Data Streams/Data Firehose, DynamoDB, Neptune DB)

Experience with event‑driven data architectures

Experience with the ELK stack is a major plus (Elasticsearch, Logstash, Kibana)

Additional Information

We offer competitive salaries, comprehensive benefits packages, and a dynamic work environment where you can grow and develop your skills.

Top Pharma Companies, Food Manufacturers, MedTech Companies, and Service firms from around the globe rely on Redica Systems to mine and process government inspection, enforcement, and registration data in order to quantify risk signals about their suppliers, identify market opportunities, benchmark against their peers, and prepare for the latest inspection trends. Our data and analytics have been cited by major media outlets such as MSNBC, WSJ, and the Boston Globe.

We are committed to creating a diverse and inclusive workplace where everyone feels welcomed and valued. We believe that diversity of perspectives, backgrounds, and experiences is essential to our success. We are always looking for talented individuals who can bring unique skills and perspectives to our team.

All your information will be kept confidential according to EEO guidelines.