Senior Data Engineer & Tech Lead, Pipelines

Redica; Pleasanton, Northern (CA, KY); Híbrido; USD 170 000 - 210 000; Tempo integral

Resumo da oferta

Redica Systems is seeking an experienced Senior Data Engineer to lead and contribute hands-on to building and optimising our core data platform. You will design pipelines, APIs, and microservices for high-volume regulatory datasets while mentoring junior engineers.

The role combines technical leadership with hands-on coding in Python and SQL/NoSQL databases, with a focus on data quality, reliability, and scalable architectures. We offer a hybrid model based in Pleasanton, CA.

Qualificações

• 5+ years of senior or lead developer experience with an emphasis on technical mentorship, code/system architecture, and quality output.
• Extensive experience designing and building data pipelines, data APIs, and ETL/ELT processes.
• Deep, hands-on experience in Python.
• Hands-on experience setting up, configuring, and maintaining SQL and NoSQL databases (MySQL/MariaDB, PostgreSQL, MongoDB).
• Computer Science, Computer Engineering, or similar technical degree.
• Bonus Points: Experience with AWS data engineering stack (S3, Lake Formation, Lambda, Fargate, Kinesis Data Streams/Data Firehose, DynamoDB, Neptune DB) and ELK stack.

Responsabilidades

• Guide & Mentor: Serve as the technical point of contact for junior and mid-level data engineers, conducting thorough code reviews, pair programming, and guiding them on best engineering practices.
• Architectural Oversight: Drive technical decisions across data sub-systems, translating high-level product requirements into clean, scalable, and maintainable engineering tasks for the team.
• Agile Execution: Work closely with Engineering Managers and Product Managers to prioritize technical backlog items, estimate effort, and break down complex epics into digestible work items for junior developers.
• Data Pipeline Development: Design, build, and maintain scalable ETL/ELT data pipelines, APIs, and microservices for high-volume regulatory and health agency datasets.
• Data Reliability & Integrity: Identify root causes of data quality issues and implement automated testing, monitoring, and validation frameworks to ensure data accuracy.
• System Integration & ML: Integrate data processing pipelines with downstream NLP/ML services and search engines (ELK stack).
• Production Operations: Ensure reliable system deployments to production and assist operations teams in resolving complex escalated pipeline or database incidents.

Conhecimentos

Python

Data pipelines

Mentorship

Architecture

ETL/ELT

SQL

NoSQL

Distributed systems

Formação académica

Bachelor's in Computer Science, Computer Engineering or equivalent

Ferramentas

Amazon S3

AWS Lake Formation

AWS Lambda

AWS Fargate

Kinesis Data Streams

Kinesis Data Firehose

DynamoDB

Neptune DB

Elasticsearch

Logstash

Kibana

MySQL

PostgreSQL

MongoDB

Descrição da oferta de emprego

Redica Systems is seeking an experienced Senior Data Engineer to lead and contribute hands-on to building and optimising our core data platform. You will design pipelines, APIs, and microservices for high-volume regulatory datasets while mentoring junior engineers.

The role combines technical leadership with hands-on coding in Python and SQL/NoSQL databases, with a focus on data quality, reliability, and scalable architectures. We offer a hybrid model based in Pleasanton, CA.