Senior Data Engineer: Real-Time Pipelines & Data Quality

ClinLab Solutions Group; Ivyland (PA); On-site; USD 120,000 - 165,000; Full time

Job summary

ClinLab Solutions Group is seeking a Data Engineer to design, build, and maintain data-intensive systems. You will collaborate with stakeholders to understand business needs and select appropriate technologies to meet requirements.

You will develop data architecture, construct pipelines, ensure data quality, and enforce security controls while partnering with data scientists and analysts to deliver impactful data solutions. Documentation and sharing best practices will be essential.

Qualifications

• Bachelor's degree in CS/Engineering or 15+ years of relevant experience.
• 10+ years of software development experience with 7+ years as Data Engineer/DBA.
• Strong SQL (Postgres) and NoSQL experience across multiple databases.
• Experience building data pipelines and data architecture.

Responsibilities

• Develop and implement data architecture including technology selection, coding, and storage solutions.
• Construct and maintain data pipelines connecting systems, databases, and data warehouses for seamless flow.
• Enforce data cleaning, standardization, and transformation rules to ensure data quality.
• Apply security controls and manage access policies to safeguard data assets.
• Monitor and optimize system performance; troubleshoot issues as needed.
• Collaborate with data scientists, analysts, and business teams to deliver data solutions.
• Document technical designs, workflows, and best practices for knowledge sharing.
• Perform additional tasks to support evolving business and technical requirements.

Skills

SQL

NoSQL

Data pipelines

Python

Java

Kafka

Kubernetes

IoT ingestion

Real-time analytics

Postgres

Education

B.S. in CS/Engineering

15+ years experience

Tools

Postgres

MongoDB

Cassandra

InfluxDB

Clickhouse

Elasticsearch

Kestra

Airflow

Kafka

Kubernetes

Kubeflow

Flink

Spark

Job description

ClinLab Solutions Group is seeking a Data Engineer to design, build, and maintain data-intensive systems. You will collaborate with stakeholders to understand business needs and select appropriate technologies to meet requirements.

You will develop data architecture, construct pipelines, ensure data quality, and enforce security controls while partnering with data scientists and analysts to deliver impactful data solutions. Documentation and sharing best practices will be essential.