Data Engineer

ClinLab Solutions Group; Ivyland (PA); On-site; USD 120,000 - 165,000; Full time

Job summary

ClinLab Solutions Group is seeking a Data Engineer to design, build, and maintain data-intensive systems. You will collaborate with stakeholders to understand business needs and select appropriate technologies to meet requirements.

You will develop data architecture, construct pipelines, ensure data quality, and enforce security controls while partnering with data scientists and analysts to deliver impactful data solutions. Documentation and sharing best practices will be essential.

Qualifications

• Bachelor's degree in CS/Engineering or 15+ years of relevant experience.
• 10+ years of software development experience with 7+ years as Data Engineer/DBA.
• Strong SQL (Postgres) and NoSQL experience across multiple databases.
• Experience building data pipelines and data architecture.

Responsibilities

• Develop and implement data architecture including technology selection, coding, and storage solutions.
• Construct and maintain data pipelines connecting systems, databases, and data warehouses for seamless flow.
• Enforce data cleaning, standardization, and transformation rules to ensure data quality.
• Apply security controls and manage access policies to safeguard data assets.
• Monitor and optimize system performance; troubleshoot issues as needed.
• Collaborate with data scientists, analysts, and business teams to deliver data solutions.
• Document technical designs, workflows, and best practices for knowledge sharing.
• Perform additional tasks to support evolving business and technical requirements.

Skills

SQL

NoSQL

Data pipelines

Python

Java

Kafka

Kubernetes

IoT ingestion

Real-time analytics

Postgres

Education

B.S. in CS/Engineering

15+ years experience

Tools

Postgres

MongoDB

Cassandra

InfluxDB

Clickhouse

Elasticsearch

Kestra

Airflow

Kafka

Kubernetes

Kubeflow

Flink

Spark

Job description

Summary

Seeking a Data Engineer skilled in designing, building, and maintaining data-intensive systems. This role involves collaborating with stakeholders to understand business needs and selecting appropriate technologies to meet those requirements.

Responsibilities

• Develop and implement data architecture, including technology selection, coding, and storage solutions.
• Construct and maintain data pipelines to connect various systems, databases, and data warehouses for seamless data flow.
• Establish and enforce rules for data cleaning, standardization, and transformation to ensure data quality.
• Apply security controls and manage access policies to safeguard data assets.
• Monitor and optimize system performance using appropriate tools, and troubleshoot technical issues as needed.
• Collaborate with data scientists, analysts, and business teams to deliver effective data solutions based on organizational needs.
• Document technical designs, workflows, and best practices to facilitate knowledge sharing and maintain system integrity.
• Perform additional tasks as assigned to support evolving business and technical requirements.

Qualifications

• Experience with SQL (Postgres preferred) and NoSQL databases such as MongoDB, Cassandra, InfluxDB, Clickhouse, and Elasticsearch.
• Proficiency with data pipeline orchestration tools (e.g., Kestra, Airflow).
• Demonstrated experience in designing data pipelines.
• Hands-on experience with Kafka, Kubernetes, Python, and Java.
• 10+ years of software development experience, with at least 7+ years as a Data Engineer or database administrator.
• Familiarity with IoT ingestion patterns.
• Experience implementing data pipelines using Kubernetes-ready workloads.
• Knowledge of real-time analytics frameworks such as Flink and Spark.
• Experience with Clickhouse and Kubeflow.
• Bachelor's degree in Computer Science, Computer Engineering, or a related technical discipline, or 15+ years of relevant experience preferred.