Senior Data Engineer: Scale Pipelines & Data Warehousing

MultiPlan; McLean (VA); On-site; USD 145,000 - 155,000; Full time

Job summary

Claritev in McLean, VA is seeking a Senior Data Engineer to collaborate with Data Architects and ML teams to implement data solutions using Python, PySpark, SQL, and Kafka. You will design data structures, build scalable pipelines, and ensure data quality for reports and analytics.

You will mentor engineers, promote DataOps practices, and help automate data analysis across departments while aligning with HIPAA requirements.

Qualifications

• Minimum high school diploma and 5 years of data engineering experience.
• Bachelor's degree in computer science, information technology or a similarly relevant field highly preferable.
• Minimum of 3 years of experience with OOP, SQL, schema designing, data modeling, designing, building and maintaining data processing systems.
• Strong experience with languages for analytics such as Python, Java, and R.
• Database development experience using SQL, Spark, or BigQuery and experience with relational, NoSQL databases.
• Big Data development experience with Hive, Impala, Spark and familiarity with Kafka (preferred).
• Experience in triaging data issues and end-to-end data pipelines with business users.
• Experience with data governance, data quality, and data security teams and production pipelines.
• Experience building infrastructure for ETL/ELT of data from diverse resources.

Responsibilities

• Understand business processes and how they are modeled in systems.
• Collaborate with users, technology teams, and executives to understand data needs.
• Design, organize, and implement data structures, workflows, and integrations between platforms.
• Develop and maintain scalable data pipelines and build API integrations.
• Guide decisions and best practices on data integration and future data infrastructure.
• Improve performance of databases, queries, tools, and solutions.
• Create and maintain data warehouses, SQL queries, and ingestion pipelines for reports and dashboards.
• Write complex queries to transform raw data into accessible models.

Skills

Python

PySpark

SQL

Data pipelines

Cloud platforms

Kafka

Data modeling

DevOps / DataOps

Mentoring

Docker

Education

Bachelor's degree in CS/IT or related field

5 years data engineering experience

Tools

Spark

Hadoop

BigQuery

MongoDB

Docker

Kubernetes

Job description

Claritev in McLean, VA is seeking a Senior Data Engineer to collaborate with Data Architects and ML teams to implement data solutions using Python, PySpark, SQL, and Kafka. You will design data structures, build scalable pipelines, and ensure data quality for reports and analytics.

You will mentor engineers, promote DataOps practices, and help automate data analysis across departments while aligning with HIPAA requirements.