Data Engineer II - Remote, End-to-End Pipelines

Credit Acceptance Corporation; United States; Remote; USD 106,000 - 153,000; Full time

Benefits offered by this job

401(K) match

Tuition reimbursement

Parental leave

Job summary

Credit Acceptance is seeking a Data Engineer to design and build end-to-end data pipelines across batch and streaming architectures, ensuring data quality and observability.

You will partner with stakeholders to understand data requirements and implement scalable, production-grade solutions on AWS and Databricks. You will also write tests, participate in code reviews, and contribute to data governance and quality frameworks while staying current with new technologies.

Qualifications

• Bachelor’s degree or equivalent work experience in CS/IS or related field.
• Minimum 2 years of data engineering experience.
• Strong programming in Python, SQL, PySpark; data modeling and SQL/NoSQL DBs.
• Experience designing scalable batch and streaming data pipelines.
• Familiar with data governance, lineage, and quality frameworks.
• Proficient with AWS data services and Databricks; CI/CD and testing.

Responsibilities

• Design and build end-to-end data pipelines across batch and streaming architectures.
• Partner with stakeholders to understand data requirements and implement integration strategies.
• Write unit tests and validate data against acceptance criteria; review code and docs.
• Ensure data quality, observability, and scalable, production-grade solutions.
• Contribute to data governance, lineage, and quality frameworks; troubleshoot production issues.

Skills

Python/SQL/PySpark

Data modeling

Batch/Streaming pipelines

Databricks

Apache Spark

AWS data services (S3, Glue, Lambda,MS

CI/CD & testing

Airflow/dbt/Dagster

Data governance/quality

AI tools & ADLC

SQL/NoSQL databases

Education

Bachelor’s degree in Computer Science or related field

Equivalent work experience

Tools

Databricks

Airflow

dbt

Dagster

S3

Glue

Lambda

MSK

Job description

Credit Acceptance is seeking a Data Engineer to design and build end-to-end data pipelines across batch and streaming architectures, ensuring data quality and observability.

You will partner with stakeholders to understand data requirements and implement scalable, production-grade solutions on AWS and Databricks. You will also write tests, participate in code reviews, and contribute to data governance and quality frameworks while staying current with new technologies.