Remote Data Engineer II: Scalable Pipelines & Observability

Credit Acceptance; United States; On-site; USD 106,000 - 153,000; Full time

Benefits offered by this job

401(k) match

Adoption sponsorship

Parental leave

Tuition reimbursement

Medical/dental/vision benefits

Job summary

Credit Acceptance is seeking a Software Engineer II, Data to design and build scalable data models and pipelines across batch and streaming architectures. You will work with structured, semi-structured, and unstructured data while emphasizing data quality and observability.

The role partners with stakeholders, writes tests, and contributes to coding standards. A strong foundation in Python/SQL/PySpark and Databricks is expected, with remote work flexibility in the United States.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or related field; or equivalent work experience.
• Minimum 2 years of data engineering experience.
• Solid grasp of programming (Python, SQL, Pyspark, etc), data modeling, and database management (SQL/NoSQL).
• Experience designing scalable batch and/or streaming data pipelines.
• Strong understanding of data modeling.
• Familiarity with data governance, lineage, and quality frameworks.
• Fluency with AI tools and ADLC
• Working knowledge of Databricks.

Responsibilities

• Designs and builds end-to-end data pipelines across batch and streaming architectures with a strong emphasis on data quality, scalability, reliability, and observability.
• Partner with stakeholders to understand data requirements and implement effective data integration strategies.
• Write unit tests and validate data against acceptance criteria.
• Apply and advocate for team coding, documentation, and testing standards.
• Troubleshoot production issues and propose effective solutions.
• Engage in continuous learning to improve design, code quality, and domain knowledge.

Skills

Python

SQL

Pyspark

Data Modeling

Database Management

Data Governance

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Tools

Databricks

Apache Spark

Airflow

dbt

Dagster

AWS data services (S3, Glue, Lambda, MSK)

Job description

Credit Acceptance is seeking a Software Engineer II, Data to design and build scalable data models and pipelines across batch and streaming architectures. You will work with structured, semi-structured, and unstructured data while emphasizing data quality and observability.

The role partners with stakeholders, writes tests, and contributes to coding standards. A strong foundation in Python/SQL/PySpark and Databricks is expected, with remote work flexibility in the United States.