Data Engineer, Databricks Pipelines — Remote

Irth Solutions; United States; Remote; USD 46,000 - 62,000; Full time

Benefits offered by this job

Competitive Salary

Medical, Dental, and Vision Insurance

401(k) Plan with Company Match

Generous PTO

Flexible Work Options

Job summary

Irth Solutions is seeking a Mid-level Data Engineer to design, build, and maintain data ingestion and processing pipelines in Databricks. The role focuses on transforming external data sources into clean, analysis-ready inputs for stakeholders and downstream analysis, supporting our Stakeholder Engagement offering.

You will work closely with Data Scientists and application teams to ensure reliable pipelines, scalable storage, and well‑documented data structures, with a focus on quality and

Qualifications

• 3 to 5 years of experience in data engineering.
• Strong experience with Databricks and Delta Lake.
• Proficiency in Python and SQL for data processing.
• Experience integrating with external APIs at scale.

Responsibilities

• Design, build and maintain ingestion pipelines from high-volume external APIs.
• Implement workflows using Databricks and medallion architectures Bronze→Silver→Gold.
• Manage Delta Lake storage structures and schema evolution.
• Ensure reliability, monitoring and alerting for pipelines.
• Collaborate with Data Scientists and developers; document pipelines and data dictionaries.

Skills

Python programming

SQL

Databricks

Data engineering

API integration

Tools

Databricks (Spark/PySpark)

Delta Live Tables

Delta Lake

ETL pipelines

Job description

Irth Solutions is seeking a Mid-level Data Engineer to design, build, and maintain data ingestion and processing pipelines in Databricks. The role focuses on transforming external data sources into clean, analysis-ready inputs for stakeholders and downstream analysis, supporting our Stakeholder Engagement offering.

You will work closely with Data Scientists and application teams to ensure reliable pipelines, scalable storage, and well‑documented data structures, with a focus on quality and