Data Engineer – Insights (AI/ML) | Remote

Irth Solutions; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical Insurance

Flexible Work Options

401(k) Plan

Paid Time Off

Job summary

Irth Solutions is building a modern, multi-cloud data estate using Databricks across AWS, Azure, and GCP. As a Data Engineer, you will implement ingestion pipelines, data quality checks, and governance under the guidance of senior architects.

The role emphasizes hands-on work with Databricks, Spark, Delta Lake, and Unity Catalog in a remote, international setting, focusing on scalable, production-grade lakehouse solutions.

Qualifications

• 3–5 years of experience in Data Engineering, ETL development, or cloud data platform engineering.

Responsibilities

• Build, maintain, and enhance data ingestion pipelines across AWS, Azure, and GCP.
• Develop batch and streaming pipelines using Databricks Workflows, Spark, PySpark, SQL, and Delta Live Tables.
• Implement Bronze → Silver → Gold medallion patterns for ingestion, transformation, and cleansing.
• Configure and maintain Delta Lake storage structures, schemas, partitions, and optimizations.
• Support data governance, profiling, validation, and monitoring per enterprise standards.
• Collaborate with the Senior Data Architect to translate architecture designs into implementation tasks.

Skills

Databricks

Apache Spark

PySpark

SQL

Delta Lake

Delta Live Tables

Cloud data pipelines

Tools

Databricks Workflows

Azure Data Factory

Databricks Lakes/DBX

Unity Catalog

Job description

Irth Solutions is building a modern, multi-cloud data estate using Databricks across AWS, Azure, and GCP. As a Data Engineer, you will implement ingestion pipelines, data quality checks, and governance under the guidance of senior architects.

The role emphasizes hands-on work with Databricks, Spark, Delta Lake, and Unity Catalog in a remote, international setting, focusing on scalable, production-grade lakehouse solutions.