Remote Data Engineer — Medallion Arch, Databricks & dbt

Recruise India Consulting; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

Recruise India Consulting is seeking an experienced Data Engineer to design and maintain scalable data pipelines using Databricks and Python, and to implement Medallion Architecture across Bronze, Silver, and Gold layers.

You will develop dbt-based data transformations, integrate Epicor ERP with data platforms, and ensure data quality while delivering reliable ETL/ELT workflows for analytics. This remote role aligns with US EST for collaboration.

Qualifications

• Strong hands-on experience with Databricks and data engineering.
• Practical experience implementing Medallion Architecture.
• Proficiency in Python for data processing and pipeline development.
• Experience with dbt for data transformation, testing, and model management.
• Experience integrating Epicor ERP with data warehouses, lakehouses, or downstream applications.
• Strong understanding of ETL/ELT concepts, data modelling, SQL, and data quality.
• Experience building and troubleshooting production-grade data pipelines.

Responsibilities

• Design, develop, and maintain data pipelines using Databricks and Python.
• Implement Medallion Architecture for Bronze, Silver, and Gold layers.
• Develop, test, and optimize data transformation models using dbt.
• Build and maintain integrations between Epicor ERP and data platforms.
• Develop ETL/ELT workflows to ingest, cleanse, transform, and validate data from multiple sources.
• Optimize data processing performance, pipeline reliability, and data quality.
• Collaborate with business stakeholders and technical teams to understand data requirements.
• Implement data validation, monitoring, error handling, and troubleshooting processes.
• Maintain technical documentation for data pipelines, integrations, and transformation models.

Skills

Databricks

Medallion Architecture

Python

dbt

Epicor ERP integration

SQL

Data quality

ETL/ELT concepts

Data modelling

Production-grade pipelines

Job description

Recruise India Consulting is seeking an experienced Data Engineer to design and maintain scalable data pipelines using Databricks and Python, and to implement Medallion Architecture across Bronze, Silver, and Gold layers.

You will develop dbt-based data transformations, integrate Epicor ERP with data platforms, and ensure data quality while delivering reliable ETL/ELT workflows for analytics. This remote role aligns with US EST for collaboration.