Data Engineer Databricks, dbt & Epicor Integration Contract

Recruise India Consulting; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Recruise India Consulting is seeking an experienced Data Engineer to design and maintain scalable data pipelines in a remote, EST-aligned contract role. You will work with Databricks, Medallion Architecture, dbt, Python, and Epicor integrations to support analytics and reporting.

You will build and optimize data transformations, ensure data quality, and collaborate with business stakeholders and technical teams across distributed locations.

Qualifications

• Hands-on Databricks experience and data engineering expertise.
• Practical experience implementing Medallion Architecture.
• Proficiency in Python for data processing and pipelines.
• Experience with dbt for data transformation and testing.
• Experience Epicor ERP integration with data platforms.
• Strong knowledge of ETL/ELT concepts, SQL, and data quality.
• Experience building production-grade data pipelines.

Responsibilities

• Design, build, and maintain data pipelines using Databricks and Python.
• Implement Medallion Architecture (Bronze, Silver, Gold).
• Develop dbt models and tests.
• Build Epicor ERP integrations with data warehouses.
• Develop ETL/ELT workflows ingesting, transforming and validating data.
• Optimize pipeline performance and data quality.
• Collaborate with stakeholders to translate data requirements.
• Maintain documentation for pipelines and integrations.

Skills

Python

ETL/ELT concepts

SQL

Data modelling

Data quality

Production-grade pipelines

Tools

Databricks

Medallion Architecture

dbt

Epicor ERP

Job description

Contract Duration: 12 Months

Work Mode: Remote

Time Zone: Eastern Standard Time (EST)

Engagement Type: Contract

Job Summary

We are looking for an experienced Data Engineer with strong expertise in Medallion Architecture, Databricks, dbt, Python, and Epicor integration. The ideal candidate will be responsible for building and maintaining scalable data pipelines, integrating enterprise data sources, and developing reliable data transformation workflows to support analytics and business reporting.

Key Responsibilities

• Design, develop, and maintain data pipelines using Databricks and Python.
• Implement and manage Medallion Architecture (Bronze, Silver, and Gold layers) for structured data ingestion, transformation, and processing.
• Develop, test, and optimize data transformation models using dbt.
• Build and maintain integrations between Epicor ERP and data platforms, ensuring accurate and reliable data exchange.
• Develop ETL/ELT workflows to ingest, cleanse, transform, and validate data from multiple sources.
• Optimize data processing performance, pipeline reliability, and data quality.
• Collaborate with business stakeholders and technical teams to understand data requirements and deliver scalable solutions.
• Implement data validation, monitoring, error handling, and troubleshooting processes.
• Maintain technical documentation for data pipelines, integrations, and transformation models.

Required Skills

• Strong hands-on experience with Databricks and data engineering.
• Practical experience implementing Medallion Architecture.
• Proficiency in Python for data processing and pipeline development.
• Experience with dbt for data transformation, testing, and model management.
• Experience integrating Epicor ERP with data warehouses, lakehouses, or downstream applications.
• Strong understanding of ETL/ELT concepts, data modelling, SQL, and data quality.
• Experience building and troubleshooting production-grade data pipelines.

Work Requirements

• Must be available to work remotely while aligning with the US Eastern Time Zone (EST/EDT).
• Ability to work independently and collaborate with distributed teams.
• Comfortable working in a 12-month contract engagement.

Preferred Qualifications

• Experience with cloud-based data platforms and lakehouse architectures.
• Familiarity with orchestration tools, version control, and CI/CD practices.
• Experience with Epicor APIs, connectors, or other ERP integration mechanisms.
• Understanding of data governance, security, and access controls.

Contract Duration: 12 months | Location: Remote | Time Zone Alignment: US Eastern Time