Contractor Remote -Medallion Architecture

Recruise India Consulting; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

Recruise India Consulting is seeking an experienced Data Engineer to design and maintain scalable data pipelines using Databricks and Python, and to implement Medallion Architecture across Bronze, Silver, and Gold layers.

You will develop dbt-based data transformations, integrate Epicor ERP with data platforms, and ensure data quality while delivering reliable ETL/ELT workflows for analytics. This remote role aligns with US EST for collaboration.

Qualifications

• Strong hands-on experience with Databricks and data engineering.
• Practical experience implementing Medallion Architecture.
• Proficiency in Python for data processing and pipeline development.
• Experience with dbt for data transformation, testing, and model management.
• Experience integrating Epicor ERP with data warehouses, lakehouses, or downstream applications.
• Strong understanding of ETL/ELT concepts, data modelling, SQL, and data quality.
• Experience building and troubleshooting production-grade data pipelines.

Responsibilities

• Design, develop, and maintain data pipelines using Databricks and Python.
• Implement Medallion Architecture for Bronze, Silver, and Gold layers.
• Develop, test, and optimize data transformation models using dbt.
• Build and maintain integrations between Epicor ERP and data platforms.
• Develop ETL/ELT workflows to ingest, cleanse, transform, and validate data from multiple sources.
• Optimize data processing performance, pipeline reliability, and data quality.
• Collaborate with business stakeholders and technical teams to understand data requirements.
• Implement data validation, monitoring, error handling, and troubleshooting processes.
• Maintain technical documentation for data pipelines, integrations, and transformation models.

Skills

Databricks

Medallion Architecture

Python

dbt

Epicor ERP integration

SQL

Data quality

ETL/ELT concepts

Data modelling

Production-grade pipelines

Job description

Contract Duration: 12 Months

Work Mode: Remote

Time Zone: Eastern Standard Time (EST)

Engagement Type: Contract

Job Summary

We are looking for an experienced Data Engineer with strong expertise in Medallion Architecture, Databricks, dbt, Python, and Epicor integration. The ideal candidate will be responsible for building and maintaining scalable data pipelines, integrating enterprise data sources, and developing reliable data transformation workflows to support analytics and business reporting.

Key Responsibilities

• Design, develop, and maintain data pipelines using Databricks and Python.
• Implement and manage Medallion Architecture (Bronze, Silver, and Gold layers) for structured data ingestion, transformation, and processing.
• Develop, test, and optimize data transformation models using dbt.
• Build and maintain integrations between Epicor ERP and data platforms, ensuring accurate and reliable data exchange.
• Develop ETL/ELT workflows to ingest, cleanse, transform, and validate data from multiple sources.
• Optimize data processing performance, pipeline reliability, and data quality.
• Collaborate with business stakeholders and technical teams to understand data requirements and deliver scalable solutions.
• Implement data validation, monitoring, error handling, and troubleshooting processes.
• Maintain technical documentation for data pipelines, integrations, and transformation models.

Required Skills

• Strong hands-on experience with Databricks and data engineering.
• Practical experience implementing Medallion Architecture.
• Proficiency in Python for data processing and pipeline development.
• Experience with dbt for data transformation, testing, and model management.
• Experience integrating Epicor ERP with data warehouses, lakehouses, or downstream applications.
• Strong understanding of ETL/ELT concepts, data modelling, SQL, and data quality.
• Experience building and troubleshooting production-grade data pipelines.

Work Requirements

• Must be available to work remotely while aligning with the US Eastern Time Zone (EST/EDT).
• Ability to work independently and collaborate with distributed teams.
• Comfortable working in a 12-month contract engagement.

Preferred Qualifications

• Experience with cloud-based data platforms and lakehouse architectures.
• Familiarity with orchestration tools, version control, and CI/CD practices.
• Experience with Epicor APIs, connectors, or other ERP integration mechanisms.
• Understanding of data governance, security, and access controls.

Contract Duration: 12 months | Location: Remote | Time Zone Alignment: US Eastern Time