Data Engineer: Spark, Delta Lake & Cloud Pipelines

ProMach; Bowling Green (KY); On-site; USD 90,000 - 120,000; Full time

Job summary

ProMach is seeking a data engineer to design, build, and maintain data flows between corporate IT systems and ProMach’s data lake. You’ll work with Databricks, Delta Lake, and CI/CD pipelines to ensure data quality and deliver actionable insights for analysts.

Responsibilities include developing scalable ETL/ELT processes, data modeling for lakes and warehouses, and cloud integration across Azure/AWS/GCP. Strong SQL, Python, and communication skills are required; manufacturing domain experience

Qualifications

• Bachelor’s degree in Information Systems, Computer Science, or related field, or equivalent work experience.
• 3-5 years of experience in data engineering or similar role.
• Proficiency in Databricks and Databricks ecosystem (Delta Lake, Databricks Runtime).
• Proficiency in SQL, Python, and Apache Spark.
• Experience with Azure, AWS, or GCP.
• Strong data modeling, ETL/ELT, and data warehousing understanding.
• Experience with CI/CD tools and practices.
• Excellent problem-solving, analytical, and communication skills.
• Eager to learn new skills and deliver where needed.

Responsibilities

• Data Pipeline Development: Design, build, and maintain scalable data pipelines using Databricks, Spark, and Delta Lake.
• ETL/ELT Processes: Develop and manage robust ETL/ELT workflows from diverse source systems.
• Monitor and resolve issues with scheduled data jobs.
• Data Architecture and Modeling: Contribute to modeling for data lakes and warehouses.
• Provide guidance on architecture and platforms for reporting and analytics.
• Cloud Integration: Integrate data solutions with Azure, AWS, or GCP.
• Data Quality and Governance: Implement data quality checks and governance practices.
• Automation: Maintain CI/CD pipelines to automate deployment and workflows.
• Collaboration: Work with analysts and stakeholders to define data requirements.

Skills

Databricks

SQL

Python

Apache Spark

Azure

AWS

GCP

Data modeling

ETL/ELT

CI/CD practices

Communication skills

Education

Bachelor’s Degree in Information Systems or Computer Science or equivalent

Tools

Databricks

Delta Lake

Tableau

Databricks SQL

Job description

ProMach is seeking a data engineer to design, build, and maintain data flows between corporate IT systems and ProMach’s data lake. You’ll work with Databricks, Delta Lake, and CI/CD pipelines to ensure data quality and deliver actionable insights for analysts.

Responsibilities include developing scalable ETL/ELT processes, data modeling for lakes and warehouses, and cloud integration across Azure/AWS/GCP. Strong SQL, Python, and communication skills are required; manufacturing domain experience