Data Engineer - Build Scalable Pipelines for High-Impact Projects

Rallyday Partners; Northern (KY); Hybrid; USD 120,000 - 145,000; Full time

Job summary

Zeal, an AI-enabled software consultancy now part of Livefront, seeks a Data Engineer to join its data platform across U.S. hubs. You will build scalable pipelines and ensure data quality for Fortune 1000 clients.

The role emphasizes collaboration with stakeholders, adoption of modern tools like Databricks and Airflow, and a focus on performance, reliability, and security. Strong SQL, OLTP/MPP experience, and AI-assisted productivity are valued.

Qualifications

• Solid foundation in data engineering and interest in consulting.
• SQL with performance awareness and parallelism.
• Experience with traditional OLTP databases (Oracle, SQL Server, Postgres).
• Experience with modern data platforms (Databricks, Snowflake, Azure Synapse, Redshift, BigQuery).
• Familiarity with cloud platforms and security basics.
• Experience with data transformation tools (Fivetran, Informatica, DataStage, dbt) or native cloud tools.
• Understanding of Medallion data architectures.

Responsibilities

• Gather and understand requirements for data migration and transformation.
• Design, build, and maintain scalable data pipelines that meet business requirements.
• Collaborate with stakeholders to ensure designs meet project standards and business needs.
• Implement data architectures using appropriate tools for performance and maintainability.
• shepherd pipelines through review and deployment, including testing and CI/CD.
• Monitor pipelines to ensure they meet requirements and expectations.
• Troubleshoot pipelines to maintain stability and effectiveness.
• Document and transfer knowledge within the project team.
• Maintain awareness of business and technical requirements to add value beyond tasks.
• Engage in project meetings to build context.
• Provide input to architecture teams for improvements.
• Ensure data quality, integrity, and availability across systems.
• Contribute to data governance and best practices.

Skills

SQL

OLTP Experience

MPP Experience

Cloud Familiarity

Transformation Tools

Data Architecture

DevOps Basics

Communication

AI Proficiency

Tools

Airflow

Git

CI/CD

Job description

Zeal, an AI-enabled software consultancy now part of Livefront, seeks a Data Engineer to join its data platform across U.S. hubs. You will build scalable pipelines and ensure data quality for Fortune 1000 clients.

The role emphasizes collaboration with stakeholders, adoption of modern tools like Databricks and Airflow, and a focus on performance, reliability, and security. Strong SQL, OLTP/MPP experience, and AI-assisted productivity are valued.