Data Engineer

Visionaire Partners; Clayton (MO); Hybrid; USD 76,000 - 80,000; Full time

Benefits offered by this job

401k with company match

Health, dental, vision insurance

Life insurance & disability

Flexible Spending Accounts

Job summary

Visionaire Partners invites a data engineer to join a contract opportunity through the end of 2027 in a top notch enterprise environment. You will design and operate modular ETL/ELT workflows with Airflow, SQL, Python, and cloud data lakes, optimize performance, and ensure data quality.

Located in St. Louis, MO, this hybrid role requires 4 days in office and 1 day remote (Friday). The team emphasizes Agile collaboration, CI/CD deployment, and secure data infrastructure with Docker and Kubernetes.

Qualifications

• 4+ years of dedicated data engineering experience focusing on scaling data delivery, automation, and resourcing efficiency.
• Advanced expertise in authoring, scheduling, and optimizing ETL/ELT pipelines and DAGs using Python, SQL, and Apache Airflow.
• Experience with schema design, query performance tuning, and integrating modern cloud data lakes and data warehousing solutions.
• Hands-on experience with cloud platform infrastructure, Docker, Kubernetes, and automated CI/CD deployment pipelines.
• Proven ability to perform root cause analysis, resolve pipeline failures/outages, and document technical workflows in an Agile environment.

Responsibilities

• Author, schedule, and maintain modular ETL/ELT workflows and DAGs using Apache Airflow and custom providers.
• Develop and tune complex SQL scripts and database schemas, optimizing cloud resource utilization and data warehousing structures.
• Configure, deploy, and manage data infrastructure using Docker or Kubernetes with CI/CD pipelines.
• Monitor pipeline health to perform root cause analysis during DAG failures or outages and drive data quality improvements.
• Collaborate in an Agile environment to document data architectures and troubleshooting workflows while seeking automation opportunities.

Skills

Data engineering

ETL/ELT pipelines

Python

SQL

Apache Airflow

DAG scheduling

Root cause analysis

Agile collaboration

Documentation

Automation

Tools

Apache Airflow

Docker

Kubernetes

Python

SQL

CI/CD

Cloud platforms

Job description

Exciting contract opportunity for someone who loves technology, and is highly motivated to be successful and grow their career as a Data Engineer within a top notch enterprise environment.

Responsibilities

• Author, schedule, and maintain modular ETL/ELT workflows and DAGs using Apache Airflow and custom providers, ensuring seamless data integration across distributed storage and modern cloud data lakes/warehouses.
• Develop and tune complex SQL scripts and database schemas, continually resolving performance bottlenecks, optimizing cloud resource utilization, and maintaining efficient data warehousing structures.
• Configure, deploy, and manage data infrastructure using Docker or Kubernetes, integrating custom connectors and CI/CD deployment pipelines under strict operational and security guidelines.
• Monitor pipeline health to perform root cause analysis during DAG failures or database outages, proactively reducing recurring errors and establishing high data quality standards.
• Collaborate in an Agile environment to document data architectures and troubleshooting workflows while continuously identifying opportunities to automate and scale data delivery systems.

This is a contract opportunity through the end of 2027. Candidates must be located in St. Louis, MO and work 4 days a week in office and 1 day remotely (Friday)!

Visionaire Partners offers all full-time W2 contractors a comprehensive benefits package for the contractor, their spouses/domestic partners, and dependents. Options include 401k with up to 4% match, medical, dental, vision, life insurance, short and long term disability, critical illness, hospital indemnity, accident coverage, and both Medical and Dependent Care Flexible Spending Accounts.

Required Skills

• 4+ years of dedicated data engineering experience with a focus on scaling data delivery, automation, and optimizing system resources
• Advanced expertise in authoring, scheduling, and optimizing complex ETL/ELT pipelines and DAGs using Python, SQL, and Apache Airflow.
• Demonstrated experience in schema design, query performance tuning, and integrating modern cloud data lakes and data warehousing solutions.
• Hands-on experience with cloud platform infrastructure, Docker, Kubernetes, and automated CI/CD deployment pipelines.
• Proven ability to perform root cause analysis, resolve pipeline failures/outages, and maintain comprehensive technical documentation in an Agile environment.

Must be authorized to work in the US. Sponsorships are not available.

Pay range: $55-58/hour W2