Data Engineer

CFS; South Bend (IN); Hybride; USD 125 000 - 140 000; Plein temps

Résumé du poste

CFS in South Bend, IN (hybrid) is seeking a Data Engineer to design, build, and optimize reliable data pipelines and systems. The role blends hands-on data engineering with Python/SQL development and automation, leveraging AI tools to improve workflows across the platform.

Responsibilities include ETL/ELT design, data modeling, APIs, and data-driven solutions, with a focus on data quality, security, and performance in a fast-paced environment.

Qualifications

• 5+ years of experience in Data Engineering or related field.
• Strong Python and SQL development skills.
• Experience with data processing libraries such as Pandas and NumPy.
• Hands-on experience designing/maintaining production ETL/ELT workflows.
• Familiarity with workflow orchestration tools (Airflow, Dagster, Prefect).
• Experience with cloud data platforms (Snowflake, Databricks, BigQuery, Redshift).
• Knowledge of data modeling, transformation, validation, and quality management.
• Experience with AI-powered development tools and ML/LLM integrations.

Responsabilités

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Develop automated data collection, integration, and web scraping solutions.
• Create and manage data models, validation frameworks, and monitoring.
• Build APIs and internal apps to improve data accessibility.
• Collaborate with stakeholders to deliver data-driven solutions.
• Leverage AI and automation to enhance workflows.
• Support improvements and evolution of the data platform.
• Ensure data quality, integrity, performance, and security.

Connaissances

Python

SQL

Data engineering

Outils

Pandas

NumPy

Airflow

Dagster

Prefect

Snowflake

Databricks

BigQuery

Redshift

AWS

Docker

Terraform

CI/CD

pgvector

Pinecone

Weaviate

Description du poste

CFS is building and operating modern data solutions, and this Data Engineer role centers on designing, building, and optimizing reliable data pipelines and systems. The position blends hands-on data engineering with automation, Python and SQL development, and the use of AI tools to improve workflows across the platform.

What you will do

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Develop automated solutions for data collection, integration, and web scraping.
• Create and manage data models, validation frameworks, and monitoring processes.
• Build APIs and internal applications to improve data accessibility and usability.
• Work with technical and business stakeholders to deliver data-driven solutions.
• Leverage AI and automation tools to enhance engineering workflows and productivity.
• Support architectural improvements and the ongoing evolution of the data platform.
• Ensure data quality, integrity, performance, and security across systems.

Key skills and experience

• 5+ years of experience in Data Engineering, Software Engineering, or a related field.
• Strong proficiency in Python and SQL.
• Experience with data processing libraries such as Pandas and NumPy.
• Hands-on experience designing and supporting production ETL/ELT workflows.
• Experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or similar platforms.
• Experience with cloud-based data platforms including Snowflake, Databricks, BigQuery, or Redshift.
• Strong understanding of data modeling, transformation, validation, and quality management.
• Experience building automated data acquisition or web scraping solutions.
• Familiarity with AI-powered development tools and machine learning or LLM integrations.
• Strong problem-solving skills and the ability to work independently in a fast-paced environment.

Technologies you will work with

• Python, SQL, Pandas, NumPy
• Airflow, Dagster, Prefect
• Snowflake, Databricks, BigQuery, Redshift
• ETL/ELT
• Machine learning, LLM

Preferred qualifications

• Experience with TypeScript or JavaScript.
• Experience with backend frameworks such as FastAPI, Django, Express, or NestJS.
• Familiarity with React, Next.js, or other modern web frameworks.
• Knowledge of AI applications, RAG architectures, and LLM-powered solutions.
• Experience with AWS or other cloud environments.
• Familiarity with Docker, Terraform, CI/CD pipelines, and Infrastructure as Code.
• Experience working with semi-structured data such as PDFs, spreadsheets, and contracts.
• Experience with vector databases such as Pinecone, Weaviate, or pgvector.
• Previous experience in a high-growth or startup environment.

Location: South Bend, IN (hybrid)

Compensation: USD 125,000 - 140,000 per year

Minimum experience: 5 years