Senior AI Data Engineer - Scalable Pipelines & Apps

dfa; Kansas City (KS); On-site; USD 140,000 - 180,000; Full time

Job summary

dfa in Kansas City seeks a senior data engineer to design, build, and support secure, scalable data pipelines connecting enterprise data sources to AI/ML models. You will ensure data accuracy, governance, and reliable delivery while enabling AI-enabled applications with frontend support using TypeScript, JavaScript, Vue, and Quasar.

Collaborate with software engineers, data architects, and product teams to align data solutions with model requirements and enterprise standards.

Qualifications

• Undergraduate degree in Computer Science, Data Engineering, Information Systems, or related field.
• 8+ years data engineering, software development, or related experience, including data pipelines for AI/ML systems.
• Proficiency with Python, SQL, PySpark, Snowflake, Databricks, and Apache Airflow.
• Experience developing or supporting modern SPAs using TypeScript/JavaScript, preferably Vue and Quasar, with API integration.
• Strong knowledge of relational/NoSQL databases, data warehouses or lakes, Azure Data Factory, and Kafka.
• Experience with at least one cloud data ecosystem (prefer Azure) and IaC/CI/CD practices.
• Certifications in cloud data engineering or data privacy/security and experience with MLOps preferred.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines for AI/ML data
• Ensure data accuracy, currency, reliability, and security with cleansing, validation, and monitoring
• Troubleshoot complex integration and performance issues, remove bottlenecks, apply caching and distributed processing
• Own AI data infrastructure components with monitoring, logging, data lineage, and quality metrics
• Apply enterprise architecture, AI governance, privacy, security, coding, and CI/CD standards; communicate risks to leadership

Skills

Data engineering

AI/ML pipelines

ETL/ELT design

Troubleshooting

Cross-team collaboration

APIs integration

Cloud data ecosystems

English communication

Education

Bachelor's degree in CS/Data Eng/IS

Tools

Python

SQL

PySpark

Snowflake

Databricks

Apache Airflow

Azure Data Factory

Kafka

TypeScript

JavaScript

Vue

Quasar

Job description

dfa in Kansas City seeks a senior data engineer to design, build, and support secure, scalable data pipelines connecting enterprise data sources to AI/ML models. You will ensure data accuracy, governance, and reliable delivery while enabling AI-enabled applications with frontend support using TypeScript, JavaScript, Vue, and Quasar.

Collaborate with software engineers, data architects, and product teams to align data solutions with model requirements and enterprise standards.