Senior Data Engineer: AI Data Platform & Pipelines

V4C.ai; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

V4C.ai is seeking a Senior Data Engineer to advance our AI strategy by designing, developing, and optimizing scalable data platforms. You will work on data engineering within the AI team, shaping data architecture, pipelines, and actionable intelligence.

The ideal candidate has expert Databricks experience, strong software engineering skills, and a track record of building robust, secure data systems for production environments.

Qualifications

• Bachelor's degree in Engineering, Computer Science, or related field.
• Advanced degree in Eng/CS/ML/AI is preferred.
• Hands-on contributor with delivery focus across SDLC.
• At least 4 years with data platform solutions across SDLC.
• At least 2 years on Databricks data pipelines on GCP.

Responsibilities

• Design, develop, refine, and implement high-quality data architecture for large-scale platforms.
• Establish best practices for modular, maintainable data engineering code.
• Develop and maintain greenfield data pipelines and production pipelines.
• Design data-driven solutions addressing cybersecurity challenges.
• Architect end-to-end platforms, evaluating approaches, risks, and performance.
• Hands-on implementation with engineers for data architecture and pipelines.
• Collaborate with DevOps and MLOps to monitor and optimize pipelines and ML workflows.
• Improve model and pipeline performance to meet latency and cost targets.
• Evaluate third-party AI tools vs internal solutions for business value.
• Establish data governance, quality, and security standards for AI models.

Skills

Delivery mindset

Collaboration

Analytical thinking

Self-management

Education

Bachelor's degree in Engineering/CS

Advanced degree preferred in Eng/CS/ML/AI

Tools

Databricks

GCP

Python

PySpark

Pandas

TensorFlow

PyTorch

Keras

LangChain

LangSmith

SQL

Parquet

PostgreSQL

DuckDB

PDF

IaC

Job description

V4C.ai is seeking a Senior Data Engineer to advance our AI strategy by designing, developing, and optimizing scalable data platforms. You will work on data engineering within the AI team, shaping data architecture, pipelines, and actionable intelligence.

The ideal candidate has expert Databricks experience, strong software engineering skills, and a track record of building robust, secure data systems for production environments.