Senior Data Engineer - AI Platforms & Databricks

V4C.ai; Oregon; Hybrid; USD 140,000 - 190,000; Full time

Job summary

V4C.ai is seeking a Senior Data Engineer in Oregon to advance our AI strategy by designing, building, and optimizing scalable data platforms. You will contribute to data architecture, pipeline optimization, and actionable intelligence across teams, with a focus on Databricks and secure, scalable data systems.

The role requires expert Databricks, strong software engineering skills, and a proven ability to deliver robust data platforms for AI and ML capabilities.

Qualifications

• Bachelor's degree in a technical field and hands-on delivery mindset.
• Experience with SDLC in data platform solutions and cross-functional collaboration.

Responsibilities

• Design scalable data architecture for large-scale platforms.
• Establish best practices for modular, maintainable data engineering code.
• Develop greenfield data pipelines for production use.
• Design data-driven solutions addressing cybersecurity challenges.
• Architect end-to-end data platforms with performance considerations.
• Collaborate with DevOps and MLOps to monitor pipelines and ML workflows.
• Improve model and pipeline performance to meet latency and cost targets.
• Evaluate third-party AI tools against internal solutions for ROI.
• Establish data governance, quality, and security standards for AI models.
• Develop incremental development strategies and production release plans.
• Serve as SME for data engineering within AI team.
• Ensure pipelines are reliable, scalable, and production-ready.

Skills

Databricks

Python

PySpark

Pandas

SQL

Data modeling

Education

Bachelor's degree in Engineering, Computer Science, or related field

Advanced degree in Engineering, Computer Science, ML or AI (preferred)

Tools

Databricks Lakehouse

Delta Lake

LangChain

LangSmith

TensorFlow

PyTorch

Keras

IaC (Infrastructure as Code)

Job description

V4C.ai is seeking a Senior Data Engineer in Oregon to advance our AI strategy by designing, building, and optimizing scalable data platforms. You will contribute to data architecture, pipeline optimization, and actionable intelligence across teams, with a focus on Databricks and secure, scalable data systems.

The role requires expert Databricks, strong software engineering skills, and a proven ability to deliver robust data platforms for AI and ML capabilities.