Senior Data Engineer — AI Data Platform Architect

V4C.ai; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

V4C.ai is seeking a Senior Data Engineer to advance our AI strategy by designing, building, and optimizing scalable data platforms. You will work on data architecture, pipelines, and governance, with a focus on Databricks Lakehouse, Datalake, and ML-enabled workflows.

Strong Python, PySpark, and SQL skills are required, alongside cloud data tooling on GCP. You will collaborate with cross-functional teams, improve production pipelines, and ensure secure, efficient data solutions that support AI

Qualifications

• Bachelor's degree in Engineering, Computer Science or related field.
• 4+ years delivering data platform solutions across SDLC.
• 2+ years mapping requirements into Databricks data pipelines on GCP.
• Hands-on with Databricks Lakehouse, Datalake, and Data Catalog.
• Experience with Databricks Medallion Architecture and data quality decisions.
• Proficient in Python, PySpark, Pandas, SQL, and data processing frameworks.
• Experience with AI/ML tools such as TensorFlow, PyTorch, Keras, LangChain/LangSmith, and IaC.
• Familiarity with Parquet, PostgreSQL, DuckDB, JSON, and PDF formats.

Responsibilities

• Design and implement high-quality data architectures for large-scale platforms.
• Establish best practices for modular, reusable data engineering code.
• Develop and maintain greenfield data pipelines for production use.
• Architect end-to-end data platforms evaluating approaches, risks, and performance.
• Collaborate with DevOps and MLOps to monitor and optimize pipelines and ML workflows.
• Improve model and pipeline performance to meet latency and cost targets.
• Develop data governance, quality, and security standards for AI models.
• Serve as subject matter expert in data engineering for the AI team.
• Ensure pipelines are reliable, scalable, and secure for production workloads.

Skills

Hands-on engineering

SDLC experience

Python

PySpark

Pandas

SQL

AI/ML tools

Databricks Lakehouse

Data modeling

Data pipelines

Education

Bachelor's degree in Engineering, Computer Science, or related field

Advanced degree in Engineering, CS, ML or AI preferred

Tools

Databricks

SQL

PySpark

Google Cloud Platform

Cloud data tooling

Job description

V4C.ai is seeking a Senior Data Engineer to advance our AI strategy by designing, building, and optimizing scalable data platforms. You will work on data architecture, pipelines, and governance, with a focus on Databricks Lakehouse, Datalake, and ML-enabled workflows.

Strong Python, PySpark, and SQL skills are required, alongside cloud data tooling on GCP. You will collaborate with cross-functional teams, improve production pipelines, and ensure secure, efficient data solutions that support AI