AI-Powered Data Engineer: Build Scalable Data Pipelines

NetVerks Inc.; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Altimate AI in San Francisco is seeking a Data Engineer to design and build large-scale data pipelines and AI-powered data solutions. You will optimize SQL workloads, implement data lineage, and integrate with modern tooling like Airflow, dbt, and Snowflake to support thousands of data teams daily.

The role emphasizes cloud-native infrastructure, scalable architectures, and collaboration with AI product teams to advance DataPilot and DataMates initiatives.

Qualifications

• 3–5 years of data engineering building scalable pipelines.
• Strong Python and SQL skills.
• Experience in SQL profiling, optimization, and Snowflake.
• Experience with SQL AST/sqlglot for lineage and ETLs.
• Experience building pipelines with Airflow or dbt.
• Optional knowledge of AWS and Kubernetes.

Responsibilities

• Build PB-scale data pipelines and high-performance data systems.
• Design cloud-native data infrastructure on AWS with Kubernetes and Airflow.
• Develop a SQL intelligence system focusing on query performance and lineage.

Skills

Python

SQL

SQL profiling & optimization

SQL AST analysis

Airflow

dbt

Tools

Snowflake

Airflow

dbt

AWS

Kubernetes

sqlglot

Job description

Altimate AI in San Francisco is seeking a Data Engineer to design and build large-scale data pipelines and AI-powered data solutions. You will optimize SQL workloads, implement data lineage, and integrate with modern tooling like Airflow, dbt, and Snowflake to support thousands of data teams daily.

The role emphasizes cloud-native infrastructure, scalable architectures, and collaboration with AI product teams to advance DataPilot and DataMates initiatives.