Data Engineer New

NetVerks Inc.; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Altimate AI in San Francisco is seeking a Data Engineer to design and build large-scale data pipelines and AI-powered data solutions. You will optimize SQL workloads, implement data lineage, and integrate with modern tooling like Airflow, dbt, and Snowflake to support thousands of data teams daily.

The role emphasizes cloud-native infrastructure, scalable architectures, and collaboration with AI product teams to advance DataPilot and DataMates initiatives.

Qualifications

• 3–5 years of data engineering building scalable pipelines.
• Strong Python and SQL skills.
• Experience in SQL profiling, optimization, and Snowflake.
• Experience with SQL AST/sqlglot for lineage and ETLs.
• Experience building pipelines with Airflow or dbt.
• Optional knowledge of AWS and Kubernetes.

Responsibilities

• Build PB-scale data pipelines and high-performance data systems.
• Design cloud-native data infrastructure on AWS with Kubernetes and Airflow.
• Develop a SQL intelligence system focusing on query performance and lineage.

Skills

Python

SQL

SQL profiling & optimization

SQL AST analysis

Airflow

dbt

Tools

Snowflake

Airflow

dbt

AWS

Kubernetes

sqlglot

Job description

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative…

Who are we?

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks. Our flagship product, DataPilot, offers advanced data automation capabilities, while our new DataMates technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.

Mission

By leveraging a proprietary framework that combines multiple language models and a custom-built knowledge graph, we enable contextually aware AI agents that integrate seamlessly into existing workflows. Our solutions, including ambient AI for continuous monitoring and optimization, are designed to meet the growing demands of data operations, business intelligence, and analytics in an era of ever-increasing data volumes. Used by thousands of users across the world, and backed by prominent investors , we're positioned at the forefront of the AI-powered data engineering revolution.

Team

You can read more about us in a recently published venture beat article. As a team, we are Silicon Valley veterans who previously created category-defining data and AI products loved by thousands of companies worldwide. We have experienced the journey of a small startup to IPO very closely. We have started on a similar journey again and are backed by prominent advisors and VC firms with multi-billion dollar portfolios.

What are we looking for?

We're in search of a Data Engineer who brings a passion for innovation and problem-solving, not limited to traditional data engineering. This role is for those with deep expertise in building large scale data pipelines, SQL optimization, and cloud infrastructure, excited to design and build the backbone of our AI-powered data solutions. The ideal candidate will play a crucial role in enhancing our AI capabilities, developing high-performance data systems, and integrating advanced AI using the product into thousands of data teams' daily workflows.

Qualifications

• 3-5 years of experience in data engineering, with a focus on building scalable data pipelines and systems
• Strong proficiency in Python and SQL
• Extensive experience with SQL query profiling, optimization, and performance tuning, preferably with Snowflake
• Deep understanding of SQL Abstract Syntax Tree (AST) and experience working with SQL parsers (e.g., sqlglot) for generating column-level lineage and dynamic ETLs
• Experience in building data pipelines using Airflow or dbt
• [Optional] Solid understanding of cloud platforms, particularly AWS
• [Optional] Familiarity with Kubernetes (K8s) for containerized deployments

Why you should join Altimate AI

Projects You'll Work On

• Building PB Scale Data Pipelines: Building highly performant large scale data infrastructure that can scale to 100K+ jobs and handle PB scale data per day.
• Cloud-Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment.
• Intelligent SQL Ecosystem: Design and develop a comprehensive SQL intelligence system encompassing query optimization, dynamic pipeline generation, and data lineage tracking. Leverage your expertise in SQL query profiling, AST analysis, and parsing to create a sophisticated engine focused on query performance improvements, building adaptive data pipelines, and implementing granular column-level lineage.

Impact

• Innovation at the Forefront: Push the boundaries of data engineering by combining traditional techniques with cutting‑off technologies.
• High Visibility: Directly affect the productivity and capabilities of global data teams, as your contributions will be crucial to the daily operations of thousands of users spread across 100s of countries.
• Open Source Contribution: As part of our commitment to the developer community, you will contribute to our open-source initiatives, gaining recognition in the tech community.
• Career Growth: This role is a launchpad into the rapidly advancing field of AI-powered data engineering, offering exposure to state‑of-the-art technologies and generative AI applications.