We are looking for a highly experienced Data Infrastructure Engineer to help build and improve a technology platform that enables queries to work seamlessly across different database engines and data platforms. This role requires strong expertise in SQL dialects, query transformation, cross-engine compatibility, and data federation. You will work on the challenges of translating, routing, and executing queries across heterogeneous database environments while ensuring consistent results, data integrity, and performance. We are particularly interested in engineers who have worked on database interoperability, SQL transpilers, query federation, database migration, or connectors between different query engines. This is not a traditional database administration or database performance tuning role. We are looking for someone who understands the boundaries and behavioral differences between database engines and has hands-on experience solving compatibility challenges across them.
Key Responsibilities
- Design and implement SQL transpilation and query transformation mechanisms across different database engines and SQL dialects.
- Develop and maintain query routing and engine-selection logic based on query characteristics, metadata, and execution costs.
- Ensure query result consistency across different engines, addressing differences in data types, numeric precision, type coercion, and SQL semantics.
- Build mechanisms for cross-engine validation, schema comparison, data diffing, and result parity testing.
- Develop and integrate database connectors, drivers, and federation layers, including query pushdown and execution offloading.
- Handle unsupported SQL features, dialect incompatibilities, and fallback execution strategies.
- Work with modern data infrastructure technologies and contribute to the reliability and scalability of distributed data processing workflows.
Required Qualifications
- Strong experience with SQL, database systems, and data infrastructure.
- Hands-on experience working across multiple database engines or data platforms.
- Practical experience with at least one of the following:
- SQL transpilation, parsing, or AST manipulation.
- Cross-database compatibility, migration validation, or result parity testing.
- Query federation, routing, pushdown, or execution offloading.
- Database connectors, drivers, or adapters.
- Strong understanding of SQL dialect differences, data type mapping, type coercion, and query semantics.
- Production experience with at least one major data platform, preferably Google BigQuery or Databricks/Spark.
- Ability to investigate and resolve behavioral differences between database engines, ensuring equivalent query results.
Highly Relevant Technologies & Experience
- SQL Transpilation & AST: SQLGlot, Apache Calcite, Substrait, custom SQL parsers and AST manipulation.
- Query Engines: DuckDB, DataFusion, Trino, Presto, Spark SQL, ClickHouse.
- Data Platforms: Google BigQuery, Databricks, Snowflake.
- Data Integration & Connectors: JDBC, ODBC, dbt adapters, Fivetran, Airbyte.
- Data Formats & Table Formats: Apache Arrow, Apache Iceberg, Delta Lake.
- Programming Languages: Python, Rust, Java, or Scala.
What Would Make You Stand Out
- Contributions to open-source projects such as SQLGlot, Apache Arrow, DataFusion, Iceberg, DuckDB, Trino, Ibis, or dbt adapters.
- Experience building automated data comparison or migration validation frameworks.
- Experience ensuring that the same SQL query produces equivalent results across different database engines.
- Experience implementing query routing, engine selection, cost estimation, or query offloading mechanisms.
- Experience developing database connectors, federation layers, or custom SQL dialect extensions.
Ideal Background
Engineers who have worked at companies building database interoperability, data integration, query federation, SQL transformation, or database migration products will be particularly interesting. Relevant backgrounds may include data infrastructure teams at companies such as Datafold, dbt Labs, Tobiko, Starburst, Databricks, Google BigQuery, Fivetran, Airbyte, Dremio, Materialize, SingleStore, or Firebolt. The ideal candidate is someone who has worked across database engines, understands their differences at a technical level, and has built practical solutions to make them interoperate reliably.