Dremio: Senior Staff Software Engineer – Query Execution Dremio

Mosaec; Portugal; Teletrabalho; EUR 120 000 - 180 000; Tempo integral

Resumo da oferta

Dremio is seeking a Senior Staff Software Engineer to join the Query Execution team, driving the runtime responsible for executing analytical queries at scale.

You will design and implement query operators, optimize memory and scheduling, and collaborate across teams to improve performance and reliability on the cloud data platform.

Qualificações

• Must have senior-level experience in building high-performance query execution engines.
• Strong background in JVM internals, garbage collection, and memory management.
• Experience tuning distributed systems for scalability and reliability.

Responsabilidades

• Build the execution engine: design, implement, test, and support query operators and runtime components.
• Improve runtime performance: optimize vectorized processing, concurrency, memory usage, and data exchange.
• Diagnose complex performance and correctness issues using profiles, telemetry, and production data.
• Collaborate with Planner, Datalake, Product and Support teams on end-to-end improvements.
• Apply AI-assisted development tools to code comprehension, debugging, and test generation.

Conhecimentos

Query execution

JVM optimization

Performance tuning

Distributed systems

Profiling tools

Ferramentas

Java

Profiling tools

Descrição da oferta de emprego

Headquarters: Portugal – Remote

Be Part of Building the Future

Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at www.dremio.com.

About the role

Dremio’s Query Execution team builds the runtime responsible for executing analytical queries at scale. The team sits between query planning and table scans, owning the systems that turn query plans into efficient, reliable execution.

As a Senior Staff Software Engineer, you’ll work on query operators, expression evaluation, memory management, execution scheduling, runtime planning, and performance optimization. Your work will directly affect query performance, scalability, and reliability across Dremio’s cloud data platform.

What you’ll be doing

• Build the execution engine: Design, implement, test, and support query operators, expression evaluation, execution scheduling, runtime planning, and resource management.
• Improve runtime performance: Optimize vectorized processing, concurrency, parallelism, memory usage, data exchange, and disk spilling.
• Diagnose difficult problems: Investigate query correctness and performance issues using query profiles, profiling tools, telemetry, benchmarks, logs, and production data.
• Optimize Java and the JVM: Improve CPU utilization, allocation behavior, garbage collection, thread behavior, and other runtime characteristics.
• Collaborate across the query engine: Work with Query Planner, Datalake, Product, Support, and field engineering teams on end-to-end query improvements.
• Use AI-assisted development tools: Apply AI tools to code comprehension, debugging, test generation, documentation, and incident analysis.
• Apply engineering judgment: Validate AI-generated code and recommendations through review, testing, benchmarking, and engineering judgment.
• Raise the engineering bar: Participate in design and code reviews, contribute to technical direction, and mentio...