Remote Data Engineer - Databricks & GCP Pipelines

AgileEngine, LLC.; Warszawa; Hybrid; PLN 435,000 - 593,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based pay

Exciting projects

Flextime with remote/office options

Job summary

AgileEngine, LLC. seeks a Data Engineer in Warsaw to develop scalable ETL/ELT pipelines using Databricks, PySpark, and SQL. You will build agentic workflows to automate data engineering and operational tasks, integrating with Databricks, GCP, BigQuery, and Delta Lake.

The role requires strong SQL, production-grade data solutions experience, and a focus on data quality, testing, and monitoring. Flexible remote/office options are offered.

Qualifications

• 5+ years hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills.
• GCP experience, especially BigQuery.
• Delta Lake and modern data lake/lakehouse architectures.
• Strong ETL/ELT, data pipeline design, performance optimization, data quality.
• Experience building reliable, scalable production-grade data solutions.
• Strong analytical and troubleshooting skills.
• Understanding of testing, version control, deployment, monitoring and production support.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes such as data validation, issue identification, troubleshooting, and workflow execution.
• Integrate agentic capabilities with Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions to support new business requirements and datasets.
• Build reusable frameworks and components across data engineering and business use cases.
• Implement data quality checks, monitoring, validation, exception handling, and production controls.
• Optimize PySpark and SQL workloads for performance, reliability, and scalability.
• Support testing, deployment, productionization, and ongoing enhancement of data and agentic solutions.
• Troubleshoot complex data and production issues and implement sustainable solutions.
• Collaborate with business, data engineering, and platform teams to identify further automation opportunities.

Skills

Databricks

PySpark

Advanced SQL

ETL/ELT design

Data pipelines

Performance optimization

Data quality

Troubleshooting

Production support

Tools

GCP

BigQuery

Delta Lake

Job description

AgileEngine, LLC. seeks a Data Engineer in Warsaw to develop scalable ETL/ELT pipelines using Databricks, PySpark, and SQL. You will build agentic workflows to automate data engineering and operational tasks, integrating with Databricks, GCP, BigQuery, and Delta Lake.

The role requires strong SQL, production-grade data solutions experience, and a focus on data quality, testing, and monitoring. Flexible remote/office options are offered.