Data Engineer: Databricks & GCP Pipelines for Automation

AgileEngine, LLC.; Santiago del Estero; On-site; ARS 181,906,000 - 272,860,000; Full time

Benefits offered by this job

Professional growth

Competitive USD compensation

Exciting projects

Flextime

Job summary

AgileEngine, LLC. is seeking a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will design and optimize data pipelines, integrate Databricks, GCP, BigQuery, and Delta Lake, and build reusable components to support multiple data use cases. This role emphasizes data quality and production readiness.

Qualifications

• 5+ years hands-on Databricks and PySpark experience.
• Advanced SQL and data processing skills.
• GCP experience with BigQuery.
• Experience with Delta Lake and modern lakehouse architectures.
• Strong ETL/ELT design, performance optimization, and data quality focus.
• Proven ability to build reliable, scalable data solutions.
• Strong analytical and troubleshooting skills.
• Understand testing, version control, deployment, monitoring, and production support.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and PySpark.
• Build and operationalize agentic workflows to automate data engineering tasks.
• Integrate Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop pipelines to support new business data requirements.
• Create reusable data engineering frameworks and components.
• Implement data quality checks, monitoring, and production controls.
• Optimize PySpark and SQL workloads for performance and reliability.
• Support testing, deployment, productionization, and ongoing enhancements.
• Troubleshoot complex data issues and provide sustainable solutions.
• Collaborate with business, data engineering, and platform teams for automation opportunities.

Skills

Databricks

PySpark

Advanced SQL

GCP/BigQuery

Delta Lake

ETL/ELT design

Production-grade data solutions

Data quality & monitoring

Testing & deployment practices

Job description

AgileEngine, LLC. is seeking a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will design and optimize data pipelines, integrate Databricks, GCP, BigQuery, and Delta Lake, and build reusable components to support multiple data use cases. This role emphasizes data quality and production readiness.