Senior Data Engineer: Ingestion & Cloud Connectors

The Walt Disney Company; Rosario; Ibrido; ARS 92.724.000 - 146.813.000; Tempo pieno

Descrizione del lavoro

Endava is seeking a data engineer to lead the design, development, and optimization of scalable data pipelines and architectures. The role emphasizes building dependable ETL/ELT processes, implementing robust data quality checks, and collaborating with cloud-based data warehouses like Snowflake.

You will design Airflow workflows, contribute to data architecture, and mentor junior engineers while ensuring production reliability and cost-efficient operations across development to production

Competenze

• Experience designing scalable ETL/ELT pipelines.
• Proficiency with Airflow, DBT, and SQL.
• Experience building data architectures and modeling.
• Ability to implement monitoring and observability.
• Mentoring junior engineers.

Mansioni

• Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, validation, and delivery.
• Develop reusable, modular, configuration-driven data processing solutions.
• Contribute to technical architecture and evaluate solutions for scalability, performance, reliability, and maintainability.
• Design and optimize data models, SQL queries, stored procedures, and data processing workflows.
• Design and maintain Airflow workflows, including scheduling, dependencies, retries, monitoring, and error handling.
• Develop automated data validation and quality checks using DBT and SQL.
• Implement monitoring, alerting, and observability for critical data pipelines.
• Troubleshoot and resolve data processing and quality issues.
• Develop data solutions using AWS and cloud-based data warehouse technologies such as Snowflake.
• Work with cloud services for data storage, processing, compute, messaging, and serverless workloads.
• Support data platforms across development, QA, staging, and production environments.
• Optimize data workloads for performance, scalability, reliability, and cost.
• Develop and maintain CI/CD pipelines for data engineering applications and infrastructure.
• Apply Infrastructure-as-Code using Terraform or equivalent technologies.
• Support production deployments, incident resolution, root cause analysis, and continuous improvement.
• Maintain technical documentation, operational runbooks, and troubleshooting guides.
• Take ownership of complex engineering initiatives from design through production.
• Conduct code reviews and promote engineering best practices.
• Mentor junior and mid-level engineers and provide technical guidance.
• Collaborate with architecture, DevOps, product, and other technology teams.

Conoscenze

ETL pipelines

Airflow

DBT

SQL

Data modeling

Cloud (AWS)

Snowflake

Terraform

CI/CD

Observability

Mentoring

Strumenti

Apache Airflow

DBT

SQL tooling

Terraform

Snowflake

AWS

Descrizione del lavoro

Endava is seeking a data engineer to lead the design, development, and optimization of scalable data pipelines and architectures. The role emphasizes building dependable ETL/ELT processes, implementing robust data quality checks, and collaborating with cloud-based data warehouses like Snowflake.

You will design Airflow workflows, contribute to data architecture, and mentor junior engineers while ensuring production reliability and cost-efficient operations across development to production