Senior Data Engineer

SwiftCruit; Brasil; Presencial; BRL 180 000 - 320 000; Tempo integral

Resumo da oferta

Coforge is hiring a Senior Data Engineer to own end-to-end data pipelines and platform architecture on cloud-based data lakes. You will lead design, development and production readiness from ingest to analytics, ensuring compliance and reliable SLAs.

You will build scalable data products using Azure Databricks, DBT, Python and SQL, drive data quality and observability, manage Terraform-based infra, and collaborate with cross-functional teams across data, product and architecture in a remote

Qualificações

• Strong hands-on expertise with Azure Databricks, DBT, Snowflake, Python and SQL.
• Proven experience building and managing large-scale data pipelines and transformations.
• Experience with Terraform and infrastructure-as-code principles.
• CI/CD pipelines and Git-based version control experience.

Responsabilidades

• Delivery & Ownership of end-to-end data pipelines and data products.
• Develop, maintain, and optimise scalable data pipelines using Azure Databricks, DBT, and Python.
• Ensure production readiness, reliability, and SLAs.
• Migrate data from Snowflake to Azure using Databricks, DBT, and Lakebridge.
• Build and manage infrastructure-as-code with Terraform.
• Ensure integration between legacy systems and Azure data platform.
• Implement data quality frameworks and observability for pipelines.
• Collaborate with cross-functional teams to translate requirements into scalable solutions.

Conhecimentos

Azure Databricks

DBT

Snowflake

Python

SQL

Ferramentas

Terraform

Git

CI/CD

Descrição da oferta de emprego

Job Title: Senior Data Engineer

Key Skills:DBT, Python, SQL, Snowflake, Databricks

Location:Brazil

Mode:Remote

We atCoforgeare hiringSenior Data Engineerwith the following skill set.

Key Responsibilities

• Delivery & Ownership
• Own the end-to-end delivery of data pipelines and data products, from design through deployment and production support
• Develop, maintain, and optimise scalable data pipelines using Azure Databricks, DBT, and Python
• Ensure solutions are production-ready, reliable, and meet defined SLAs
• Migration & Platform Engineering
• Execute and support migration of data from Snowflake (AWS) to Azure using Databricks, DBT, and Lakebridge
• Build and manage infrastructure-as-code using Terraform to enable scalable and repeatable deployments
• Ensure seamless integration between legacy systems and the Azure data platform
• Data Quality, Observability & Governance
• Implement data quality frameworks (e.g., DBT testing, validation rules) to ensure trusted data pipelines
• Enable observability through logging, monitoring, and alerting of pipelines and data workflows
• Support data governance standards including data lineage, consistency, and compliance requirements
• Architecture & Engineering Excellence
• Contribute to the design and architecture of scalable data solutions, aligned with lakehouse principles
• Apply best practices in data modelling, performance optimisation, and cost efficiency
• Follow and promote engineering standards, including modular design and reusable components
• Production Support & Reliability
• Monitor and maintain data pipelines in production, ensuring high availability and performance
• Troubleshoot issues and perform root cause analysis (RCA) for incidents
• Continuously improve system stability, resilience, and operational processes
• Collaboration & Technical Leadership
• Work closely with cross-functional teams (data, product, architecture, business) to translate requirements into scalable technical solutions
• Provide guidance and mentorship to junior engineers through code reviews and best practicesContribute to documentation of architecture, pipelines, and operational processes

Required Skills & Qualifications

• Strong hands-on expertise with:Azure Databricks,DBT,Snowflake,Python and SQL
• Proven experience building and managing large-scale data pipelines and transformations
• Experience working with high-volume datasets (e.g., terabytes, complex data models, multiple pipelines)
• Solid understanding of:Data modelling and ETL/ELT frameworks,Distributed data systems and lakehouse architectures,Experience with Terraform and infrastructure-as-code principles
• Strong experience with CI/CD pipelines and Git-based version control
• Experience supporting production systems, including monitoring, alerting, and incident resolution
• Knowledge of data quality, testing, and observability frameworks
• Strong problem-solving and analytical skills
• Excellent communication skills with the ability to work across technical and non-technical stakeholders
• Experience in insurance or financial services domains is highly desirable

Preferred Skills:

• Experience with real-time/streaming technologies (Kafka, Event Hubs, Delta Live Tables)
• Knowledge of security, compliance, and data protection standards in regulated industries
• Experience with cost optimisation and performance tuning in cloud environments
• Exposure to multi-cloud or hybrid architectures

Posted On:14-07-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.