Senior Data Engineer

Encora; Campinas; Remote; BRL 180,000 - 240,000; Full time

Job summary

Coforge is seeking a Senior Data Engineer to design, implement, and optimize scalable data pipelines in AWS and Snowflake. You will craft production-grade Python solutions, integrate external APIs/SDKs, and contribute to governance, quality, and reliability across the data platform.

Responsibilities include implementing Airflow-based orchestration, dbt transformations, and IaC with Terraform, while ensuring cost efficiency and observability through Grafana and CloudWatch.

Qualifications

• Advanced Python (3.x) in production applications and API integrations.
• Strong T-SQL with performance tuning.
• Snowflake data warehousing and dbt modeling knowledge.
• Experience with AWS services (S3, Lambda, EMR, ECS) and IaC tooling.

Responsibilities

• Design and maintain scalable data pipelines using Airflow (MWAA).
• Develop production-grade Python code for API/SDK integrations and data processing.
• Model and evolve Snowflake warehouse; build transformations with dbt.
• Define architecture, development standards, and best practices.
• Manage infrastructure as code with Terraform.
• Ensure data quality, monitoring and reliability using Grafana and CloudWatch.
• Implement data governance practices including cataloging and lineage.
• Optimize cost and performance across Snowflake, AWS and Spark.
• Build and maintain CI/CD processes for data pipelines and models.

Skills

Python

Data governance

Query tuning

Production-grade code

Tools

Snowflake

dbt

Airflow/MWAA

Terraform

Docker

Grafana

CloudWatch

Job description

Job Title: Senior Data Engineer
Key Skills: Snowflake, T-SQLPython,Terraform, AWS, Docker.
Location: Brazil
Mode: Remote

We are seeking a Senior Data Engineer with strong expertise in Python to design, build, and enhance our data platform utilizing AWS and Snowflake. As a technical reference within the team, you will contribute to architectural decisions while ensuring data quality, reliability, and governance. This role involves developing production-grade Python solutions, including integrations with external APIs and SDKs, as well as custom logic for data pipeline orchestration.

Key Responsibilities

• Design and maintain scalable data pipelines using Airflow (MWAA).
• Develop production-grade Python code for API/SDK integrations, data processing, and custom pipeline orchestration.
• Model and evolve the Snowflake Data Warehouse and build transformations with dbt.
• Define architecture, development standards, and best practices.
• Manage infrastructure as code with Terraform.
• Ensure data quality, monitoring, and reliability using Grafana, CloudWatch, and automated testing.
• Implement data governance practices, including cataloging, lineage, and access control.
• Optimize cost and performance across Snowflake, AWS, and Spark.
• Build and maintain CI/CD processes for data pipelines and models.

Required Skills & Qualifications

• Solid experience as a Data Engineer in production environments.
• Advanced Python (version 3.x), including production applications, external APIs/SDKs, error handling, testing, and maintainable code.
• Advanced T-SQL, including query tuning.
• Experience with Snowflake and dbt.
• Proficiency in AWS, especially S3, Lambda, EMR, and ECS.
• Experience with Terraform or equivalent IaC tools.
• Familiarity with Docker, CD practices.
• Knowledge of DATA MODELING and Data Governance.
• Experience with monitoring and Observability tools.

Preferred Skills

• Experience with APACHE SPARK / PY-SPARK.
• Familiarity with Agentic AI, LLMs, and AWS Bedrock.
• Knowledge of additional AWS services such as Glue, Athena, Secrets Manager, SNS, VPC, EC2, and AppFlow.
• Experience with InfluxDB and OpenSearch.
• Familiarity with Collibra Connect, GUIDEWIRE DATA HUB.
• Experience with Great Expectations or Elementary.
• Familiarity with Azure Devops.
• Knowledge of FinOps and cloud cost optimization.

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.