Data Engineer

LanceSoft, Inc.; São Paulo; Presencial; BRL 200 000 - 320 000; Tempo integral

Resumo da oferta

LanceSoft, Inc. is seeking a Data Engineer in São Paulo to design and maintain ELT/ETL pipelines, optimize Snowflake objects, and automate data workflows. The role requires expertise in SQL, Python, and Snowflake, with exposure to dbt, Airflow, and AWS data services.

The candidate should be proficient in Linux, shell scripting, and containerization using Docker, as the position involves working in Linux environments and deploying containerized data solutions in cloud and local setups.

Qualificações

• Strong proficiency in SQL with complex queries, performance tuning, and data modeling.
• Hands-on Snowflake experience including schema design, optimization, and cost management.
• Experience refactoring and optimizing Snowflake objects and pipelines for large-scale data environments.
• Experience building ELT/ETL pipelines using dbt, Airflow or similar.
• Familiarity with AWS data services including RDS, S3, Aurora and backup/restore mechanisms.
• Python scripting for data pipelines and automation.
• Git and GitHub workflows for collaborative development.
• Linux server environments and shell scripting experience.
• Docker/containerized environments across cloud and local environments.

Responsabilidades

• Build and maintain ELT/ETL pipelines.
• Refactor and optimize Snowflake objects and pipelines for large-scale data environments.
• Develop data pipeline scripting, automation, and tooling support using Python.
• Work with AWS data services including RDS, S3, Aurora and backup/restore mechanisms.
• Manage development workflows using Git and GitHub.
• Work within Linux server environments and support shell scripting and service management.
• Work with Docker and containerized environments across cloud and local environments.

Conhecimentos

SQL

Python

Data Modeling

Shell Scripting

Git/GitHub

Docker

Ferramentas

Snowflake

dbt

Apache Airflow

AWS (RDS S3 Aurora)

Descrição da oferta de emprego

Employment Type: Full-Time Employee (CLT)

Primary Skills: SQL, Python, Snowflake

Experience: 7+ years

About the Role

We are looking for a Data Engineer with strong proficiency in SQL, Python, and Snowflake to work on large-scale data environments. The role involves developing and maintaining ELT/ETL pipelines, optimizing Snowflake objects and pipelines, supporting data-related automation, and working within Linux and containerized environments.

Requirements

• Strong proficiency in SQL, including complex queries, performance tuning, and data modeling.
• Hands-on experience with Snowflake, including schema design, optimization, warehousing best practices, and cost management.
• Experience refactoring and optimizing Snowflake objects and pipelines for large-scale data environments.
• Experience building and maintaining ELT/ETL pipelines using tools such as dbt, Apache Airflow, or similar.
• Familiarity with AWS data services including RDS, S3, Aurora, and backup/restore mechanisms.
• Working knowledge of Python for data pipeline scripting, automation, and tooling support.
• Proficiency with Git and GitHub for version control, branching workflows, pull requests, and collaborative development.
• Ability to work in Linux server environments, including file system navigation, shell scripting, and service management.
• Familiarity with containerization technologies such as Docker across cloud and local environments.

Responsibilities

• Build and maintain ELT/ETL pipelines.
• Refactor and optimize Snowflake objects and pipelines for large-scale data environments.
• Develop data pipeline scripting, automation, and tooling support using Python.
• Work with AWS data services including RDS, S3, Aurora, and backup/restore mechanisms.
• Manage development workflows using Git and GitHub.
• Work within Linux server environments and support shell scripting and service management.
• Work with Docker and containerized environments across cloud and local environments.