Chief Data Architect

Bebeedata; Porto Alegre; Presencial; BRL 200.000 - 250.000; Tempo integral

Resumo da oferta

A leading data solutions firm is seeking an experienced Cloud Data Engineer to join their team in Porto Alegre, Brazil. This role will involve designing and developing scalable data processing pipelines in a cloud environment, using technologies such as Apache Spark. The ideal candidate will work closely with data scientists and business stakeholders to deliver high-quality datasets. The firm offers an extensive benefits package including health insurance, meal vouchers, and childcare support.

Serviços

Health insurance

Dental plan

Life insurance

Transportation assistance

Meal vouchers

Childcare support

Qualificações

• Experience in designing and developing data processing pipelines in a cloud environment.
• Proficiency with big data technologies, specifically Apache Spark.
• Knowledge of best practices for data security and governance.

Responsabilidades

• Create high-performance data processing solutions using big data technologies.
• Optimize data workflows/pipelines for performance and scalability.
• Implement best practices for data security and compliance.
• Develop CI/CD pipelines for data engineering workflows.
• Monitor and enhance existing data solutions for reliability.

Conhecimentos

Apache Spark

Data processing solutions

Data pipelines

Cloud infrastructure

Data governance

Descrição da oferta de emprego

Cloud Data Engineer Position We are seeking an experienced Cloud Data Engineer to lead the design, development, and maintenance of scalable data processing pipelines in a cloud environment. This role involves working closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality datasets.

Key responsibilities include:

• Creating high-performance data processing solutions using big data technologies like Apache Spark on cloud-based platforms.
• Optimizing data workflows / pipelines for performance, scalability, and cost-effectiveness in a cloud infrastructure.
• Implementing best practices for data security, governance, and compliance.
• Developing continuous integration / continuous deployment (CI / CD) pipelines for data engineering workflows.
• Monitoring, troubleshooting, and enhancing existing data solutions for reliability and performance.
• Documenting design patterns, best practices, and operational procedures.
• The successful candidate will be part of a collaborative and innovative team that values teamwork and professional growth.

Our organization offers a comprehensive benefits package including health insurance, dental plan, life insurance, transportation assistance, meal vouchers, childcare support, and more.