Data Engineer - Work from home

Nearsure; São Paulo; Teletrabalho; USD 60.000 - 100.000; Tempo integral

Resumo da oferta

An innovative staff augmentation company is looking for a skilled Data Engineer to join their remote LATAM team. This role offers the opportunity to work on cutting-edge projects in the insurance industry, designing and implementing scalable data solutions using AWS services. You'll collaborate with top talent, enhance your skills, and enjoy a supportive work environment that prioritizes work-life balance. With a focus on autonomy and communication, this position allows you to thrive while contributing to impactful projects. If you're passionate about data engineering and eager to make a difference, this is the perfect role for you!

Serviços

100% remote work

Paid time off

National holidays

Sick leave

Refundable annual credit

Team-building activities

Birthday week off

Qualificações

• 5+ years of experience in Python and Scala for data engineering and ETL.
• Expertise in SQL programming and building scalable data pipelines.

Responsabilidades

• Design and maintain scalable data engineering solutions using AWS.
• Collaborate with teams to develop ETL processes and ensure data quality.

Conhecimentos

Python

Scala

Data Engineering

ETL Processes

SQL Programming

Cloud Computing

Agile Methodologies

Data Quality Assurance

Machine Learning

Collaboration Skills

Formação académica

Bachelor's Degree in Computer Science

Engineering or related field

Ferramentas

AWS

Informatica

Spark

Airflow

Kubernetes

PySpark

SQL Databases

Descrição da oferta de emprego

A remote team never felt so close Join our LATAM team and stay connected while working remotely. We value our team members and candidates interested in our vacancies. Enjoy fun activities like coffee breaks, tech talks, and games with our developers and management teams during your stay with us.

Who needs micromanagement? For us, communication is key, so we focus on working autonomously, with honesty, and respecting diversity. Micromanagement is not part of our corporate values.

Work-life Balance Your well-being is our priority with our People Care team, available from day one to offer support and help with anything from needing someone to talk to, requesting time off or a holiday, or using any of our offered benefits.

Additionally, our Accounts Management team ensures a smooth and effective stay with our clients, fostering a harmonious relationship with both the client and the project.

Here you'll get:

1. USD Salary compensation.
2. 100% remote work but if you feel like connecting with people you can visit co-working spaces all over LATAM allowing you to expand your professional network.
3. Paid time off according to your country’s law without affecting your monthly salary to ensure that you have plenty of time to rest and recharge.
4. Your country’s national holidays to celebrate important events and traditions with your loved ones.
5. Sick or medical leave when needed so that you can take a day off to take care of your health, and have well-being without worrying about work.
6. Refundable annual credit for you to spend on your favorite perks.
7. Team-building activities such as coffee breaks, tech talks, and after-work gatherings with your Nearsure colleagues, to feel close to our community.
8. A day off during your birthday week to enjoy with your family and friends, ensuring that you have a chance to make memories on your special day.

About the project:

As a Data Engineer, you will participate in developing the next generation of truly game-changing products in the Insurance Industry. The company is a leader in providing the most technologically advanced solutions in the insurance industry, dedicated to expanding the horizons of what is possible.

You will be able to:

• Design, develop, maintain, and enhance highly scalable data engineering solutions leveraging AWS services.
• Design, build, document, and implement scalable pipelines with a clear focus on data quality and reliability.
• Ingest and transform structured, semi-structured, and unstructured data from multiple sources.
• Build an enterprise-level ETL/ELT solution.
• Innovate and build proprietary algorithms to tackle complex problems involving interesting data challenges.
• Execute and continually optimize new customer data ingestion and model implementation processes.
• Integrating business knowledge with technical functionalities.
• Collaborate with application engineers, data scientists, product managers, and product delivery teams.
• Develop solutions at the intersection of data and ML.
• Experienced in best practices in using Cloud provider AI services.
• Ability to contribute in an agile, collaborative, and fast-paced environment.
• Monitor workflow performance, reliability, and ensure SLA targets are met.
• Automate existing code and processes using scripting, CI/CD, infrastructure-as-code and configuration management tools.

What will help you succeed in this role:

• Bachelor's Degree in Computer Science, Engineering, or a related field.
• 5+ Years of experience working with Python and Scala for data engineering and ETL. Proven ability to build robust and scalable ETL processes.
• 5+ Years of experience working with data pipeline tools (e.g., Informatica, Spark) and DAG orchestration tools (e.g., Airflow, AWS Step Functions).
• 5+ Years of experience working in the AWS ecosystem or GCP.
• 3+ Years of experience working using cloud provider AI services.
• 3+ Years of experience working with Kubernetes and developing applications at scale.
• 3+ Years of experience developing ETL solutions using AWS services (e.g., S3, IAM, Lambda, RDS, Redshift, Glue, SQS, EKS, ECR).
• 2+ Years of experience working utilizing Scala with Spark or PySpark for large-scale data processing and analysis. Strong understanding of Spark architecture and optimization techniques.
• Expert in SQL programming with relational databases.
• High proficiency in SQL programming and writing complex queries.
• Experience with distributed computing tools (e.g., Spark, Hive).
• Experience with software engineering best practices (e.g., version control, CI/CD, automated testing, DevOps).
• Advanced English Level is required for this role as you will work with US clients. Effective communication in English is essential to deliver the best solutions to our clients and expand your horizons.

Here's what you can expect from our hiring process:

• We'd love to discuss your experience in an interview with our recruiters.

• If all goes well, we'll arrange a technical interview with our top developers to evaluate your skills.

• If you advance to the next stage, you'll have a chance to meet our client and potentially become a part of our amazing team!

Would you like to work alongside top Latin American talent?

Work remotely from Latin America for US clients with Nearsure, a staff augmentation company that values people and culture. Gain cross-cultural expertise and improve your English skills with daily communication in English.

We're excited to have you on board and can't wait to learn more about you.

By applying to this position, you authorize Nearsure to collect, store, transfer, and process your personal data in accordance with our Privacy Policy. For more information, please review our Privacy Policy. (https://www.nearsure.com/privacy-policy)

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology
• Software Development