Software Engineer 2, Data Lake Engineering

WEX Inc.; Brasil; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

Join a forward-thinking company as a Software Engineer in Data Lake Engineering, where you'll contribute to innovative Data Lakehouse solutions that drive AI and machine learning initiatives. This exciting role offers the chance to work with cutting-edge technologies like AWS and Azure, while collaborating with a talented team of engineers. You'll tackle challenging problems that have a significant business impact, gain hands-on experience with containerization and CI/CD pipelines, and continuously learn from your peers. If you're eager to grow your career in a dynamic environment and make a real difference, this opportunity is perfect for you.

Qualificações

• Bachelor's degree in Computer Science or equivalent experience required.
• Strong programming skills in Java, Python, or similar languages.

Responsabilidades

• Collaborate with stakeholders to understand Data and AI requirements.
• Design and maintain a Data Lakehouse on AWS and Azure.

Conhecimentos

Problem-solving skills

Strong programming skills (Java, Python, C/C++, Golang)

Excellent communication skills

Collaboration skills

Scripting skills (Python, Bash)

Formação académica

Bachelor's degree in Computer Science or related field

Master's or PhD in Computer Science

Ferramentas

AWS

Azure

Docker

Kubernetes

CI/CD tools (Jenkins, GitLab CI/CD)

Monitoring tools (Prometheus, Grafana, CloudWatch)

Descrição da oferta de emprego

Software Engineer 2, Data Lake Engineering

Software Engineer 2, Data Lake Engineering

Apply locations Brazil - Remote time type Full time posted on Posted 30+ Days Ago job requisition id R16763

About the Team/Role

We are looking for a highly motivated and high-potential entry-level Engineer to join our Data Lake engineering team to make significant contributions to our Data Lakehouse product and grow your career.

This is a really exciting time to be in the Data Lake engineering team at WEX. The team has an opportunity to create a brand new Data Lakehouse that powers our Data, AI and machine learning initiatives. We work with cutting-edge technologies like AWS, Azure, Docker, and Kubernetes to create a dynamic environment that supports the development and deployment of AI models at scale.

We have challenging problems with huge business impact potential for you to work on and grow. We also have a strong team with highly talented and skillful engineers and leaders to support, guide, and coach you.

If you dream to be a strong engineer who can solve tough problems, generate big impacts, and grow fast, this is a great opportunity for you!

How you’ll make an impact

1. Collaborate with partners/stakeholders to understand the requirements of our Data and AI development teams and key challenges.

2. Learn and practice designing, building, and maintaining a Data Lakehouse on AWS and Azure to support Data and AI/ML workloads.

3. Gain hands-on experience with containerization technologies (Docker) and orchestration platforms (Kubernetes).

4. Learn and implement CI/CD pipelines for automating the deployment and management of AI infrastructure.

5. Develop and maintain monitoring and alerting systems to ensure the health and performance of production Data Lakehouse infrastructure.

6. Learn to analyze system performance data to identify bottlenecks and opportunities for improvement.

7. Learn from your peers and foster continuous learning of new cloud technologies and best practices.

8. Learn our team’s processes and best practices and apply them to given tasks with help from peers and your manager. Make sure to understand the underlying problems you try to solve with these tasks, and your implementations effectively address these problems in a reliable and sustainable way.

9. Partner with team members in development and problem-solving.

10. Proactively seek reviews from senior engineers on your work to ensure quality.

Experience you’ll bring

1. Bachelor's degree in Computer Science, Software Engineering, or a related field. OR demonstrable equivalent deep understanding, experience, and capability.

2. A Master's or PhD degree in Computer Science (or related field) is a plus.

3. Good experience in software engineering or cloud infrastructure, with a focus on supporting AI/ML workloads.

4. Demonstrable strong programming skills in a 3GL strongly-typed language like Java, Python, C/C++ or Golang.

5. Experience in Spark or Flink is a big plus.

6. Strong understanding of cloud platforms (AWS and Azure), including services relevant to AI/ML (e.g., EC2, S3, EKS, Azure ML, AKS).

7. Hands-on experience with containerization (Docker) and container orchestration (Kubernetes).

8. Experience with building and managing CI/CD pipelines for infrastructure and ML model deployment (using tools like Jenkins, GitLab CI/CD, etc.).

9. Experience with infrastructure monitoring and alerting tools (e.g., Prometheus, Grafana, CloudWatch, Azure Monitor).

10. Strong scripting skills (Python, Bash) for automation and configuration management.

11. Excellent problem-solving skills, with the ability to analyze complex systems and identify performance bottlenecks.

12. Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Qualifications:

1. Experience with CI/CD tools and processes.

2. Familiarity with infrastructure monitoring and alerting tools.