Big Data Senior - Remote Work

INDI Staffing Services; São Paulo; Remote; BRL 180,000 - 320,000; Full time

Benefits offered by this job

Tailored compensation

Tech-driven tools

Autonomous workflow

Generous leave policies

Diversity & inclusion

Job summary

INDI is seeking a Senior Big Data engineer to join our Development team and work on diverse projects with global, multicultural teams. You will tackle challenging data problems and help deliver scalable analytics solutions.

You will work with Spark, Hadoop, and cloud-based DevOps on AWS, mentor peers, and collaborate with architects, data scientists, and PMs to build robust data pipelines. Remote-friendly and flexible work arrangements are available.

Qualifications

• 6+ years of software development experience.
• 5+ years of Big Data experience.
• Advanced English language proficiency.
• Ability to work flexibly and remotely.

Responsibilities

• Identify and recommend paradigms and technology choices for batch and realtime ML scenarios.
• Write highly efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with a cross-functional team of Architects, Data scientists, Data engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python or Chef.
• Teach and mentor other engineers on the team.

Skills

Analytical thinking

Troubleshooting

Problem solving

English language proficiency

Tools

Spark

Hadoop

AWS

Java

Python

Chef

Job description

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role:

We are looking for Big Data Seniors to join our Development team and participate in different projects made up of multicultural teams distributed throughout the world. We are looking for proactive people, team players passionate about programming in this language and oriented to provide the best experience to the end user. This is an excellent opportunity for those professionals looking to develop in one of the fastest growing companies in the industry!

These developers will face numerous technical challenges, so they must use current technologies, get involved in the mobile world, web applications, devices, etc.

Key responsibilities:

• Identify and recommend the most appropriate paradigms and technology choices for batch and realtime ML scenarios.
• Write highly efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with a x-functional team of Architects, Data scientists, Data engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python or Chef.
• Teach and mentor other engineers on the team.

Requirements:

• 6+ years of experience working as a developer.
• 5+ years of experience in Big Data.
• Proficient with analysis, troubleshooting, and problem solving.
• Hands-on experience with managing data loads and data quality a plus.
• Advanced English level.
• Flexibility: Choose where and how you work for enhanced creativity and innovation.
• Tailored Compensation: Personalize your earnings to suit your financial goals.
• Tech-Driven Tools: Access cutting-edge resources for seamless collaboration and productivity.
• Autonomous Workflow: Take control of your schedule to achieve work-life balance.
• Well-being: Enjoy generous leave policies for rest and rejuvenation.
• Diversity & Inclusion: Thrive in a diverse and inclusive environment.
• Collaboration: Engage with industry leaders for collective growth.
• Development: Access mentorship and growth opportunities for continuous advancement.