Big Data Senior - Remote Work

INDI Staffing Services; Belo Horizonte; Híbrido; BRL 180 000 - 280 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Flexible work location

Tailored compensation

Tech‑driven tools

Autonomous schedule

Generous leave policies

Resumo da oferta

INDI Staffing Services is seeking a Senior Big Data Developer to join the development team and work on multicultural projects globally. You will tackle batch and real-time ML workloads, build scalable Spark jobs, and optimize pipelines on Hadoop clusters.

Proactive, collaborative engineers will mentor others, contribute to DevOps on AWS, and shape data-driven solutions for end users while enjoying flexible work arrangements and competitive compensation.

Qualificações

• 6+ years of experience as a developer.
• 5+ years of experience in Big Data.
• Advanced English level.
• Flexible work location and schedule.

Responsabilidades

• Identify appropriate paradigms and tech choices for batch and real-time ML.
• Write efficient Spark jobs processing large data volumes.
• Optimize Spark jobs on large Hadoop clusters.

Conhecimentos

Big Data

Analytical thinking

Troubleshooting

Data quality

Ferramentas

Spark

Hadoop

AWS

Java

Python

Chef

Descrição da oferta de emprego

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting‑edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role:

We are looking for Big Data Seniors to join our Development team and participate in different projects made up of multicultural teams distributed throughout the world. We are looking for proactive people, team players passionate about programming in this language and oriented to provide the best experience to the end user. This is an excellent opportunity for those professionals looking to develop in one of the fastest growing companies in the industry!

These developers will face numerous technical challenges, so they must use current technologies, get involved in the mobile world, web applications, devices, etc.

Key responsibilities:

• Identify and recommend the most appropriate paradigms and technology choices for batch and realtime ML scenarios.
• Write highly efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with a x-functional team of Architects, Data scientists, Data engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python or Chef.
• Teach and mentor other engineers on the team.

Requirements:

• 6+ years of experience working as a developer.
• 5+ years of experience in Big Data.
• Proficient with analysis, troubleshooting, and problem solving.
• Hands-on experience with managing data loads and data quality a plus.
• Advanced English level.
• Flexibility: Choose where and how you work for enhanced creativity and innovation.
• Tailored Compensation: Personalize your earnings to suit your financial goals.
• Tech-Driven Tools: Access cutting-edge resources for seamless collaboration and productivity.
• Autonomous Workflow: Take control of your schedule to achieve work-life balance.
• Well-being: Enjoy generous leave policies for rest and rejuvenation.

Diversity & Inclusion: Thrive in a diverse and inclusive environment.

Collaboration: Engage with industry leaders for collective growth.

Development: Access mentorship and growth opportunities for continuous advancement.