Big Data Senior - Remote Work

INDI Staffing Services; Florianópolis; Ibrido; BRL 250.000 - 420.000; Tempo pieno

Vantaggi offerti da questo lavoro

Flexible work location

Professional growth opportunities

Mentorship program

Generous leave policies

Diversity & Inclusion

Descrizione del lavoro

INDI Staffing Services is seeking a Senior Big Data Developer to join a multinational development team. You will tackle batch and realtime ML workloads, write Spark jobs, and optimize pipelines on Hadoop clusters while collaborating with data scientists and engineers across the globe.

You should bring 6+ years in development and 5+ years in Big Data, strong English skills, and the ability to work flexibly in a distributed setup.

Competenze

• Strong analytical and troubleshooting abilities with a problem-solving mindset.
• Experience working on data-intensive projects with large-scale data processing.
• Comfortable collaborating with cross-functional teams and stakeholders.

Mansioni

• Identify suitable paradigms and tech choices for batch and realtime ML scenarios.
• Write efficient Spark jobs to process terabytes of data.
• Optimize Spark workloads on large Hadoop clusters and monitor performance.
• Perform DevOps on AWS ensuring resiliency, security, and HA/DR.
• Collaborate with Architects, Data scientists, Data engineers, Analysts, PMs, and customers.
• Write clean code and deployment artifacts in Java or Python or Chef.
• Mentor fellow engineers on the team.

Conoscenze

Analytical skills

Troubleshooting

Problem solving

Team collaboration

Strumenti

Spark

Hadoop

Java

Python

AWS

Chef

Descrizione del lavoro

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role:

We are looking for Big Data Seniors to join our Development team and participate in different projects made up of multicultural teams distributed throughout the world. We are looking for proactive people, team players passionate about programming in this language and oriented to provide the best experience to the end user. This is an excellent opportunity for those professionals looking to develop in one of the fastest growing companies in the industry!

These developers will face numerous technical challenges, so they must use current technologies, get involved in the mobile world, web applications, devices, etc.

Key responsibilities:

• Identify and recommend the most appropriate paradigms and technology choices for batch and realtime ML scenarios.
• Write highly efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with a x-functional team of Architects, Data scientists, Data engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python or Chef.
• Teach and mentor other engineers on the team.

Requirements:

• 6+ years of experience working as a developer.
• 5+ years of experience in Big Data.
• Proficient with analysis, troubleshooting, and problem solving.
• Hands-on experience with managing data loads and data quality a plus.
• Advanced English level.
• Flexibility: Choose where and how you work for enhanced creativity and innovation.
• Tailored Compensation: Personalize your earnings to suit your financial goals.
• Tech-Driven Tools: Access cutting-edge resources for seamless collaboration and productivity.
• Autonomous Workflow: Take control of your schedule to achieve work-life balance.
• Well-being: Enjoy generous leave policies for rest and rejuvenation.
• Diversity & Inclusion: Thrive in a diverse and inclusive environment.
• Collaboration: Engage with industry leaders for collective growth.
• Development: Access mentorship and growth opportunities for continuous advancement.