Big Data Senior - Remote Work

INDI Staffing Services; Florianópolis; Hybrid; BRL 200.000 - 300.000; Vollzeit

Zusammenfassung

INDI Staffing Services is seeking Senior Big Data Developers to join our development team and work on projects with multicultural, globally distributed teams. The role focuses on building scalable data processing and ML pipelines, using Spark on big data and cloud-based DevOps on AWS.

You will collaborate with architects, data scientists, engineers, analysts, PMs, and clients to deliver high-impact solutions.

Qualifikationen

• 6+ years of experience as a developer.
• 5+ years of experience in Big Data.
• Advanced English level.

Aufgaben

• Identify and recommend the most appropriate paradigms and technology choices for batch and realtime ML scenarios.
• Write highly efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with a cross-functional team of Architects, Data scientists, Data engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python or Chef.
• Teach and mentor other engineers on the team.

Kenntnisse

Advanced English

Team player

Problem solving

Mentoring

Tools

Spark

Hadoop

AWS

Java

Python

Chef

Jobbeschreibung

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role:

We are looking for Big Data Seniors to join our Development team and participate in different projects made up of multicultural teams distributed throughout the world. We are looking for proactive people, team players passionate about programming in this language and oriented to provide the best experience to the end user. This is an excellent opportunity for those professionals looking to develop in one of the fastest growing companies in the industry!

These developers will face numerous technical challenges, so they must use current technologies, get involved in the mobile world, web applications, devices, etc.

Key responsibilities:

• Identify and recommend the most appropriate paradigms and technology choices for batch and realtime ML scenarios.
• Write highly efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with a x-functional team of Architects, Data scientists, Data engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python or Chef.
• Teach and mentor other engineers on the team.

Requirements:

• 6+ years of experience working as a developer.
• 5+ years of experience in Big Data.
• Proficient with analysis, troubleshooting, and problem solving.
• Hands-on experience with managing data loads and data quality a plus.
• Advanced English level.
• Flexibility: Choose where and how you work for enhanced creativity and innovation.
• Tailored Compensation: Personalize your earnings to suit your financial goals.
• Tech-Driven Tools: Access cutting-edge resources for seamless collaboration and productivity.
• Autonomous Workflow: Take control of your schedule to achieve work-life balance.
• Well-being: Enjoy generous leave policies for rest and rejuvenation.
• Diversity & Inclusion: Thrive in a diverse and inclusive environment.
• Collaboration: Engage with industry leaders for collective growth.
• Development: Access mentorship and growth opportunities for continuous advancement.