Senior Data Engineer (ADB + Spark)

Exadel open positions; Brasil; Presencial; USD 60.000 - 100.000; Tempo integral

Resumo da oferta

Join a forward-thinking company as a Senior Data Engineer, where you will leverage your expertise in Apache Spark and Python to drive impactful projects. You will collaborate with a talented team, define best practices, and develop scalable data solutions that meet the needs of a prestigious client. This role offers an exciting opportunity to work with cutting-edge technologies in a dynamic environment. If you are passionate about data engineering and eager to make a difference, this position is perfect for you. Embrace the chance to grow and innovate with a leader in the tech industry.

Qualificações

• 5+ years of software development experience required.
• Expertise in data processing, analysis, and transformation workflows.

Responsabilidades

• Define best practices and coding standards across the project.
• Design, develop, and maintain robust Spark applications.
• Provide guidance and mentorship to junior developers.

Conhecimentos

Apache Spark

Python

Data Manipulation (Pandas/Polars)

Analytical Skills

Problem-Solving

Formação académica

Bachelor's Degree in Computer Science or related field

Ferramentas

Databricks

Azure Cloud

Docker

Kubernetes

GitHub Enterprise

Descrição da oferta de emprego

We are looking for a motivated Senior Data Engineer (ADB + Spark) who is willing to dive into the new project with a modern stack. If you’re driven by a curiosity to learn and a desire to produce meaningful results, please apply!

Work at Exadel - Who We Are

We don’t just follow trends—we help define them. For 25+ years, Exadel has transformed global enterprises. Now, we’re leading the charge in AI-driven solutions that scale with impact. And it’s our people who make it happen—driven, collaborative, and always learning.

About Our Customer

You will work with the 6th-largest privately owned organization in the United States. The сustomer is one of the "Big Four" accounting organizations and the largest professional services network in the world in terms of revenue and number of professionals. The company provides audit, tax, consulting, enterprise risk, and financial advisory services to 263,900 professionals globally.

Azure Cloud, Microservices Architecture, .NET 8, ASP.NET Core services, Python, Mongo, Azure SQL, Angular 18, Kendo, GitHub Enterprise with Copilot

Requirements

• 5+ years of hands-on experience in software development
• Extensive experience working with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric
• Proficient in Python, with strong skills in data manipulation using Pandas/Polars and similar
• Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables
• Proven expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving abilities with a detail-oriented mindset
• Practical and pragmatic approach to balancing standardized processes with flexibility to meet project goals effectively
• Excellent organizational skills with the ability to self-manage, prioritize tasks, structure workload, and meet tight deadlines

Nice to have

• Experience working with Azure Cloud services (or other major cloud platforms), including a range of SaaS offerings such as Service Bus, Data Lake, Blob Storage, Redis, and more
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes
• Solid understanding of microservices architecture and its implementation in scalable systems

Intermediate+

Responsibilities

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to ensure adherence to established guidelines and maintain high code quality
• Working both independently and in close collaboration with others in the team
• Communicating clear instructions to team members and helping manage the flow of day-to-day operations
• Communicating with the client regularly
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code following best practices and coding standards
• Optimize code for performance and scalability, ensuring efficient data handling
• Work closely with cross-functional teams to deliver high-quality software solutions
• Identify and resolve technical issues, ensuring the reliability and performance of applications
• Create and maintain comprehensive documentation for code, processes, and workflows
• Provide guidance and mentorship to junior developers, fostering a collaborative and productive team environment

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Resume/CV

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile

Website

Select...

Country of Residence * Select...

What interests you most about this role specifically?

Additional Comment

Are you a resident of the European Union? * Select...

Consent Form

I have read and understood the Privacy Notice detailing how my personal data will be collected, processed, and used. I acknowledge that I can access the Privacy Notice at any time on the Exadel website or by sending an email at [e-mail].*

If you would like us to consider you for other currently open and/or future positions within the Exadel group (full list of Exadel Group companies), please provide the following consent: *

I consent to the processing of my Persona Data for the purpose of evaluating my suitability for other currently open positions within the Exadel Group.

I consent to the retention of my Personal Data for 365 days after completion of my current recruitment process for the purpose of evaluating my suitability for future recruitment and future roles that may become available.

You have the right to withdraw your consent at any time, without affecting the lawfulness of processing based on consent before its withdrawal. This means that any processing carried out prior to the withdrawal of consent will remain valid and lawful. To exercise your right to withdraw consent or if you have any questions regarding the processing of your personal data, please contact us at [e-mail].

By checking this box, I agree to allow Exadel open positions to store and process my data for the purpose of considering my eligibility regarding my current application for employment. *

By checking this box, I agree to allow Exadel open positions to retain my data for future opportunities for employment for up to 365 days after the conclusion of consideration of my current application for employment.