Senior Data Engineer (ADB + Spark)

Exadel Inc; Brasil; Presencial; USD 60.000 - 100.000; Tempo integral

Resumo da oferta

Join a forward-thinking company as a Senior Data Engineer, where your expertise in Apache Spark and Python will drive impactful projects. You'll collaborate with cross-functional teams and lead the charge in developing scalable solutions that meet modern data demands. This role offers a unique opportunity to work with cutting-edge technologies in a dynamic environment, ensuring high-quality deliverables and fostering a culture of learning and collaboration. If you're passionate about data engineering and eager to make a difference, this position is perfect for you.

Qualificações

• 5+ years of software development experience with a focus on data engineering.
• Strong proficiency in Apache Spark and Python for data processing.

Responsabilidades

• Define best practices and coding standards for the project.
• Design and develop scalable Spark applications while optimizing performance.

Conhecimentos

Apache Spark

Python

Data Manipulation (Pandas/Polars)

Analytical Skills

Problem-Solving

Ferramentas

Azure Cloud

Docker

Kubernetes

GitHub Enterprise

FastAPI

Descrição da oferta de emprego

We are looking for a motivated Senior Data Engineer (ADB + Spark) who is willing to dive into a new project with a modern stack. If you’re driven by curiosity to learn and a desire to produce meaningful results, please apply!

Work at Exadel - Who We Are

We don’t just follow trends—we help define them. For 25+ years, Exadel has transformed global enterprises. Now, we’re leading the charge in AI-driven solutions that scale with impact. And it’s our people who make it happen—driven, collaborative, and always learning.

About Our Customer

You will work with the 6th-largest privately owned organization in the United States. The customer is one of the "Big Four" accounting organizations and the largest professional services network in the world in terms of revenue and number of professionals. The company provides audit, tax, consulting, enterprise risk, and financial advisory services to 263,900 professionals globally.

Technologies involved include Azure Cloud, Microservices Architecture, .NET 8, ASP.NET Core, Python, MongoDB, Azure SQL, Angular 18, Kendo UI, and GitHub Enterprise with Copilot.

Requirements

1. 5+ years of hands-on experience in software development
2. Extensive experience working with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric
3. Proficiency in Python, with strong skills in data manipulation using Pandas/Polars and similar libraries
4. Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables
5. Proven expertise in data processing, analysis, and transformation workflows
6. Strong analytical and problem-solving abilities with a detail-oriented mindset
7. Practical and pragmatic approach to balancing standardized processes with flexibility to meet project goals effectively
8. Excellent organizational skills with the ability to self-manage, prioritize tasks, structure workload, and meet tight deadlines

Nice to Have

1. Experience with Azure Cloud services (or other major cloud platforms), including SaaS offerings such as Service Bus, Data Lake, Blob Storage, Redis, etc.
2. Familiarity with FastAPI
3. Experience with containerization and orchestration tools like Docker and Kubernetes
4. Understanding of microservices architecture and its implementation in scalable systems

Intermediate+

Responsibilities

1. Define and enforce best practices and coding standards across the project
2. Conduct thorough code reviews to ensure high code quality and adherence to standards
3. Work independently and collaboratively within the team
4. Communicate clear instructions to team members and manage daily operations
5. Maintain regular communication with the client
6. Design, develop, and maintain scalable Spark applications
7. Write clean, maintainable, and efficient code following best practices
8. Optimize code for performance and scalability
9. Collaborate with cross-functional teams to deliver high-quality solutions
10. Identify and resolve technical issues, ensuring application reliability
11. Create and maintain documentation for code, processes, and workflows
12. Mentor junior developers and foster a collaborative team environment

Apply for this job

* indicates a required field

First Name *

Last Name *

Email *

Phone

Resume/CV

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile

Website

Campaign

Candidate's source

Google Candidate Id

By submitting, I agree to allow Exadel Inc to store and process my data for employment consideration and future opportunities, as per the consent checkboxes.