Senior Data Engineer (ADB + Python)

Bonapolia; Deutschland; Vor Ort; EUR 90.000 - 150.000; Vollzeit

Zusammenfassung

Bonapolia seeks a Senior Data Engineer (ADB + Python) to join a client project with a modern stack including Spark, Azure, and microservices.

You will design, develop, and maintain scalable data pipelines, enforce coding standards, review code, collaborate with cross-functional teams, and regularly communicate with the client to ensure delivery of high-quality solutions.

Qualifikationen

• 5+ years of hands-on software development experience.
• Extensive Spark experience, Databricks and/or Azure Synapse/Fabric.
• Proficient in Python with Pandas/Polars.
• Experience with Parquet and Delta Tables.
• Strong data processing and transformation skills.
• Analytical and problem-solving mindset.
• Ability to self-manage and meet tight deadlines.

Aufgaben

• Define and enforce coding standards across the project.
• Conduct thorough code reviews for quality.
• Develop and maintain robust Spark applications.
• Write clean, scalable code following best practices.
• Collaborate with cross-functional teams to deliver software.
• Communicate with the client regularly.
• Create comprehensive documentation for code and workflows.
• Optimize code for performance and scalability.
• Identify and resolve technical issues.
• Manage day-to-day operations and project flow.
• Design and maintain data processing pipelines.

Kenntnisse

Apache Spark

Python

Databricks

Azure Synapse

Delta Lake

Pandas/Polars

Data pipelines

Microservices

Tools

Azure Databricks

Azure Synapse

GitHub Enterprise with Copilot

Jobbeschreibung

We are looking for a motivated Senior Data Engineer (ADB + Python) who is willing to dive into the new project with a modern stack.

About the Client

Our client is one of the Big Four accounting firms and the world’s largest professional services network. Headquartered in London, they operate in 150+ countries with 460,000+ professionals delivering excellence in audit, tax, consulting, and advisory.

The team you will join designs, develops, and deploys innovative enterprise technology and AI-driven tools to support the delivery of tax services. It is a dynamic group combining expertise in tax, software engineering, change management, and project management, working on initiatives from tool design and deployment to training development and engagement management.

Project Tech Stack

Azure Cloud, Microservices Architecture, .NET 8, ASP.NET Core services, Python, MongoDB, Azure SQL, Angular 18, Kendo, GitHub Enterprise with Copilot, LangGraph, LangChain, RAG Pipelines, Multi-modal LLMs

What You’ll Do

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to ensure adherence to established guidelines and maintain high code quality
• Working both independently and in close collaboration with others in the team
• Communicating clear instructions to team members and helping manage the flow of day-to-day operations
• Communicating with the client regularly
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code following best practices and coding standards
• Optimize code for performance and scalability, ensuring efficient data handling
• Work closely with cross-functional teams to deliver high-quality software solutions
• Identify and resolve technical issues, ensuring the reliability and performance of applications
• Create and maintain comprehensive documentation for code, processes, and workflows

What You Bring

• 5+ years of hands-on experience in software development
• Extensive experience working with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric
• Proficient in Python, with strong skills in data manipulation using Pandas/Polars and similar
• Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables
• Proven expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving abilities with a detail-oriented mindset
• Practical and pragmatic approach to balancing standardized processes with flexibility to meet project goals effectively
• Excellent organizational skills with the ability to self-manage, prioritize tasks, structure workload, and meet tight deadlines
• Solid understanding of microservices architecture and its implementation in scalable systems

Nice to have

• Experience working with Azure Cloud services (or other major cloud platforms), including a range of SaaS offerings such as Service Bus, Data Lake, Blob Storage, Redis, and more
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes

English level

Intermediate+