Senior Data Engineer (ADB, Python)

United States Digital Space LLC; Poland; Hybrid; PLN 388,000 - 603,000; Full time

Benefits offered by this job

International projects

In-office, hybrid, or remote flex

Medical healthcare

Recognition program

Ongoing learning & reimbursement

Well-being program

Team events & local benefits

Sports compensation

Referral bonuses

Top-tier equipment provision

Job summary

United States Digital Space LLC is seeking a Senior Data Engineer to bring data pipelines to life using Python and PySpark. You will design, develop, and optimize Spark-based solutions, collaborating with cross-functional teams to deliver scalable analytics platforms for enterprise clients.

You will leverage Databricks, Delta Tables, and cloud services to build robust data processing workflows, with a focus on performance, reliability, and clear documentation for stakeholders.

Qualifications

• Solid commercial experience in data engineering.
• Practical experience with SQL stored procedures and Spark SQL/PySpark.
• Expertise using PySpark on Databricks with Delta Tables, cluster mgmt, and automation.
• Proven track record of optimizing Spark performance in production.
• Strong Python skills for complex data manipulation (Polars/Pandas).
• Understanding of Parquet and Delta Tables for columnar storage.
• Experience with data processing, analysis, and transformation workflows.
• Analytical and problem-solving mindset; ability to balance process with flexibility.
• Solid understanding of microservices architecture and scalable systems.

Responsibilities

• Define and enforce coding standards across the project.
• Conduct thorough code reviews to maintain high quality.
• Collaborate with team members and work independently as needed.
• Communicate with the client regularly and manage day-to-day flow.
• Design, develop, and maintain robust Spark applications.
• Write clean, maintainable code following best practices.
• Optimize code for performance and scalability.
• Work with cross-functional teams to deliver high-quality software.
• Identify and resolve technical issues ensuring reliability.
• Create and maintain comprehensive documentation.

Skills

Python

SQL

PySpark

Databricks

Spark SQL

Polars

Pandas

Parquet

Microservices

Tools

Delta Tables

Azure Cloud

Kubernetes

Docker

FastAPI

Job description

Join the company as a Senior Data Engineer and bring logic to life with Python. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team.

Why Join the company

We’re an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Starbucks.

From AI platforms to digital transformation, we partner with enterprise leaders to build what’s next.

What powers it all? Our people are ambitious, collaborative, and constantly evolving.

About the Client

Our client is one of the Big Four accounting firms and the world’s largest professional services network. Headquartered in London, they operate in 150+ countries with 460,000+ professionals delivering excellence in audit, tax, consulting, and advisory.

The team you will join designs, develops, and deploys innovative enterprise technology and AI-driven tools to support the delivery of tax services. It is a dynamic group combining expertise in tax, software engineering, change management, and project management, working on initiatives from tool design and deployment to training development and engagement management.

Project Tech Stack

Azure Cloud, Microservices Architecture, .NET 8, ASP.NET Core services, Python, MongoDB, Azure SQL, Angular 18, Kendo, GitHub Enterprise with Copilot, LangGraph, LangChain, RAG Pipelines, Multi-modal LLMs

What You’ll Do

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to ensure adherence to established guidelines and maintain high code quality
• Working both independently and in close collaboration with others in the team
• Communicate clear instructions to team members and helping manage the flow of day-to-day operations
• Communicate with the client regularly
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code following best practices and coding standards
• Optimize code for performance and scalability, ensuring efficient data handling
• Work closely with cross-functional teams to deliver high-quality software solutions
• Identify and resolve technical issues, ensuring the reliability and performance of applications
• Create and maintain comprehensive documentation for code, processes, and workflows

What You Bring

• Solid commercial experience in data engineering
• Practical experience developing SQL stored procedures and migrating them into Spark SQL or PySpark environments
• Extensive expertise using PySpark on Databricks, encompassing Delta tables, cluster management, and workflow automation
• Proven track record of optimizing Spark performance within production-level projects
• Strong proficiency in Python, specifically for complex data manipulation utilizing libraries like Polars or Pandas
• Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables
• Proven expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving abilities with a detail-oriented mindset
• Practical and pragmatic approach to balancing standardized processes with flexibility to meet project goals effectively
• Solid understanding ofmicroservices architecture and its implementation in scalable systems

Nice to have

• Experience working with Azure Cloud services (or other major cloud platforms), including a range of SaaS offerings such as Service Bus, Data Lake, Blob Storage, Redis, and more
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes

English level

Intermediate+

Legal & Hiring Information

• the company is proud to be an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more.
• Reasonable accommodations are available to enable individuals with disabilities to perform essential functions.
• Please note: this job description is not exhaustive. Duties and responsibilities may evolve based on business needs.
• In anticipation of EU Pay Transparency requirements, compensation details are shared with candidates at the early stage of the recruitment process.
• The offer is not binding until a signed contract is in place.

Your Benefits at the company

the company benefits vary by location and contract type. Your recruiter will fill you in on the details.

• International projects
• In-office, hybrid, or remote flexibility
• Medical healthcare
• Recognition program
• Ongoing learning & reimbursement
• Well-being program
• Team events & local benefits
• Sports compensation
• Referral bonuses
• Top-tier equipment provision

the company Culture

We lead with trust, respect, and purpose. We believe in open dialogue, creative freedom, and mentorship that helps you grow, lead, and make a real difference. Ours is a culture where ideas are challenged, voices are heard, and your impact matters.