Data engineer

Digipal; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work setup

Competitive compensation

Opportunities for growth

Work with global experts

Build digital products for multiple ge

Job summary

DIGIPAL is hiring for a remote Data Engineer to design, build, and optimize data platforms for European and North American clients. You will work on scalable data Lakehouse architectures, implement Delta Live Tables, and drive data quality across pipelines.

The role emphasizes CI/CD, Terraform-like automation, and strong collaboration with cross-functional teams. The position offers a flexible remote setup, competitive compensation, and opportunities for professional growth as part of a global

Qualifications

• Strong experience designing and building production-grade data platforms and pipelines.
• Hands-on with Azure Databricks, Spark, Python, and SQL.
• Proven ability to implement ETL/ELT processes and optimize data workflows.
• Experience with the Azure data ecosystem (ADF, Data Lake, Synapse).
• Familiarity with CI/CD and production support for data platforms.

Responsibilities

• Design, develop, and maintain scalable data solutions across Azure Databricks, Synapse, and Lake environments.
• Build and optimize ETL/ELT pipelines for multi-domain data ingestion and serving.
• Develop data processing with Python, SQL, and Spark; implement DLTs and workflows.
• Support migrations, Unity Catalog adoption, and platform upgrades.
• Collaborate with architects, engineers, analysts, and stakeholders to translate requirements into solutions.

Skills

Azure Databricks

Apache Spark

Python

SQL

Data pipelines

Tools

Azure Data Factory

Azure Data Lake

Azure Synapse Analytics

Delta Live Tables

Databricks workflows

Azure DevOps

Job description

Описание

We are DIGIPAL, a software delivery agency specialising in building high-performing product design and software development teams for clients across Europe and North America. We work with a wide range of organisations from ambitious startups to multinational corporations. We have a unique career opportunity for you to work on building exciting digital products for international clients. Yet, remaining flexible in a remote-only environment and getting a top-tier compensation package.

Задачи

• Design, develop, and maintain scalable data solutions across Azure Databricks, Azure Synapse Analytics, and Azure Data Lake environments.
• Build, maintain, and optimize ETL/ELT pipelines for ingesting, transforming, and serving data from multiple business domains.
• Develop data processing solutions using Python, SQL, and Apache Spark.
• Implement and maintain Databricks workflows, Delta Live Tables (DLT), metadata-driven frameworks, and data orchestration processes.
• Support data platform migration and modernization initiatives, including Unity Catalog adoption, platform upgrades, and architectural improvements.
• Apply Lakehouse architecture principles to build reliable, scalable, and maintainable data solutions.
• Ensure data quality, consistency, reliability, security, and performance across data pipelines and platform components.
• Optimize data processing workloads, pipeline execution, and storage structures to improve performance and reduce infrastructure costs.
• Contribute to CI/CD implementation and deployment automation using Azure DevOps and related tools.
• Support infrastructure automation, monitoring, logging, and operational best practices.
• Troubleshoot production incidents, conduct root cause analysis, and implement long-term corrective actions.
• Collaborate with Data Architects, platform engineers, analysts, and business stakeholders to translate business requirements into technical solutions.
• Participate in solution design and architecture reviews, ensuring alignment with enterprise data architecture, governance standards, and Lakehouse principles.
• Support reporting, analytics, and AI/ML initiatives by providing reliable, high-quality data foundations.
• Promote engineering best practices, contribute to knowledge sharing, and support the technical development of team members.

Требования

• Strong professional experience in Data Engineering, building and maintaining production-grade data platforms and pipelines.
• Hands-on experience with Azure Databricks, Apache Spark, Python, and SQL.
• Proven experience designing, implementing, and optimizing ETL/ELT processes.
• Experience working with the Azure data ecosystem, including Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics.
• Practical experience with Delta Live Tables (DLT) and Databricks workflows.
• Understanding of Unity Catalog, including data governance, access control, and metadata management.
• Solid understanding of Lakehouse architecture and modern data platform design principles.
• Experience with CI/CD practices and deployment automation, preferably using Azure DevOps.
• Familiarity with infrastructure automation, monitoring, logging, and production support.
• Experience improving data pipeline performance, reliability, scalability, and cost efficiency.
• Understanding of data quality, data governance, security, compliance, and operational excellence.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to work independently, take ownership of technical initiatives, and drive tasks through to completion.
• Proactive approach to identifying risks, resolving blockers, and proposing practical improvements.
• English proficiency at B2 level or higher.
• Будет плюсом: Familiarity with Power BI and its integration with data platforms is beneficial; Experience with Azure Data Explorer is an advantage.

Условия

• Remote work setup B2B Contract
• Attractive compensation package
• Opportunities for professional growth and development
• Collaborate with top minds from around the globe
• Build world‑class digital products for European and US markets