Azure data engineer

Valce Talent Solutions

United States

Remote

USD 49,000 - 81,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Valce Talent Solutions seeks a Data Engineer to design, build, and maintain scalable cloud-native data pipelines and infrastructure for analytics, BI, and real-time processing. You will work with Azure Data Factory, Databricks, ADLS, Synapse, and Event Hubs to enable robust data platforms.

Responsibilities include ETL/ELT pipeline design, data modeling, API/data service integration, and ensuring data governance and security across systems. Remote Mexico-based role with collaboration across teams.

Qualifications

  • Proficient in SQL and relational databases (Oracle, SQL Server, MySQL).
  • Strong programming skills in Python, PySpark, Java/Scala.
  • Hands-on experience with Azure cloud services and Databricks Lakehouse.
  • Experience with Delta Lake, Delta Tables, and API development.

Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines for batch and real-time processing.
  • Build and optimize data models and lakehouse architectures to support analytics.
  • Develop and integrate RESTful APIs and data services for data exchange.
  • Implement real-time ingestion frameworks using streaming tech and event-driven architecture.
  • Leverage Azure services (ADF, Databricks, ADLS, Synapse, Event Hubs) for data platforms.
  • Develop Spark apps for large-scale transformations and data processing.
  • Ensure data quality, governance, security, and compliance across data platforms.
  • Collaborate with data scientists, analysts, and stakeholders to deliver data solutions.
  • Monitor, troubleshoot, and optimize pipeline performance and reliability.
  • Support DataOps and CI/CD practices for data pipelines.

Skills

SQL
Python
PySpark
PL/SQL
Java/Scala
Azure Cloud
Databricks
Delta Lake
REST APIs
Kafka
Kinesis
Spark
Hadoop
OpenShift
Kubernetes
Docker
Airflow
Data Governance

Tools

Azure Data Factory
Azure Databricks
Azure Data Lake Storage
Azure Synapse Analytics
Azure Event Hubs
Azure Functions
Azure API Management
Azure DevOps
Delta Live Tables

Job description

Remote position in México Data Engineer Role Overview The Data Engineer is responsible for designing, building, and maintaining scalable, cloudnative data pipelines and data infrastructure that support analytics, reporting, business intelligence, and real-time data processing.

Key Responsibilities
  • Design, develop, and maintain scalable ETL/ELT pipelines for batch and real-time data processing.
  • Build and optimize data models, Delta Tables, and Lakehouse architectures to support analytics and reporting.
  • Develop and integrate RESTful APIs and data services to facilitate seamless data exchange across enterprise systems.
  • Implement real-time and high-frequency data ingestion frameworks using streaming technologies and event-driven architectures.
  • Design and manage cloud-native data solutions leveraging Azure services including Azure Data Factory, Azure Databricks, ADLS, Event Hubs, and Synapse Analytics.
  • Develop and optimize Databricks Spark applications for large-scale data transformation and processing.
  • Ensure data quality, governance, security, and compliance across data platforms.
  • Collaborate with data scientists, analysts, application teams, and business stakeholders to deliver scalable data solutions.
  • Troubleshoot, monitor, and optimize pipeline performance and data platform reliability.
  • Support DataOps and CI/CD practices for data pipeline deployment and automation.
Required Skills & Qualifications
  • Strong proficiency in SQL and relational databases such as Oracle, SQL Server, and MySQL.
  • Strong programming skills in Python, PySpark, PL/SQL, Java, or Scala.
  • Hands-on experience with Azure Cloud technologies: o Azure Data Factory (ADF) o Azure Databricks o Azure Data Lake Storage (ADLS) o Azure Synapse Analytics o Azure Event Hubs o Azure Functions o Azure API Management o Azure DevOps
  • Experience with Databricks Lakehouse architecture, Delta Lake, and Delta Tables.
  • Expertise in API development, API integration, RESTful services, and microservices architecture.
  • Experience processing high-volume and high-frequency data with low-latency requirements.
  • Strong knowledge of real-time data ingestion and streaming technologies such as Kafka, Azure Event Hubs, or Kinesis.
  • Experience with Spark, Hadoop, and distributed data processing frameworks.
  • Hands-on experience with OpenShift, Kubernetes, Docker, and containerized deployments.
  • Experience with workflow orchestration tools such as Apache Airflow and Azure Data Factory.
  • Understanding of data governance, data security, and compliance best practices.
Preferred Qualifications
  • Experience with Delta Live Tables (DLT), Auto Loader, and Change Data Capture (CDC).
  • Knowledge of DataOps, CI/CD, and Infrastructure as Code (IaC).
  • Familiarity with event-driven architectures and real-time analytics platforms.

Azure Data Engineer (DP-203) and Databricks certifications mandatory skills: Python Azure SQL REMOTE ADVANCED ENGLISH

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

TechDigital Group • Pleasanton (CA)

On-site
USD 120,000 - 170,000
Azure Data Engineer
Azure Data Engineer

Signature IT World • Pennsylvania

Hybrid
USD 120,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Signature IT World • New Jersey

Hybrid
USD 110,000 - 150,000
Azure Databricks Data Engineer - Real-Time Analytics
Azure Databricks Data Engineer - Real-Time Analytics

Luxoft • United States

Remote
USD 120,000 - 180,000
Azure Data Engineer
Azure Data Engineer

Recru • Fort Worth (TX), Arlington (TX), Dallas (TX)

On-site
USD 120,000 - 150,000
Azure Databricks Engineer
Azure Databricks Engineer

IQuest Solutions Corporation • Newtown Square

On-site
USD 120,000 - 170,000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Raleigh (NC)

On-site
USD 120,000 - 150,000
None
Azure Data Engineer
Azure Data Engineer

9nexus • United States

Remote
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 150,000