Senior Data Engineer

Piper Companies; United States; Remote; USD 160,000 - 165,000; Full time

Job summary

A leading shipping and logistics organization seeks a Senior Data Engineer to build robust and scalable code for data transformation and analytics. The role demands expertise in Azure Data Factory, Databricks, and requires over 10 years of experience in data strategies and analysis. Comprehensive benefits are included, making this an attractive opportunity for qualified professionals.

Benefits

Medical

Dental

Vision

401K

PTO

Sick Leave as required by law

Holidays

Qualifications

• 10+ years of experience in data strategies, data analysis, and database architecture.
• Strong skills in Azure Data Factory, Databricks, SQL, Python (PySpark), and Scala.
• Experience with Apache Kafka and event-based data processing.

Responsibilities

• Utilize advanced knowledge of Azure Databricks to design and deploy solutions.
• Construct real-time streaming pipelines using tools like Streamsets and Qlik.
• Partner with stakeholders to gather requirements and build robust models.

Skills

Data Strategies

Data Analysis

Database Architecture

ETL Processes

Azure Data Factory

Databricks

SQL

Python (PySpark)

Scala

Apache Kafka

Education

Bachelor's degree in Computer Science

Job description

Piper Companies is seeking a Senior Data Engineer, to join a leading shipping and logistics organization. The Senior Data Engineer will be responsible for building robust & scalable code to transform and deliver data for reporting & analytics.

Responsibilities of the Senior Data Engineer include:

• Utilize advanced knowledge of Azure Databricks to design, develop, and deploy solutions for reporting and analytics.
• Construct real-time streaming pipelines using tools like Streamsets and Qlik.
• Manage data movement and orchestration through Azure Data Factory.
• Partner with internal customers and stakeholders to gather requirements, build robust models, and deploy solutions.
• Create and maintain data management frameworks to properly tag and manage curated data assets.

Qualifications for the Senior Data Engineer include:

• 10+ years of experience in data strategies, data analysis, database architecture and management, development, or administration.
• Strong skills in Azure Data Factory, Databricks, SQL, Python (PySpark), and/or Scala.
• Proven experience in building ETL processes and data warehouse transformation processes.
• Hands-on experience designing and delivering solutions using the Azure Data Analytics platform, including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, and Azure Stream Analytics.
• Experience with Apache Kafka and event-based data processing.
• Bachelor's degree in Computer Science

Compensation for the Senior Data Engineer include:

• Salary: $160,000 - $165,000
• Comprehensive Benefits: Medical, Dental, Vision, 401K, PTO, Sick Leave as required by law, and Holidays

This job opens for applications onMay 14, 2025. Applications for this job will be accepted for at least 30 days from the posting date.

#LI-JT2 #LI-REMOTE

Keywords: Senior Data Engineer, Azure Databricks, Data Analytics, Real-Time Streaming, Azure Data Factory, ETL Processes, Data Warehousing, Python (PySpark), Scala, SQL, Apache Kafka, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics, Database Architecture, Data Management, Big Data, Cloud Services, Data Transformation, Data Pipeline.