Senior Data Engineer

Jobs via Dice; United States; Remote; USD 160,000 - 165,000; Full time

Job summary

A leading shipping and logistics organization is seeking a Senior Data Engineer to build robust code for data transformation and analytics. Responsibilities include designing solutions on Azure, managing ETL processes, and collaborating with stakeholders. Ideal candidates have extensive experience in data strategies and a Bachelor's degree in Computer Science.

Benefits

Comprehensive Benefits: Medical, Dental, Vision, 401K

PTO and Sick Leave as required by law

Holidays

Qualifications

• 10+ years of experience in data strategies, data analysis, database architecture.
• Strong skills in Azure Data Factory, Databricks, SQL, Python, Scala.
• Experience in building data warehouse transformation processes.

Responsibilities

• Utilize Azure Databricks to develop solutions for reporting and analytics.
• Construct real-time streaming pipelines using Streamsets and Qlik.
• Manage data movement and orchestration through Azure Data Factory.

Skills

Azure Data Factory

SQL

Python (PySpark)

Scala

ETL processes

Data warehousing

Apache Kafka

Education

Bachelor's degree in Computer Science

Job description

Piper Companies is seeking a Senior Data Engineer, to join a leading shipping and logistics organization. The Senior Data Engineer will be responsible for building robust & scalable code to transform and deliver data for reporting & analytics.

Responsibilities of the Senior Data Engineer include:

• Utilize advanced knowledge of Azure Databricks to design, develop, and deploy solutions for reporting and analytics.
• Construct real-time streaming pipelines using tools like Streamsets and Qlik.
• Manage data movement and orchestration through Azure Data Factory.
• Partner with internal customers and stakeholders to gather requirements, build robust models, and deploy solutions.
• Create and maintain data management frameworks to properly tag and manage curated data assets.

Qualifications for the Senior Data Engineer include:

• 10+ years of experience in data strategies, data analysis, database architecture and management, development, or administration.
• Strong skills in Azure Data Factory, Databricks, SQL, Python (PySpark), and/or Scala.
• Proven experience in building ETL processes and data warehouse transformation processes.
• Hands-on experience designing and delivering solutions using the Azure Data Analytics platform, including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, and Azure Stream Analytics.
• Experience with Apache Kafka and event-based data processing.
• Bachelor's degree in Computer Science

Compensation for the Senior Data Engineer include:

• Salary: $160,000 - $165,000
• Comprehensive Benefits: Medical, Dental, Vision, 401K, PTO, Sick Leave as required by law, and Holidays

This job opens for applications on May 14, 2025. Applications for this job will be accepted for at least 30 days from the posting date.

#LI-JT2 #LI-REMOTE

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.