Senior Data Engineer: Cloud Pipelines & AI (Remote)

Zachary Piper Solutions; United States; Remote; USD 130,000 - 150,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k)

Paid time off

Job summary

Piper Companies is seeking a Sr. Data Engineer III to join an enterprise technology organization supporting a modern, cloud-based data platform. This fully remote role requires US work authorization and residence in EST or CST time zones.

The Sr. Data Engineer III will design scalable data pipelines, optimize SQL, and leverage Azure, Fabric, Spark, and Python to automate data processes. Mentoring, API work, and leadership of complex projects are expected.

Qualifications

• 5+ years of data engineering or related experience.
• Strong expertise in SQL, Python, dbt, and/or C#.
• Experience with Azure Data Factory or similar orchestration tools.
• Hands-on experience with Microsoft Azure and Fabric.
• Experience with Databricks or Snowflake is acceptable.
• Strong understanding of data modeling and ETL concepts.
• Experience with Git and version control best practices.
• Ability to work independently and solve complex problems.
• Background leading in small or mid-sized environments.

Responsibilities

• Design and maintain scalable data pipelines and ETL workflows.
• Develop and optimize advanced SQL queries for performance and reliability.
• Leverage Azure, Fabric, Spark, and Python to automate data processes.
• Build and support REST and SOAP APIs for system integrations.
• Monitor and troubleshoot data pipelines for high availability.
• Identify bottlenecks in data workflows and resolve them.
• Lead engineering efforts supporting AI and ML initiatives.
• Collaborate with stakeholders and cross-functional teams.
• Conduct code reviews and contribute to technical documentation.
• Provide Tier 3 support for reporting and integrated systems.
• Mentor teammates and lead complex technical projects.

Skills

SQL

Python

ETL

Data modeling

Git

Tools

Azure Data Factory

Microsoft Fabric

Databricks

Snowflake

REST APIs

Job description

Piper Companies is seeking a Sr. Data Engineer III to join an enterprise technology organization supporting a modern, cloud-based data platform. This fully remote role requires US work authorization and residence in EST or CST time zones.

The Sr. Data Engineer III will design scalable data pipelines, optimize SQL, and leverage Azure, Fabric, Spark, and Python to automate data processes. Mentoring, API work, and leadership of complex projects are expected.