Data Engineer

Jobtailor; Town of Florida (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor is seeking an experienced Data Engineer to design, build, and operate production data pipelines across enterprise systems in a cloud-first environment. You will work with Azure Data services and Microsoft Fabric to enable BI, AI, and ML use cases.

The role requires strong SQL and Python skills, data modeling expertise, and hands-on experience with API integrations and orchestration tools. Collaboration with analytics, IT security, and business teams is essential.

Qualifications

• 5+ years of experience designing, building, and operating production data pipelines and integrations.
• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related field; directly relevant experience, certifications, or training demonstrating comparable expertise in data pipelines, integrations, cloud data platforms, APIs, data governance, and secure data workflows may be considered in lieu of a degree
• Strong SQL skills and experience with PostgreSQL or similar relational databases
• Proficiency in Python for data engineering, automation, and workflow development
• Hands-on experience with Microsoft Azure data services and Microsoft Fabric, or equivalent cloud data platforms
• Experience with ETL/ELT pipelines, data modeling, curated datasets, orchestration, and production data workflows
• Strong experience with APIs and integration patterns, including REST, webhooks, authentication, error handling, retry strategies, and cross-system data movement
• Familiarity with SDLC and CI/CD for data workflows using GitHub Enterprise, Azure DevOps, or similar tools
• Strong understanding of security, data governance, access controls, and secure handling of sensitive business information
• Ability to communicate clearly with technical and non-technical stakeholders in an AEC or similar business environment
• Operational discipline with the ability to maintain, monitor, troubleshoot, and improve mission-critical data flows over time

Responsibilities

• Design, build, operate, and support ETL/ELT pipelines across enterprise systems, including Salesforce, Deltek Vantagepoint, Autodesk data sources, Azure, and Microsoft Fabric
• Implement data models, curated datasets, Lakehouse/Warehouse structures, and transformation layers to support BI, reporting, AI, and machine learning use cases
• Build and support API-first data services, data contracts, and integration workflows using REST, JSON, SOAP where applicable, webhooks, and related patterns
• Develop orchestration and scheduling processes using Microsoft Fabric Data Pipelines, Azure Data Factory, Azure Logic Apps, Functions, Spark notebooks, dbt, or similar tools
• Apply event-driven integration patterns using Event Grid, Service Bus, Kafka concepts, or similar technologies where appropriate
• Own the operational reliability of pipelines and integrations, including monitoring, alerting, incident response, troubleshooting, root‑cause analysis, and remediation
• Implement data quality checks, validation, lineage, documentation, and governance practices to ensure data is accurate, trusted, and usable
• Partner with analytics, application, IT/Security, and business teams to support secure access, data governance, compliance, and reliable data delivery
• Support AI initiatives by preparing reliable datasets, including AI/ML pipelines or RAG-oriented datasets where applicable
• Use AI tools responsibly to improve productivity, accelerate development, support testing, and improve documentation while maintaining security and quality standards

Skills

SQL

Python

Data modelling

ETL/ELT design

API integration

Stakeholder communication

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Data Services

Microsoft Fabric

dbt

GitHub Enterprise

Azure DevOps

Job description

Responsibilities

• Design, build, operate, and support ETL/ELT pipelines and integrations across enterprise systems, including Salesforce, Deltek Vantagepoint, Autodesk data sources, Azure, and Microsoft Fabric
• Implement data models, curated datasets, Lakehouse/Warehouse structures, and transformation layers to support BI, reporting, AI, and machine learning use cases
• Build and support API‑first data services, data contracts, and integration workflows using REST, JSON, SOAP where applicable, webhooks, and related patterns
• Develop orchestration and scheduling processes using Microsoft Fabric Data Pipelines, Azure Data Factory, Azure Logic Apps, Functions, Spark notebooks, dbt, or similar tools
• Apply event‑driven integration patterns using Event Grid, Service Bus, Kafka concepts, or similar technologies where appropriate
• Own the operational reliability of pipelines and integrations, including monitoring, alerting, incident response, troubleshooting, root‑cause analysis, and remediation
• Implement data quality checks, validation, lineage, documentation, and governance practices to ensure data is accurate, trusted, and usable
• Partner with analytics, application, IT/Security, and business teams to support secure access, data governance, compliance, and reliable data delivery
• Support AI initiatives by preparing reliable datasets, including AI/ML pipelines or RAG‑oriented datasets where applicable
• Use AI tools responsibly to improve productivity, accelerate development, support testing, and improve documentation while maintaining security and quality standards

Requirements

• 5+ years of experience designing, building, and operating production data pipelines and integrations
• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related field; directly relevant experience, certifications, or training demonstrating comparable expertise in data pipelines, integrations, cloud data platforms, APIs, data governance, and secure data workflows may be considered in lieu of a degree
• Strong SQL skills and experience with PostgreSQL or similar relational databases
• Proficiency in Python for data engineering, automation, and workflow development
• Hands‑on experience with Microsoft Azure data services and Microsoft Fabric, or equivalent cloud data platforms
• Experience with ETL/ELT pipelines, data modeling, curated datasets, orchestration, and production data workflows
• Strong experience with APIs and integration patterns, including REST, webhooks, authentication, error handling, retry strategies, and cross‑system data movement
• Familiarity with SDLC and CI/CD for data workflows using GitHub Enterprise, Azure DevOps, or similar tools
• Strong understanding of security, data governance, access controls, and secure handling of sensitive business information
• Ability to communicate clearly with technical and non‑technical stakeholders in an AEC or similar business environment
• Operational discipline with the ability to maintain, monitor, troubleshoot, and improve mission‑critical data flows over time