AI-Driven Data Pipeline Engineer

Jobtailor; Massachusetts; On-site; USD 110,000 - 160,000; Full time

Job summary

Jobtailor is seeking a data engineer in Massachusetts to design and maintain end-to-end data pipelines for occupancy, lease, and facilities data. You will implement automated validation, help improve data quality, and collaborate with stakeholders to align solutions with operational needs.

You will work with Airflow, dbt, and cloud data platforms like Snowflake, BigQuery, Redshift, or Azure Synapse, applying AI/ML concepts for anomaly detection and data matching.

Qualifications

• 3+ years in data engineering or related field.
• Proficiency in Python and SQL.
• Hands-on with ETL/ELT pipelines and orchestration tools (Airflow, dbt, Prefect).
• Experience with cloud data platforms (Snowflake, BigQuery, Redshift, Azure Synapse).
• Strong data modeling and data quality practices.
• Ability to work independently and solve complex data problems.
• Excellent communication across technical and non-technical teams.
• Interest in AI/ML concepts (anomaly detection, NLP) is a plus.
• Willingness to learn new tools and technologies.

Responsibilities

• Design, build, and maintain end-to-end data pipelines to consolidate and transform occupancy, lease, and facilities data from multiple sources
• Develop automated validation and reconciliation frameworks to improve data quality and reduce manual effort
• Analyze current workflows, identify pain points, and translate them into scalable data engineering solutions
• Collaborate with business and technical stakeholders to align solutions with operational needs
• Partner with offshore teams to automate repetitive processes and improve overall efficiency
• Implement monitoring and alerting systems to proactively identify and resolve data issues
• Explore and apply AI/ML techniques (e.g., anomaly detection, intelligent data matching) to enhance validation and insights
• Continuously improve workflows and processes to increase scalability, accuracy, and performance

Skills

Python

SQL

ETL/ELT

Airflow

dbt

Prefect

Cloud platforms

Data modeling

Data quality

Analytical thinking

Communication

Independent work

AI/ML basics

Job description

Jobtailor is seeking a data engineer in Massachusetts to design and maintain end-to-end data pipelines for occupancy, lease, and facilities data. You will implement automated validation, help improve data quality, and collaborate with stakeholders to align solutions with operational needs.

You will work with Airflow, dbt, and cloud data platforms like Snowflake, BigQuery, Redshift, or Azure Synapse, applying AI/ML concepts for anomaly detection and data matching.