Data Integration Specialist: Real-Time ETL & Cloud-On-Prem

Prescient Edge; Town of Florida (NY); On-site; USD 90,000 - 130,000; Full time

Benefits offered by this job

Competitive salary

Performance bonus potential

Comprehensive healthcare benefits

Retirement plan with no vesting

Career development & tuition support

Job summary

Prescient Edge is seeking a Data Integration Specialist to support a Federal Government client in Doral, Florida. The role focuses on ingesting, transforming, and interconnecting data across DoD and commercial networks, leveraging cloud and on-premises environments.

The candidate will manage ETL pipelines, collaborate with AI/ML teams, and ensure data quality, governance, and traceability while delivering timely ingestion reports for ongoing project needs.

Qualifications

• Must have demonstrated experience in developing and managing ETL workflows, integrating data from multiple sources, and ensuring data quality and consistency.
• Must have experience with tools such as Apache NiFi, Databricks, and SQL based data warehouses are required.

Responsibilities

• Handle data ingestion and interoperability across DoD and commercial networks, including PAI/CAI sources.
• Manage data ingestion, transformation, and interoperability across cloud-based and on-prem environments.
• Proficient in data integration tools, API development, ETL pipelines, and schema management.
• Develop and maintain scalable data pipelines for real-time and batch processing of structured and unstructured data.
• Implement ETL workflows to facilitate data interoperability across cloud and on-premises environments.
• Manage schema alignment, metadata tagging, and data governance for quality and traceability.
• Coordinate with AI/ML Engineer to meet model training and analytical requirements.
• Submit the Data Ingestion & Transformation Report documenting sources, optimizations, and updates.

Skills

ETL workflows

Data ingestion

Interoperability

APIs

Real-time processing

Education

Bachelor’s degree in data science or related field

Five years of equivalent experience in data integration

Tools

NiFi

Databricks

SQL-based data warehouses

Job description

Prescient Edge is seeking a Data Integration Specialist to support a Federal Government client in Doral, Florida. The role focuses on ingesting, transforming, and interconnecting data across DoD and commercial networks, leveraging cloud and on-premises environments.

The candidate will manage ETL pipelines, collaborate with AI/ML teams, and ensure data quality, governance, and traceability while delivering timely ingestion reports for ongoing project needs.