Data Engineer

ITnova; Jersey City (NJ); À distance; USD 110 000 - 160 000; Plein temps

Avantages offerts par ce poste

Medical, Dental, and Vision coverage

Short Term Disability, AD&D and Life

401(k) Program

Paid Time Off

11 Paid Holidays

Employee Assistance Program

Résumé du poste

ITnova is seeking a Data Engineer to support the Port Authority of New York and New Jersey Aviation Data Analytics Warehouse (ADAW). You will build and maintain data pipelines, ELT workflows, and integrate data using Azure Synapse Analytics, Data Factory, Azure SQL, and Databricks to enable BI and analytics.

Proficiency in SQL and Microsoft SQL Server is required, with experience designing semantic models in Power BI and a track record delivering reliable data solutions in Azure.

Qualifications

• Bachelor's degree in CS, IS, Data Engineering, or related field.
• Experience building data pipelines and data integration solutions.
• Experience with Azure data services: Synapse Analytics, Data Factory, Azure SQL, Databricks.
• Experience with relational databases, including Microsoft SQL Server.
• Proficiency in SQL and creating database objects (tables, views, procedures).
• Experience designing ELT/ETL workflows.
• Experience data transformation, cleansing, and quality practices.
• Experience with Power BI semantic modeling.
• Experience using Azure DevOps for development coordination and version control.
• Ability to troubleshoot data processing issues and document solutions.

Responsabilités

• Develop and maintain data pipelines for the ADAW.
• Configure automated data extraction and troubleshoot ingestion issues.
• Design, develop, and maintain ELT workflows.
• Transform data per governance standards and business rules.
• Build reusable data transformation frameworks using Azure Synapse.
• Optimize pipelines for performance and efficiency.
• Create and maintain database objects (tables, views, stored procedures).
• Support serverless and dedicated SQL pools and SQL Server databases.
• Design and maintain Power BI semantic models for reporting and dashboards.
• Integrate new data sources and enhance existing workflows.
• Document pipelines, transformations, and technical processes.
• Collaborate with Cloud Architecture/Team Lead/PM/QA to deliver reliable data solutions.

Connaissances

SQL

Microsoft SQL Server

Azure Synapse Analytics

Data Factory

Databricks

Power BI

ELT/ETL design

Data governance

Azure DevOps

Troubleshooting data processing

Formation

Bachelor's degree in Computer Science or related field

Outils

Azure Synapse Analytics

Data Factory

Azure SQL

Databricks

Power BI

Description du poste

ITnova is seeking a Data Engineer to support the Port Authority of New York and New Jersey (PANYNJ) Aviation Department's Aviation Data Analytics Warehouse (ADAW). The ideal candidate will have hands-on experience developing and maintaining data pipelines, building ELT workflows, and integrating data using Microsoft Azure services, including Synapse Analytics, Data Factory, Azure SQL, and Databricks. This role will support data transformation, database development, pipeline optimization, and Power BI semantic modeling to ensure accurate, reliable data is available for business intelligence and reporting. Strong SQL and Microsoft SQL Server experience is required.

Responsibilities

• Develop new and maintain existing data pipelines supporting the Aviation Data Analytics Warehouse (ADAW).
• Configure automated data extraction processes and troubleshoot data ingestion failures and connectivity issues.
• Design, develop, and maintain Extract, Load, Transform (ELT) workflows.
• Clean, standardize, and transform data according to established data governance standards and business rules.
• Build reusable data transformation frameworks using Azure Synapse Analytics.
• Optimize data pipelines for performance, efficiency, and processing speed.
• Create and maintain database objects, including tables, views, and stored procedures.
• Support serverless and dedicated SQL pools and SQL Server databases.
• Design and maintain Power BI semantic data models to support reporting, dashboards, and analytical requirements.
• Integrate new data sources and enhance existing data processing workflows.
• Document data pipelines, transformations, database objects, and technical processes.
• Collaborate with the Cloud Architecture/Team Lead, Program Manager, and QA/QC Specialist to deliver reliable data solutions.

Required Qualifications

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field preferred
• Demonstrated experience developing and maintaining data pipelines and data integration solutions.
• Experience with Microsoft Azure data services, including Synapse Analytics, Data Factory, Azure SQL, and Databricks.
• Experience with relational databases, including Microsoft SQL Server.
• Proficiency in SQL and experience developing database objects such as tables, views, and stored procedures.
• Experience designing and implementing ELT or ETL workflows.
• Experience with data transformation, data cleansing, and data quality practices.
• Experience with Microsoft Power BI and semantic data modeling.
• Experience using Azure DevOps or similar tools for development coordination, version control, and work tracking.
• Ability to troubleshoot data processing issues and document technical solutions.

Preferred Experience

• Experience developing enterprise data warehouse or lakehouse solutions.
• Experience integrating data from APIs, batch feeds, streaming sources, and SFTP file transfers.
• Experience optimizing large-scale data pipelines and SQL queries.
• Experience with Power Apps and Power Automate.
• Experience supporting business intelligence dashboards and enterprise reporting.
• Experience working in an Agile development environmen

Must be US Citizen

Full-time remote (Mon - Fri, 9:00 am - 5:00 pm EST)

Benefits:

• Medical, Dental, and Vision coverage
• Short Term Disability, AD&D and Life insurance
• 401(k) Program
• Paid Time Off
• 11 Paid Holidays
• Employee Assistance Program

ITnova is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.