Senior BI Data Engineer

Compunnel, Inc.; New York, Northern (NY, KY); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Compunnel, Inc. is seeking a Sr. BI Data Engineer to design, develop, and deliver scalable OLTP and Data Warehouse solutions using Microsoft Fabric, SSIS, SQL Server, and related BI technologies in a NY-based setting.

You will build enterprise reports, ETL/ELT processes, dashboards, data models, and API integrations while ensuring data quality, regulatory compliance, and performance across Azure cloud platforms and on-prem systems.

Qualifications

• Bachelor's degree in Engineering or Computer Science.
• 6+ years of experience in reporting and data warehouse development.
• 5+ years of software development experience on the Microsoft BI Platform, including Microsoft SQL Server.
• 4+ years of experience in OLTP database development using Microsoft SQL Server.
• 2+ years of experience building Data Marts using dimensional models.
• 2+ years of experience building dashboards and KPI visualizations using Power BI and/or Tableau.
• Strong reporting and data warehouse development skills, including the ability to troubleshoot complex and evaluative issues using advanced technical knowledge.
• Experience with large-scale data migration initiatives.
• Hands‑on experience with Oracle.
• Strong SQL Server, T-SQL, ETL/ELT, data modeling, and data warehouse development capabilities.
• Experience working with data quality, integrity, troubleshooting, and performance optimization.

Responsibilities

• Develop and maintain ETL/ELT processes using SSIS, Microsoft Fabric Pipelines, and/or Azure Data Factory.
• Develop advanced Script Tasks using C# or VB.NET to automate file operations and implement custom business logic.
• Develop and implement Microsoft Power BI and Microsoft Fabric solutions, including Lakehouse/Warehouse models, Dataflows Gen2, Pipelines, and Semantic Models.
• Support modernization of existing ETL and reporting assets into Microsoft Fabric and Azure cloud-based frameworks.
• Design, develop, and optimize complex T-SQL stored procedures, functions, and database objects for high-volume OLTP and Data Warehouse environments.
• Work with transaction isolation levels, table hints, deadlocks, linked servers, OPENQUERY, triggers, and column-level encryption.
• Perform advanced database performance tuning, including execution plan analysis, indexing strategies, partitioning, and transaction optimization.
• Contribute to the design and enhancement of OLTP and OLAP data models based on business, analytical, and performance requirements.
• Build and support integrations that consume or expose REST APIs, including testing, validation, and troubleshooting using Postman and related API tools.
• Create and govern dashboards and visual analytics using Power BI and/or Tableau.
• Ensure dashboards and visualizations accurately align with established semantic models and governance standards.
• Verify and maintain data quality and integrity across data warehouses, semantic models, dashboards, reports, and data extracts.
• Troubleshoot database, ETL, reporting, data quality, performance, capacity, replication, and distributed data issues.
• Participate in incident resolution and root-cause remediation activities.
• Maintain thorough technical documentation and adhere to change control processes.
• Support regulatory, cybersecurity, and data protection compliance requirements.
• Collaborate with Product Managers, Analysts, Engineers, and cross-functional teams to enhance BI and data platform capabilities.
• Evaluate technical approaches and recommend appropriate solutions for business and data requirements.
• Stay current with industry trends and participate in relevant training, conferences, and professional development programs.
• Uphold service excellence behaviors and support organizational mission, values, policies, and guiding principles.

Skills

SQL Server

T-SQL

ETL/ELT

Power BI

Tableau

Data Modeling

OLTP

Azure

Fabric

API integration

Education

Bachelor's degree in Engineering or CS

Tools

SSIS

Microsoft Fabric

Azure Data Factory

Postman

SQL Server Management Studio

Oracle

Job description

The Sr. BI Data Engineer will design, develop, and deliver scalable OLTP, Business Intelligence, and Data Warehouse solutions using Microsoft Fabric, SSIS, SQL Server, and related BI technologies. The role will develop and maintain enterprise reports, ETL/ELT processes, dashboards, data models, and integrations while supporting requirements gathering, technical evaluations, troubleshooting, and modernization of existing BI and data assets into Fabric and Azure cloud-based frameworks. The position requires strong database development, data warehouse, reporting, Power BI, data migration, and data quality expertise, along with the ability to deliver complex solutions within established timelines and support regulatory, cybersecurity, and data protection requirements.

Key Responsibilities

• Develop and maintain ETL/ELT processes using SSIS, Microsoft Fabric Pipelines, and/or Azure Data Factory.
• Develop advanced Script Tasks using C# or VB.NET to automate file operations and implement custom business logic.
• Develop and implement Microsoft Power BI and Microsoft Fabric solutions, including Lakehouse/Warehouse models, Dataflows Gen2, Pipelines, and Semantic Models.
• Support modernization of existing ETL and reporting assets into Microsoft Fabric and Azure cloud-based frameworks.
• Design, develop, and optimize complex T-SQL stored procedures, functions, and database objects for high-volume OLTP and Data Warehouse environments.
• Work with transaction isolation levels, table hints, deadlocks, linked servers, OPENQUERY, triggers, and column-level encryption.
• Perform advanced database performance tuning, including execution plan analysis, indexing strategies, partitioning, and transaction optimization.
• Contribute to the design and enhancement of OLTP and OLAP data models based on business, analytical, and performance requirements.
• Build and support integrations that consume or expose REST APIs, including testing, validation, and troubleshooting using Postman and related API tools.
• Create and govern dashboards and visual analytics using Power BI and/or Tableau.
• Ensure dashboards and visualizations accurately align with established semantic models and governance standards.
• Verify and maintain data quality and integrity across data warehouses, semantic models, dashboards, reports, and data extracts.
• Troubleshoot database, ETL, reporting, data quality, performance, capacity, replication, and distributed data issues.
• Participate in incident resolution and root-cause remediation activities.
• Maintain thorough technical documentation and adhere to change control processes.
• Support regulatory, cybersecurity, and data protection compliance requirements.
• Collaborate with Product Managers, Analysts, Engineers, and cross-functional teams to enhance BI and data platform capabilities.
• Evaluate technical approaches and recommend appropriate solutions for business and data requirements.
• Stay current with industry trends and participate in relevant training, conferences, and professional development programs.
• Uphold service excellence behaviors and support organizational mission, values, policies, and guiding principles.

Required Qualifications

• Bachelor's degree in Engineering or Computer Science.
• 6+ years of experience in reporting and data warehouse development.
• 5+ years of software development experience on the Microsoft BI Platform, including Microsoft SQL Server.
• 4+ years of experience in OLTP database development using Microsoft SQL Server.
• 2+ years of experience building Data Marts using dimensional models.
• 2+ years of experience building dashboards and KPI visualizations using Power BI and/or Tableau.
• Strong reporting and data warehouse development skills, including the ability to troubleshoot complex and evaluative issues using advanced technical knowledge.
• Experience with large-scale data migration initiatives.
• Hands‑on experience with Oracle.
• Strong SQL Server, T-SQL, ETL/ELT, data modeling, and data warehouse development capabilities.
• Experience working with data quality, integrity, troubleshooting, and performance optimization.

Preferred Qualifications

• Experience maintaining code and scripts in TFS across multiple environments.
• Experience with Microsoft Azure, Microsoft Power BI, and Microsoft Fabric.
• Experience performing DBA activities such as database backup and restore.
• Experience extracting data through APIs.
• Experience working with XML data.