Sr Data Engineer

SoHo Dragon; New York (NY); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical insurance

Vision insurance

Dental insurance

401(k)

Job summary

SoHo Dragon in Commack, NY is seeking a Sr Data Engineer to design and manage a data warehouse, integrate NetSuite, IRI, and POS data, and own ETL processes. The role includes building APIs and developing Power BI dashboards to deliver actionable insights for stakeholders.

You will guide third-party data analytics resources, collaborate with multiple departments, ensure data governance and security, and continuously improve data systems.

Qualifications

• Bachelor's degree in CS, IT, or related field and relevant data engineering experience.
• Proven experience designing and managing data warehouses in manufacturing/distribution environments.
• Strong SQL, JSON/XML skills; experience with Power BI and Cognos.
• Experience building and managing APIs and ETL pipelines.
• Knowledge of RBAC and data governance standards.

Responsibilities

• Design, construct, test, and maintain robust data architectures aligned to business needs.
• Build and manage APIs for data extraction and transformation.
• Develop and optimize ETL processes from multiple data sources.
• Develop data extracts to feed warehouse data to internal/external systems.
• Create and manage Power BI dashboards and reports for stakeholders.
• Assist analysts in reports/dashboard development and ensure data accuracy.
• Maintain SQL, Power BI, Cognos, and related data engineering tools.
• Collaborate with departments to deliver data solutions aligned with objectives.
• Ensure data integrity and security with governance/compliance.
• Evaluate and improve existing data systems and processes.
• Conduct data analysis on large datasets to answer business questions.
• Deliver data analytics including AI-enabled insights.

Skills

SQL

Power BI

Cognos

Python

ETL

APIs

Data warehousing

RBAC

APIs development

Data governance

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Data Factory

SSIS

Fivetran

Microsoft Fabric

Job description

Sr Data Engineer

Full-time | Commack, NY | Hybrid

Position Overview:

Our client, a global haircare company, isseekin g a highly skilled and motivated Sr Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other point-of-sale data sources. This role is pivotal in owning the ETL processes, developing Power BI dashboards, and supporting our data analysts in report and dashboard creation. The ideal candidate will be adept at developing architecture such as databases and large-scale processing systems and aligning data projects with organizational goals. This position is also responsible for guiding and managing the third-party resources contracted for data analytics projects.

Essential Job Duties & Responsibilities:

• Design, construct, test, and maintain robust data architectures to align with business requirements.


• Build and manage API’s for data extraction and transformation.


• Develop and optimize ETL processes for efficient data extraction, transformation, and loading from various sources.


• Develop data extracts to feed data warehouse data to other internal and/or external systems.


• Create and manage Power BI dashboards and reports, providing actionable insights to business stakeholders.


• Assist data analysts in the development of reports and dashboards, ensuring data accuracy and relevance.


• Maintain and improve SQL, Power BI, Cognos, and other data engineering tools and practices.


• Collaborate with various departments to understand data needs and provide technical solutions that align with business objectives.


• Ensure data integrity and security, adhering to data governance and compliance standards.


• Continuously evaluate and recommend improvements to existing data systems and processes.


• Conduct research for industry and business questions using large data sets.


• Recommend ways to improve data reliability, efficiency, and quality.


• Deliver Data Analytics using AI.

Required Skills/Qualifications:

• Bachelor’s degree in Computer Science, IT, or related field


• Proven experience in data engineering, especially in a manufacturing/distribution environment.


• Extensive experience in data collection and standardizing database schema to accommodate bespoke data sources


• Proficiency in SQL, JSON, XML. Power BI, Cognos, Python, and other relevant tools.


• Strong understanding of ETL processes and tools (like Fivtran, SSIS, Azure Data Factory Pipelines).


• Experience Building/managing API.


• Experience with data warehouse design and management.


• Experience Building Database Objects (Design and create schemas, tables, views, and indexes)


• Experience Writing Code (complex stored procedures, functions, and triggers)


• Experience Optimizing Performance (Query Optimization, Execution Plans, Index Management)


• Experience with Analysis Services, multi-dimensional databases, parent child dimensions, alternate hierarchies, OLAP/ROLAP cubes.


• Experience deploying database on SQL server with role-based access control (RBAC) for admins and users.


• Prefer experience with Microsoft Fabric, Azure Data Factory, Data Lake)


• Prefer Experience configuring MCP Servers connecting data models to LLMs


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with non-technical stakeholders

Benefits

Medical insurance, Vision insurance, Dental insurance, 401(k)