Sr Data Engineer

sohodragon; New York (NY); Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Medical insurance

Vision insurance

Dental insurance

401(k)

Job summary

sohodragon seeks a Senior Data Engineer to own the data warehouse, ETL processes, and BI reporting. You will integrate NetSuite, IRI, and POS data, develop scalable data architectures, and guide third-party analytics resources. Hybrid role in Commack, NY with collaboration across teams.

The role focuses on building robust data pipelines, dashboards, and data governance to deliver actionable insights for business stakeholders.

Qualifications

• Bachelor’s degree in Computer Science, IT, or related field.
• Proven experience in data engineering in manufacturing/distribution environments.
• Extensive experience with data collection and standardizing database schemas for bespoke sources.
• Strong SQL, JSON, XML, Power BI, Python skills.

Responsibilities

• Design, construct, test, and maintain robust data architectures.
• Build and manage APIs for data extraction and transformation.
• Develop and optimize ETL processes across multiple sources.
• Create data extracts to feed data warehouses to internal/external systems.
• Create and manage Power BI dashboards and reports for stakeholders.
• Assist analysts in developing reports and dashboards with accurate data.
• Maintain and improve SQL, Power BI, Cognos, and related tools.
• Collaborate with departments to provide data solutions aligned with business goals.

Skills

SQL

Power BI

Python

ETL

Data warehouse

APIs

RBAC

Azure

SQL Server

Cognos

Education

Bachelor's degree in Computer Science, IT, or related field

Tools

SQL Server

Azure Data Factory

Cognos

SSIS

Job description

Sr Data Engineer

Full-time | Commack, NY | Hybrid

Position Overview:

Our client, a global haircare company is seeking a highly skilled and motivated Sr Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other point-of-sale data sources. This role is pivotal in owning the ETL processes, developing Power BI dashboards, and supporting our data analysts in report and dashboard creation. The ideal candidate will be adept at developing architecture such as databases and large-scale processing systems and aligning data projects with organizational goals. This position is also responsible for guiding and managing the third-party resources contracted for data analytics projects.

Essential Job Duties & Responsibilities:

• Design, construct, test, and maintain robust data architectures to align with business requirements.


• Build and manage API’s for data extraction and transformation.


• Develop and optimize ETL processes for efficient data extraction, transformation, and loading from various sources.


• Develop data extracts to feed data warehouse data to other internal and/or external systems.


• Create and manage Power BI dashboards and reports, providing actionable insights to business stakeholders.


• Assist data analysts in the development of reports and dashboards, ensuring data accuracy and relevance.


• Maintain and improve SQL, Power BI, Cognos, and other data engineering tools and practices.


• Collaborate with various departments to understand data needs and provide technical solutions that align with business objectives.


• Ensure data integrity and security, adhering to data governance and compliance standards.


• Continuously evaluate and recommend improvements to existing data systems and processes.


• Conduct research for industry and business questions using large data sets.


• Recommend ways to improve data reliability, efficiency, and quality.


• Deliver Data Analytics using AI.

Required Skills/Qualifications:

• Bachelor’s degree in Computer Science, IT, or related field


• Proven experience in data engineering, especially in a manufacturing/distribution environment.


• Extensive experience in data collection and standardizing database schema to accommodate bespoke data sources


• Proficiency in SQL, JSON, XML. Power BI, Cognos, Python, and other relevant tools.


• Strong understanding of ETL processes and tools (like Fivtran, SSIS, Azure Data Factory Pipelines).


• Experience Building/managing API.


• Experience with data warehouse design and management.


• Experience Building Database Objects (Design and create schemas, tables, views, and indexes)


• Experience Writing Code (complex stored procedures, functions, and triggers)


• Experience Optimizing Performance (Query Optimization, Execution Plans, Index Management)


• Experience with Analysis Services, multi-dimensional databases, parent child dimensions, alternate hierarchies, OLAP/ROLAP cubes.


• Experience deploying database on SQL server with role-based access control (RBAC) for admins and users.


• Prefer experience with Microsoft Fabric, Azure Data Factory, Data Lake)


• Prefer Experience configuring MCP Servers connecting data models to LLMs


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with non-technical stakeholders

Benefits

• Medical insurance


• Vision insurance


• Dental insurance


• 401(k)