Remote Enterprise Data Platform Manager

Vialto; New York (NY); On-site; USD 125,000 - 225,000; Full time

Benefits offered by this job

Telecommuting

Job summary

Galaxy US Opco Inc. in New York, NY, seeks a Manager, Enterprise Data Engineer to design, develop and implement data pipelines and architectures for enterprise data initiatives.

You will optimize ETL/ELT processes, ensure data quality, governance and compliance, and build enterprise-grade data solutions in the cloud. You will supervise and coach the team, collaborate with analytics and ML teams, and deploy GPT-based models in Azure OpenAI with cost and token monitoring.

Qualifications

• Bachelor’s degree or foreign equivalent in MIS/Engineering/Business Administration, plus 5 years of related work experience.
• Alternative: Master’s degree or foreign equivalent plus 3 years of related work experience.
• At least 1 year of experience with enterprise data platform architecture, CI/CD pipelines and Azure Data Factory integrations.

Responsibilities

• Design and implement architecture for the Enterprise Data Platform, focusing on CI/CD pipelines and integrating Azure Data Factory to move data between ADLS and Snowflake.
• Use Python and PowerShell to script jobs for automation, scheduled maintenance, and dynamic scaling with Azure serverless services to optimize costs.
• Ensure automated build and deploy pipelines (CI/CD) run smoothly and remediate issues with minimal service impact.
• Deploy GPT-based AI models in Azure OpenAI and monitor token counts, costs, and use of Azure AI tools like Search Service and Text Analytics.
• Provide supervision and coaching to the data engineering team and collaborate with analytics and ML teams.

Skills

CI/CD pipelines

Python

PowerShell

Azure

Snowflake

Azure Data Factory

Data governance

Education

Bachelor’s degree or foreign equivalent in MIS/Engineering/Business Administration

Tools

Azure

OpenAI Azure services

Job description

Galaxy US Opco Inc. in New York, NY, seeks a Manager, Enterprise Data Engineer to design, develop and implement data pipelines and architectures for enterprise data initiatives.

You will optimize ETL/ELT processes, ensure data quality, governance and compliance, and build enterprise-grade data solutions in the cloud. You will supervise and coach the team, collaborate with analytics and ML teams, and deploy GPT-based models in Azure OpenAI with cost and token monitoring.