Sr Data Platform Architect

General Electric; City of Schenectady (NY); Remote; USD 110,000 - 185,000; Full time

Job summary

An innovative firm is seeking a Sr. Data and Information Architect to lead the Dataiku DSS platform management. In this pivotal role, you will empower business users by driving the architecture for self-service data and analytics projects, ensuring optimal performance and security. You will collaborate with diverse teams to implement machine learning solutions and enhance data-driven decision-making. This remote position offers an exciting opportunity to work in a dynamic environment, fostering innovation and professional growth in the data field while enjoying competitive salary and benefits.

Benefits

Health Coverage

Retirement Plans

Tuition Assistance

Paid Parental Leave

Disability Insurance

Paid Time Off

Qualifications

• 4+ years of professional experience in data management and architecture.
• Minimum 3 years of experience in Dataiku administration.

Responsibilities

• Manage and optimize the Dataiku DSS platform for data projects.
• Collaborate with teams to integrate ML solutions and provide training.

Skills

Dataiku

Linux

SQL

Python

AWS

Data Architecture

MLOps

Data Visualization

Education

Bachelor's in Computer Science

STEM Degree

Tools

AWS EKS

Spotfire

PySpark

Job description

**Job Description Summary**

The Data and Infrastructure organization helps solve our customers' toughest challenges, making flights safer, power cheaper, and oil & gas production safer for people and the environment by leveraging data and analytics.

The Sr. Data and Information Architect will be responsible for managing and maintaining the Dataiku DSS platform, ensuring smooth operations, security, and performance.

**Job Description**

**Essential Responsibilities:**

The Sr. Data Platform Architect will be part of the Horizontal Family in the STE organization. In this role, you will drive the architecture for both the Self-Service Data program and Analytic Invention program, empowering business users to create their own data and analytics projects and building a comprehensive, high-performance ecosystem to foster innovation in analytics. You will manage, optimize, and scale our Dataiku DSS platform, including seamless deployment of machine learning models. The role requires expertise in Dataiku administration, infrastructure management, automation, and operationalizing AI/ML models.

**Responsibilities include, but are not limited to, platform administration:**

1. Installing, configuring, upgrading, and troubleshooting the Dataiku DSS environment.
2. Managing user access, permissions, and security settings.
3. Monitoring system performance, logs, and resources, including EKS memory usage.
4. Developing custom Python plugins, managing workflows, and integrating databases, cloud storage (S3), APIs, and external ML frameworks.
5. Ensuring security and compliance policies are met.
6. Collaborating with data scientists, engineers, and product teams to integrate ML solutions, and providing technical support and training.
7. Designing and implementing CI/CD pipelines for automated ML model deployment using Dataiku.
8. Applying best practices for containerization and MLOps.

**Technical Skills:**

• Deep experience with Dataiku
• Proficiency in Linux environments
• Knowledge of data lake concepts
• Strong SQL and Python skills
• Hands-on experience with AWS and AWS EKS
• Knowledge of Spark, distributed processing, and S3
• Experience automating manual processes
• Extensive experience with data architecture and engineering
• Understanding of data science concepts
• Experience with data visualization and web applications
• Familiarity with IT process automation
• Ability to teach technical concepts to non-technical audiences

**Qualifications/Requirements:**

• Bachelor’s degree with at least 4 years of professional experience, or equivalent education/experience combinations.
• Minimum 3 years of experience in Dataiku administration.

**Eligibility:**

• Legal authorization to work in the U.S.; no visa sponsorship provided.

**Desired Characteristics:**

• Bachelor’s in Computer Science, IT, or related STEM field
• Strong collaboration skills and ability to work with diverse teams
• Experience with Spotfire, data applications, data science, ML libraries, R, PySpark, SparkR
• Interest in professional growth in data fields

**Pay and Benefits:**

The salary range is $110,700 to $184,600 annually, with potential bonuses. Benefits include health coverage, retirement plans, tuition and adoption assistance, paid parental leave, disability and life insurance, and paid time off.

**Additional Information:**

GE Aerospace promotes a diverse, inclusive work environment and is an Equal Opportunity Employer. Employment is contingent upon legal work authorization and passing a drug screen. No relocation assistance is provided. This position is remote.