Sr Data Platform Architect

General Electric; Kansas City (MO); Remote; USD 110,000 - 185,000; Full time

Job summary

An innovative organization is seeking a Sr. Data and Information Architect to lead the Dataiku DSS platform's management and optimization. This exciting role involves ensuring smooth operations, security, and performance while fostering a culture of data-driven decision-making. You will empower business users to create their own analytics projects and drive the architecture for self-service data programs. The position offers a dynamic work environment where you can collaborate with diverse teams and leverage cutting-edge technologies to implement best practices in MLOps and automation. If you're passionate about data and eager to make an impact, this opportunity is for you.

Benefits

Health insurance

Retirement plan

Tuition assistance

Professional development opportunities

Qualifications

• 4+ years of experience in Dataiku administration and data architecture.
• Proficient in Python and SQL with strong AWS skills.

Responsibilities

• Manage and optimize the Dataiku DSS platform for performance and security.
• Collaborate with teams to integrate ML solutions and automate processes.

Skills

Dataiku

Linux

SQL

Python

AWS

Spark

MLOps

Data architecture

Education

Bachelor’s degree in Computer Science or related field

Associate’s degree with additional experience

High School Diploma with extensive experience

Tools

Dataiku DSS

AWS (EKS, S3)

Spotfire

Scikit-learn

PySpark

Job description

Job Description Summary

The Data and Infrastructure organization helps solve our customers' toughest challenges, making flights safer, power cheaper, and oil & gas production safer for people and the environment by leveraging data and analytics.

The Sr. Data and Information Architect will be responsible for managing and maintaining the Dataiku DSS platform, ensuring smooth operations, security, and performance.

Job Description

Essential Responsibilities:

The Sr. Data Platform Architect will be part of the Horizontal Family in the STE organization. In this role, you will drive the architecture for both the Self-Service Data program and Analytic Invention program, empowering business users to create their own data and analytics projects and building a comprehensive ecosystem to foster innovation. You will manage, optimize, and scale our Dataiku DSS platform, including seamless machine learning model deployment. The role requires expertise in Dataiku administration, infrastructure management, automation, and operationalizing AI/ML models.

Responsibilities include, but are not limited to:

1. Installing, configuring, upgrading, and troubleshooting the DSS environment.
2. Managing user access, permissions, and security settings.
3. Monitoring and optimizing system performance, logs, and resources, including EKS memory usage.
4. Developing custom Python plugins, managing workflows, and integrating databases, cloud storage (S3), APIs, and external ML frameworks.
5. Ensuring security and compliance with policies as required by Cybersecurity standards.
6. Collaborating with data scientists, engineers, and product teams to integrate ML solutions, providing technical support and training.
7. Designing and implementing CI/CD pipelines for automated ML model deployment using Dataiku.
8. Implementing best practices for containerization and MLOps.

Technical Skills

• Extensive experience with Dataiku
• Proficiency in Linux environments
• Knowledge of data lake concepts
• Strong SQL and Python skills
• Hands-on experience with AWS, including EKS and S3
• Experience with Spark and distributed processing
• Automating manual processes and data architecture expertise
• Understanding of data science concepts and visualization/web applications

Qualifications/Requirements

• Bachelor’s degree with at least 4 years of professional experience, or an Associate’s degree with 7 years, or a High School Diploma with 9 years of experience
• Minimum of 3 years of experience in Dataiku administration

Eligibility

Legal authorization to work in the U.S. is required. We do not sponsor visas.

Desired Characteristics

• Bachelor’s in Computer Science, IT, or related STEM field
• Ability to work well with diverse teams and backgrounds
• Experience with Spotfire, data applications, data science, and machine learning concepts
• Knowledge of libraries like Scikit-learn, MLlib, H2O, R, PySpark, SparkR
• Understanding of infrastructure architecture and technical competencies
• Interest in growing as a data professional

Pay and Benefits

The annual base salary ranges from $110,700 to $184,600, influenced by experience and skills. The role is eligible for bonuses and other benefits, including health, retirement, tuition assistance, and more.

Additional Information

GE Aerospace offers a supportive work environment, professional development, and competitive compensation. We are an Equal Opportunity Employer. Employment is contingent on legal work authorization and passing a drug screen. This is a remote position.