Sr Data Platform Architect

General Electric; Dover (DE); Remote; USD 110,000 - 185,000; Full time

Job summary

An established industry player is seeking a Sr. Data and Information Architect to lead the Dataiku DSS platform management. This role offers a unique opportunity to shape the architecture for innovative data and analytics projects, empowering business users to harness the power of data. You will be responsible for optimizing the Dataiku environment, ensuring security and performance, and collaborating with diverse teams to implement cutting-edge ML solutions. Join a forward-thinking organization that values professional growth and offers competitive compensation and benefits, all while making a significant impact in the field of data analytics.

Benefits

Health Coverage

Retirement Plans

Tuition Assistance

Paid Parental Leave

Disability Insurance

Life Insurance

Paid Time Off

Qualifications

• 4+ years of experience in data architecture and engineering.
• Proficient in managing Dataiku DSS platform and ML model deployment.
• Strong background in SQL, Python, and AWS environments.

Responsibilities

• Manage and optimize Dataiku DSS platform for data projects.
• Collaborate with teams to integrate ML solutions and provide support.
• Design CI/CD pipelines for automated ML deployment.

Skills

Dataiku

Python

SQL

AWS

Linux

Data Architecture

MLOps

CI/CD

Machine Learning

Data Visualization

Education

Bachelor's Degree in Computer Science or IT

Associate Degree

High School Diploma

Tools

AWS EKS

Spotfire

Scikit-learn

PySpark

Job description

Job Description Summary

The Data and Infrastructure organization helps solve our customers' toughest challenges, making flights safer, power cheaper, and oil & gas production safer for people and the environment by leveraging data and analytics.

The Sr. Data and Information Architect will be responsible for managing and maintaining the Dataiku DSS platform, ensuring smooth operations, security, and performance.

Job Description

Essential Responsibilities:

The Sr. Data Platform Architect will be part of the Horizontal Family in the STE organization. In this role, you will drive the architecture for both the Self-Service Data program and the Analytic Invention program, empowering business users to create their own data and analytics projects and to develop a comprehensive and high-performance ecosystem to foster new analytics inventions. You will manage, optimize, and scale our Dataiku DSS environment, including seamless ML model deployment. The role requires expertise in Dataiku administration, infrastructure management, automation, and operationalizing AI/ML models.

Responsibilities include, but are not limited to:

1. Installing, configuring, upgrading, and troubleshooting the DSS environment.
2. Managing user access, permissions, and security settings.
3. Monitoring system performance, logs, and resources, including EKS memory usage.
4. Developing custom Python plugins, managing workflows, and integrating databases, cloud storage (S3), APIs, and external ML frameworks.
5. Ensuring platform security and compliance in line with Cyber policies.
6. Collaborating with data scientists, engineers, and product teams to integrate ML solutions, providing technical support and training.
7. Designing and implementing CI/CD pipelines for automated ML deployment using Dataiku.
8. Implementing best practices for containerization and MLOps.

Technical Skills

• Extensive experience with Dataiku
• Proficiency in Linux environments
• Knowledge of data lake concepts
• Strong SQL and Python skills
• Hands-on experience with AWS and AWS EKS
• Knowledge of Spark, distributed processing, and S3
• Experience automating manual processes
• Deep understanding of data architecture and engineering
• Knowledge of data science concepts and visualization/web app development
• Experience with IT automation processes
• Ability to communicate technical concepts effectively to non-technical audiences

Qualifications/Requirements

Bachelor’s degree with at least 4 years of professional experience, or an associate degree with 7 years, or a high school diploma with 9 years of experience. Military experience is considered equivalent.

Eligibility

Legal authorization to work in the U.S. is required. No visa sponsorship is provided.

Desired Characteristics

• Degree in Computer Science, IT, or related STEM field
• Ability to work well with diverse teams
• Experience with Spotfire, data applications, and data science/statistics
• Knowledge of machine learning libraries (Scikit-learn, MLlib, H2O), R, PySpark, SparkR
• Understanding of infrastructure architecture and technical competencies
• Interest in professional growth in data fields

Pay and Benefits

The salary range is $110,700 - $184,600 annually, plus discretionary bonuses. Benefits include health coverage, retirement plans, tuition and adoption assistance, paid parental leave, disability, life insurance, and paid time off.

Additional Information

GE Aerospace promotes a great work environment, professional development, and competitive compensation. We are an Equal Opportunity Employer committed to diversity and inclusion. Employment is contingent upon background checks and drug screening. This is a remote position. Relocation assistance is not provided.