Sr Data Platform Architect

General Electric; Charlottesville (VA); Remote; USD 110,000 - 185,000; Full time

Job summary

An established industry player is seeking a Sr. Data and Information Architect to lead the management of a cutting-edge data platform. This role is pivotal in enhancing data accessibility and fostering innovation through analytics. You will be at the forefront of deploying machine learning models and ensuring the security and performance of the Dataiku DSS platform. Join a dynamic team that values collaboration and professional growth, and contribute to making impactful decisions that drive efficiency and safety across sectors. If you're passionate about data and technology, this is the opportunity for you!

Benefits

Healthcare

Retirement plans

Tuition assistance

Paid parental leave

Disability insurance

Life insurance

Paid time off

Qualifications

• 4+ years of experience in data management and architecture.
• Proficient in Dataiku administration and machine learning deployment.

Responsibilities

• Manage and optimize Dataiku DSS platform operations.
• Collaborate with teams to integrate machine learning solutions.

Skills

Dataiku

Linux

SQL

Python

AWS

EKS

Spark

MLOps

Data Architecture

Data Visualization

Education

Bachelor's degree in Computer Science or IT

Associate degree with 7 years of experience

High school diploma with 9 years of experience

Tools

Dataiku DSS

AWS S3

Spotfire

Scikit-learn

PySpark

Job description

Job Description Summary

The Data and Infrastructure organization helps solve our customers' toughest challenges, making flights safer, power cheaper, and oil & gas production safer for people and the environment by leveraging data and analytics.

The Sr. Data and Information Architect will be responsible for managing and maintaining the Dataiku DSS platform, ensuring smooth operations, security, and performance.

Job Description

Essential Responsibilities:

The Sr. Data Platform Architect will be part of the Horizontal Family in the STE organization. In this role, you will drive the architecture for both the Self-Service Data program and Analytic Invention program, empowering business users to create their own data and analytics projects and building a comprehensive, high-performance ecosystem to foster new analytics invention. You will manage, optimize, and scale our Dataiku DSS platform, including seamless machine learning model deployment. The role requires expertise in Dataiku administration, infrastructure management, automation, and operationalizing AI/ML models.

Responsibilities include, but are not limited to:

1. Installing, configuring, upgrading, and troubleshooting the DSS environment.
2. Managing user access, permissions, and security settings.
3. Monitoring system performance, logs, and resources, including EKS memory usage.
4. Developing custom Python plugins, managing workflows, and integrating databases, cloud storage (S3), APIs, and external ML frameworks.
5. Ensuring platform security and compliance with policies.
6. Collaborating with data scientists, engineers, and product teams to integrate ML solutions, providing technical support and training.
7. Designing and implementing CI/CD pipelines for automated ML model deployment using Dataiku.
8. Implementing best practices for containerization and MLOps.

Technical Skills

• Extensive experience with Dataiku
• Proficiency in Linux environments
• Knowledge of data lake concepts
• Strong SQL and Python skills
• Hands-on experience with AWS and AWS EKS
• Knowledge of Spark, distributed processing, and S3
• Experience automating manual processes
• Deep expertise in data architecture and engineering
• Understanding of data science concepts and visualization/web apps
• Experience with IT process automation and teaching technical concepts to non-technical users

Qualifications/Requirements

• Bachelor’s degree with at least 4 years of professional experience, or an associate degree with 7 years, or a high school diploma with 9 years of experience
• Minimum 3 years of professional experience in Dataiku administration
• Military experience is considered equivalent

Eligibility

Legal authorization to work in the U.S. is required. We do not sponsor visas.

Desired Characteristics

• Bachelor's in Computer Science, IT, or related STEM field
• Ability to collaborate across diverse backgrounds
• Experience with Spotfire, data applications, data science/statistics, machine learning, Scikit-learn, MLlib, H2O, R, PySpark, SparkR
• Knowledge of infrastructure architecture and demonstrated technical competencies
• Interest in professional growth in data fields

Pay and Benefits

The salary range is $110,700 - $184,600 annually, with potential bonuses. Benefits include healthcare, retirement plans, tuition and adoption assistance, paid parental leave, disability and life insurance, and paid time off.

Additional Information

GE Aerospace offers a supportive work environment with professional development opportunities. We are an Equal Opportunity Employer and do not discriminate based on protected characteristics. Employment is contingent upon legal work authorization and passing a drug screen. This position is remote.