Sr Data Platform Architect

General Electric; Madisonville (KY); Remote; USD 110,000 - 185,000; Full time

Job summary

An established industry player seeks a Sr. Data and Information Architect to enhance its data ecosystem. In this pivotal role, you will manage the Dataiku DSS platform, ensuring optimal performance and security while empowering teams to innovate with data. Your expertise in data architecture, machine learning, and automation will drive the development of high-performance analytics solutions. Join a dynamic team that values diversity and offers comprehensive benefits, including health and retirement plans. If you're passionate about data and eager to make an impact, this remote opportunity awaits you!

Benefits

Comprehensive health insurance

Retirement benefits

Tuition assistance

Adoption assistance

Paid parental leave

Disability insurance

Life insurance

Qualifications

• 4+ years of experience in data architecture and Dataiku administration.
• Strong background in SQL, Python, and AWS for data management.

Responsibilities

• Manage and optimize the Dataiku DSS platform for performance and security.
• Collaborate with teams to integrate ML solutions and automate processes.

Skills

Dataiku

Linux

SQL

Python

AWS (EKS, S3)

Spark

Data Architecture

MLOps

Education

Bachelor's in Computer Science or IT

Associate's Degree with 7 years experience

High School Diploma with 9 years experience

Tools

Dataiku DSS

Spotfire

Scikit-learn

MLlib

H2O

PySpark

SparkR

Job description

**Job Description Summary**

The Data and Infrastructure organization helps solve our customers' toughest challenges, making flights safer, power cheaper, and oil & gas production safer for people and the environment by leveraging data and analytics.

The Sr. Data and Information Architect will be responsible for managing and maintaining the Dataiku DSS platform, ensuring smooth operations, security, and performance.

**Job Description**

**Essential Responsibilities:**

The Sr. Data Platform Architect will be part of the Horizontal Family in the STE organization. In this role, you will drive the architecture for both the Self-Service Data program and the Analytic Invention program, empowering business users to create their own data and analytics projects and building a comprehensive, high-performance ecosystem to foster analytics innovation. You will manage, optimize, and scale our Dataiku DSS platform, including seamless deployment of machine learning models. The role requires expertise in Dataiku administration, infrastructure management, automation, and operationalizing AI/ML models.

**Responsibilities include, but are not limited to:**

1. Platform administration:
2. Installing, configuring, upgrading, and troubleshooting the DSS environment.
3. Managing user access, permissions, and security settings.
4. Monitoring and optimizing system performance, logs, and resources, including EKS memory usage.
5. Developing automation and integrations, such as custom Python plugins, workflows, database and cloud storage integrations (e.g., S3), APIs, and external ML frameworks.
6. Ensuring security and compliance policies are adhered to.
7. Collaborating with data scientists, engineers, and product teams to integrate ML solutions, providing technical support and training.
8. Designing and implementing CI/CD pipelines for automated ML model deployment using Dataiku.
9. Applying best practices for containerization and MLOps.

**Technical Skills:**

• Extensive experience with Dataiku.
• Proficiency in Linux environments.
• Knowledge of data lake concepts.
• Strong SQL and Python skills.
• Hands-on experience with AWS, especially EKS and S3.
• Knowledge of Spark and distributed processing.
• Experience automating manual processes and designing data architectures.
• Understanding of data science concepts and visualization/web apps.
• Experience with IT process automation.
• Ability to communicate technical concepts effectively to non-technical audiences.

**Qualifications/Requirements:**

• Bachelor’s degree in a relevant field with at least 4 years of professional experience, or an Associate’s degree with at least 7 years, or a High School Diploma with at least 9 years of experience.
• Minimum 3 years of professional experience in Dataiku administration.

**Eligibility:**

• Legal authorization to work in the U.S. is required. We do not sponsor visas.

**Desired Characteristics:**

• Bachelor’s in Computer Science, IT, or related STEM field.
• Ability to work well with diverse teams and backgrounds.
• Experience with Spotfire, data applications, data science, machine learning, and relevant libraries (Scikit-learn, MLlib, H2O, R, PySpark, SparkR).
• Interest in professional growth in data fields.

**Pay and Benefits:**

The annual base salary ranges from $110,700 to $184,600, with potential bonuses. GE Aerospace offers comprehensive health, retirement, and other benefits, including tuition and adoption assistance, paid parental leave, disability, and life insurance.

**Additional Information:**

GE Aerospace promotes a diverse, inclusive environment and is an Equal Opportunity Employer. Employment is contingent upon a successful background check and drug screening. This is a remote position.