IT Applications Data Engineer

DataJobs; Amarillo (TX); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Comprehensive health coverage

Robust retirement planning

Education reimbursement

Opportunities for continuous learning

Job summary

DataJobs is seeking an IT Applications Data Engineer to design and optimize high-performance data pipelines and infrastructure for enterprise AI and analytics. You will build scalable batch and real-time data flows using Databricks, Snowflake, and cloud services, writing production-grade Python/Scala code to transform data for models.

Responsibilities include data quality, lineage, monitoring, MLOps support, and secure ingestion.

Qualifications

• Bachelor’s degree in engineering/science/IT with 2+ years of experience.
• Master’s degree in engineering/science/IT is alternative.
• 10 years education/experience combination acceptable.
• At least 2 years in enterprise data pipelines incl. ELT/ETL.
• Expert SQL and Python/Scala for data manipulation.
• Experience with Spark/Databricks/Snowflake and cloud data services.
• MS degree plus 3+ years of relevant experience.
• Certifications such as Databricks/Snowflake/Azure Data Engineer are a plus.
• Experience with streaming (Kafka, Event Hubs).
• Data modeling concepts: Dimensional Modeling, Data Vault.

Responsibilities

• Build, test, and maintain scalable data pipelines for batch and real-time use.
• Manage systems in the modern data stack (Databricks, Snowflake, cloud warehouses).
• Develop production-grade Python/Scala code to ETL data into models.
• Implement data quality, lineage, and monitoring tooling.
• Optimize database performance and cost across cloud storage/services.
• Support Data Science with feature-ready data and MLOps integration.
• Enforce DataOps and DevSecOps for testing, deployment, and security.
• Maintain data flow docs, dictionaries, and runbooks for production infra.
• Collaborate with API teams to secure ingestion from sources.
• Model new sources with Data Architects to align with standards.

Skills

SQL

Python

Scala

Databricks

Snowflake

Apache Spark

Azure Data Factory

AWS Glue

Kafka

Azure Event Hubs

MLOps

ELT/ETL

DataOps

DevSecOps

Dimensional Modeling

Data Vault

Telemetry and data governance

Education

Bachelor’s degree in engineering/science/IT

Minimum 2 years of relevant experience

Master’s degree in engineering/science/IT

10 years education/experience combination

MS degree with 3+ years experience

Relevant certifications (Databricks/Snowflake/Azure Data Engineer)

Tools

Databricks

Snowflake

Apache Spark

Azure Data Factory

AWS Glue

Kafka

Azure Event Hubs

Job description

The IT Applications Data Engineer designs and optimizes high-performance data pipelines and data infrastructure to enable enterprise AI, machine learning, and advanced analytics.

Responsibilities

• Build, test, and maintain highly scalable data pipelines for batch and real-time consumption using cloud-native services and distributed processing frameworks.
• Construct and manage systems in the modern data stack (including Databricks, Snowflake, or equivalent cloud warehouse/lakehouse solutions) to support accessibility and performance.
• Develop production-grade code in Python or Scala to cleanse, transform, and load complex, high-volume data into structured models defined by the Data Architect.
• Implement data quality controls, data lineage tooling, and pipeline monitoring to ensure integrity and rapid detection of failures.
• Optimize database performance, query efficiency, and cost management across secure cloud storage and processing services.
• Enable Data Science by providing efficient data access, supporting feature engineering workflows, and integrating model-ready data into MLOps.
• Help define and enforce DataOps and DevSecOps practices for automated data pipeline testing, deployment, and security.
• Maintain documentation for data flows, data dictionaries, and operational runbooks for production data infrastructure.
• Collaborate with application development teams and API developers to establish secure, efficient ingestion points from source systems.
• Work with Data Architects to model new sources so new data assets align with enterprise data standards and architectures.

Requirements

• Bachelor’s degree in an engineering/science/information technology discipline and minimum 2 years of relevant experience.
• OR Master’s degree in an engineering/science/information technology discipline.
• OR applicants without a bachelor’s degree may be considered based on a combination of at least 10 years of completed education and/or relevant experience.
• Minimum 2 years of relevant experience, including at least 1 year focused on enterprise data pipelines and ELT/ETL processes.
• Expert proficiency in SQL and Python or Scala for data manipulation, transformation, and automation.
• Demonstrated experience with distributed processing frameworks (e.g., Apache Spark, Databricks, Snowflake) and cloud data services (e.g., Azure Data Factory, AWS Glue).
• Master’s degree (MS) plus minimum 3 years of relevant experience.
• Relevant certifications (examples: Databricks Certified Data Engineer, Snowflake Certification, Azure Data Engineer Associate).
• Experience with streaming technologies for near real-time ingestion (e.g., Kafka, Azure Event Hubs).
• Experience with data modeling concepts (e.g., Dimensional Modeling, Data Vault) as implemented in data warehousing solutions.

Technologies

• Python, Scala, SQL
• Databricks, Snowflake
• Apache Spark
• Azure Data Factory, AWS Glue
• Kafka, Azure Event Hubs
• MLOps
• ELT, ETL
• DataOps, DevSecOps
• Dimensional Modeling, Data Vault

Benefits

• Comprehensive health coverage
• Robust retirement planning
• Education reimbursement
• Opportunities for continuous learning

Location

• Amarillo, TX (Onsite) - Pantex Plant

Additional Requirements and Notes

• Requires a Q clearance; all qualified candidates will be considered regardless of current clearance status.
• Must be able to obtain and maintain a Department of Energy Q clearance.
• Position may require entry into Materials Access Areas (MAA) and participation in the Human Reliability Program (HRP).
• If HRP is required, candidate must complete a counterintelligence-scope polygraph per 10 CFR 709.
• Medical requirements may apply.
• Pantex is a drug-free workplace; pre-placement physical, drug screening, and background investigation required for candidates accepting an offer.
• U.S. citizenship is required for security clearance applicants.
• Employees are subject to random drug testing without advance notification.

Career level: Senior Associate to Specialist

Organization: Mission Systems (50214380)

Job specialty: System Development

DOE Order 426.2A requirements: Not Applicable