Security Data & Automation Engineer (AI Pipelines)

Xcel Engineering

Oak Ridge (TN)

On-site

USD 120,000 - 180,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

XCEL Engineering seeks a highly skilled Security Data & Automation Engineer with hands-on experience in data acquisition, pipeline development, ETL processes, automation, API integration, and application development.

The ideal candidate will have a strong technical background in Python, data engineering, and secure data management, with the ability to develop scalable data pipelines, integrate diverse data sources, support AI capabilities, and ensure data is accurate, secure, and accessible for

Qualifications

U.S. Citizen with the ability to obtain and maintain a DoE security clearance.
B.S. degree in Information Technology, Computer Science, Data Engineering, Software Engineering, or a similar technical field.
Minimum 10 years of substantial progressive experience in data engineering, software development, automation, systems integration, or a related technical field.
Strong proficiency in Python for application development, scripting, data processing, and automation.
Demonstrated experience designing, developing, and maintaining data pipelines, ingestion workflows, and ETL processes.
Experience acquiring, transforming, validating, and integrating data from multiple sources, including databases, APIs, and file systems.
Experience developing and maintaining API integrations, automated workflows, and scalable data processing solutions.
Proficiency with Git-based development workflows, including version control and collaborative software development practices.
Experience with data integration, ETL, or workflow automation tools such as Apache NiFi, Talend, Informatica, or similar platforms.
Familiarity with data processing and streaming technologies such as Kafka, Spark, or Hadoop.
Knowledge of secure data storage, data integrity, access controls, and applicable data governance requirements.
Experience troubleshooting complex data ingestion, integration, automation, and application development issues.
Strong analytical, problem-solving, and organizational skills, with the ability to translate technical requirements into effective solutions.
Excellent written and verbal communication skills, with the ability to collaborate effectively across technical teams and stakeholder groups.
Ability to work independently, manage competing priorities, and deliver reliable, secure, and scalable technical solutions.

Responsibilities

Identify, connect to, and acquire data from diverse sources, including databases, APIs, file systems, and streaming platforms.
Design, develop, automate, and maintain scalable data pipelines and ingestion workflows.
Transform, clean, validate, parse, enrich, and convert raw data into reliable, usable formats.
Integrate data from multiple sources to create cohesive, accurate datasets.
Design, implement, monitor, troubleshoot, and optimize ETL processes, automation workflows, and API integrations.
Develop and maintain custom applications, scripts, and automation tools using Python and Git-based development workflows.
Troubleshoot data ingestion, processing, workflow, and integration issues to ensure reliable performance and scalability.
Support advanced AI integration, including hardware and software deployment, inference workflows, and performance optimization.
Implement secure data storage and management practices to ensure data integrity, availability, and accessibility for downstream systems and users.
Document data sources, ingestion processes, transformations, integrations, and workflows in accordance with established standards.
Ensure data engineering and automation solutions comply with applicable security, governance, and regulatory requirements.
Collaborate with technical teams and stakeholders to identify requirements, improve data workflows, and implement effective automation and integration solutions.
Communicate technical concepts, project updates, and solutions clearly to technical and non-technical stakeholders.