Senior Data Engineer (TS/SCI) — Cloud Pipelines & Spark

Accenture Federal Services Careers Marketplace; North Dakota; On-site; USD 130,000 - 265,000; Full time

Benefits offered by this job

Health insurance

Job summary

Accenture Federal Services seeks a data engineer to design and optimize data pipelines using Spark, Iceberg, EMR, and Kubernetes, ensuring data pedigree and security for government missions.

You will preprocess data for advanced analytics, collaborate with data stewards and engineers, and support data services with performance tuning across cloud and on-prem environments. A TS/SCI clearance is required.

Qualifications

• 4 to 7+ years of experience in data engineering including data lifecycle engineering; ETL tools; cloud and on-prem data storage/processing; Python, SQL, Spark; ElasticSearch, NiFi; Palantir Foundry; Agile / Scrum

Responsibilities

• Design and optimize Data Pipelines using Spark, Apache Iceberg, EMR cloud services, and Kubernetes containers.
• Ensure the pedigree and provenance of the data is maintained to protected data access.
• Clean and preprocess data to enable access for advanced analytics.
• Collaborate with enterprise working groups to advance data standards.
• Collaborate with engineering teams, data stewards, and mission partners to extract actionable value from data holdings.
• Collaborate with software engineers to update, configure, and maintain data services.
• Conduct quarterly analyses and provide recommendations for data tools in new environments.
• Provide support including administration and performance tuning of data tools.

Job description

Accenture Federal Services seeks a data engineer to design and optimize data pipelines using Spark, Iceberg, EMR, and Kubernetes, ensuring data pedigree and security for government missions.

You will preprocess data for advanced analytics, collaborate with data stewards and engineers, and support data services with performance tuning across cloud and on-prem environments. A TS/SCI clearance is required.