Cloud Data Pipeline Architect (AWS, Databricks)

Accenture Federal Services; Virginia Beach (VA); On-site; USD 140,000 - 190,000; Full time

Job summary

Accenture Federal Services is seeking a Pipeline Architect to design and build scalable data pipelines, integrating diverse data sources for analytics and reporting. You will collaborate with data science and business units to implement robust data solutions in a cloud-native environment.

The role focuses on data processing, validation, monitoring, and governance, leveraging AWS services and modern platforms to ensure data accuracy and security in a federal government context.

Qualifications

• Experience with cloud-based ETL services (AWS Glue, Google Cloud Dataflow, Azure Data Factory)
• Experience with data warehousing technologies (Redshift, BigQuery, Snowflake)
• Proficiency in Python, SQL, Spark, and PySpark
• Experience with data platforms such as Databricks, Palantir, and Snowflake
• Familiarity with data orchestration and data quality processes
• Must be a US Citizen

Responsibilities

• Design, build, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies
• Develop efficient data processing and transformation workflows to support analytics and reporting needs
• Integrate diverse data sources including APIs, databases, and cloud storage into unified datasets
• Collaborate with data science, analytics, and business teams to design data solutions that align with goals
• Implement validation, monitoring, and observability to ensure data accuracy and reliability
• Contribute to data governance, security, and automation initiatives in the data ecosystem
• Leverage AWS services (S3, Glue, Lambda, Redshift) to deploy cloud-native data solutions

Skills

Python

SQL

Spark

PySpark

Data governance

Data quality

Education

Palantir Foundry Data Engineer certification

Azure Data Engineer Associate

Google Professional Data Engineer

IBM Certified Data Engineer

Tools

Databricks

Palantir

Snowflake

AWS

Redshift

Glue

Lambda

ElasticSearch

NiFi

Job description

Accenture Federal Services is seeking a Pipeline Architect to design and build scalable data pipelines, integrating diverse data sources for analytics and reporting. You will collaborate with data science and business units to implement robust data solutions in a cloud-native environment.

The role focuses on data processing, validation, monitoring, and governance, leveraging AWS services and modern platforms to ensure data accuracy and security in a federal government context.