Cloud Data Pipeline Architect for Federal Analytics

Accenture Federal Services; Boston (MA); On-site; USD 140,000 - 180,000; Full time

Job summary

Accenture Federal Services is seeking a Pipeline Architect to design, build, and maintain scalable data pipelines using Databricks, Spark, and AWS services. You will collaborate with data science and analytics teams to deliver data solutions that meet business goals.

You will implement validation, monitoring, and governance processes to ensure data quality, reliability, and security, and enable analytics across defense, civilian, and health domains.

Qualifications

• Experience designing end-to-end data pipelines and workflows.
• Strong SQL, Python, and Spark-based data processing skills.
• Familiarity with cloud data warehouses and data governance.

Responsibilities

• Design, build, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies.
• Develop efficient data processing and transformation workflows to support analytics and reporting needs.
• Integrate diverse data sources including APIs, databases, and cloud storage into unified datasets.
• Work closely with cross-functional teams to design and implement data solutions aligned with business goals.
• Implement robust validation, monitoring, and observability processes to ensure data accuracy and reliability.
• Contribute to data governance, security, and automation initiatives within the data ecosystem.
• Leverage AWS services to build and deploy data solutions in a cloud-native environment.

Skills

Data pipeline design

Cloud data engineering

Data modeling

Python programming

SQL querying

Team collaboration

Tools

Databricks

Spark

AWS services

PySpark

Job description

Accenture Federal Services is seeking a Pipeline Architect to design, build, and maintain scalable data pipelines using Databricks, Spark, and AWS services. You will collaborate with data science and analytics teams to deliver data solutions that meet business goals.

You will implement validation, monitoring, and governance processes to ensure data quality, reliability, and security, and enable analytics across defense, civilian, and health domains.