Cloud Data Pipeline Architect for Analytics

Accenture Federal Services; Montpelier (VT); In loco; USD 140.000 - 180.000; Tempo pieno

Descrizione del lavoro

Accenture Federal Services is seeking a Pipeline Architect to design, build, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies. You will develop data processing workflows and integrate diverse data sources to support analytics and reporting across federal programs.

You will collaborate with data science, analytics, and business units to align data solutions with mission goals, while implementing validation, monitoring, and governance to ensure data

Competenze

• US Citizen required
• Experience with cloud-based ETL services (AWS Glue, Dataflow, Azure Data Factory)
• Experience with data platforms (Databricks, Palantir, Snowflake)
• Proficiency in Python, SQL, Spark and PySpark
• Experience integrating diverse data sources and APIs
• Knowledge of data governance, security, and data quality processes
• Experience with AWS services (S3, Glue, Lambda, Redshift) is a plus

Mansioni

• Design, build, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies.
• Develop efficient data processing and transformation workflows to support analytics and reporting needs.
• Integrate diverse data sources including APIs, databases, and cloud storage into unified datasets.
• Work closely with cross-functional teams to design and implement data solutions that align with business goals.
• Implement validation, monitoring, and observability to ensure data accuracy and reliability.
• Contribute to data governance, security, and automation initiatives within the data ecosystem.
• Leverage AWS services to deploy data solutions in a cloud-native environment.

Conoscenze

Python

SQL

Spark

PySpark

Databricks

Palantir

Snowflake

ETL

APIs

Cloud Data Warehousing

Strumenti

Databricks

Palantir

Snowflake

Descrizione del lavoro

Accenture Federal Services is seeking a Pipeline Architect to design, build, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies. You will develop data processing workflows and integrate diverse data sources to support analytics and reporting across federal programs.

You will collaborate with data science, analytics, and business units to align data solutions with mission goals, while implementing validation, monitoring, and governance to ensure data