Cloud Data Engineer: Pipelines, Spark & Databricks

Accenture Federal Services; Washington (District of Columbia); On-site; USD 93,400 - 176,200; Full time

Job summary

Accenture Federal Services seeks a skilled Pipeline Architect for their Washington D.C. office to design, build, and maintain data pipelines using technologies like Databricks and AWS. Candidates must have experience with cloud-based ETL services, data warehousing, and programming in Python and SQL. A Top Secret security clearance is required. The position offers a competitive salary range of $93,400 to $176,200 depending on experience and location.

Qualifications

• Experience with cloud-based ETL services like AWS Glue, Google Cloud Dataflow.
• Familiarity with data orchestration and data quality processes.
• Data engineering certification such as Azure Data Engineer Associate.

Responsibilities

• Design and maintain scalable end-to-end data pipelines.
• Develop efficient data processing workflows for analytics.
• Integrate diverse data sources into unified datasets.
• Implement robust data validation and monitoring.
• Leverage AWS services to build and deploy data solutions.

Skills

Cloud-based ETL services

Data warehousing technologies

Python

SQL

Spark

PySpark

Data platforms like Databricks

Tools

Docker

Kubernetes

Hadoop

NiFi

ElasticSearch

Job description

Accenture Federal Services seeks a skilled Pipeline Architect for their Washington D.C. office to design, build, and maintain data pipelines using technologies like Databricks and AWS. Candidates must have experience with cloud-based ETL services, data warehousing, and programming in Python and SQL. A Top Secret security clearance is required. The position offers a competitive salary range of $93,400 to $176,200 depending on experience and location.