Senior Cloud Data Architect - ETL, Spark, AWS

VTG; McLean (VA); On-site; USD 180,000 - 240,000; Full time

Job summary

VTG is seeking an experienced Data Architect to join a team supporting data engineering, operations, software engineering, security engineering, DevOps, application development, data science, and program management in data acquisition, exploitation, engineering and management tasks. The role requires communicating across organizational boundaries to customer staff and external stakeholders.

You will work with cloud environments (AWS), big data stacks (HDFS, Cloudera, Spark, Presto, SQL, NoSQL)

Qualifications

• Experience with cloud infrastructure and data management.
• Experience with Windows, Linux, and MacOS.
• Experience with AWS cloud environments.
• Experience with Hadoop, Cloudera, Spark, Presto, SQL and NoSQL.
• Experience conducting data processing activities.
• Experience working with Python.
• Experience building ETL pipelines.
• Experience with integrating data flows with Niagara Falls.
• Ability to work independently in fast-paced environments and be proactive.
• Ability to communicate clearly to technical and non-technical audiences.

Responsibilities

• Demonstrated experience with cloud infrastructure and data management.
• Demonstrated experience with multiple OS environments including Windows, Linux, and MacOS.
• Demonstrated experience with cloud environments, including AWS.
• Demonstrated experience with development environments including AWS, Hadoop distributed file system (HDFS), Cloudera, Spark, Presto, SQL, and NoSQL.
• Demonstrated experience conducting data processing activities.
• Experience working with Python.
• Demonstrated experience building executing ETL pipelines.
• Demonstrated experience with integrating data flows with industry standard systems such as Niagra Falls.
• Ability to work independently in a fast-paced environment and be a proactive problem solver.
• Experience providing clear and concise communications for both technical and non-technical audiences.

Skills

Python

ETL pipelines

Cloud infrastructure

Data processing

Tools

AWS

Hadoop/HDFS

Cloudera

Spark

Presto

SQL

NoSQL

Neo4j

Niagara Falls

Job description

VTG is seeking an experienced Data Architect to join a team supporting data engineering, operations, software engineering, security engineering, DevOps, application development, data science, and program management in data acquisition, exploitation, engineering and management tasks. The role requires communicating across organizational boundaries to customer staff and external stakeholders.

You will work with cloud environments (AWS), big data stacks (HDFS, Cloudera, Spark, Presto, SQL, NoSQL)