Senior Data Analytics Engineer - Production Data Pipelines

AIS (Applied Information Sciences); Alabama; On-site; USD 110,000 - 166,000; Full time

Job summary

Applied Information Sciences seeks a Senior Data Analytics Engineer to support a federal client. You will design and implement scalable data pipelines, perform data validation, and establish robust schemas using Python, Pandas, and Spark.

Required: 5+ years in Data Engineering, strong Python background, and an Active Secret Clearance. Experience with Databricks and Postgres is essential for success on this complex project.

Qualifications

• Bachelor’s Degree in Computer Science (or closely related degree).
• At least 5+ years of experience in Data Engineering.
• Must have experience with Python, pandas, pandera, SQL, Postgres, Databricks, and Spark.
• Must have a strong Python background.
• Must have strong experience working with messy data, disparate data sources, establishing and maintaining schemas, and setting up data validation steps.
• Must be comfortable working with large data workflows (100GB+).
• Must have an Active Secret Clearance.

Responsibilities

• Develop and deploy software into production in government environments.
• Set up data validation steps.
• Establish and maintain schemas.

Skills

Python

pandas

pandera

SQL

Postgres

Databricks

Spark

Education

Bachelor’s Degree in Computer Science (or closely related degree)

Tools

Databricks

Job description

Applied Information Sciences seeks a Senior Data Analytics Engineer to support a federal client. You will design and implement scalable data pipelines, perform data validation, and establish robust schemas using Python, Pandas, and Spark.

Required: 5+ years in Data Engineering, strong Python background, and an Active Secret Clearance. Experience with Databricks and Postgres is essential for success on this complex project.