Senior Data Engineer - Azure Data Platform & ETL

CACI International; Arlington (VA); On-site; USD 104,000 - 218,000; Full time

Job summary

CACI is seeking a Sr. Data Engineer to design, implement, and maintain robust data pipelines and data warehouse solutions. The role focuses on ETL, data integrity, and scalable architectures using Azure data services, collaborating with data scientists and analysts to deliver high-quality data products.

Ideal candidates have DoD Secret clearance, 7+ years in data engineering, and hands-on experience with Azure ETL tools and AI/ML initiatives across complex datasets.

Qualifications

• Active DoD Secret clearance.
• BA/BS in Computer Science, Information Technology, Data Analytics, or related field.
• 7+ years of related experience.
• Strong experience in data extract transform load (ETL) processes using Azure services, such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Database, or Azure Synapse Analytics.
• 6+ years' experience and skill writing coding languages (such as SQL, Python, R, SAS, and Java Scripts).
• 4+ years' experience working with projects involving machine learning, natural language processing, robotics process automation, artificial intelligence, text and/or data mining, as well as statistical and mathematical methods.
• Experience with using SQL to conduct complex database queries.
• Experience with AI/ML.

Responsibilities

• Build, maintain, and optimize data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse.
• Integrate large, complex data sets that meet functional and non-functional business requirements.
• Design and implement scalable and reliable data warehousing solutions.
• Extract data from various sources, transform it into a usable format, and load it into Azure data storage solutions such as Azure Data Lake Storage, - Azure SQL Database, or Azure Synapse Analytics
• Develop and maintain data pipelines using Azure Data Factory and other relevant Azure technologies
• Manage and optimize databases, ensuring data quality, integrity, and security.
• Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability.
• Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver high-quality data solutions.
• Document data flows, processes, and system architecture to ensure clarity and knowledge sharing within the team.

Skills

ETL processes

Azure services

SQL

Python

R

SAS

JavaScript

Education

BA/BS in Computer Science, Information Technology, Data Analytics, or related field

Tools

Azure Data Factory

Azure Databricks

Azure Data Lake Storage

Azure SQL Database

Azure Synapse Analytics

Job description

CACI is seeking a Sr. Data Engineer to design, implement, and maintain robust data pipelines and data warehouse solutions. The role focuses on ETL, data integrity, and scalable architectures using Azure data services, collaborating with data scientists and analysts to deliver high-quality data products.

Ideal candidates have DoD Secret clearance, 7+ years in data engineering, and hands-on experience with Azure ETL tools and AI/ML initiatives across complex datasets.