Senior Data Engineer: Cloud Data Pipelines & AI-Ready

Index Analytics LLC; Milford Mill (MD); On-site; USD 120,000 - 160,000; Full time

Job summary

Index Analytics LLC is seeking a Sr. Data Engineer to design, build, and optimize scalable cloud-based data pipelines for government clients.

The role centers on modernizing data ecosystems, transitioning legacy solutions to modern infrastructure, and delivering analytics-ready data ecosystems. The ideal candidate will collaborate with data engineers, health policy researchers, and analysts to ingest diverse data sources and enable advanced analytics and reporting.

Qualifications

• Bachelor's degree and 10+ years of professional experience in BI/data analytics or enterprise IT solutions.
• Experience designing, developing, and implementing scalable data pipelines, data warehouses, and data lakes.
• Strong proficiency in SQL and Python for data transformation and analytics.

Responsibilities

• Gather requirements and document business rules with stakeholders and cross-functional teams.
• Design and implement scalable ETL/ELT pipelines using AWS and Databricks.
• Oversee Databricks Unity Catalog population and administration.
• Develop data models and data dictionaries to support analytics and reporting.
• Build secure, scalable, and cost-optimized data solutions.
• Implement data quality, validation, and monitoring frameworks.

Skills

SQL

Python

AWS

Databricks

CI/CD

GitHub

Agile

Communication

Data modeling

ETL/ELT

Education

Bachelor's degree

Tools

Databricks

AWS

GitHub

Job description

Index Analytics LLC is seeking a Sr. Data Engineer to design, build, and optimize scalable cloud-based data pipelines for government clients.

The role centers on modernizing data ecosystems, transitioning legacy solutions to modern infrastructure, and delivering analytics-ready data ecosystems. The ideal candidate will collaborate with data engineers, health policy researchers, and analysts to ingest diverse data sources and enable advanced analytics and reporting.