Senior Data Engineer (Azure Data Factory Databricks, PostgreSQL, Python) -(USC or GC only) - Lo[...]

Creative Solutions Services, LLC; Reston (VA); Hybrid; USD 120,000 - 170,000; Full time

Job summary

Creative Solutions Services, LLC in Reston, VA seeks a Senior Data Engineer to design and maintain scalable data pipelines in Azure. On-site 9-10 days a month, with no relocation.

You will work with Azure Data Factory, Databricks, Python, and PostgreSQL to build reliable analytics-ready data products, collaborate with analytics and engineering teams, and contribute to governance and performance tuning.

Strong SQL, ETL/ELT, Spark and CI/CD experience required; US work authorization is required.

Qualifications

• Bachelor's degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or related field (Master's preferred)
• 5 years of data engineering experience working with production data pipelines
• 5 years of applied data analysis and statistical data work
• 3 years of ETL / ELT development experience
• 3 years working with relational databases and performance tuning
• Experience with Azure data services (Data Factory, Databricks, Data Lake, Synapse, Delta Lake, or similar)
• Strong programming experience with Python, PySpark, SQL, and Bash
• Experience with Kafka, SAP data services, or similar integration tools preferred
• Experience with PostgreSQL, SAP ASE, or comparable databases
• Experience with Power BI or BusinessObjects is a plus
• Experience with CI/CD pipelines, Git, Kubernetes, and infrastructure-as-code
• Knowledge of data governance, cataloging, and access control
• Experience with monitoring tools such as Datadog, Grafana, or Prometheus
• Ability to work independently while managing multiple priorities
• Strong communication and documentation skills
• Must be eligible to work in the United States

Responsibilities

• Design, build, and maintain scalable production data pipelines supporting enterprise data platforms
• Perform exploratory data analysis, statistical analysis, and data validation to support analytics and reporting
• Develop and optimize ETL/ELT workflows including job design, orchestration, and performance tuning
• Build and maintain relational database schemas, queries, and stored procedures
• Work within Azure-based data environments including Data Factory, Databricks, and Data Lake Storage
• Collaborate with analytics, BI, and engineering teams to deliver reliable data products
• Implement monitoring, logging, and observability for data pipelines
• Maintain documentation, data lineage, and governance standards
• Participate in architecture discussions and contribute to long-term data platform strategy

Skills

Azure Data Factory

Databricks

Python

SQL

ETL/ELT pipelines

Data Lake

Spark

Data Engineering

Cloud Data Platforms

CI/CD

Education

Bachelor's degree in related field

Tools

Azure Data Factory

Databricks

Data Lake

Job description

Senior Data Engineer (PostgreSQL, Python, Azure)

Location: Reston VA (on-site 9-10 days a month) - Only local candidates will be considered. No relocation is available.

Salary: Open and will be commensurate with experience.

NOTE: This is a full time position and this person must be a Green Card Holder or be a US Citizen of the United States, as per the company, due to government compliance.

Must have the following:

• Azure Data Factory
• Databricks
• Python
• SQL
• ETL/ELT pipelines
• Data Lake
• Spark
• Data Engineering
• Cloud Data Platforms
• CI/CD

Responsibilities:

• Design, build, and maintain scalable production data pipelines supporting enterprise data platforms
• Perform exploratory data analysis, statistical analysis, and data validation to support analytics and reporting
• Develop and optimize ETL/ELT workflows including job design, orchestration, and performance tuning
• Build and maintain relational database schemas, queries, and stored procedures
• Work within Azure-based data environments including Data Factory, Databricks, and Data Lake Storage
• Collaborate with analytics, BI, and engineering teams to deliver reliable data products
• Implement monitoring, logging, and observability for data pipelines
• Maintain documentation, data lineage, and governance standards
• Participate in architecture discussions and contribute to long-term data platform strategy

Requirements:

• Bachelor's degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or related field (Master's preferred)
• 5 years of data engineering experience working with production data pipelines
• 5 years of applied data analysis and statistical data work
• 3 years of ETL / ELT development experience
• 3 years working with relational databases and performance tuning
• Experience with Azure data services (Data Factory, Databricks, Data Lake, Synapse, Delta Lake, or similar)
• Strong programming experience with Python, PySpark, SQL, and Bash
• Experience with Kafka, SAP data services, or similar integration tools preferred
• Experience with PostgreSQL, SAP ASE, or comparable databases
• Experience with Power BI or BusinessObjects is a plus
• Experience with CI/CD pipelines, Git, Kubernetes, and infrastructure-as-code
• Knowledge of data governance, cataloging, and access control
• Experience with monitoring tools such as Datadog, Grafana, or Prometheus
• Ability to work independently while managing multiple priorities
• Strong communication and documentation skills
• Must be eligible to work in the United States