Data Engineer

Valiant Technologies LLC; McLean (VA); Ibrido; USD 120.000 - 180.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid work schedule

Onsite 3 days/week

Descrizione del lavoro

Valiant Technologies LLC is seeking a data engineer to design, build, and optimize scalable data pipelines on AWS. You will develop cloud-based data solutions, leverage Snowflake for storage and processing, and create dashboards for cross-platform data consumption.

The role emphasizes monitoring, observability, and incident response in production environments. The ideal candidate has 6+ years of data engineering experience with PySpark, AWS Glue, Snowflake, SQL, and Databricks, and is

Competenze

• 6+ years of data engineering experience.
• Strong hands-on expertise with AWS data engineering services.
• Proven experience with PySpark, AWS Glue, Snowflake, SQL, and Databricks.
• Experience building and supporting enterprise-scale data pipelines.
• Knowledge of dashboard development, monitoring, and observability solutions.
• Comfort working in production environments and supporting critical data workflows.
• Ability to work onsite three days per week in McLean, VA or Riverwoods, IL.

Mansioni

• Design, develop, and optimize scalable data pipelines.
• Build data solutions for evolving consumer and business requirements.
• Develop and maintain cloud-based data engineering solutions on AWS.
• Use Snowflake for enterprise data storage and processing.
• Create dashboards and support data consumption across platforms.
• Implement and enhance monitoring, observability, and operational excellence practices.
• Monitor production workflows and respond to incidents, including through PagerDuty.
• Collaborate with business and technology teams to deliver reliable data products.

Conoscenze

AWS data services

PySpark

Snowflake

SQL

Databricks

Dashboard development

Monitoring/observability

Strumenti

AWS Glue

PagerDuty

Descrizione del lavoro

• Design, develop, and optimize scalable data pipelines.
• Build data solutions for evolving consumer and business requirements.
• Develop and maintain cloud-based data engineering solutions on AWS.
• Use Snowflake for enterprise data storage and processing.
• Create dashboards and support data consumption across platforms.
• Implement and enhance monitoring, observability, and operational excellence practices.
• Monitor production workflows and respond to incidents, including through PagerDuty.
• Collaborate with business and technology teams to deliver reliable data products.

Required Qualifications:

• 6+ years of data engineering experience.
• Strong hands-on expertise with AWS data engineering services.
• Proven experience with PySpark, AWS Glue, Snowflake, SQL, and Databricks.
• Experience building and supporting enterprise-scale data pipelines.
• Knowledge of dashboard development, monitoring, and observability solutions.
• Comfort working in production environments and supporting critical data workflows.
• Ability to work onsite three days per week in McLean, VA or Riverwoods, IL.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.