Data Engineer

Robotics Technologies; Dallas (TX); In loco; USD 100.000 - 150.000; Tempo pieno

Descrizione del lavoro

Robotics Technologies LLC in Dallas, TX is seeking a Data Engineer to transform complex data into trusted information to support program delivery and operational improvements. The role requires designing and building data pipelines, integrating data from multiple sources, and ensuring data quality for actionable insights.

The successful candidate will work with data scientists and policy analysts to support reproducible research, while supporting data conversions and modernization efforts.

Competenze

• Understand policy-relevant research questions and data sources.
• Develop analytics products to deliver actionable insights.
• Self-directed and able to support multiple teams and systems.

Mansioni

• Create and maintain optimal data pipeline architecture.
• Design and implement cloud-based data solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda).
• Build and maintain data orchestration workflows (Airflow, Step Functions).
• Assemble large, complex datasets meeting business requirements.
• Engineer data environments to support statistical analysis, predictive modeling, ML.
• Collaborate with data scientists and policy analysts to ensure reproducible research.
• Identify and implement internal process improvements for data delivery and scalability.
• Build infrastructure for ETL from diverse sources using SQL and big data tech.

Conoscenze

Data pipeline design

SQL

Analytical thinking

Big data

Collaboration

Strumenti

AWS S3

AWS Glue

Amazon Redshift

AWS EMR

Amazon Athena

AWS Kinesis

AWS Lambda

Apache Airflow

AWS Step Functions

Descrizione del lavoro

Work Authorization

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Description

Data Engineer to transform complex data into trusted, usable information to support program delivery and operational improvements. The candidate will understand policy-relevant research questions, evaluate available data sources, and develop analytics products to deliver actionable insights.

Design and build data pipelines, integrate and transform data from multiple sources, identify and address data quality issues, and establish controls to support responsible use of data. This role requires both technical depth and strong analytical judgment, including the ability to work with large, complex, and confidential datasets.

The successful candidate must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. They must also be comfortable supporting data conversions associated with system modernization and/or replacement efforts. The right candidate will be excited by the prospect of optimizing the Commonwealth's longitudinal data architecture to support its next generation of data initiatives.

Roles and Responsibilities

• Create and maintain optimal data pipeline architecture.
• Design and implement cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Kinesis, and Lambda.
• Build and maintain data orchestration workflows using tools such as Apache Airflow, AWS Step Functions, or similar services.
• Assemble large, complex datasets that meet functional and non-functional business area requirements.
• Engineer analytical data environments that support advanced statistical analysis, predictive modeling, machine learning, and evidence-building activities.
• Partner with data scientists, research analysts, and policy analysts to ensure enterprise data assets support reproducible research and statistical modeling.
• Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.