Remote Data Engineer: Cloud Pipelines & Governance

Socket.dev; Oak Brook (IL); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Collegis Education seeks a data engineer to design, build, and maintain cloud-native data integrations and transformations across data warehouses, lakes, and lakehouses. You will ensure data governance, quality, and security while collaborating with cross-functional teams to onboard new sources and align with policy standards.

The role requires 2–5 years in data engineering, strong SQL, Python, and bash, plus familiarity with Terraform and dbt.

Qualifications

• Bachelor's or Master's Degree in MIS, IS, Business Analytics, Computer Science, a related field, or equivalent experience.
• 2-5 years of experience in data engineering.
• Advanced SQL, plus bash and Python competency. Terraform familiarity a plus.
• Experience with cloud-native data integration and transformation tools such as Apache Beam, Google Cloud Data Fusion, dbt, serverless functions.
• Experience with cloud-native data storage solutions.

Responsibilities

• Design, develop and maintain data integration and transformation solutions using cloud-native tools such as Apache Beam, Google Cloud Data Fusion, dbt, serverless functions, and cloud-based database and data storage solutions.
• Build and run scalable and reliable data pipelines using cloud data pipeline orchestration tools and approaches.
• Ensure data quality and governance by implementing data quality processes and workflows.
• Collaborate with cross-functional teams to identify and integrate new data sources and to ensure alignment to data governance and security standards.
• Provide technical expertise in executing cloud-native big data architecture, including cloud data warehouse, data lake, and lakehouse approaches.
• Understand cloud and legacy RDBMS and NoSQL design patterns and trade-offs.
• Design, develop and deploy data solutions using common API integration and consumption patterns.
• Ensure adherence to development and security processes and workflows.
• Chip into team competency and cohesion with other data engineers through code reviews, working sessions, knowledge sharing sessions, and team activities.
• Document data engineering activities and processes.
• Lead technical partner engagements.
• Adhere to and enforce the appropriate information security policies based on the sensitivity of company data and report any security related issues.
• Reduce risk of theft, fraud, or misuse of information assets by acting as the data steward for the application(s) you administer.

Skills

Advanced SQL

bash

Python

Terraform

Education

Bachelor's or Master's Degree in MIS/IS/Business Analytics/CS

Related field or equivalent experience

Tools

Apache Beam

Google Cloud Data Fusion

dbt

Serverless functions

Job description

Collegis Education seeks a data engineer to design, build, and maintain cloud-native data integrations and transformations across data warehouses, lakes, and lakehouses. You will ensure data governance, quality, and security while collaborating with cross-functional teams to onboard new sources and align with policy standards.

The role requires 2–5 years in data engineering, strong SQL, Python, and bash, plus familiarity with Terraform and dbt.