Data Integration Engineer

Talantir; United States; Remote; USD 83,000 - 152,000; Full time

Job summary

Talantir is seeking a Data Integration Engineer for a 1+ year contract, fully remote in the United States. You will design and maintain scalable data pipelines, build integrations and APIs, and ensure data governance and security across systems to enable data-driven decisions.

You will collaborate with analytics teams to improve data models for BI, develop tests, and deploy streaming data processing solutions while mentoring junior engineers.

Qualifications

• 4-year college degree or equivalent in CS/math/statistics or related field.
• 7+ years of analytics, data engineering, BI or related experience.
• Proficient in Python and API-driven integrations.
• Experience with multi-system data integrations and APIs.
• Familiarity with Agile software development methodologies.
• Experience with AWS data services (Redshift, S3, EMR, EC2, Kinesis).
• SQL querying and optimization in large-scale datasets.

Responsibilities

• Develop, test, document and maintain scalable data pipelines.
• Build data integrations including APIs to support data growth.
• Establish data governance processes for data availability, usability, integrity and security.
• Create scalable solutions aligned to governance standards and road map.
• Collaborate with analytics and business teams to improve data models for BI.
• Design data integrations and a data quality framework; write tests and document.
• Design, deploy and automate distributed system for streaming events collection/processing.
• Analyze data to troubleshoot issues and resolve data problems.
• Mentor junior engineers on coding best practices and optimization.

Skills

Python

APIs

SQL

ETL/ELT

Agile

Data governance

Data modeling

Linux

Spark

Hadoop

Kafka

NoSQL

Testing

Education

Bachelor's degree in Computer Science, Mathematics, Statistics or related field

Tools

AWS Redshift

AWS S3

AWS EC2

AWS EMR

AWS Kinesis

Job description

Title: Data Integration Engineer

Duration: 1+ Year Contract

Location: 100% REMOTE Work

Rate: $Open/hr.

Responsibilities

• Develop, test, document and maintain scalable data pipelines.
• Build out new data integrations including APIs to support continuing increases in data volume and complexity.
• Establish and follow data governance processes and guidelines to ensure data availability, usability, consistency, integrity, and security.
• Build and implement scalable solutions that align to our data governance standards and architectural road map for data integrations, data storage, reporting, and analytic solutions.
• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Design and develop data integrations and a data quality framework. Write unit/integration/functional tests and document work.
• Design, implement, and automate deployment of our distributed system for collecting and processing streaming events from multiple sources
• Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
• Guide and mentor less experienced engineers on coding best practices and optimization.

Qualifications

• Education: 4-year college degree or equivalent combination of education and experience. Prefer academic background in in Computer Science, Mathematics, Statistics, or related technical field.
• 7 years of relevant work experience in analytics, data engineering, business intelligence or related field.
• Skilled in object-oriented programming (Python in particular).
• Experience developing integrations across multiple systems and APIs.
• Experience with or knowledge of Agile software development methodologies.
• Experience with cloud-based databases, specifically AWS technologies (e.g. Redshift, RDS, S3, EMR, EC2, Kinesis).
• Experience using SQL queries as well as writing and optimizing SQL queries in a business environment with large-scale, complex datasets.
• Experience with data warehouse technologies. Experience creating ETL and/or ELT jobs.
• Excellent problem solving and troubleshooting skills.
• Process oriented with great documentation skills.
• Experience developing in a Linux environment.
• Experience designing data schemas and operating SQL/NoSQL database systems is a plus.
• Experience with Big Data tools like Spark, Hadoop, Kafka, etc. is a plus.