Senior Data Engineer

Talentify; Mountain View (CA); Remote; USD 140,000 - 190,000; Full time

Job summary

Talentify is seeking a Sr. Data Engineer to join our Data Platform and Engineering teams. You will design data pipelines, ingest data from multiple sources, and ensure data quality to empower BI, analytics and data products.

The role requires hands-on expertise in Python, SQL, Spark, and AWS, with a focus on scalable, cross-team collaboration and continuous improvement.

Qualifications

• Strong experience designing scalable data processing pipelines.
• Hands-on ETL, data integration from multiple sources.
• Proficient in SQL and data warehousing concepts.
• Experience with AWS (S3, EC2) and cloud data platforms.
• Hands-on Python with big data tech like Spark.
• Familiar with Docker and containerized workflows.
• Ability to translate business requirements into data solutions.

Responsibilities

• Design and implement data processing pipelines.
• Integrate data from multiple sources and develop cross-platform ETL processes.
• Ensure data validation and quality across data products.
• Analyze data, solve problems, and implement scalable solutions.
• Create systems for data acquisition and wrangling.
• Develop tools for managing data workflows and infrastructure.
• Collaborate with Engineering and Data Science to maintain databases.
• Work with product teams to translate requirements into solutions.
• Client and analyze data from web sources.

Skills

Python (OO)

SQL

Spark

Big Data / Data Mining

AWS Cloud

Reporting & Analytics

ETL & Storage

Data Sourcing

Other Languages (Scala/C++/Java)

Machine Learning Libraries

Tech Selection

Deploy at Scale

Tools

Docker

Job description

Sr. Data Engineer

MOUNTAIN VIEW, CA / DENVER, CO / REMOTE

FULL-TIME

Position Summary:

We are looking for a Sr. Data Engineer to join our growing Data Platform and Engineering teams. The ideal candidate has significant experience in building scalable data platforms that enable business intelligence, analytics, data science and data products. They must have strong, hands‑on technical expertise in a variety of technologies and the proven ability to fashion robust scalable solutions. They must be at ease working in an agile environment with little supervision. The ability to work across teams with product managers, data scientists and business stakeholders to translate sometimes vague business requirements into working code will be critical to success in this role. This person should embody a passion for continuous improvement and data quality.

Responsibilities

• Design and implement data processing pipelines
• Integrate data from multiple data sources, develop cross-platform ETL processes
• Data Validation and Verification
• Analyze data, solve problems, and implement solutions for ensuring data quality and delivery
• Create systems for data acquisition and wrangling
• Develop new tools and processes for managing our data workflows and data infrastructure
• Collaborate with our Engineering and Data Science teams on building, maintaining, and monitoring the database infrastructure
• Collaborate with product managers, data scientists, business users and other engineers to define requirements and design solutions
• Client and analyze data from the web (census, open data, commercial vendors)

Skills/Requirements

• Expert in reporting, analytics, and databases
• Data ingestion, ETL and storage
• Interest in pulling data from many sources
• Experience in big data, data mining and statistical analysis
• Cloud computing, especially AWS technologies (S3, EC2, etc.)
• Comfortable choosing technologies that fit the application (e.g., MySQL versus PostgreSQL, Hadoop versus Cassandra)
• More than 5 years of experience in object-oriented development with Python
• Other languages like Scala, C++, Java, or similar are a plus
• Experience with spark
• Expertise with SQL
• Familiarity with Docker
• Machine Learning libraries and frameworks like scikit-learn, TensorFlow, Pytorch a plus
• Deploying algorithms at scale