Data Engineer

Valiant Technologies LLC; Weehawken (NJ); On-site; USD 120,000 - 170,000; Full time

Job summary

Valiant Technologies LLC in Plano, Texas is seeking a highly skilled Data Engineer with a strong background in AI/ML Engineering to design and build scalable data pipelines and architectures that enable advanced analytics and machine learning initiatives.

The ideal candidate will have 7–10 years of experience in data engineering, with deep knowledge of data modeling, ETL, data warehousing, and hands-on experience with Hadoop, Spark, Kafka, and cloud data services.

Qualifications

• 7–10 years of experience in data engineering or a related field.
• Strong focus on AI/ML engineering and data pipelines.
• Excellent problem solving and communication abilities.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures to support AI/ML applications.
• Collaborate with data scientists to understand data requirements and ensure data availability for machine learning models.
• Implement ETL processes to extract, transform, and load data from various sources into data warehouses and lakes.
• Optimize data storage and retrieval processes for performance and efficiency.
• Monitor and troubleshoot data pipeline performance and reliability.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Stay updated with the latest trends and technologies in data engineering and AI/ML.
• Document data engineering processes and maintain clear communication with cross functional teams.

Skills

AI/ML Engineering

Programming languages

Data modeling & ETL

Big data: Hadoop/Spark/Kafka

SQL & NoSQL databases

Cloud data services

Education

Bachelor's degree in CS/Engineering/DS

Master's degree preferred

Tools

TensorFlow

PyTorch

Scikit-learn

Hadoop

Spark

Kafka

PostgreSQL/MySQL

MongoDB/Cassandra

AWS/Azure/Google Cloud

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Summary

We are seeking a highly skilled Data Engineer with a strong background in AI/ML Engineering to join our dynamic team in Plano, Texas. The ideal candidate will have 7 10 years of experience in data engineering, with a proven track record of designing and implementing data pipelines and architectures that support advanced analytics and machine learning initiatives. This role requires a deep understanding of data modeling, ETL processes, and the ability to work collaboratively with data scientists and other stakeholders to drive data driven decision making.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures to support AI/ML applications.
• Collaborate with data scientists to understand data requirements and ensure data availability for machine learning models.
• Implement ETL processes to extract, transform, and load data from various sources into data warehouses and lakes.
• Optimize data storage and retrieval processes for performance and efficiency.
• Monitor and troubleshoot data pipeline performance and reliability.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Stay updated with the latest trends and technologies in data engineering and AI/ML.
• Document data engineering processes and maintain clear communication with cross functional teams.

Mandatory Skills

• Strong expertise in AI/ML Engineering, including experience with machine learning frameworks such as TensorFlow, PyTorch, or Scikit learn.
• Proficient in programming languages such as Python, Java, or Scala.
• Extensive experience with data modeling, ETL processes, and data warehousing solutions.
• Hands on experience with big data technologies such as Hadoop, Spark, or Kafka.
• Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field; Master's degree preferred.
• 7 10 years of experience in data engineering or a related field, with a strong focus on AI/ML Engineering.
• Proven ability to work in a fast paced environment and manage multiple priorities.
• Excellent problem solving skills and attention to detail.
• Strong communication and interpersonal skills, with the ability to work collaboratively in a team environment.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.