Data Engineer

Blackstraw AI; Chennai District; On-site; INR 800,000 - 1,500,000; Full time

Job summary

A leading technology services firm in Chennai is looking for a Data Engineer. The role involves transforming raw data and building data pipelines using Python and PySpark. Candidates should have strong analytical skills, experience with SQL, and familiarity with ETL processes. This full-time position requires a degree in Computer Science or related fields, and a passion for data solutions. Join a team dedicated to solving complex business challenges through AI and engineering solutions.

Qualifications

• 3 to 10 years experience in data engineering.
• Hands-on experience with Python and PySpark.
• Good analytical skills and familiarity with data integration.

Responsibilities

• Transform raw data into useful data systems.
• Create algorithms and conduct statistical analysis.
• Build and maintain data pipelines in Spark/PySpark.

Skills

ETL processes and tools

Python

PySpark

SQL

Shell Scripting

Cloud technologies (Azure/AWS/GCP)

Kubernetes

Apache Kafka

Education

Degree in Computer Science, IT, or similar

Master’s degree

Job description

Data Engineer

3 to 9 Years India All Jobs

Company Name: Blackstraw.ai

Office Location: Chennai

Job Type: Full-time

Experience: 3 to 10 Years

We are looking for data engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.

Job Requirements:

• Participate in the customer’s system design meetings and collect the functional/technical requirements.
• Build up data pipelines for consumption by the data science team.
• Participate in the customer’s system design meetings and collect the functional/technical requirements.
• Build up data pipelines for consumption by the data science team.
• Skillful in ETL process and tools.
• Clear understanding and experience with Python and PySpark or Spark and SCALA, with Hive and RDBMS architecture.
• Experience in writing Python programs and SQL queries.
• Experience in SQL Query tuning.
• Experienced in Shell Scripting (Unix/Linux).
• Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.
• Knowledge of Cloud (Azure/AWS/GCP, etc.) technologies is additional.
• Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka.
• Suggest and implement best practices in data integration.
• Guide the QA team in defining system integration tests as needed.
• Split the planned deliverables into tasks and assign them to the team.
• Needs to maintain/deploy the ETL code and follow the Agile methodology.
• Needs to work on optimization wherever applicable.
• Good oral, written and presentation skills.

Preferred Qualifications:

• Degree in Computer Science, IT, or similar field; a Master’s is a plus.
• Hands‑on experience with Python and Pyspark.
• Great numerical and analytical skills.
• Technical expertise with data models, data mining, and segmentation techniques.

Key traits:

• Should have excellent communication skills.
• Should be self‑motivated and willing to work as part of a team.
• Should be able to collaborate and coordinate in a remote environment.
• Be a problem solver and be proactive to solve the challenges that come his way.

Company Profile:

Blackstraw.ai is an end‑to‑end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps.

Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators and proven engineering practices.

With a 450+ strong team of engineers, data scientists and AI specialists, we partner with organizations to deliver real‑world outcomes in areas such as predictive analytics, computer vision, natural language processing and Generative AI.

At Blackstraw.ai, we’re passionate about solving complex business challenges through intelligent automation, modern data architectures and next‑gen AI applications – enabling enterprises to move from AI experimentation to transformation.

Headquartered in Florida (USA) with operations in Canada and India, Blackstraw.ai continues to empower global enterprises to unlock the true potential of AI.

Apply to this Job

Fill in your information and submit your application.

Join our Talent Pool !