Senior Data Engineer

WebDataGuru; Indiana (PA); On-site; USD 100,000 - 150,000; Full time

Job summary

WebDataGuru is seeking a Data Engineer to build and maintain the data infrastructure for ETL from diverse sources. You will assemble large datasets to meet business needs and enable data-driven decisions.

Responsibilities include automating data delivery with Python and SQL, deploying ML techniques for analytics, and building scalable pipelines and API integrations. You will also validate data and maintain schemas for accessible data layers.

Qualifications

• Degree in CS/Engineering; MCA/MSc CS acceptable.
• Experience with Python and SQL/NoSQL.
• Experience with ETL processes and AWS.
• Basic server knowledge.

Responsibilities

• Build and maintain data infrastructure for ETL workflows.
• Assemble large datasets to meet business needs.
• Automate data delivery with Python and SQL scripts.
• Create data validation methods for accuracy and reliability.
• Deploy ML techniques to support analytics.
• Develop scalable data pipelines and API integrations.
• Run ETL jobs and connect dashboards and reports.
• Create and maintain data schemas for organization.

Skills

Python

SQL/NoSQL

ETL

AWS

Data pipelines

Education

B.E./B.Tech CS/Engineering

M.C.A./M.Sc CS

Diploma/B.Sc./BCA (considered)

Job description

WebDataGuru is hiring a Data Engineer

10.10.24

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for building and maintaining the infrastructure needed for optimal extraction, transformation, and loading (ETL) of data from a variety of sources. This role plays a critical part in assembling complex datasets that meet business requirements and enable informed decision-making.

Role And Responsibilities

• Data Infrastructure: Build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from diverse data sources.
• Data Management: Assemble large and complex datasets that meet business requirements; collect, manage, and convert raw data into meaningful information.
• Process Automation: Automate manual processes and optimize data delivery using SQL and Python scripts; redesign infrastructure for greater scalability.
• Data Validation and Analysis: Create data validation methods and develop data analysis tools to ensure data accuracy and reliability.
• Machine Learning Deployment: Deploy machine learning techniques to create and sustain data structures that facilitate analytics.
• Data Pipelines and API Integrations: Develop and maintain scalable data pipelines and build API integrations to support increasing data volume and complexity.
• ETL and Reporting: Run ETL jobs and integrate with data visualization platforms that include dashboards and analytic reports.
• Schema Management: Create and maintain schemas to support data organization and accessibility.

Skills And Requirements

• Educational Background:
• B.E./B. Tech. in Computer Science/Engineering or M.C.A., M.Sc. (Computer Science).
• Candidates from non-computer streams (B.Sc./B.C.A./Diploma holders) may be considered if they possess exceptional skills and significant experience.
• Technical Skills:
• Proficiency in Python and SQL/NoSQL.
• Experience with ETL processes and AWS.
• Basic server knowledge.

Experience

• A minimum of 4+ years of hands-on experience in data engineering or related fields.

Why Join Us?

At WebDataGuru, we value innovation, collaboration, and the continuous growth of our team. If you're looking to advance your career and make a significant impact in the field of data engineering, we invite you to apply!