Senior Data Engineer- Databricks, PySpark,Python

Innovya Technologies; Pasadena (CA); Presencial; USD 150.000 - 190.000; Jornada completa

Descripción de la vacante

Innovya Technologies in Pasadena, CA is seeking a Sr. Data Engineer to design, build, and maintain scalable data pipelines using PySpark and Databricks. You will collaborate with analysts, scientists, and product teams to ensure high-quality data for analytics and reporting.

The role emphasizes performance tuning, data governance, and best-practices documentation while leveraging cloud data platforms and modern tools in a full-time, on-site capacity in Pasadena.

Formación

• Strong data engineering skills with scalable data pipelines.
• Experience with data modeling and warehousing design.
• Hands-on ETL development to integrate multiple sources.
• Analytics support for reporting and dashboards.
• Advanced PySpark, Databricks, and Python for processing.
• Experience with cloud data platforms and distributed processing.
• Knowledge of SQL/NoSQL, performance tuning, and optimization.
• Understanding of data governance, quality, and security.
• Bachelor’s degree or equivalent experience; cross-functional collaboration.

Responsabilidades

• Design, build, and maintain scalable data pipelines with PySpark and Databricks.
• Develop and optimize data models and support data warehousing.
• Collaborate with data analysts, data scientists, and product teams.
• Tune performance, monitor data systems, and ensure security governance.
• Contribute to best practices and maintain documentation.

Conocimientos

Data engineering

PySpark

Databricks

Python

Data modeling

ETL pipelines

Cloud platforms

SQL & NoSQL

Data governance

Cross-functional collaboration

Educación

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field

Herramientas

Databricks

PySpark

Python

SQL

NoSQL

AWS/Azure/GCP

Descripción del empleo

Company Description Innovya Technologies is a technology services company focused on accelerating business value from digital initiatives. The organization brings together experts who rapidly understand client needs and drive end-to-end product and feature development. Innovya operates across multiple segments, including RPA deployments, game development, web and mobile applications, and cloud implementations. Team members collaborate with diverse industries and projects, offering opportunities to work with modern tools and emerging technologies. The company values innovation, practical problem-solving, and measurable outcomes for its clients.

Role Description The Sr. Data Engineer – PySpark/Databricks/Python is a full-time, on-site role based in Pasadena, CA. This role is responsible for designing, building, and maintaining scalable data pipelines using PySpark, Databricks, and related cloud data platforms. Day-to-day work includes implementing robust ETL workflows, developing and optimizing data models, and supporting data warehousing solutions to ensure reliable, high-quality data for analytics and reporting. The individual will collaborate closely with data analysts, data scientists, and product teams to understand data requirements, improve data accessibility, and enhance overall data architecture. The role also involves performance tuning, monitoring data systems, ensuring data security and governance, and contributing to best practices and documentation.

Qualifications

• Strong Data Engineering skills, including experience building and maintaining scalable data pipelines.
• Proficiency in Data Modeling and Data Warehousing to design efficient, reliable data structures and storage solutions.
• Hands-on experience with Extract Transform Load (ETL) processes and frameworks to integrate data from multiple sources.
• Applied Data Analytics skills to support reporting, dashboards, and data-driven decision-making.
• Advanced experience with PySpark, Databricks, and Python for data processing and automation.
• Experience with cloud data platforms (e.g., AWS, Azure, or GCP) and distributed processing frameworks.
• Knowledge of SQL and NoSQL databases, performance tuning, and data optimization techniques.
• Understanding of data governance, data quality, and security best practices.
• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field; equivalent experience considered.
• Ability to work collaboratively with cross-functional teams and communicate complex data concepts clearly.