A geospatial technology company in Poland is seeking a Data Engineering Intern to assist in the automation of data collection, ensuring the quality of geospatial datasets, and supporting in building data pipelines. The ideal candidate should possess strong skills in Python and SQL, have exposure to tools like Selenium or Scrapy, and an eagerness to learn more about geographic data formats. This role offers a great opportunity to collaborate with professionals and gain practical experience in geospatial applications.
Qualifications
Strong skills in Python and SQL, with a willingness to learn about geospatial data.
Exposure to tools like Selenium and Scrapy is a plus.
Eagerness to learn about geographic data formats such as GeoJSON.
Basic experience with data manipulation libraries is helpful.
Interest in learning about data validation.
Responsibilities
Assist in automating data collection from APIs and databases.
Ensure data quality and consistency in geographic datasets.
Support in organizing and structuring geospatial data.
Implement checks to maintain data integrity.
Assist in building automated data pipelines.
Skills
Python
SQL
Data manipulation
Web scraping
Collaboration skills
Tools
Selenium
Scrapy
pandas
NumPy
Job description
Data Extraction & Crawling: Assist in the automation of collecting geospatial data from APIs, databases, and web sources using tools like Selenium, Scrapy, or custom scripts.
Data Cleaning: Learn how to ensure the quality and consistency of geographic datasets by addressing missing or inconsistent data with guidance from senior engineers.
Data Preparation & Aggregation: Support in organizing and structuring geospatial data for use in xMap’s mapping and AI-driven analysis tools.
Data Manipulation: Work with geographic datasets to sort, filter, and transform them under the guidance of experienced team members.
Data Quality Assurance: Participate in implementing checks to maintain data integrity and geospatial accuracy.
Data Pipeline Development: Assist in building and maintaining automated data pipelines to support xMap’s platform.
Performance Optimization: Learn how to optimize data structures and queries for speed and efficiency in geospatial applications.
Automation & Process Improvement: Collaborate on automating repetitive tasks to streamline processes.
Collaboration & Communication: Work closely with xMap’s engineering team, GIS experts, and project managers, gaining experience in delivering high-quality data solutions.
Troubleshooting & Support: Assist in diagnosing and resolving issues in data pipelines, ensuring smooth operation of geospatial applications.
Requirements
Knowledge of Data Manipulation Languages: Strong skills in Python and SQL, with a willingness to learn more about handling geospatial data.
Knowledge in Web Scraping: Exposure to tools like Selenium, BeautifulSoup, or Scrapy is a plus, but not required.
Geospatial Data Awareness: Eagerness to learn about geographic data formats such as GeoJSON and shapefiles.
Data Preparation Tools: Basic experience with pandas, NumPy, or other data manipulation libraries is helpful but can be developed on the job.
Data Quality Management: An interest in learning about data validation and ensuring accuracy in mapping datasets.
Pipeline Design: Willingness to develop skills in tools like Apache Airflow, Luigi, or similar, with a focus on data pipelines.
Problem-Solving Mindset: Eagerness to grow in troubleshooting skills for resolving issues in data pipelines.
Collaboration Skills: Ability to communicate effectively and work well with cross-functional teams.