Python – Data Ingestion



Job Description:

As a Python engineer, you will be responsible for developing and maintaining the data extractors for multiple projects. You will need to extract data from different online and offline sources and then transform data to desired schemas. Ensuring that the data being extracted is both accurate and reliable is a key responsibility. The ideal candidate should possess strong technical abilities to solve complex data extraction problems.

Experience:

Minimum 3 years of experience.

Qualifications

Bachelor’s degree in Computer Science (minimum).

Responsibilities

Data Extraction, Transformation, and Management.

Design and develop data extractors for different projects.

Monitor and maintain data extractors/crawlers.

Data accuracy and reliability via automated sanity pipelines

Manage project deliveries.

Client communications.

Requirements:

Good problem-solving skills.

Strong proficiency in languages like Python.

Good understanding of web languages like HTML and CSS.

Good grip on Regular expressions, Xpaths, and CSS selectors.

Basic knowledge of Web data extraction tools and techniques.

Basic knowledge of Linux commands.

Experienced working with different data formats (CSV, JSON, etc).

Good communication skills.

Good to Have:

Experience in Python scripting.

Experience with VMs and Containers.

Proficiency in data pipeline and workflow management tools.

Basic understanding of the ETL process.

APPLY HERE


Published On: July 15, 2023 15:54

DETAILS

Salary: Unknown PKR

Experience: 3 years

Job Type: Full Time

Location: Lahore

Published: July 15, 2023

Update: July 15, 2023

Join newsletter to receive jobs updates.