TE - 2 - Scraping & Data Engineering Developer

A Tunga client is seeking a technical developer to design and maintain reliable web scraping and data pipelines. You’ll extract data from JavaScript-rendered web pages, store and model it for time-series use cases, and run production-grade workflows with strong monitoring and deployment practices.

Key Responsibilities

• Build and maintain scrapers for dynamic (JavaScript-rendered) websites

• Design and manage data storage for time-series workloads (PostgreSQL, QuestDB)

• Orchestrate and schedule pipelines using Airflow (retries, backfills, SLAs)

• Automate deployments and infrastructure tasks with Ansible on Linux servers

• Implement monitoring/observability with Prometheus and Grafana

• Write maintainable, testable code and collaborate on improvements to pipeline reliability and performance

Requirements

• Strong experience with web scraping, including JS-rendered pages

• PostgreSQL + time-series data handling; QuestDB experience is a plus

• Airflow for pipeline orchestration

• Ansible, Linux system administration, and Bash scripting

• Monitoring with Prometheus + Grafana

• Proficient in Python and JavaScript; basic Golang (or ability to collaborate in Go)

Nice to have:

• Data warehousing/analytics foundations and applied data science exposure

• Experience with TikTok Shop and/or TikTok/social platform APIs*