Web Scrapper
Web Scrapper connector enables data synchronization from Web Scrapper source to various data destination. It gives information about sitemaps, users, scraping jobs etc.
Configuration
Streams
| Stream Name |
Primary Key |
Pagination |
Supports Full Sync |
Supports Incremental |
| sitemap_list |
id |
DefaultPaginator |
✅ |
❌ |
| sitemap_detail |
id |
DefaultPaginator |
✅ |
❌ |
| users |
|
No pagination |
✅ |
❌ |
| scraping_jobs |
id |
DefaultPaginator |
✅ |
❌ |
| scraping_job_data_quality |
|
No pagination |
✅ |
❌ |
Changelog
Expand to review
| Version |
Date |
Pull Request |
Subject |
| 0.0.3 |
2024-12-11 |
49115 |
Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64 |
| 0.0.2 |
2024-11-04 |
48269 |
Update dependencies |
| 0.0.1 |
2024-10-29 |
|
Initial release by @bishalbera via Connector Builder |
