Apify Blog
blog.apify.com · Company blog · on HN since 2017
Blog of Apify, a web scraping and automation platform, covering scraping legality, proxies, APIs and building data tools.
What HN saysHN links it for web scraping how-tos and the legality of scraping; a company commenter argues people have a right to access public web data.
15HN people shared it
2linked it in comments
25stories submitted
106story points
4 months agolast shared
2017people per year2026
Most-shared posts
- 1Is Web Scraping Legal?3 people · 35 points · first shared 2021 · 16 comments on HN
- 2The accidental click that changed everything: the Apify origin story1 people · 24 points · first shared 2025 · 7 comments on HN
- 3IP session management and smart proxy rotation1 people · 7 points · first shared 2024 · 1 comments on HN
- 4Show HN: Make regular passive income developing web automation actors1 people · 7 points · first shared 2021 · 1 comments on HN
- 5How to get data from Hacker News with unofficial HN API1 people · 6 points · first shared 2021 · 2 comments on HN
- 6Using a man-in-the-middle proxy to scrape data from a mobile app API1 people · 4 points · first shared 2019 · discussion on HN
- 7Sponja found 897 companies running webinars (and who runs them) for under $201 people · 3 points · first shared 2026 · discussion on HN
- 8How to Scrape Paginated Websites1 people · 2 points · first shared 2024 · discussion on HN
- 9Scrape Hotel Data from Booking.com1 people · 2 points · first shared 2019 · 1 comments on HN
- 10Who are your organization's GitHub champions?1 people · 2 points · first shared 2021 · discussion on HN
- 11Are website terms of use enforced?1 people · 2 points · first shared 2022 · discussion on HN
- 12Combine web scraping with LLMs to create AI tools in 10 minutes (no clickbait)1 people · 1 points · first shared 2024 · 1 comments on HN
- 13Web Scraping Tutorial Using Crawlee1 people · 1 points · first shared 2024 · 1 comments on HN
- 1410x more tools on x4021 people · 1 points · first shared 2026 · discussion on HN
- 15How to integrate Google search into your AI apps1 people · 1 points · first shared 2023 · discussion on HN
What HN people wrote when they linked it
jancurn · 2024-07-09
There are many legitimate and legal use cases where one might want to circumvent blocking of bots. We believe that everyone has the moral right to access and fairly use non-personal publicly available data on the web the way they want, not just the way the publishers want them to. This is the core founding principle of the open web, which allowed the web to become what it is today.
BTW we continuously update this exhaustive post covering all legal aspects of web scraping: https://blog.apify.com/is-web-scraping-legal/
mtrunkat · 2017-11-09
Check out my previous blogpost - how to easily create a RSS feed for websites that don't have it
https://blog.apify.com/how-to-turn-any-website-into-an-rss-feed-a8f9f2…