<![CDATA[Firecrawl on Cloudron - Turn any site into LLM data by web scraping]]>[EDITED by Mod]

  • Summary:
    Firecrawl (https://www.firecrawl.dev) is a web scraping tool that prepares data in LLM-readable format that can be self-hosted.
    Crawl and convert any website into LLM-ready markdown or structured data. Built by Mendable.ai and the Firecrawl community. Includes powerful scraping, crawling and data extraction capabilities.

  • This repository is in its early development stages. We are still merging custom modules in the mono repo. It's not completely yet ready for full self-host deployment, but you can already run it locally.

  • Alternative to / Libhunt link: e.g.
  • Screenshots:

brave_DZHeHo0izL.png brave_yMpKnkfukV.png brave_nEtYQ7lekr.png

]]>https://forum.cloudron.io/topic/12140/firecrawl-on-cloudron-turn-any-site-into-llm-data-by-web-scrapingRSS for NodeFri, 17 Jul 2026 11:43:12 GMTMon, 22 Jul 2024 05:37:51 GMT60<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Sat, 14 Jun 2025 09:59:23 GMT]]>A new release of Firecrawl came available:
https://github.com/mendableai/firecrawl/releases/tag/v1.11.0

There are lots of new improvements:

Firecrawl v1.11.0 is here!
Major Features
Launched our Firecrawl Index
Speed up scrapes 5x if opted in
Improved Activity Logs
View webhook events
Active crawl management
Fire Enrich Example (Open Source Clay)
Community Java SDK
and a lot more
Features
Improved Playwright tests and webhook test coverage
Added GET /crawl/ongoing endpoint
Introduced tag support in change tracking
Added integration field to jobs and propagated through queue worker
Parallel testing for runpod v2 and updated mu
Ported queryIndexAtSplitLevel to RPC
Enhanced SDK with index and missing parameters
Removed redundant GCS check to improve performance
Added credits_billed field across pipeline
Enabled domain-level index splitting for better map querying
Used index in search and extract operations
Removed unused index columns
Fixes & Improvements
Fixed crawl pre-finishing logic
Refactored callWebhook and added logging
Improved index testing (FIR-2214)
Fixed JS SDK tests
Clarified scrape options usage in README
Fixed missing PLAYWRIGHT_MICROSERVICE_URL in env example
Improved concurrency limit notification emails
Removed query param sanitization that broke extract

]]>https://forum.cloudron.io/post/108661https://forum.cloudron.io/post/108661Sat, 14 Jun 2025 09:59:23 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Thu, 12 Jun 2025 14:01:34 GMT]]>Has anyone used Firecrawl self-hosted? They describe as a main difference of their self-hosted vs. cloud variant that the cloud version rotates IP addresses, so it gets better around blockers. I have never used Firecrawl self-hosted, has this been an issue to anyone?

]]>https://forum.cloudron.io/post/108568https://forum.cloudron.io/post/108568Thu, 12 Jun 2025 14:01:34 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Thu, 12 Jun 2025 08:10:26 GMT]]>Vote for this two times

]]>https://forum.cloudron.io/post/108528https://forum.cloudron.io/post/108528Thu, 12 Jun 2025 08:10:26 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Wed, 11 Jun 2025 21:32:35 GMT]]>I second this. Firecrawl would be a great addition to the App Library.

]]>https://forum.cloudron.io/post/108493https://forum.cloudron.io/post/108493Wed, 11 Jun 2025 21:32:35 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Tue, 10 Jun 2025 20:20:06 GMT]]>Definitely needed! This would catapult the possibilities for N8N & Cloudron being able to leverage it's capabilities in big ways!

]]>https://forum.cloudron.io/post/108420https://forum.cloudron.io/post/108420Tue, 10 Jun 2025 20:20:06 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Sat, 14 Sep 2024 15:52:45 GMT]]>@ekevu123 The template is a new idea. I have marked your original posted as edited by mod.

]]>https://forum.cloudron.io/post/94254https://forum.cloudron.io/post/94254Sat, 14 Sep 2024 15:52:45 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Sat, 14 Sep 2024 15:39:26 GMT]]>As I said, I would mark it accordingly, then it should be fine. I didn't know about the template, I will try to use it next time.

]]>https://forum.cloudron.io/post/94253https://forum.cloudron.io/post/94253Sat, 14 Sep 2024 15:39:26 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Thu, 12 Sep 2024 19:48:49 GMT]]>@ekevu123 The template is posted at https://forum.cloudron.io/topic/12472/please-use-this-template-to-make-an-app-wishlist-request by @LoudLemur . Looks like a good idea to have posts (in this category) formatted a certain way. For other part of the forum, generally moderators don't edit posts (only obvious typos and language).

I am hoping people don't consider it rude if moderators edit the posts in the App Requests Category alone. Besides, the original poster gets reputation (the up arrow) anyway.

]]>https://forum.cloudron.io/post/94172https://forum.cloudron.io/post/94172Thu, 12 Sep 2024 19:48:49 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Thu, 12 Sep 2024 19:15:39 GMT]]>Yes, I like the template, however, I think if someone else's post has been edited by a moderator, this should be very clearly marked.

]]>https://forum.cloudron.io/post/94170https://forum.cloudron.io/post/94170Thu, 12 Sep 2024 19:15:39 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Thu, 12 Sep 2024 09:24:46 GMT]]>Hey, @ekevu123, thank you for this brilliant app wish! I really hope this is supported on Cloudron soon.

I have heavily edited your initial post to try and use the new template that is being developed for the App Wishlist forum.

  • What do you think about the new appearance of your post?
  • Is it very objectionable to have somebody mod your post like this?
  • Do you have any suggestions about doing this in the future?

Thanks!

]]>https://forum.cloudron.io/post/94154https://forum.cloudron.io/post/94154Thu, 12 Sep 2024 09:24:46 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Wed, 11 Sep 2024 18:58:52 GMT]]>I want this!

]]>https://forum.cloudron.io/post/94138https://forum.cloudron.io/post/94138Wed, 11 Sep 2024 18:58:52 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Wed, 28 Aug 2024 05:36:38 GMT]]>When can we have this? This is extremely useful to build AI applications, since it can scrape data from nearly any website. And data is valuable these days.

]]>https://forum.cloudron.io/post/93434https://forum.cloudron.io/post/93434Wed, 28 Aug 2024 05:36:38 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Mon, 26 Aug 2024 11:31:45 GMT]]>I want this as well!

]]>https://forum.cloudron.io/post/93322https://forum.cloudron.io/post/93322Mon, 26 Aug 2024 11:31:45 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Mon, 22 Jul 2024 16:47:49 GMT]]>Yeah. Unfortunately, I wasn't able to re-package it for Cloudron, although I tried. So, if someone wants to do it, we all have something new to play with 🙂

]]>https://forum.cloudron.io/post/91717https://forum.cloudron.io/post/91717Mon, 22 Jul 2024 16:47:49 GMT<![CDATA[Reply to Firecrawl on Cloudron - Turn any site into LLM data by web scraping on Mon, 22 Jul 2024 07:16:14 GMT]]>Wow! The ai community is so brainy! This is a great find and how wonderful it is that people created it and released it under a Free licence!

]]>https://forum.cloudron.io/post/91696https://forum.cloudron.io/post/91696Mon, 22 Jul 2024 07:16:14 GMT