[firecrawl-ui] Expose v2 scrape options and migrate structured extraction into Scrape#91
Merged
Conversation
Surface the new v2 scrape options in the Scrape form and adapter: onlyCleanContent, minAge, lockdown, redactPII, zeroDataRetention and a comma-separated languages field folded into the location payload. Cloud only options are flagged with a "*" and a footnote clarifying they may be ignored on self-hosted instances. Rework the JSON output format into a prompt and/or JSON schema pair so structured extraction lives on the Scrape page, replacing the deprecated extractor-options blob. Also tidy the per-action row so it wraps on narrow panes and its buttons read as secondary affordances.
Warn that /v2/extract is deprecated and route users to the Scrape page with the JSON output format as the supported replacement for structured data extraction.
6 tasks
Add marked to parse markdown and dompurify to sanitize the resulting HTML before it is injected into the Scrape preview pane.
The Scrape Preview tab now renders the scraped markdown as formatted HTML instead of showing the raw source. The markdown is parsed with marked and sanitized with DOMPurify before reaching v-html to prevent XSS from untrusted page content. The Markdown tab still shows the raw source, and non-markdown results fall back to the previous raw dump.
Mark scrape/format options that only work on the official Firecrawl cloud API with a * and a footnote, mirroring the Scrape page. Rename the Pages response tab to History since it holds the crawl history.
Rework the About page into the aurora/glass language: gradient hero with Visit Firecrawl and GitHub CTAs, an icon capability grid, and a Powered by Firecrawl section linking to firecrawl.dev, the API docs and the repo. Opt the page out of the app-main flex stretch so tall content scrolls instead of being clipped.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Brings the Scrape page up to the Firecrawl v2 API surface and folds structured extraction into it, deprecating the standalone Extract view.
Scrape form + adapter
minAge,lockdown,redactPII,zeroDataRetention, plus a comma-separatedlanguagesfield folded into thelocationpayload alongsidecountry.onlyCleanContent(beta, extra LLM pass to strip residual boilerplate).*and a footnote noting they may be ignored on self-hosted instances.toScrapeRequest) passes all of the above through to/v2/scrape.Structured extraction on Scrape
/v2/extract.Extract view
UI polish
Verification
npx prettier --checkcleannpx eslintcleannpm run buildsucceeds (126 modules, no errors)No automated tests in this project (
npm testis a no-op).