Crawl Website Content (Apify)
Apify → Crawl Website Content (Apify)
Crawls website pages and extracts structured content including text, metadata, and URLs.
Input
What it needs.
Map each field to a column in your table. Optional fields can stay empty.
urlWebsite URLtext
When to use this.
The "Crawl Website Content (Apify)" action is designed to efficiently crawl specified website pages and extract structured content, including text, metadata, and URLs. By providing a single input parameter, the website URL, users can initiate the crawling process. The action outputs essential data fields such as page text, title, description, canonical URL, language code, loaded URL, and referrer URL, all formatted as text or URL types. This action is particularly useful for data enrichment, enabling businesses to gather insights from web content for SEO analysis, competitive research, and content aggregation. With its ability to deliver structured data, it supports various applications in digital marketing, content management, and web analytics.
Output
What it returns.
Every field this action writes back to the row. Click a line to expand nested objects.
page_textPage Texttextpage_titlePage Titletextpage_descriptionPage Descriptiontextpage_canonical_urlPage Canonical Urlnullabletextpage_language_codePage Language Codenullabletextcrawl_loaded_urlCrawl Loaded Urltextcrawl_referrer_urlCrawl Referrer Urlnullabletext
Compose
How this fits a workflow.
The next 2 actions most operators chain after this one.
enrichment
Search LinkedIn Sales Navigator People (Apify)
Scrape LinkedIn Sales Navigator search results via Apify. Returns a list of profiles including Name, Title, Company, and Location.
enrichment
Search LinkedIn Profiles (Apify)
Search for LinkedIn profiles using filters (Current Company, Job Title, Location, Past Company).
enrichment
Get LinkedIn Posts from Profile (Apify)
Retrieves all LinkedIn posts from a specified user profile using Apify.
Workflow
A real example.
Trigger → crawl website content (apify) → enrich → push to your CRM. You set it up once; after that it runs without you.
Built for
Who runs this.
Reliability
Throughput & reliability.
How fast it drains a table, and what happens when the upstream provider has a bad day.
- Per-minute limit30 / min
- Per-day limit5,000 / day
- RetriesAutomatic w/ backoff
- Failed lookupsZero credits
Pricing
What it costs to run.
Pricing tier on /pricing. Per-action credit cost is private.
Related
More Apify actions.
enrichment
Search LinkedIn Sales Navigator People (Apify)
Scrape LinkedIn Sales Navigator search results via Apify. Returns a list of profiles including Name, Title, Company, and Location.
enrichment
Search LinkedIn Profiles (Apify)
Search for LinkedIn profiles using filters (Current Company, Job Title, Location, Past Company).
enrichment
Get LinkedIn Posts from Profile (Apify)
Retrieves all LinkedIn posts from a specified user profile using Apify.
enrichment
Search LinkedIn Companies (Apify)
Retrieve enriched LinkedIn company search results returns detailed company profiles including name, industries, employee counts, locations, LinkedIn URL, websit
FAQ.
Is this real-time?
Mostly. Fast actions fill the cell in a few seconds. Long-running ones run in the background and write back to the row when they finish, so you can close the tab.
Do I get charged on failure?
No. A failed lookup costs zero credits. When a provider misses or times out, the waterfall moves to the next one and you only pay for the match you actually got.
Do I have to run it row by row?
No. Run it on one cell, on a selection, on the whole table, or on a schedule. Same action either way.
What CRMs can I push results to?
HubSpot, Salesforce, Pipedrive, Zoho, and GoHighLevel are bidirectional. Smartlead, Instantly, Lemlist, HeyReach, Apollo Sequences, and Reply.io for outbound.
Run Crawl Website Content (Apify) in 60 seconds.
Connect the account, drop the action on a column, run it on your rows.