The Scenario
An SEO consultant has just signed a new client — a 300-page e-commerce site scheduled for a relaunch in six weeks. The first deliverable is a technical content audit, and the first step of that audit is a complete URL inventory. The client's team has no sitemap they trust. The CMS is a custom build. The only way to know what pages exist is to crawl the site — and the consultant needs that list in a Google Sheet so the audit can be structured, filtered, and shared with the client's content lead.
The bad version:
- Download a desktop crawl tool, set it up, run a crawl, wait 20 minutes.
- Export the results as a CSV, open it in Excel, fix the encoding, import into Google Sheets.
- Discover the crawl missed the blog subdirectory because of a robots.txt configuration. Re-run. Export again.
There is nothing technically wrong with this flow. It is just three tools, two exports, and a debugging pass — for what should be a single step in the audit setup.
The Easy Way: One Prompt in SheetXAI
SheetXAI is an AI agent that lives inside your Google Sheet. It reads the domain you specify and, through its built-in Supadata web crawling integration, discovers all URLs on the site and writes them directly into the sheet — no separate tool, no CSV export.
Use Supadata to crawl https://example.com and write every discovered URL into column A of this sheet — include the total URL count in cell B1
What You Get
- Column A filled with every URL Supadata discovered on the site, one per row.
- Cell B1 showing the total count for a quick reference.
- The full inventory in the sheet and ready for the next audit step — filtering, categorising, or handing to the client's content lead.
- No separate tool, no export, no import.
What If the Data Is Not Quite Ready
The site has multiple subdomains that need to be audited separately
The client runs a blog on blog.example.com and a help centre on help.example.com in addition to the main site.
Use Supadata to crawl https://example.com, https://blog.example.com, and https://help.example.com separately and write the URLs from each crawl into columns A, B, and C respectively — write the URL count for each in row 1
You want to filter the URL list to only content pages
The crawl will return product pages, tag archives, and admin paths that are not relevant to the content audit.
Use Supadata to crawl https://example.com and write all discovered URLs into column A — then filter the list to keep only URLs that contain '/blog/' or '/articles/' and write the filtered set into column B
You need to check which discovered URLs are missing from an existing list
The client provided a list of 120 pages they think exist. You want to see what the crawl reveals that is not on their list.
Use Supadata to crawl https://example.com and write all discovered URLs into column A — then compare against the URLs already listed in column C and flag any URLs in column A that do not appear in column C by writing 'New page' in column B
You want the crawl plus a quick structural analysis in one pass
Use Supadata to crawl https://example.com, write all discovered URLs into column A, count the total URLs in cell B1, count the URLs containing '/product/' in cell B2, and count the URLs containing '/blog/' in cell B3
The pattern: get the inventory and the structural summary in one prompt, so the audit kickoff slide is already half-built.
Try It
Get the 7-day free trial of SheetXAI and open a blank Google Sheet, specify the client's domain, and ask it to crawl and map the site in one operation. When you have the URL list, look at the spoke on scraping competitor pages to pull the content from the most important ones.