Screaming Frog is one of the most powerful on page SEO audit tools available, and if you’re not using it systematically, you’re leaving ranking opportunities on the table.
This guide shows you exactly how to use Screaming Frog to improve on page SEO across six critical areas: page titles, meta descriptions, heading structure, content quality, internal linking, and image optimization. Whether you’re auditing a 50-page site or a 50,000-page e-commerce store, the same workflow applies.
You’ll get actionable steps, specific filters to apply, and precise signals to look for, so every crawl you run turns into a clear, prioritized fix list. No guesswork, no manual spot-checking. Just a structured audit process that scales.
| What You’ll Learn | Why It Matters |
|---|---|
| Setup for targeted crawls | Accurate data from the start |
| Title & meta audits | Directly impacts CTR and indexing |
| Heading tag audits | Supports content hierarchy and crawlability |
| Thin/duplicate content detection | Prevents ranking dilution |
| Internal link analysis | Distributes PageRank efficiently |
| Image alt text audits | Improves accessibility and image search |
Setting Up Screaming Frog for a Targeted On-Page Audit
Before you crawl a single URL, your Screaming Frog configuration determines the quality of your audit data. A misconfigured crawl produces noise. A targeted setup produces actionable insights.
Download and License
Download Screaming Frog SEO Spider from screamingfrog.co.uk/seo-spider. The free version crawls up to 500 URLs, sufficient for small sites. For larger sites, the paid license costs £259/year (~$330 USD) and removes the URL cap entirely.
Storage Mode Selection
For sites with more than 1,000 URLs, switch to Database Storage Mode before you start. Go to File > Settings > Storage Mode > Database. This prevents memory overload and keeps the crawl stable on large sites. RAM-based mode works fine for smaller audits under 5,000 pages.
Configuration for On-Page Audits
Open the Configuration menu and adjust these settings before crawling:
| Setting | Recommended Configuration |
|---|---|
| User Agent | Googlebot Desktop |
| Crawl Depth | Unlimited (or set to 10 for massive sites) |
| JavaScript Rendering | Enable if site uses React/Vue/Angular |
| Canonicals | Always check to avoid auditing noindexed pages |
| Images | Include for alt text audit |
Under Configuration > Spider, enable Crawl All Subdomains only if the site uses subdomains you want to audit. Disable it if you want a clean, single-domain crawl.
Enter Your URL and Start
Paste the root domain (e.g., https://www.example.com) into the search bar and click Start. Watch the bottom status bar, if you see a high percentage of 4xx errors or redirects early on, pause and check your starting URL and robots.txt configuration.
Once the crawl completes, you have a full snapshot of your site’s on page SEO health. Now let’s dig into what to do with it.
Auditing Page Titles and Meta Descriptions at Scale
Page titles and meta descriptions are the first on page SEO elements search engines and users encounter. Screaming Frog surfaces every issue across your entire site in seconds, something that would take days to do manually.
Identifying Missing, Duplicate, and Over-Length Title Tags
Click the Page Titles tab at the top of the Screaming Frog interface. Use the Filter dropdown to isolate specific problem categories:
| Filter | What It Catches |
|---|---|
| Missing | Pages with no title tag at all |
| Duplicate | Multiple pages sharing the same title |
| Over 60 Characters | Titles likely truncated in SERPs |
| Under 30 Characters | Titles too short to be descriptive |
| Multiple | Pages with more than one title tag in the HTML |
Sort the Title 1 Length column to quickly find the worst offenders. Export the filtered list via Reports > Bulk Export > Page Titles to work through fixes in a spreadsheet.
Pro tip: Duplicate titles are often more damaging than missing ones. If two product pages share the same title, Google struggles to determine which to rank. Use the Duplicate filter first.
For large e-commerce sites, titles auto-generated by CMS templates are a frequent issue. Look for patterns like “Product Title – Shop Name” repeating across hundreds of SKUs with minimal variation.
Flagging Weak or Auto-Generated Meta Descriptions
Switch to the Meta Description tab and apply the same filter logic:
- Missing: Google writes its own snippet, often poorly.
- Duplicate: A strong signal of templated or low-effort content.
- Over 155 Characters: Risk of truncation in mobile SERPs.
- Under 70 Characters: Likely too thin to drive clicks.
Export the full list and scan the Meta Description 1 column for templated phrases like “Buy [Product] online” repeated across 200 pages. These auto-generated descriptions contribute to lower CTR and signal weak on-page SEO hygiene to search engines.
Prioritize fixing meta descriptions on your highest-traffic pages first, check Google Search Console to cross-reference which URLs get the most impressions.
Auditing Heading Tag Structure Across Your Entire Site
Heading tags, H1 through H6, communicate content hierarchy to both users and search engines. A broken or inconsistent heading structure is one of the most underrated on page SEO issues, and Screaming Frog makes site-wide auditing fast.
Auditing H1 Tags
Click the H1 tab in Screaming Frog. Apply these filters:
| Filter | Issue Identified |
|---|---|
| Missing | Page has no H1, major on-page gap |
| Duplicate | Same H1 across multiple pages |
| Multiple | More than one H1 on a single page |
| Over 70 Characters | H1 may be too verbose for clarity |
A page with no H1 is a missed opportunity to reinforce your primary keyword. A page with two H1s sends mixed signals about the page’s topic. Both are common issues on WordPress sites using certain page builders.
Auditing H2 Tags
Select the H2 tab and apply the Missing filter. While not every page requires H2s, long-form content pages, blog posts, guides, landing pages, that lack H2 structure are harder for crawlers to parse and harder for users to scan.
Export H1 and H2 data together via Bulk Export > H1 and Bulk Export > H2 to compare them in a spreadsheet side by side.
Auditing H3 and Deeper Headings
Screening Frog doesn’t show H3+ in native tabs by default. Use Custom Extraction to pull them:
- Go to Configuration > Custom > Extraction
- Add a new extraction with CSS Path:
h3 - Set extraction type to Text
- Re-run the crawl
This gives you H3 content for every page crawled. Look for pages where H3 tags exist but H2 tags are missing, a structural hierarchy issue that confuses both users and crawlers.
For most sites, fixing H1 issues alone, missing or duplicate, delivers measurable on page SEO improvements within 4–6 weeks of re-indexing.
Detecting Thin, Duplicate, and Low-Value Content
Thin and duplicate content suppress rankings by diluting your site’s authority across pages that offer little unique value. Screaming Frog helps you identify these pages precisely, so you can consolidate, improve, or remove them.
Finding Thin Content
In the Internal tab, locate the Word Count column. Sort ascending to surface the lowest word-count pages first.
| Word Count Range | Typical Classification |
|---|---|
| 0–50 words | Near-empty pages (login pages, stubs) |
| 51–200 words | Likely thin content |
| 201–300 words | Borderline, assess by page type |
| 300+ words | Acceptable baseline for informational pages |
Keep in mind that context matters. A contact page with 80 words isn’t thin content, it’s appropriate. A blog post or product page with 120 words almost certainly is. Filter for HTML page type under the Content tab to focus on actual content pages.
Finding Duplicate and Near-Duplicate Content
Go to the Content tab and use the Filter dropdown:
- Exact Duplicate: Pages where Screaming Frog detects identical body content. These are high-priority fixes, usually caused by URL parameters, pagination, or faceted navigation.
- Near Duplicate: Pages with 85–99% content similarity. Common on e-commerce sites with product variants.
For duplicate content, your three options are:
- Canonical tags – Point duplicate URLs to the preferred version.
- 301 redirects – Permanently redirect duplicates to the canonical page.
- noindex – Remove low-value pages from the index entirely.
Exporting and Prioritizing Fixes
Export the full content audit via Reports > Content. Add a priority column in your spreadsheet: flag pages with thin content and significant organic traffic as urgent (they’re actively hurting you). Pages with thin content and no traffic are lower priority, consolidate them over time.
Optimizing Internal Links and Anchor Text with Screaming Frog
Internal linking is one of the most controllable on page SEO levers you have. It distributes PageRank across your site, helps search engines discover pages, and guides users toward conversion points. Screaming Frog’s internal link reports give you full visibility into how your link equity flows.
Using the Inlinks Report to Find Orphaned and Under-Linked Pages
An orphaned page has zero internal links pointing to it. Search engines can only find it through a sitemap or external backlink, which means it rarely ranks well regardless of content quality.
To find orphaned pages in Screaming Frog:
- Complete a full crawl
- Go to Reports > Crawl Analysis (make sure Crawl Analysis is enabled in Configuration)
- Export All Inlinks under Bulk Export > All Inlinks
- In your spreadsheet, filter for pages with 0 inbound internal links
Alternatively, use the Site Structure > Crawl Depth visualization. Pages sitting at crawl depth 4 or deeper are often under-linked and harder for Googlebot to prioritize.
Target: No important page should sit more than 3 clicks from the homepage. If your key landing pages are at depth 5+, add internal links from high-authority hub pages.
Auditing Anchor Text Diversity and Over-Optimized Patterns
Over-optimized anchor text, where every internal link to a page uses the exact same keyword phrase, is an on page SEO red flag that can trigger algorithmic penalties.
To audit anchor text:
- Go to Bulk Export > All Inlinks
- Open the export in a spreadsheet
- Filter by destination URL
- Review the Anchor Text column for each target page
Look for these patterns:
| Anchor Text Pattern | Risk Level |
|---|---|
| 100% exact-match keyword | High – over-optimization signal |
| Mix of brand, keyword, and generic | Low – natural and safe |
| All generic (“click here”, “read more”) | Medium – missed keyword opportunity |
| All branded | Low – but lost topical relevance signal |
For any page where 80%+ of internal anchor text is identical, diversify by editing 4–6 linking pages to use variations, branded terms, or partial matches. This alone can improve on page SEO signals without changing a single word of body content.
Finding and Fixing Image Alt Text and On-Page Media Issues
Images without alt text are invisible to search engines, and inaccessible to screen readers. They also miss out on image search rankings entirely. Screaming Frog audits every image on your site in a single crawl.
Running the Image Audit
Click the Images tab in Screaming Frog after your crawl completes. Use the Filter dropdown:
| Filter | Issue |
|---|---|
| Missing Alt Text | Images with no alt attribute, fix first |
| Alt Text Over 100 Characters | Likely stuffed or verbose alt text |
| Missing | Images that returned a 4xx or 5xx error |
| Over 100KB | Images that may be slowing page load |
Export the Missing Alt Text list and sort by the pages with the most missing images. Prioritize product pages and blog posts, these are the pages where image alt text contributes most directly to on page SEO and image search visibility.
Writing Effective Alt Text
Alt text should describe the image accurately and include a relevant keyword where it fits naturally, not force one in. Follow this format:
- Weak:
alt="image1.jpg" - Over-optimized:
alt="buy red running shoes cheap red running shoes online" - Correct:
alt="Women's red trail running shoes on rocky terrain"
For large sites with thousands of images, create an alt text template based on image naming conventions, then programmatically generate descriptive alt attributes and review exceptions manually.
Connecting Google PageSpeed Insights API
For oversized images and Core Web Vitals diagnostics, connect the Google PageSpeed Insights API directly in Screaming Frog:
- Go to Configuration > API Access > PageSpeed Insights
- Enter your API key (free from Google Cloud Console)
- Re-run the crawl
Screening Frog will now pull LCP, CLS, and FID scores per page, giving you image-related performance data alongside your on page SEO audit in a single export. Pages with LCP above 2.5 seconds and unoptimized images are your highest-priority fixes.
Export the full images report via Reports > Images and work through fixes systematically. For most mid-sized sites (500–5,000 pages), completing the image alt text audit alone adds 30–60 newly optimized on-page signals within a single sprint.
Frequently Asked Questions
1. How to use Screaming Frog to improve on page SEO across my entire site?
Download Screaming Frog from screamingfrog.co.uk/seo-spider, configure Database Storage Mode for larger sites, then run a full crawl. Use the Page Titles, Meta Descriptions, H1/H2, Content, and Images tabs to identify and fix critical on-page SEO issues like missing titles, duplicate content, thin pages, and missing alt text systematically.
2. What’s the difference between the free and paid versions of Screaming Frog?
The free version crawls up to 500 URLs, suitable for small sites. The paid license (~$330 USD annually) removes the URL cap entirely and handles unlimited crawls, making it essential for larger e-commerce stores and multi-thousand-page sites.
3. How do I find duplicate titles and meta descriptions with Screaming Frog?
Click the Page Titles or Meta Descriptions tabs, use the Filter dropdown to select ‘Duplicate,’ then export the list. Duplicate titles are high-priority fixes—they confuse search engines about which page to rank. Cross-reference high-traffic pages in Google Search Console and fix those first.
4. What heading tag issues should I prioritize when auditing on-page SEO?
Missing or multiple H1 tags are top priorities. Check the H1 tab for pages with zero H1s or more than one H1—both are on page SEO red flags. For long-form content, also audit H2 tags using the H2 tab to ensure proper content hierarchy.
5. How can I identify thin content and low-value pages using Screaming Frog?
Go to the Internal tab, sort the Word Count column ascending to surface pages under 200–300 words. Filter by HTML page type to focus on actual content pages. Prioritize fixing thin content on high-traffic pages first, as these actively hurt your rankings.
6. What’s the best way to audit internal linking and anchor text with Screaming Frog?
Use the Inlinks report to find orphaned pages with zero internal links. Export Bulk Export > All Inlinks and review the Anchor Text column for over-optimization. Diversify anchor text where 80%+ use identical keywords—mix in brand terms, partial matches, and generic anchors for natural, safe linking.
