Skip to content

Commit

Permalink
doc: clean up
Browse files Browse the repository at this point in the history
  • Loading branch information
harlan-zw committed Nov 1, 2024
1 parent 1dc8c16 commit 9e433b2
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 3 deletions.
2 changes: 1 addition & 1 deletion docs/content/1.getting-started/1.installation.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ For this, it's recommended to use the Nuxt DevTools Robots tab to see the curren

The DevTools will show you that in production we're just serving a minimal robots.txt file.

```robots
```robots-txt [robots.txt]
User-agent: *
Disallow:
```
Expand Down
6 changes: 4 additions & 2 deletions docs/content/2.guides/1.disable-page-indexing.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
title: Disallow Pages
title: Disable Page Indexing
description: Learn how to disable indexing for specific pages on your app.
---

Expand All @@ -9,7 +9,9 @@ As not all sites are the same, it's important for you to have a flexible way to

The best options to choose are either:
- [Robots.txt](#robotstxt) - Great for blocking robots from accessing specific pages that haven't been indexed yet.
- [useRobotsRule](#userobotsrule) - Useful for dynamic pages where you may not know if it should be indexed at build time and when you need to remove pages from search results. For example, a user profile page that should only be indexed if the user has made their profile public.
- [useRobotsRule](#userobotsrule) - Controls the `<meta name="robots" content="...">` meta tag and `X-Robots-Tag` HTTP Header. Useful for dynamic pages where you may not know if it should be indexed at build time and when you need to remove pages from search results. For example, a user profile page that should only be indexed if the user has made their profile public.

If you're still unsure about which option to choose, see the [Robots.txt vs Robots Meta Tag](/docs/robots/guides/robots-txt-vs-meta-tag) guide.

[Route Rules](#route-rules) and [Nuxt Config](#nuxt-config) are also available for more complex scenarios.

Expand Down

0 comments on commit 9e433b2

Please sign in to comment.