63554bc323
Remove Disallow for query-string URLs and /_next/, which caused Google Search Console "Indexed, though blocked by robots.txt" for legitimate pages discovered with UTM/tracking params. Canonical tags already handle duplicate param URLs. Co-authored-by: Cursor Agent <cursoragent@cursor.com> Co-authored-by: Jatin K Malik <jatinkrmalik@users.noreply.github.com>
16 lines
449 B
Plaintext
16 lines
449 B
Plaintext
# Robots.txt for Vocalinux
|
|
# https://vocalinux.com
|
|
#
|
|
# Intentionally permissive for marketing pages. Do not blanket-block
|
|
# query-string URLs or /_next/static — those caused Google Search Console
|
|
# "Indexed, though blocked by robots.txt" for otherwise valid pages.
|
|
# Duplicate/param URLs are handled via canonical tags instead.
|
|
|
|
User-agent: *
|
|
Allow: /
|
|
Disallow: /api/
|
|
Disallow: /out/
|
|
|
|
# Sitemap location
|
|
Sitemap: https://vocalinux.com/sitemap.xml
|