Block indexing on dev domain #4

Open
opened 2025-09-20 06:06:16 +00:00 by Nicholai · 0 comments
Owner

Summary: Prevent search engines from indexing development hostname.
Tasks:

  • Add X-Robots-Tag header noindex,nofollow via middleware or CDN
  • Add meta robots noindex as a fallback in layout
  • robots.txt for dev: Disallow: /
  • Verify response headers on a random dev page
    Acceptance Criteria:
  • Dev pages return noindex and robots.txt blocks crawling
**Summary:** Prevent search engines from indexing development hostname. **Tasks:** - [ ] Add X-Robots-Tag header noindex,nofollow via middleware or CDN - [ ] Add meta robots noindex as a fallback in layout - [ ] robots.txt for dev: Disallow: / - [ ] Verify response headers on a random dev page **Acceptance Criteria:** - [ ] Dev pages return noindex and robots.txt blocks crawling
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Nicholai/united-tattoo#4
No description provided.