Chiedo John 7924aea2f8 Instruct search engines to not crawl archived versions (#16292) ...

* Instruct search engines to not crawl archived versions

* Update middleware/robots.js

Co-authored-by: Sarah Schneider <sarahs@users.noreply.github.com>

* Add test

* Fix spooky bug

Co-authored-by: Chiedo <chiedo@users.noreply.github.com>
Co-authored-by: Sarah Schneider <sarahs@users.noreply.github.com>

2020-11-03 08:23:22 -05:00

4.7 KiB

Raw Blame History

View Raw