Kevin Heis
|
c62f49aa0e
|
Block indexing not crawling (#17044)
* Block indexing instead of crawling
* Lint
* Update deprecated-enterprise-versions.js
* Combine loops
|
2020-12-17 11:57:18 -08:00 |
|
Sarah Schneider
|
b46e881557
|
properly concat versioned hidden product hrefs
|
2020-12-03 12:45:05 -05:00 |
|
Sarah Schneider
|
1b051afa18
|
Merge branch 'main' of github.com:github/docs-internal into hidden-docs-alt
|
2020-12-02 15:13:43 -05:00 |
|
Kevin Heis
|
e3cfacd8df
|
Fix robots.txt from being self repeating (#16705)
* Fix robots.txt from being self repeating
* Add test to make sure robots doesnt have duplicate lines
|
2020-12-02 19:45:22 +00:00 |
|
Kevin Heis
|
8b8d6d24d3
|
Merge branch 'main' into hidden-docs-alt
|
2020-11-03 10:19:14 -08:00 |
|
Chiedo John
|
7924aea2f8
|
Instruct search engines to not crawl archived versions (#16292)
* Instruct search engines to not crawl archived versions
* Update middleware/robots.js
Co-authored-by: Sarah Schneider <sarahs@users.noreply.github.com>
* Add test
* Fix spooky bug
Co-authored-by: Chiedo <chiedo@users.noreply.github.com>
Co-authored-by: Sarah Schneider <sarahs@users.noreply.github.com>
|
2020-11-03 08:23:22 -05:00 |
|
Sarah Schneider
|
d290d40ffc
|
update middleware and tests around robots.txt exclusions of hidden/EA content
|
2020-10-22 10:07:20 -04:00 |
|
Vanessa Yuen
|
3df90fc9b8
|
Hello git history spelunker!
Are you looking for something? Here is all of the GitHub Docs history in one single commit. Enjoy! 🎉
|
2020-09-27 14:10:11 +02:00 |
|