James M. Greene
c940dcd98b
Middleware overhaul! ( #18218 )
...
* Middleware overhaul!
- Remove unnecessary 'async' keywords from middleware functions
- Ensure all middleware functions we create have names
- Wrap the method contents of all async middleware functions in a try-catch+next(error) pattern
* Use asyncMiddleware wrapper instead of try-catch+next(error) pattern
* Remove unnecessary try-catch+next(error) pattern from context middleware
2021-03-11 01:12:41 +00:00
Kevin Heis
c62f49aa0e
Block indexing not crawling ( #17044 )
...
* Block indexing instead of crawling
* Lint
* Update deprecated-enterprise-versions.js
* Combine loops
2020-12-17 11:57:18 -08:00
Sarah Schneider
b46e881557
properly concat versioned hidden product hrefs
2020-12-03 12:45:05 -05:00
Sarah Schneider
1b051afa18
Merge branch 'main' of github.com:github/docs-internal into hidden-docs-alt
2020-12-02 15:13:43 -05:00
Kevin Heis
e3cfacd8df
Fix robots.txt from being self repeating ( #16705 )
...
* Fix robots.txt from being self repeating
* Add test to make sure robots doesnt have duplicate lines
2020-12-02 19:45:22 +00:00
Kevin Heis
8b8d6d24d3
Merge branch 'main' into hidden-docs-alt
2020-11-03 10:19:14 -08:00
Chiedo John
7924aea2f8
Instruct search engines to not crawl archived versions ( #16292 )
...
* Instruct search engines to not crawl archived versions
* Update middleware/robots.js
Co-authored-by: Sarah Schneider <sarahs@users.noreply.github.com >
* Add test
* Fix spooky bug
Co-authored-by: Chiedo <chiedo@users.noreply.github.com >
Co-authored-by: Sarah Schneider <sarahs@users.noreply.github.com >
2020-11-03 08:23:22 -05:00
Sarah Schneider
d290d40ffc
update middleware and tests around robots.txt exclusions of hidden/EA content
2020-10-22 10:07:20 -04:00
Vanessa Yuen
3df90fc9b8
Hello git history spelunker!
...
Are you looking for something? Here is all of the GitHub Docs history in one single commit. Enjoy! 🎉
2020-09-27 14:10:11 +02:00
