Commit 0be9172
committed
fix(darren): serve real robots.txt instead of 302-to-apex fallback
spivanatalie64/darren gh-pages has no robots.txt, so the worker's
not-found fallback 302'd crawlers to https://acreetionos.org/ with the
path dropped — GSC saw a redirect, not a valid per-host robots.txt.
- special-case /robots.txt: answer 200 text/plain directly
- extMap += .txt/.xml so repo-side text files get correct content types1 parent 6fdf2b3 commit 0be9172
1 file changed
Lines changed: 15 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2163 | 2163 | | |
2164 | 2164 | | |
2165 | 2165 | | |
| 2166 | + | |
| 2167 | + | |
| 2168 | + | |
| 2169 | + | |
| 2170 | + | |
| 2171 | + | |
| 2172 | + | |
| 2173 | + | |
| 2174 | + | |
| 2175 | + | |
| 2176 | + | |
| 2177 | + | |
| 2178 | + | |
2166 | 2179 | | |
2167 | 2180 | | |
2168 | 2181 | | |
| |||
2187 | 2200 | | |
2188 | 2201 | | |
2189 | 2202 | | |
| 2203 | + | |
| 2204 | + | |
2190 | 2205 | | |
2191 | 2206 | | |
2192 | 2207 | | |
| |||
0 commit comments