hvg-dev/blog
1
0
Fork 0
Code Actions Packages Activity

+ ADD robots.txt and ads.txt files

Browse Source
This commit is contained in:
felegy
2025-07-31 19:30:17 +00:00
parent c9cb4a4ca8
commit 7c8d2d60a7
13 changed files with 91 additions and 342 deletions
Download Patch File Download Diff File Expand all files Collapse all files

18
web/robots.txt Normal file
View File

@@ -0,0 +1,18 @@
User-agent: Googlebot
Allow: /
User-agent: Bingbot
Allow: /
User-agent: BingPreview
Allow: /
User-agent: Pinterestbot
Allow: /
User-agent: facebookexternalhit
Allow: /
User-agent: Applebot
Allow: /
User-agent: OSZKbot
Allow: /
User-agent: upday
Allow: /
User-agent: Mediapartners-Google
Allow: /