molave@reddthat.com to Selfhosted@lemmy.worldEnglish · 10 days agoRunning web sites makes me not want to - Lowkey Partylowkey.partyexternal-linkmessage-square50linkfedilinkarrow-up1170arrow-down15
arrow-up1165arrow-down1external-linkRunning web sites makes me not want to - Lowkey Partylowkey.partymolave@reddthat.com to Selfhosted@lemmy.worldEnglish · 10 days agomessage-square50linkfedilink
minus-squarediaphragmwp@discuss.tchncs.delinkfedilinkEnglisharrow-up3·8 days agoI have a simple static site. It’s been up for less than a month. On the cheapest possible VPS, someone gave me. Robots.txt: User-Agent: * Allow: / How long do yall think it will take for it to blow up?
minus-squarePossibly linux@lemmy.ziplinkfedilinkEnglisharrow-up1·7 days agoRobots.txt is completely ignored these days
minus-squarediaphragmwp@discuss.tchncs.delinkfedilinkEnglisharrow-up2·7 days agoCool. Doesn’t really answer my question, though.
I have a simple static site. It’s been up for less than a month. On the cheapest possible VPS, someone gave me. Robots.txt:
How long do yall think it will take for it to blow up?
Robots.txt is completely ignored these days
Cool. Doesn’t really answer my question, though.