Skip to main content

r/opendirectories

Feed About
Hot
Open sort options
Change post view
Advertisement: Winning in F1 isn't one thing. It's a thousand things, all at once. Microsoft powers them across the Mercedes-AMG PETRONAS F1 team.
Winning in F1 isn't one thing. It's a thousand things, all at once. Microsoft powers them across the Mercedes-AMG PETRONAS F1 team.
media poster
microsoft.com
Learn More
An I'm sharing some videos
u/Jerome_the_Giraffe avatar u/Jerome_the_Giraffe
An I'm sharing some videos
Movies

I am hosting my own fast web file server. That link goes to a page that tells you what you can find on my server with links to the directories. I can't find my site in a google search even though it has sitemap files that link to every file on my server.

ChatGPT made this super awesome web spider. It outputs a file that you can feed to wget to download what you find. The cool thing about it is that you can edit the list of links before you download them if you want. It runs in Linux which is what you should be using on the VPS you use to download your files.

There is a web page explaining how to find media files. It includes instructions on how to use the web spider I mentioned above. The google search on that page shows mostly open directories!