Way to download NEXUS

[Traged]

Hello there,

if one would want to download contents of this forum, what would be the best way to approach it?

There are days that I am worried that I might lose access to this resource. Also data could be used for other purposes.

 

[northape]

Notebook & pen or maybe typewriter?
Why worry about this at all? Electricity can easily disappear. We don't live forever, either.
If nexus ever went away, it would be the least of your worries.
ChatGPT has a copy nowadays too. So why worry?

 

[Traged]

I do not trust robots I haven't build. Also, I will probably not trust any robots I will build because I build them.

I want data to play with, the thing is, I have to be interested in that data.

I would like an offline copy, for multiple reasons. And also I would like to acquire it without some kind of scraper.

 

[The Traveler]

A Friendly Reminder for Scrapers

When you are collecting data or scraping content from our platform, please be considerate with your approach. Think about things like limiting the number of requests and keeping the bandwidth inside a fair range to avoid unnecessarily straining our resources.

Thank you in advance for this!


Kind regards,

The Traveler

 

[Traged]

well that is why I am asking, maybe there is a good way implemented already... some backup or something... If I ever attempt to scrape Nexus, I will of course be considerate, but there is always human factor, making mistakes...

 

[The Traveler]

Only the public face of the DMT-Nexus will be, well, publicly shared. Databases and such would never be handed over due to privacy issues.

I think 4 parallel threads to scrape at any time might make it easy to cope with, while giving you plenty of time to scrape all within a useful timeframe.


Kind regards,

The Traveler

 

[Traged]

Thanks