Is OldWitt in danger of being taken down soon?

Started by GV, March 23, 2021, 03:46:23 PM

Previous topic - Next topic

GV

Quote from: Sir Alexandreu Davinescu on March 25, 2021, 07:37:39 PM
Okay, all downloaded!  Zipping now and then I'll upload it.  11,710 threads in total.  It'll take probably about a half hour or so to zip, since it's 6 gigs and 64,128 files.  And then it'll take a while to upload.  As you might guess, my computer and my internet connection aren't top of the line.  But by morning, GV, you will be the proud owner of a genuine and reasonably complete backup of Wittenberg.

Tech seems to have caught up with our advanced needs in Talossa.

Baron Alexandreu Davinescu

Quote from: GV on March 25, 2021, 08:16:35 PM
Quote from: Sir Alexandreu Davinescu on March 25, 2021, 07:37:39 PM
Okay, all downloaded!  Zipping now and then I'll upload it.  11,710 threads in total.  It'll take probably about a half hour or so to zip, since it's 6 gigs and 64,128 files.  And then it'll take a while to upload.  As you might guess, my computer and my internet connection aren't top of the line.  But by morning, GV, you will be the proud owner of a genuine and reasonably complete backup of Wittenberg.

Thank you!!  What I will do is go through and make sure all threads are represented.  This will not take too long.

As for internal file-linkage, I've always had the expectation people would have to do the searching for whatever on OldWitt by hand. 

If the batch-editing messes with the original thread numbers, don't do the batch editing.  The thread numbers are critical to future citation and research.
11,710 threads is a lot to check, since you have to open each one manually.  If you are able to open and check each thread at a rate of one every five seconds without ever stopping or slowing down, that's more than sixteen straight hours of checking!  Unless there's some urgent need, I'd suggest it might save you a lot of time if you just gave me a little bit to sort it out so that it's navigable.  I don't know if I'll be able to get fancy stuff like searching working, but I bet I can get it a lot better-sorted for you than the current state.

In an hour it'll all be uploaded, compressed to 1 gig.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

#22
Restarting the upload because I figured out the batch edit thing pretty quickly.  I think this should work on your computer now.  Once you unzip the 7z file, then you want to open up the Witt2 folder, then the talossa.proboards.com folder.  Inside of that folder is a file named index.html, and it should open normally with any web browser.  You can navigate through any page that the crawler could access, and the links should be purely relative to their location and operate normally.  In order to advance through multiple pages in a board with a large size, like the main one, you need to use the "next" link (or you can manually edit the URL to the intended number).  If you click the ellipsis, the dialogue box to pick a page will come up, but it won't work.  No external links were copied, so any links to other sites outside of talossa.proboards.com will be dead (but there will be an error page to point you to a live version, if one exists).  No images were downloaded, but that'll be something I can try in the future (why not, after all?)

To be clear, I've only done spot checks here and there, but I didn't find any missing pages.  If something's not working or missing, let me know and I'll see if I can figure it out.

EDIT: Uploaded and sorted.  Enjoy.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

GV

Stunning.  I will take a look at everything this coming week.

Baron Alexandreu Davinescu

Working on grabbing images, but running into some problems with that amount of data.  Working on it, but expect nothing in the near term.  Seems pretty low priority anyway.

Everything work okay for you?  I know you'd been wanting this for years now, so I hope that this whole thing wasn't anticlimactic.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

GV

Quote from: Sir Alexandreu Davinescu on April 05, 2021, 09:53:23 PM
Working on grabbing images, but running into some problems with that amount of data.  Working on it, but expect nothing in the near term.  Seems pretty low priority anyway.

Everything work okay for you?  I know you'd been wanting this for years now, so I hope that this whole thing wasn't anticlimactic.

Argh.  This got buried with other stuff I'm working on.  Alexander, I'll let you know on this by the end of this month.  Thanks already for an amazing amount of work on this.

What I will need to do is check to see if every thread number (save Chat) is covered.  Once I'm sure we can open everything without prioprietary software, I'll call this project done.

Baron Alexandreu Davinescu

No rush at all; I was just curious.  Take your time and whenever you get around to it, let me know if it works or if something's broken.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

GV

Quote from: Sir Alexandreu Davinescu on April 05, 2021, 11:10:38 PM
No rush at all; I was just curious.  Take your time and whenever you get around to it, let me know if it works or if something's broken.

Sounds good.  Thanks again!

Baron Alexandreu Davinescu

I haven't been able to get the images yet, but I'm still working on this.  Just FYI.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

GV

Quote from: Sir Alexandreu Davinescu on April 20, 2021, 07:51:56 AM
I haven't been able to get the images yet, but I'm still working on this.  Just FYI.

TY for you continuing efforts!

Baron Alexandreu Davinescu

Doesn't look like I'll be able to grab the images, since I keep getting shut down by Proboards.  Did the existing archive work?
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

Quote from: GV on April 05, 2021, 10:28:55 PM
Quote from: Sir Alexandreu Davinescu on April 05, 2021, 09:53:23 PM
Working on grabbing images, but running into some problems with that amount of data.  Working on it, but expect nothing in the near term.  Seems pretty low priority anyway.

Everything work okay for you?  I know you'd been wanting this for years now, so I hope that this whole thing wasn't anticlimactic.

Argh.  This got buried with other stuff I'm working on.  Alexander, I'll let you know on this by the end of this month.  Thanks already for an amazing amount of work on this.
Not to be a pest, but I spent a decent amount of time getting this set up and working, and I just want to verify that the archive did work okay.  It's been a few months -- have you had a chance to check it?
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

Quote from: GV on April 20, 2021, 12:02:25 PM
Quote from: Sir Alexandreu Davinescu on April 20, 2021, 07:51:56 AM
I haven't been able to get the images yet, but I'm still working on this.  Just FYI.

TY for you continuing efforts!
Quote from: Baron Alexandreu Davinescu on July 28, 2021, 10:51:19 PM
Quote from: GV on April 05, 2021, 10:28:55 PM
Quote from: Sir Alexandreu Davinescu on April 05, 2021, 09:53:23 PM
Working on grabbing images, but running into some problems with that amount of data.  Working on it, but expect nothing in the near term.  Seems pretty low priority anyway.

Everything work okay for you?  I know you'd been wanting this for years now, so I hope that this whole thing wasn't anticlimactic.

Argh.  This got buried with other stuff I'm working on.  Alexander, I'll let you know on this by the end of this month.  Thanks already for an amazing amount of work on this.
Not to be a pest, but I spent a decent amount of time getting this set up and working, and I just want to verify that the archive did work okay.  It's been a few months -- have you had a chance to check it?
Maybe you missed this, @GV ?
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

GV

#33
Extracting the near-one-gig compressed archive now...

Assuming it works fine (as it should with you having put it together), I will upload it to the Library of Talossa.

Baron Alexandreu Davinescu

Quote from: GV on August 04, 2021, 10:55:31 PM
Extracting the near-one-gig compressed archive now...

Assuming it works fine (as it should with you having put it together), I will upload it to the Library of Talossa.
You can do that, but it won't really work or be navigable. I recommend that for public access you'll leave it as a compressed file that people can download to their own computers and extract as they so choose. Once it's on someone's computer, then the local links should all work properly and they should be able to just click through as though it were a live site, but that's not possible on Google drive. On Google drive, it will just be a giant collection of unlabeled HTML files in different folders, and thus pretty much useless.

I just want to confirm that you are able to download it, extract it, and then navigate normally through all the different boards at different levels without any trouble or encountering any missing threads?
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

So in the last five months, were you able to download this archive, extract it, and then navigate normally without any trouble or any missing threads?  You were working on this for years, and I'd still like to confirm that it actually works for you.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

Quote from: GV on August 04, 2021, 10:55:31 PM
Assuming it works fine (as it should with you having put it together)

Did you ever have a chance to check to make sure that the archive extracts correctly, and that you can navigate through to all the forums and look at different threads? 

I've been keeping my copy for a long while now in case I need to tweak it, but I don't have the space since it's so large.  But I don't want to delete it if something is wrong with the uploaded copy.  It's been more than half a year that I've been asking you this, GV -- please find the time to check this out and make sure it's working.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

Okay, well, I guess I'm just going to delete this file and hope that the archive really does work for you, @GV .  You've been on Witt multiple times over the last eight months, and I've tagged you several times, so pretty clearly you're just purposefully ignoring me -- and that's really rude.  Especially considering how I busted my butt to do this for you and save you from manually saving each thread of the old forum, one at a time, like you'd been doing.
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan

                   

Baron Alexandreu Davinescu

@GV , it's been a year or so.  Did you ever got around to checking to see if the archive works for you?
Alexandreu Davinescu, Baron Davinescu del Vilatx Freiric del Vilatx Freiric es Guaír del Sabor Talossan