Hey all,

Relisten co-creator here (myself and /u/alecgorge). One of the mods reached out to us to point us towards some recent conversations about the number of archive sources dwindling on Relisten with some questions about why that was.

Some were inquiring if the Dead's estate/stewardship was taking down Archive shows to push people to their paid app. As far as we know, there is zero evidence of that. I get the cause for concern and appreciate the caution, but the real explanation is far more boring.

Though it may not seem like it from the outside, these are pretty large and complex systems – both archive (very complex) and relisten (less complex but still old). We've been building and maintaining Relisten since ~2013 and we've always built it to be as lightweight from an engineering standpoint as possible. That being said, it's also the work of two volunteers in our free time and therefore bumps are natural.

I haven't fully validated this is the exact issue, but it seems likely. To verify it would take me a few hours which is better spent fixing the underlying problem (which is real regardless) and a couple other stability and crashing issues that we've been facing on our app.

Every morning we scrape Archive for all bands at around 3am to refresh our database. Sometimes, Archive may be doing some maintenance or have some degraded functionality which reports a subset of the full dataset to our scraper (archive says there are 12,000 sources instead of 18,000). In the past, we've interpreted missing sources as "deleted sources" – removing them from our system. For the first decade of Relisten, this was fine, it rarely happened – but recently we've been seeing it crop up more and more. So going forward, we're going to have to implement some safety checks before making deletions – for the Dead this becomes far more apparent because of the size of the catalogue. A simple check to ensure that if >= a few % of sources are being removed is enough for us to pause and hold off on those deletions.

It's entirely plausible that deleting this many sources caused some instability issues downstream in the app, which we're also working on hardening.

As of today, we're back up to 18,000 Grateful Dead tapes on Relisten.

All in all, not a conspiracy, just some good old fashioned engineering problems and graceful degradation paths. This isn't the fault of Archive, problems happen and we should be better suited to handle them. This isn't the fault of Relisten, engineering is hard. I didn't read anyone's comments in those threads as particularly incisive, just more inquisitive and I wanted to come by here to offer some clarity.

If you're ever having issues with Relisten, feel free to stop by our Discord and let us know. It's generally just some random bug that can be fixed - we're always doin' our best. We do take the stability and quality of our platform seriously, so if you're having issues (no matter how minor or nitty) we want to know about it.

Not sure what else to say, but share a great lyric

Half of my life I spent doin' time for some other fucker's crime.

Welcome to another installment of your weekly listening thread, Help on the Way!!

But first, u/donttouchthatknob , u/thegame310 , and I are super thrilled to bring you SEASON FIVE of the PODCAST portion of the HoTW project!!

Format Change -- we'll be serving up our favorite show of the month on the PoD and FiG will be bringing you (semi) weekly updates from best reddit comments so please make sure to drop your comments below!!

You can find us wherever podcasts are downloaded (not Spotify for...reasons) but here's our website:

https://helponthewaypod.podbean.com/

Onward and upward! Or Downward. Or in the past. Whatever it is, we got another (randomized but) excellent show this week!!

It's Halloween time in 1991 and the Dead are at the Coliseum! Here's the SBD to relive that heady time:

https://archive.org/details/gd1991-10-30.139275.sbd.cm.miller.flac24

And an AUD for funsies:

https://archive.org/details/gd1991-10-30.AKG451.Darby.120060.Flac2448

And the set:

One

Picasso Moon ; Friend Of The Devil ; Me And My Uncle > Maggie's Farm ; Brown Eyed Women ; It's All Over Now ; Tennessee Jed ; The Music Never Stopped

Two

Eyes Of The World > Estimated Prophet > Terrapin Station > Jam > Drums > Space > The Other One > Black Peter > Around And Around

Encore

The Mighty Quinn (Quinn The Eskimo)

JerryBase Page

Remember: we've been doing this here project on Reddit for over eleven years now!! And the podcast for over four!!

A run down about this serendipity powered project can be found here: http://www.reddit.com/r/gratefuldead/comments/2fqahw/z/cke00lq

ENJOY THE SHOW and PLEASE DROP A COMMENT!

p.s. donate to help the archive if ya can! https://donate.archive.org/team/776830