Hey everyone,
As many of you may have heard, Reddit has recently decided to become a closed platform due to financial reasons, which has left us concerned about preserving the rich history of discussions and content on the site. However, there’s good news! We have found an alternative platform called Lemmy, where we can continue our vibrant community.
Now, our main challenge lies in archiving the vast amount of valuable posts and discussions from Reddit and migrating them to Lemmy. I believe it’s crucial to preserve this history and make it accessible to future users and researchers. Therefore, I would like to gather ideas and suggestions from all of you on how we can achieve this daunting task effectively.
If you have any experience or knowledge in mass archiving, data migration, or similar projects, please share your thoughts and recommendations. Let’s brainstorm together and find a way to safeguard our cherished Reddit posts on Lemmy.
Thank you all for your support and dedication to preserving online history!
Note: Please keep the focus of this discussion on archiving and migration ideas. Let’s refrain from discussing the reasons behind Reddit’s decision or engaging in negative comments. This is a constructive effort to ensure the preservation of our community’s contributions.
Looking forward to your insights!
Here is the master post from r/DataHoarder regarding the archival: https://www.reddit.com/r/DataHoarder/comments/1479c7b/historic_reddit_archives_ongoing_archival_effort
And one source for the PushShift up to March of 2023: https://github.com/Watchful1/PushshiftDumps