21,864 Yugoslavian .yu Domains

Summary

TLDR; get a list of 21,864 domains from the former Yugoslavia’s “.yu” top level domain: download the .CSV In 2010 the entire domain space of Yugoslavia (.yu) was taken off the internet. After all, the country didn’t exist anymore. I heard about this from an interview with Kaloyan Kolev on Agnes Bytes’ “Archiving the Web”. Kaloyan had several interesting insights: We’ve baked the concept of “countries” into the Internet domain system. And that makes domain names tied to real-world territorial conflicts, countries splitting apart and countries going underwater (like Tuvalu) .yu is an early example of something that will happen more and more often. It is unfortunate that we didn’t preserve the .yu domain space like a nostalgic Internet memorial to the country. Instead, the sites became unmoored and unreachable. Kaloyan referred to the research paper “What does the Web remember of its deleted past? An archival reconstruction of the former Yugoslav top-level domain” by Anat Ben-David. In that paper, Ms. Ben-David reconstructed a network graph of .yu domains from the Internet Archive’s Wayback Machine. Ben-David’s paper used the below sources as seed lists: Unfortunately, Nikola Smolenski’s list on toolserver.org is not longer available By crawling links from these pages to other .yu URLs, she eventually found 17,460 unique websites in the .yu domain. The adventure begins Dear Reader: after hearing all this, I bellowed out a mighty Akshuallyyyyyyyy! I dropped my bag of mini M&Ms onto the house robe I was wearing. Unshaven and red eyed, I yelled up from the basement: “MOM, fire up the router! I’m going on an Internet Adventure!!!!”. You see, I figured I was good enough to discover all the archived domains under the .yu TLD. After all, last time I had an akshually moment, good things happened! At first I tried doing a wildcard search for all *.yu domains at the Wayback Machine. That didn’t work. The CDX API – a dead(ish) end Then, I discovered that the Wayback Machine has a...