05.22.22
Gemini version available ♊︎Gemini is Bigger Than Most People Care to Realise
Video download link | md5sum b51e676372fb6f9c4ca2af66c37b91e0
Lupa Outgrown
Creative Commons Attribution-No Derivative Works 4.0
Summary: Geminispace has gotten to the point where it’s too computationally expensive (or outright pricey) to study, let alone keep abreast of, Gemini capsules or the domain space as a whole
OVER the past few months (maybe 3 months) I’ve noticed that Lupa, which studies Geminispace by downloading hundreds of thousands of pages and then analysing them, is not crawling as much as before (it ‘binged’ pages a lot more last year). This is understandable because the process is expensive (not just bandwidth for downloads but also RAM and CPU for analysis). The decrease in the number of pages analysed by Lupa can be seen in the first graph here.
“It seems safe to say that in the coming years there won’t be a census or detailed survey of Geminispace, only rough estimates.”Big Gemini capsules continue to grow (ours adds about 500 pages per month), so what’s happening here is Lupa failing to keep up, not just with large sets of pages under single domains but also the total number of Gemini domains overall.
It seems safe to say that in the coming years there won’t be a census or detailed survey of Geminispace, only rough estimates. Nothing comprehensive, complete, exhaustive. This is perfectly fine. In 2019 there were probably less than a hundred domains; now we have several thousands. █