b51e676372fb6f9c4ca2af66c37b91e0
Lupa Outgrown
Creative Commons Attribution-No Derivative Works 4.0
OVER the past few months (maybe 3 months) I've noticed that Lupa, which studies Geminispace by downloading hundreds of thousands of pages and then analysing them, is not crawling as much as before (it 'binged' pages a lot more last year). This is understandable because the process is expensive (not just bandwidth for downloads but also RAM and CPU for analysis). The decrease in the number of pages analysed by Lupa can be seen in the first graph here.
"It seems safe to say that in the coming years there won't be a census or detailed survey of Geminispace, only rough estimates."Big Gemini capsules continue to grow (ours adds about 500 pages per month), so what's happening here is Lupa failing to keep up, not just with large sets of pages under single domains but also the total number of Gemini domains overall.
It seems safe to say that in the coming years there won't be a census or detailed survey of Geminispace, only rough estimates. Nothing comprehensive, complete, exhaustive. This is perfectly fine. In 2019 there were probably less than a hundred domains; now we have several thousands. ⬆