●● IRC: #boycottnovell @ Techrights IRC Network: Tuesday, April 12, 2022 ●● ● Apr 12 [01:11] *u-amarsh04 has quit (Quit: Konversation terminated!) [01:11] *u-amarsh04 has quit (Quit: Konversation terminated!) [01:13] *u-amarsh04 (~amarsh04@v6xmmrhxmbafc.irc) has joined #boycottnovell [01:14] *u-amarsh04 (~amarsh04@joseon-rmogvn.g0d7.dtdf.mc4289.IP) has joined #boycottnovell [01:27] schestowitz-TR [00:48] Years ago FOSS Force spoke about the corruption of Linux Foundation. Now, after getting money from Linux [01:27] schestowitz-TR Foundation, it does puff pieces for the corrupt Linux Foundation. SJVN effect. https://fossforce.com/2022/04/protecting-open-sour [01:27] schestowitz-TR ce-security-as-cold-war-turns-hot/ [01:27] -TechrightsBN/#boycottnovell-fossforce.com | OpenSSF Protects Open Source Security as Cold War Turns Hot- FOSS Force [01:27] schestowitz-TR do not restart tuxmachines or anything, I work on its DB. As I worried, it was in a poor state, this may take a while ● Apr 12 [02:26] *DaemonFC (~daemonfc@m2cqwwx99y5wi.irc) has joined #boycottnovell ● Apr 12 [04:33] schestowitz-TR gm [04:33] schestowitz-TR no hurry [04:33] schestowitz-TR let's start with, is it ok to leave channel settings for wifi as is? [04:33] schestowitz-TR it 'felt' faster' after changing that AND finding the culprit [04:34] Techrights-sec ack [04:34] Techrights-sec gm [04:34] Techrights-sec ok [04:34] Techrights-sec probably. checking [04:34] Techrights-sec I don't see any overlapping channels but a whole bunch of them have all changed [04:34] Techrights-sec at the same time. that might be part of the problem [04:35] schestowitz-TR I see [04:35] schestowitz-TR anyway, it was not the problem in our case [04:35] schestowitz-TR but I will leave wifi like that [04:35] schestowitz-TR it 'felt' like latency came down a bit [04:37] schestowitz-TR so, about tuxmachines, at the moment I try a bunch of tools to fix the records [04:37] schestowitz-TR but just in case we can also restore from sunday morning backup, then I can manually re-add all the node [04:37] schestowitz-TR but I want to take advantage of this situation to just change the OS [04:37] schestowitz-TR you can see in irc scrollback stuff related to this [04:37] schestowitz-TR I also sent email [04:38] Techrights-sec ok [04:38] Techrights-sec yes, I saw the e-mail and skimmed through it. There were quite a few log [04:38] Techrights-sec entries warning of repair [04:38] Techrights-sec needed [04:40] schestowitz-TR this is at the very least educational to me [04:40] schestowitz-TR I am not stressed as we can get it orking again, we had worse downtimes too [04:40] schestowitz-TR it has just finished doing recovery that took 15 minutes with a tool [04:40] schestowitz-TR but I see that too resulted in no solution [04:40] schestowitz-TR I want to try another tool, I've not yet received a reply from kaniia [04:40] schestowitz-TR I'm certain that means afk [04:43] Techrights-sec there are mysqldup gzip'ed files for each day, if that helps [04:43] Techrights-sec mysqldump [04:46] schestowitz-TR yes, we have 4 for sunday and monday [04:47] schestowitz-TR I made some copies of dumps [04:47] schestowitz-TR thje current DB works well if you are logged in [04:47] schestowitz-TR this is an issue we had at least twice about 4 years ago [04:47] schestowitz-TR same symptoms, same outcome [04:47] schestowitz-TR but really we need to move to a better system [04:47] schestowitz-TR xrevan has explained that the storage engine used at least for some of the tables is veru bad [04:47] schestowitz-TR innodb should be used universally [04:47] schestowitz-TR this, I think, explains why kaniini struggled to move this DB to the dedicated DB container [04:47] Techrights-sec ack [04:47] Techrights-sec I thought it was innodb there all the way through? [04:50] schestowitz-TR [03:57] psydruid: just throwing out there this remark, ymmv [04:50] schestowitz-TR [03:57] techdirt moved to wordpress last month [04:50] schestowitz-TR [03:57] they were anxious to migrate [04:50] schestowitz-TR [03:57] not sure what they used before [04:50] schestowitz-TR [03:57] techdirt goes back to the 1990s [04:50] schestowitz-TR [03:57] running sites for this long is very hard, without "overhaul", as technology changes far too fast [04:50] schestowitz-TR [03:58] php may not work after a version bump, OSes deprecate support for "old" things, some projects get abandon [04:50] schestowitz-TR ed, so no security fixes [04:50] schestowitz-TR tuxmachines goes all the way to 2004 [04:50] schestowitz-TR there's tons of material there long lost from the web [04:50] schestowitz-TR the urls it links to can be recovered from IA [04:50] schestowitz-TR susan left his life's work with us [04:50] schestowitz-TR with challenges that her ex, texstar, was able to tackle [04:50] schestowitz-TR but not her [04:51] Techrights-sec yes [04:51] Techrights-sec not everything is (still) in the IA though [04:55] schestowitz-TR IA is just a backup plan, but not dependable [04:55] schestowitz-TR for research etc. [04:55] schestowitz-TR most people focus on the present, not the distant past [04:55] schestowitz-TR and then there are revisionists, who should be confroned [04:55] schestowitz-TR without evidence from the past it's easier to lie about the past [04:55] schestowitz-TR there are museums made to ensure this does not happen [04:55] schestowitz-TR "bush was right to liberate afghanistan" [04:55] schestowitz-TR "thatcher was misunderstood" [04:59] Techrights-sec I wonder if there is already a plugin which adds parallel links to the IA [04:59] Techrights-sec some projects, like Ubuntu, expend effort to delete their archives and to [04:59] Techrights-sec erase what could have been preserved in an organized fashion with less effort [04:59] Techrights-sec Yes, being able to lie about the past as M$ does is one of the "advantages" of [04:59] Techrights-sec having no records of the past anywhere [04:59] Techrights-sec "reagan did not sow the seeds of destruction which would ultimately bring down [04:59] Techrights-sec the nation" [04:59] Techrights-sec Reagan undid the educational system in the US and that is by far the most [04:59] Techrights-sec harmful act so far when considered in the long term. Ultimately the populace [04:59] Techrights-sec loses the knowledge needed to govern itself and even retain an operational [04:59] Techrights-sec economy. The Soviets who arranged for him to do that would be laughing if they [04:59] Techrights-sec would have been still around, [04:59] schestowitz-TR US capital got funneled into very few hands in the course of several decades [04:59] schestowitz-TR and then bought the media, "charter" schools etc. [04:59] schestowitz-TR so we're meant to delebrate this [04:59] schestowitz-TR poor folks struggling to maintain a site while the oligarchs buy papers, twitter, [04:59] schestowitz-TR and reputatyion-laundering PR firms ● Apr 12 [05:00] Techrights-sec That too [05:00] Techrights-sec yes. the gratuitious complexity which has entered most projects contributes to [05:00] Techrights-sec the difficulty in operating a site. [05:00] Techrights-sec backing up TR now [05:02] schestowitz-TR operating soites is a multi-faceted thing [05:02] schestowitz-TR as groklaw shows [05:02] schestowitz-TR writing articles is one aspect [05:02] schestowitz-TR at work we help some who write about human rights [05:02] schestowitz-TR but who struggle with the technical side [05:02] schestowitz-TR let aside preservation [05:02] schestowitz-TR so writing "for free" is hard [05:02] schestowitz-TR blogspot will vanish [05:02] schestowitz-TR you need a host [05:02] schestowitz-TR and then you need maintainers [05:02] schestowitz-TR that's why so many "news" sites are now offline [05:02] schestowitz-TR keeping a sysadmin for $50,000 a year was not worth the gains [05:03] Techrights-sec It only gets complex when you add the ability to comment. That requires both [05:03] Techrights-sec a database and moderators. Just posting articles only (on the technology side) [05:03] Techrights-sec requires a static site generator. [05:05] schestowitz-TR last MyISAM recovery attempt will finished in about 2 minutes [05:05] schestowitz-TR after so many scans and repairs I would not even trust its state [05:06] schestowitz-TR even if it "worked" again [05:06] schestowitz-TR Sunday morning at 5am was the last "trustworthy" state and I can add the missing node and comments [05:06] schestowitz-TR in the right order within an hour [05:06] schestowitz-TR but that would not solve the OS issue, so we might wait [05:06] Techrights-sec yes, most activities require at least a 25% FTE administrator [05:06] Techrights-sec right, I hope there is the opportunity to migrate now [05:10] schestowitz-TR as expected, that last attempt did not solve the issue either [05:10] schestowitz-TR but to be honest, even if it did, given our experience with similar [05:10] schestowitz-TR situations 4 or so years ago, I would revert back to an old site state [05:10] schestowitz-TR with the old password and settings [05:10] schestowitz-TR but I do wonder if we can, without bothering kaniini configure the DB software to run OK [05:10] schestowitz-TR with this tuxmachines DB [05:10] schestowitz-TR maybe some distros keep older, long-term DB versions [05:10] Techrights-sec can the site be set to use innodb during that process? [05:15] schestowitz-TR according to xrevan it is not so simple [05:15] schestowitz-TR I imagine that legacy drupal (maybe 4 or 5) used that old storage engine [05:15] schestowitz-TR which trotted forward [05:15] schestowitz-TR to avoid ending up like joindiaspora we need to move to a more robusst DB [05:15] schestowitz-TR but some DB conversion tools I saw online are no longer maintained [05:15] schestowitz-TR one extreme approach (VERY EXTREME, bear with me, I don't mean that seriously) [05:15] schestowitz-TR is to scrape all the pages for 162,000 nodes and make static pages for each [05:15] schestowitz-TR this is tricky for many reasons, but that's not the point [05:15] schestowitz-TR and then, using the same URL for RSS feed [05:15] schestowitz-TR you start afresh with a better or more "modern" stack [05:15] schestowitz-TR modern does not mean better [05:15] schestowitz-TR I would rather stay with the same CMS of course, which we can do, but I want to [05:15] schestowitz-TR push the OS back to the present [05:15] schestowitz-TR I've just checked again. no reply from kaniini [05:16] Techrights-sec I would think that the dump could be without the createtables parts and the [05:16] Techrights-sec creation done manually then import just the data from the dumps [05:16] Techrights-sec :/ [05:16] Techrights-sec That would take weeks [05:16] Techrights-sec and be error prone [05:16] Techrights-sec modern often means unnecessarily complex and bloated [05:16] Techrights-sec yes that sounds like a good idea [05:16] Techrights-sec ack [05:16] Techrights-sec just backed up Git too; that could be automated [05:19] schestowitz-TR for irc, the sole purpose of a backup now is new registered users I think [05:19] schestowitz-TR the rest stays the same [05:20] schestowitz-TR going from the dumbs is, afaic remember, what we did the last time, when [05:20] schestowitz-TR we moved DBs outwards [05:20] schestowitz-TR that seemed to work at first [05:20] schestowitz-TR but then as soon as you post something the same thing would happedn as happened past midnight [05:20] Techrights-sec I have no backup of IRC [05:23] schestowitz-TR one thing def. worth trying is, use a reject tm backup dump [05:23] schestowitz-TR does not have to be recent (i.e. broken) [05:23] schestowitz-TR load that into localghost in a laptop [05:23] schestowitz-TR and then try to see if the OS handles it OK [05:23] schestowitz-TR when new nodes are added [05:23] schestowitz-TR this way we can even make a ready system to deploy [05:24] Techrights-sec yes [05:24] Techrights-sec which distro? [05:24] schestowitz-TR I was just thinking the same [05:24] schestowitz-TR maybe something not too modern [05:24] schestowitz-TR but with legacy php and mysql/mariadb [05:24] Techrights-sec ubuntu lts? [05:27] schestowitz-TR yes, that might work [05:27] schestowitz-TR if the backup import (techrights has many dumps under ~archives) [05:27] schestowitz-TR is out of date, it can later be brought up to data [05:27] schestowitz-TR the hard part will be seeing if new stories can be added without the DB [05:27] schestowitz-TR getting all worked up [05:27] schestowitz-TR this is not a new "challenge" [05:27] schestowitz-TR it's something that just had us go "fuck it" [05:27] schestowitz-TR "let's leave that for another day" [05:27] schestowitz-TR the db host was alpine afaik [05:27] schestowitz-TR the centos os tuxmachines has sysctl [05:27] schestowitz-TR alpine is... different [05:28] Techrights-sec ack [05:28] Techrights-sec alpine is ok [05:31] schestowitz-TR remember that tuxmachines was imported into centos in 2013 from a DEBIAN [05:32] schestowitz-TR box [05:32] schestowitz-TR hence, the files, ALL THE FILES, are under /var [05:32] schestowitz-TR /home and /root are just a bunch of junk, the settings for apache are [05:32] schestowitz-TR in the usual place [05:32] schestowitz-TR using a local install of it, extracting gemtext by going through ~/node/1 upwards [05:32] schestowitz-TR would not be too hard [05:32] schestowitz-TR it might even be worth doing as it's vastly easier than mediawiki or wordpress [05:32] schestowitz-TR and then serve as a static record with canonical form [05:32] Techrights-sec following a rolling release distro would require occasional cleanups [05:32] Techrights-sec followign an LT distro would require major work periodically but spaced much [05:32] Techrights-sec further apart temporarly [05:32] Techrights-sec So the old records would be static? [05:34] schestowitz-TR I meant, if we get this running also on a laptop, then running a program to cycle [05:34] schestowitz-TR through nodes 1-162,000... and then get the body of that would be simple, e.g. [05:34] schestowitz-TR to make gemtext pages for each [05:34] schestowitz-TR the pi can even serve those with the existing proxy, we have lots of space [05:34] Techrights-sec I could set up devuan temporarily on a spare device for a while. [05:34] Techrights-sec It could be accessible via SSH. The web aspect would have to be tunneled over [05:34] Techrights-sec SSH [05:40] schestowitz-TR that would be excellent. [05:40] schestowitz-TR asa I said, apache under /etc and /var with the rest, all that's needed then it DB import [05:40] schestowitz-TR and pointing to localhost [05:40] schestowitz-TR the scary part is adding a new node [05:40] schestowitz-TR when we tried that with alpine it was not happy, rianne does not yet know about the site [05:40] schestowitz-TR bbut she knows we epent a lot of time investigation [05:40] schestowitz-TR we're very committed to that site and need the upgrade [05:40] schestowitz-TR "modern" means bloat, and while it might work this year and next year and maybe another year [05:40] schestowitz-TR that exponentially becomes expensive to maintain [05:40] schestowitz-TR diasoora is dying, jusging by steep deceline in active users [05:40] schestowitz-TR mastodon is the next identica [05:40] schestowitz-TR distro.toot and drew devault would not bother snymore [05:40] schestowitz-TR mastodon, like diaspora, need to keep huge DBs and stuff, even for just a few users [05:40] schestowitz-TR the concept is OK, but blogs with RSS are better [05:40] schestowitz-TR dogg.com died partly due to technical debt [05:40] schestowitz-TR it was poorly coded with mysql iirc [05:40] schestowitz-TR and they needed to do major overhauls just for the site to keep going [05:42] Techrights-sec mastodon requires a *tremendous* amount of overhead for very little result [05:42] Techrights-sec and then on top of that there is the javascript [05:42] schestowitz-TR at one point, iirc, they would hide the comments by default [05:42] schestowitz-TR those were computationallly expensive, e.g. checking for each of your "friends" [05:42] schestowitz-TR if they were related to any of the comments displayed [05:42] schestowitz-TR nice "feature", but huige overhead [05:45] Techrights-sec ack [05:52] schestowitz-TR speaking in the abstract [05:52] schestowitz-TR onm coffe, not drunk [05:52] schestowitz-TR there is a sea of change for the net/web [05:52] schestowitz-TR for a number or reasons we both know about [05:52] schestowitz-TR those who managed to stay afloat will eat those who perish [05:52] schestowitz-TR cnx added a TOOOOOOON oif bloat [05:52] schestowitz-TR that's why his site went offline like 3 times in a week [05:52] schestowitz-TR he ran afoul of rules biolated by the crap he had added [05:52] schestowitz-TR yesterday I thought about the fast agging of "apps" [05:52] schestowitz-TR of lxer being offline for like 3 days [05:52] schestowitz-TR social media is collapsing [05:52] schestowitz-TR FB even admits it [05:52] schestowitz-TR I see it for myself, not just my account by others', like glynmoody [05:52] schestowitz-TR 'free' video hosting [05:52] schestowitz-TR and another thing I was gonna mention but forgot (it was not that iumportant anyway, and this is informal chat) [05:52] schestowitz-TR I forgot, cannot remember, pressing on [05:52] schestowitz-TR techrights has debt, same for all old sites [05:52] schestowitz-TR techdirt is one example [05:52] schestowitz-TR ipwatchtroll is antoehr [05:52] schestowitz-TR the editor left, not they try to hide the lack of visitors/comments [05:52] schestowitz-TR phoronis is plastered together [05:52] schestowitz-TR several "overhauls" over theyears [05:52] schestowitz-TR maybe what I wanted to say though, a lot of history will be accessible through those [05:52] schestowitz-TR more capable of staying online longer, and on a shoestring budget [05:52] Techrights-sec http/3 is an ummitigated disaster and will cut out all the small shops which [05:52] Techrights-sec happen to remain [05:52] Techrights-sec ack [05:55] *DaemonFC has quit (Quit: Leaving) [05:57] schestowitz-TR also CAs and TLS, imposed by btoewdwser [05:57] schestowitz-TR maybew this is the intention, to crush the smal [05:57] schestowitz-TR because you cannot just leave it there alone, you have to routinely renew things [05:57] schestowitz-TR and then top-level CAs go out of existence [05:57] schestowitz-TR taking out older devices from the Web [05:57] schestowitz-TR so you need to buy new TV/phone [05:57] schestowitz-TR it still feels like yesterday's Internet self-nuke resulted for me in a [05:57] schestowitz-TR connection with lower latency [05:57] schestowitz-TR I did not measure anything, but it feels like it [05:57] schestowitz-TR if Sunday's TM deterioration (caused by nothing in particular|) results in a gemini capsule for it [05:57] schestowitz-TR and a more modern OS, then maybe it's for the better [05:57] schestowitz-TR the point I was mking earlier when the head became overloaded with example is, [05:57] schestowitz-TR the longevity of tech in general (online and offline) is nder attack [05:57] schestowitz-TR to be clear, techdirt did not move to wordpress [05:57] schestowitz-TR it moved to wordpress.com [05:57] schestowitz-TR they do censorship and other stuff [05:57] schestowitz-TR so their resolution to techniacal debt was running into a trap [05:57] schestowitz-TR that they cannot get out of [05:58] Techrights-sec :/ [05:58] Techrights-sec that was a disadvantageous decision for techdirt to make ● Apr 12 [06:00] schestowitz-TR I mentioned this to him in Twitter [06:00] schestowitz-TR (to Mike) [06:00] schestowitz-TR I was one of the first dozen in that pplatform [06:00] schestowitz-TR like drupal, hosting is their business model [06:00] schestowitz-TR when pressed over things techdirt published [06:00] schestowitz-TR it would be matt mulleneg et al and their lawyers deciding [06:00] schestowitz-TR not mmasnick's lawyers [06:00] schestowitz-TR and you do know they have many enemies [06:00] schestowitz-TR it's like github, but for journalism [06:00] schestowitz-TR when I was in berlin wordpress.com suspended my account [06:00] schestowitz-TR I was their beta tester! [06:00] schestowitz-TR then they accepted it was in error [06:00] schestowitz-TR but they never asked me or notificed me [06:01] schestowitz-TR mike's enemies can do to him now what shiva ayadurai did to joindiaspora [06:01] schestowitz-TR or diasporta [06:01] schestowitz-TR lukas did delete that past after charles harder had sent the latter [06:02] Techrights-sec interesting so they have an anti-FOSS agenda from early on [06:03] schestowitz-TR no, wordpress is that ios what you mean gives the source code as GPL [06:03] schestowitz-TR never mind the crappy non-GPL stuff they add to wordpress [06:03] schestowitz-TR (and which I oppose, some of it came from facebook) [06:03] schestowitz-TR but the hosting is a service they tell [06:04] schestowitz-TR while I suppose keeping incentive to use the hosting [06:04] schestowitz-TR like drupal's company [06:04] schestowitz-TR by increasing the underlying complexity [06:04] schestowitz-TR some of the recent security fixes in wordpress are for plugins and bloat they added later on [06:04] schestowitz-TR those contribute to the attack surface [06:04] schestowitz-TR so newer does not always mean safer [06:12] schestowitz-TR --- [06:12] schestowitz-TR key for test setup? [06:12] schestowitz-TR oh, one thing mentioned in irc was https for tuxmachines [06:12] schestowitz-TR tbere were some missing packages needed for certbot before [06:24] schestowitz-TR going to take a nap, no word back from kaniini yet [06:24] schestowitz-TR btw, galler at tuxmachines uses external db [06:24] schestowitz-TR which is specified in the config file [06:24] schestowitz-TR *Gallery2 ● Apr 12 [08:38] *activelow has quit (connection closed) [08:38] *activelow (~activelow@x7va5n7zgh7hg.irc) has joined #boycottnovell ● Apr 12 [09:14] *Despatche (~desp@u3xy9z2ifjzci.irc) has joined #boycottnovell [09:33] schestowitz-TR no reply yet from kaniini [09:33] schestowitz-TR I am connected to the server now [09:38] schestowitz-TR I can see techrights on it [09:38] schestowitz-TR and version bookworm/sid, devuan deadalus/ceres [09:38] schestowitz-TR I think it would help to test tuxmachines for DB compatibility [09:38] schestowitz-TR do you deem it a good idea to host both sites on the same VM? [09:38] schestowitz-TR while possible, they share IP address, I think [09:38] schestowitz-TR also, techrights migration is a very big job and less urgent [09:38] schestowitz-TR should I, in the meanwtime , restore TM from a good backup and add the missing nodes? [09:38] schestowitz-TR seeing that kaniini is not likely to respond today? [09:41] Techrights-sec yes rsyncing stuff to /var/www/techrights.org/* [09:41] Techrights-sec it'll take a while longer before the files are there [09:41] Techrights-sec I [09:41] Techrights-sec I'm not sure. It'd make it easier to move them separately if they are each [09:41] Techrights-sec in their own VM [09:41] Techrights-sec perhaps. how long would it take to do the restoration and how much inconvenience would it be to do that work and would it ease th [09:41] Techrights-sec e migration? [09:45] schestowitz-TR restoring old DEB is fast [09:45] schestowitz-TR what would take less than an hour is manually copying nodes from the new to old [09:45] schestowitz-TR the latter would need to be done either way, eventually [09:45] schestowitz-TR thoughts?> [09:46] Techrights-sec ack [09:46] Techrights-sec I guess it nees to be done then [09:46] schestowitz-TR I will start now [09:46] schestowitz-TR won't be fun, but this should work OK [09:46] Techrights-sec ack [09:51] schestowitz-TR the file I will restore the DB from is not in the homedir of tuxmachines [09:51] schestowitz-TR but first I will put the service back up and copy across from current copy [09:51] schestowitz-TR the diffs [09:51] schestowitz-TR eta 1 hour ● Apr 12 [10:45] schestowitz-TR extracting posts since Sunday midnigth done [10:45] schestowitz-TR next: comments [10:45] schestowitz-TR after that: db restore [10:45] schestowitz-TR then restore posts [10:45] Techrights-sec (still syncing videos and such here) [10:45] Techrights-sec np [10:45] schestowitz-TR then restore comments [10:45] schestowitz-TR thanks for helping! ● Apr 12 [11:14] schestowitz-TR done comment extraction [11:14] schestowitz-TR wtf? [11:14] schestowitz-TR I can gunzip the 09042022 dump OK [11:14] schestowitz-TR but the one of 10042022 says [11:14] schestowitz-TR invalid compressedm data--crc error [11:14] schestowitz-TR no, on live TM or live TR [11:14] schestowitz-TR for the tuxmachines dump [11:14] schestowitz-TR I first failed to gunziup it on tm, after copying it from tr archives [11:14] schestowitz-TR then I tried on TR, same outcome [11:14] schestowitz-TR I check the 9th April file just to go phew! [11:14] schestowitz-TR no [11:14] schestowitz-TR 9 works [11:14] schestowitz-TR wait, can you uncompress tm-db-2022-0410.dump.gz OK on your own machines? [11:14] schestowitz-TR because on the server it fails [11:16] Techrights-sec ack [11:16] Techrights-sec on the test machine? [11:16] Techrights-sec ?? [11:16] Techrights-sec strange, the gzip takes place on TR after fetching the dump from TM [11:16] Techrights-sec 2022-04-09 failed too [11:16] Techrights-sec tm-db-20220410.dump.gz on TR seems ok so far maybe it did not get copied back [11:16] Techrights-sec to TM ok [11:16] Techrights-sec checking [11:16] Techrights-sec it gunzips ok on the backup drive but I do not have it copied to the beta machine ye [11:16] Techrights-sec yet [11:20] schestowitz-TR what is the size of ther the resultant file? should be around 1.84gb [11:20] schestowitz-TR on the TR server that file is 472MB [11:20] schestowitz-TR for the 11th it sank to 452MB [11:20] schestowitz-TR maybe you run another commeand? [11:20] schestowitz-TR I just gunzip file [11:20] schestowitz-TR can you uncompress the file on TR for me? just to be sure no error seen? [11:20] schestowitz-TR Then I will rsync it across to TM (takes seconds) [11:21] Techrights-sec 451M [11:21] Techrights-sec 1a589ecf2f578d49c5e71fb8fcdd4ea30723033d7bf39e3c9ca9155861f9b8f9 tm-db-20220410.dump.gz [11:21] Techrights-sec SHA256 checksum [11:21] Techrights-sec checksum matches for the gzipped file on both TR and here [11:21] Techrights-sec Yes, I see [11:21] Techrights-sec gunip -c [11:21] Techrights-sec to leave the file untouched and then redirect somewhere [11:21] Techrights-sec ok [11:23] Techrights-sec /tmp/tm-db-20220410.dump [11:23] schestowitz-TR it says 67mb [11:25] schestowitz-TR the one for 9th, as you can see, is bigger [11:25] Techrights-sec yes 1.8G in /tmp/ [11:27] *DaemonFC (~daemonfc@rp7cv6p2a57tu.irc) has joined #boycottnovell [11:30] Techrights-sec maybe something happened well before the backup on the 10th but after the 9th? [11:31] schestowitz-TR this backup was taken about 5 hours before the incident, the 9th is 29 hours [11:31] schestowitz-TR but either way, gzip ought not fail unless there is an issue elsewhere [11:45] schestowitz-TR I can retrieve posts (not comments) from the 9th too, then restore these also [11:45] schestowitz-TR a bit scary if some of these backup dumps are not usable, try 8th and 7th [11:45] schestowitz-TR just to be sure prior ones were OK? [11:45] schestowitz-TR I am checking system logs for the 10th [11:45] schestowitz-TR messages (syslog by RH) contains nothing related to these backups [11:45] schestowitz-TR I think debian logs things for cron jobs [11:45] schestowitz-TR oh, I think cron is another file [11:45] schestowitz-TR cron files under /var/log just say that it ran [11:45] schestowitz-TR do not provide any status or i/o [11:45] schestowitz-TR the mariadb logs (mysql) on TM shoed nothing major BUT [11:45] schestowitz-TR prior to the crash there were lots of these warnings we discussed the other day [11:45] schestowitz-TR did you test the backups of 7th and 8th? if not, I will [11:45] schestowitz-TR but even a bad dump ought not results in a bad gzip [11:47] Techrights-sec maybe something happened well before the backup on the 10th but after the 9th? [11:47] Techrights-sec ack [11:47] Techrights-sec what about the mariadb log? [11:47] Techrights-sec the status of cron jobs goes into the mail spool as an e-mail if the task [11:47] Techrights-sec produced anything on either stdout or stderr [11:47] Techrights-sec otherwise no records are kept [11:47] Techrights-sec (if no other logging has been arranged explicitly) [11:58] schestowitz-TR mailq | grep cron (or zip) produces nothing [11:58] schestowitz-TR but if we see that 7th, 8th were OK [11:58] schestowitz-TR also also test the backups after restorting the site [11:58] schestowitz-TR then I think we should be safe [11:58] schestowitz-TR I don't mind taking another 24 hours of posts and resorting them by hand [11:58] schestowitz-TR should I or you test guznip on older tm-backups? [11:58] schestowitz-TR I've left tmux where it shows a silence between march 8th until april 10th [11:58] schestowitz-TR it is not very unusual [11:58] schestowitz-TR on your offsite backups, are the 7th and 8th about 1.8gb in size when deflated? [11:58] schestowitz-TR if so, I will go ahead and make more copies of another 24 hours [11:58] Techrights-sec ack [11:58] Techrights-sec looking [11:58] Techrights-sec how unusual is that? [11:58] Techrights-sec That's over a month. ● Apr 12 [12:04] Techrights-sec :( [12:04] Techrights-sec $ gunzip -c tm-db-20220410.dump.gz > /dev/null [12:04] Techrights-sec gzip: tm-db-20220410.dump.gz: invalid compressed data--crc error [12:04] Techrights-sec gzip: tm-db-20220410.dump.gz: invalid compressed data--length error [12:04] Techrights-sec the 9th is the last working backup [12:04] Techrights-sec ok [12:04] Techrights-sec 9th is ok [12:04] schestowitz-TR yes, I know [12:04] schestowitz-TR but try prior days just to be sure we don't have lots of faolure but only the odd [12:04] schestowitz-TR one [12:04] schestowitz-TR IIRC, that was around the time I copied everything over rsync, but that should [12:04] schestowitz-TR not cause such damage, I don't think... [12:04] schestowitz-TR I ran rsync with no option, just recursive for the /var/www dir [12:04] Techrights-sec rsync is read-only in one direction or the other unless it is told to delete [12:04] Techrights-sec the original after the copy [12:04] Techrights-sec 8th is ok [12:07] schestowitz-TR another side benefit here is that we get to test the most important backups: the DBs [12:07] schestowitz-TR these are, for the site, what matters most [12:07] schestowitz-TR it doesn't stroe much media or anythingf [12:07] schestowitz-TR also, drupal table structure is such that givees drupal.nodes [12:07] schestowitz-TR you can in theory import tham into latest drupal [12:08] Techrights-sec 8th is ok [12:08] Techrights-sec 7th uncompresses ok too [12:08] Techrights-sec yes that is true [12:09] schestowitz-TR ok, going another 24 hours backwards sounds sane enough to me, assuming problems silence started before the 10th [12:09] schestowitz-TR I will get nodes and comments for Saturday also, then import the dump of the 9th 5am [12:12] schestowitz-TR eta 1 hour [12:12] schestowitz-TR curiously enough I cannot access the node with all the articles about the microsoft bribery [12:12] schestowitz-TR it's the only such issue I found [12:12] schestowitz-TR I put it in my notes to check for its integrity after the DB restore [12:15] Techrights-sec ack [12:16] schestowitz-TR i now see the same in another node [12:16] schestowitz-TR my guess is that all my failed recoveries [12:16] schestowitz-TR damaged some of the older nodes on this [12:16] schestowitz-TR but we'll have them restored [12:47] *DaemonFC has quit (Quit: Leaving) [12:48] schestowitz-TR importing db now [12:48] schestowitz-TR so far no errors shown [12:48] schestowitz-TR remember tha the upside of this incident is that we test the backups [12:48] schestowitz-TR for the first time since it was on tessier's servers afaik [12:48] schestowitz-TR and in the process we'll lose almost no data [12:48] schestowitz-TR afterwards remind me to test dumpb/backups [12:48] schestowitz-TR because when we move to the new OS [12:48] schestowitz-TR we'll use that dump to import the latest [12:48] schestowitz-TR kaniini has not responded [12:48] schestowitz-TR so IU assume afak [12:48] schestowitz-TR *afk [12:48] schestowitz-TR yes, we will need to clean up a bit afterards [12:48] schestowitz-TR I will race against the clock [12:48] schestowitz-TR in case marius or other sneak in a post [12:48] schestowitz-TR runing the sequence [12:48] schestowitz-TR and therefore node numbers [12:48] schestowitz-TR I will restore them with consistency [12:49] Techrights-sec shall we delete the defective two? ● Apr 12 [13:32] schestowitz-TR starting httpd [13:32] schestowitz-TR ok, lookiung good on the http side [13:32] schestowitz-TR Now I race against the clock [13:32] schestowitz-TR i use social control media to ask people not to post anything yet [13:32] schestowitz-TR eta 60 mins [13:32] schestowitz-TR saturday restored [13:33] schestowitz-TR can you space up loal and remote backups so that one dump is around 5pm, not am? [13:33] schestowitz-TR it would make recovery more robust [13:33] schestowitz-TR i'm halfway restorting now [13:33] schestowitz-TR all good so far [13:33] schestowitz-TR testing the backup/as in dumping when done would also give epace of mind [13:33] schestowitz-TR can bounce in via tr or change crontab on TR for time? [13:33] schestowitz-TR I think whether that can cause any issues, other than 5pm being "busy" [13:33] schestowitz-TR on the current strong hardware it only causes a hang for about 1-2 mins [13:33] schestowitz-TR TM's DV is the only probematic one of the 5 [13:33] schestowitz-TR we could not put that on apline/mariadb [13:33] schestowitz-TR hence I was eager to see how devuan copes [13:33] schestowitz-TR esp. if you add a new node [13:33] schestowitz-TR as that's when it 'breaks' [13:33] Techrights-sec ok [13:33] Techrights-sec excellent [13:33] Techrights-sec ack [13:33] Techrights-sec ok [13:33] Techrights-sec there are two parts, one is the creation of the dump file on TM [13:33] Techrights-sec the other part is the transfer to TR [13:33] Techrights-sec I don't have access to TM though due to the kex algorithm being too out of date [13:33] Techrights-sec for connection. [13:33] Techrights-sec on TR's side that would be /home/boycottn/bin/fetch-tm-dump.sh [13:34] Techrights-sec and /home/boycottn/bin/delete-old-tm-dumps-except-mondays.sh [13:34] Techrights-sec Is TM's database in TM or in the new VM for databases? [13:34] Techrights-sec IF the latter, then a couple of steps are unnecessary and can be removed from [13:34] Techrights-sec the work flow. [13:34] Techrights-sec ok [13:39] *u-amarsh04 has quit (Ping timeout: 2m30s) ● Apr 12 [14:06] schestowitz-TR all the posts are fully restore now [14:06] schestowitz-TR the url scheme unchanges [14:06] schestowitz-TR and no errors detected [14:06] schestowitz-TR I will now add the comments [14:06] schestowitz-TR i am going to set remote DB backups to 17:12 and then test\ [14:06] schestowitz-TR I think, given a number os improper dumps, we did demonstrate [14:06] schestowitz-TR that we have some resileience [14:06] schestowitz-TR the new DB dumps will hopefully be good [14:06] schestowitz-TR testing in a few mins [14:06] schestowitz-TR the microsoft corruption post that went bad before [14:06] schestowitz-TR it's working OK again [14:06] schestowitz-TR along with another that gave me errors [14:15] schestowitz-TR running backup, having added all the comments [14:16] schestowitz-TR dumping across the network, I will later hunzip it [14:16] Techrights-sec ack [14:16] Techrights-sec excellent [14:16] Techrights-sec ack [14:20] schestowitz-TR ok, the dump is learn, 385mb in size [14:20] schestowitz-TR but that is possible if during the import it omits [14:20] schestowitz-TR some 'cruft' like caches [14:20] schestowitz-TR so I expect it to grow each day [14:20] schestowitz-TR it is 1.57gb when uncompressed [14:20] schestowitz-TR running head and tail on it [14:20] schestowitz-TR this looss OK [14:20] schestowitz-TR faint memory tells me this deflation in size is quite [14:20] schestowitz-TR normal when you export and then import afresh [14:20] schestowitz-TR but you should expect it to build up over time, fast [14:21] schestowitz-TR I mean both the gz and dump are a los smaller now [14:21] schestowitz-TR but I see no errors in the site [14:21] schestowitz-TR or in the files [14:21] schestowitz-TR or from programs [14:21] Techrights-sec ack [14:21] Techrights-sec caches ought not be in the backups [14:21] Techrights-sec text compresses a lot [14:21] Techrights-sec so if the dumps are text, they will be quite small after comptression [14:21] Techrights-sec ok [14:24] schestowitz-TR I have removed the unwanted DBs from TM and from TR, leaving the bad 1104 and 104 in there but we can avoid them [14:24] Techrights-sec ok [14:24] schestowitz-TR thanks for all the help! I'll keep chasing kaniini and rianne will not post links [14:25] schestowitz-TR while I deal with Daily Links, using their newe format [14:25] Techrights-sec np [14:36] schestowitz-TR I've just noticed an issue with the interleave changed [14:36] schestowitz-TR they cull out the closign

and closing [14:36] schestowitz-TR yes, that's the one [14:36] Techrights-sec checking [14:36] Techrights-sec add-lines-for-irc.pl ? [14:36] Techrights-sec yes, I see it. Looking. [14:56] Techrights-sec try Gut [14:56] Techrights-sec ^Git [14:57] schestowitz-TR excellent, this seems to have fixed it!!rianne says thanks btw, she's back to scanning the news [14:57] schestowitz-TR TM and TR are closely connected as without TM or without running it it's hard to keep abrease of eventa ● Apr 12 [15:05] schestowitz-TR kaniiani says no time this week but "maybe soon" [15:12] schestowitz xhttps://twitter.com/MikeKelman6/status/1513847271087284225 [15:12] schestowitz https://twitter.com/MikeKelman6/status/1513847271087284225 [15:12] -TechrightsBN/#boycottnovell-@MikeKelman6: @schestowitz Tnx dude [15:16] schestowitz https://translate.google.com/translate?sl=sv&tl=en&u=https://trevligmjukvara.se/ [15:16] -TechrightsBN/#boycottnovell-trevligmjukvara-se.translate.goog | Trevlig Mjukvara | Trevlig mjukvara [15:16] schestowitz = [15:16] schestowitz old: [15:16] schestowitz https://www.hourdetroit.com/community/muskrat-dinners-a-tradition-during-lent-downriver/ [15:16] -TechrightsBN/#boycottnovell-www.hourdetroit.com | Muskrat Dinners a Tradition During Lent Downriver - Hour Detroit Magazine [15:16] schestowitz = [15:16] schestowitz https://abcnews.go.com/International/wireStory/mimi-reinhard-typed-schindlers-list-dies-107-84011078 [15:16] -TechrightsBN/#boycottnovell-abcnews.go.com | Mimi Reinhard, who typed up Schindler's list, dies at 107 - ABC News [15:16] schestowitz = [15:23] schestowitz-TR "Our once limitless horizon is suddenly contracting" https://www.thenation.com/article/environment/degrowth-movement-economy/ [15:23] -TechrightsBN/#boycottnovell-www.thenation.com | Shrinking the Economy to Save the World | The Nation [15:23] schestowitz-TR "EFF's Cindy Cohn and Danny OBrien" https://www.eff.org/deeplinks/2022/04/podcast-episode-making-hope-adam-savage | Gilmore and [15:23] -TechrightsBN/#boycottnovell-www.eff.org | Podcast Episode: Making Hope, with Adam Savage | Electronic Frontier Foundation [15:23] schestowitz-TR Barlow knew better how to run EFF [15:23] schestowitz-TR Christine Hall's pension must be really bad [15:23] schestowitz-TR given how she is selling us out [15:34] *u-amarsh04 has quit (Connection closed) [15:34] *u-amarsh04 (~amarsh04@joseon-rmogvn.g0d7.dtdf.mc4289.IP) has joined #boycottnovell [15:34] *u-amarsh04 (~amarsh04@v6xmmrhxmbafc.irc) has joined #boycottnovell [15:39] *psydruid (~psydruid@jevhxkzmtrbww.irc) has left #boycottnovell [15:43] *psydruid (~psydruid@jevhxkzmtrbww.irc) has joined #boycottnovell [15:54] Techrights-sec Wouldn't it be better for Hall to work at a shop? At least some dignity would [15:54] Techrights-sec be retained and less damage would be done. ● Apr 12 [16:07] schestowitz-TR One thing I dislikem about culture (not a US/Raegan thing) [16:07] schestowitz-TR "look at those educated people; they make fun of us; let's be the opposite of them" [16:08] schestowitz-TR or [16:08] schestowitz-TR MBAs/marketing/media: similar, let's lie to piss off those who know the trade [16:17] Techrights-sec LOL I was just commenting here about some incidents where MBA-types got in the [16:17] Techrights-sec way without contributing and then nonetheless tried to take full credit for [16:17] Techrights-sec the success and result. [16:17] Techrights-sec ^results [16:42] schestowitz-TR til how to do 'sed' with perl and what /g is for [16:42] schestowitz-TR very handy as it does cross-line subs [16:42] schestowitz-TR pushing some changes to git now [16:47] Techrights-sec nice. I went /many/ years without looking at sed because it was just as [16:47] Techrights-sec easy (actually easier) as well as more powerful to use a perl one-liner for [16:47] Techrights-sec the task. [16:47] Techrights-sec See especially the -i, -n, and -p options in "man perlrun" [16:48] schestowitz-TR 40 and still learning [16:48] schestowitz-TR tbh, this week I might not be able to produce manyu articles [16:48] schestowitz-TR but links or TM or Daily Links are a priority regardless [16:48] schestowitz-TR and the news looks dire this week [16:48] schestowitz-TR no "major" thing to cover [16:48] Techrights-sec yes it gets quieter every month :/ [16:50] schestowitz-TR today I started bombarding "social" again, as it's a lot faster posting there bits that are non-tech [16:50] schestowitz-TR we'll refine this over time [16:50] schestowitz-TR I'll keep an eye on backups tonight, in fact expect (checks system clock) TR to pull a DB dump [16:50] schestowitz-TR from TM in about 90 mins [16:50] schestowitz-TR tuxmachines is the work of many people, inc. the people whose work is covered [16:50] Techrights-sec excellent use of the channel [16:50] Techrights-sec yes [16:56] schestowitz-TR let the web rot away [16:56] schestowitz-TR when you search for things like 'novell hovsepian interview' [16:56] schestowitz-TR we are very visible because other sites perish [16:56] schestowitz-TR so people can see a more proper angle [16:56] schestowitz-TR I wonder if a capsule is worth having for TM and, if so, if homed [16:56] schestowitz-TR in its own domain [16:56] schestowitz-TR I only have one IP address at home so a subsite for TM would need [16:56] schestowitz-TR to go on non-1965 port [16:58] Techrights-sec yes it would probably be rather popular to have a capsule for TM. [16:58] Techrights-sec It would definitely need its own host name but it need not be on a separate [16:58] Techrights-sec machine if the OS gets updated. It would be best to keep it on port 1965, [16:58] Techrights-sec since that is where it is expected, but the OS upgrade is the bottleneck there. [16:58] schestowitz-TR ah, yes, if it's oin some thing like devuan it can be configured with agate [16:58] schestowitz-TR and then dns point to it [16:58] Techrights-sec Yes devuan or any recent distro could handle it no problem. It's just [16:58] Techrights-sec we have a while before work on TM can start. [16:59] schestowitz-TR based on the tone there is desire but high workload at work (security company) [16:59] schestowitz-TR at this moment ● Apr 12 [17:00] Techrights-sec not much is needed for proactive security: a list of managers that have [17:00] Techrights-sec signed off on M$ purchases+deployments and a stout but short length of rebar >:( [17:01] schestowitz-TR not sure if you noticed, but this past weekend and this week almost no annoying news at all, not even the security FUD [17:01] schestowitz-TR it's kind of smooth sailing in that regard [17:01] schestowitz-TR except when I touch the patent FUD [17:02] Techrights-sec I'm sure something dirty is being cooked up by the microsofters, they are [17:02] Techrights-sec probably having a convention in DC or something [17:02] Techrights-sec Remember for many years microsofters and their mouthpieces used to go quiet [17:02] Techrights-sec once or twice a year and then reappear with new talking points after the [17:02] Techrights-sec quiet [17:02] schestowitz-TR i knoew you were about to say this as you had said it before [17:02] schestowitz-TR but I never saw strong enough evidencw [17:04] Techrights-sec It was just something obsevered. Though I did see one, long since gone, article [17:04] Techrights-sec about some "training" or somesuch which most of them were at. Given [17:04] Techrights-sec M$ style, it is almost certainly hidden behind NDAs, even its existence [17:09] schestowitz-TR you know, when we started the 2020 gates articles I dared not say what some l00ns on Twitter said [17:09] schestowitz-TR because evidence was it was weak [17:09] schestowitz-TR openeing up to labels like "crank" and "conspiracy" [17:09] schestowitz-TR however, in 2021 several things happened that suggest it's no longer outlandish [17:09] schestowitz-TR and deep inside people feel that way [17:09] schestowitz-TR so perception have changed profoundly [17:09] schestowitz-TR I rarely hear his name anymore [17:09] schestowitz-TR now it's the south african with the big mouth [17:10] Techrights-sec evidence is essential when writing posts [17:10] Techrights-sec a method which would work would be open source intelligence (which is unrelated [17:10] Techrights-sec to open source software) However, I'm not sure how to explain it though [17:10] Techrights-sec I have tried several times. [17:10] Techrights-sec Maybe there is a clear book on it. With it, you can assemble many crumbs into [17:10] Techrights-sec actual evidence. [17:10] schestowitz-TR btw, rms talks tomorrow [17:10] schestowitz-TR he was partly canceled [17:11] schestowitz-TR same for gates [17:11] Techrights-sec Where will RMS talk and what is the URL for the stream? [17:11] schestowitz-TR fsf.org RE-posted, twice, the calendar item last night [17:25] schestowitz-TR > "Twitter labeled his account as being Russia state-affiliated media." https://www.techdirt.com/2022/04/11/uk-politician-who- [17:25] -TechrightsBN/#boycottnovell-UK Politician Who Had Shows On Russian TV Channel Threatens To Sue Twitter For Noting His Connections To Russian Media | Techdirt [17:25] schestowitz-TR had-shows-on-russian-tv-channel-threatens-to-sue-twitter-for-noting-his-connections-to-russian-media/ | Source: Techdirt, WTH?? [17:25] schestowitz-TR RMS was a guest a few times [17:25] schestowitz-TR Corbyn was on Press TV (Tahran) [17:25] schestowitz-TR one apparance and you're fried [17:26] schestowitz-TR "The hedge fund Alden Global Capital is notorious for plundering newspapers, relentlessly creating news deserts and ghost papers." https://fair.org/home/documenting-the-struggle-against-a-hedge-fund-stripping-journalism-for-parts/ [17:27] -TechrightsBN/#boycottnovell-fair.org | Documenting the Struggle Against a Hedge Fund Stripping Journalism for Parts - FAIR [17:36] schestowitz-TR "Reagan and Biden" https://www.counterpunch.org/2022/04/12/the-reagan-and-biden-booms/ [17:36] -TechrightsBN/#boycottnovell-The Reagan and Biden Booms - CounterPunch.org [17:36] Techrights-sec "news desert" is an apt term [17:38] schestowitz-TR " The media were happy to completely ignore the reality of declining real wages throughout the Reagan era " [17:38] Techrights-sec " The media were happy to completely ignore the reality of declining real wages throughout the Reagan era " [17:39] schestowitz-TR my salary now is a little lower, in absolute terms, than when I first joined [17:39] schestowitz-TR That's OK, just don't expect me to work much :-) [17:41] Techrights-sec :/ [17:43] schestowitz-TR when you work from home you can adjust your hourly pay [17:43] schestowitz-TR nowadays, a lot if just automated [17:43] schestowitz-TR and so I have many screens and computers [17:43] schestowitz-TR rianne has them too [17:43] schestowitz-TR so she 'babysits the elephants' (videos) while rasp400 does the job [17:44] Techrights-sec :) [17:44] Techrights-sec The media were happy to completely ignore the reality of declining real wage^W^W [17:44] Techrights-sec http://www.lanet.lv/users/judrups/Humor/canoneleph.html [17:44] -TechrightsBN/#boycottnovell-www.lanet.lv | Canonical List Of Elephant Jokes [17:45] schestowitz-TR gafam workers that I know (+intel) are forced back into their cages [17:45] schestowitz-TR because "job" something [17:45] schestowitz-TR and "jab" something [17:45] schestowitz-TR they will never be able to use that money to compensate for it [17:47] Techrights-sec The stupidest part about the reduction of jobs via automation is that it is [17:47] Techrights-sec complete corruption of the purpose of computers as a tool to be a force [17:47] Techrights-sec multiplier. Imagine if M$ were not in the way and if computers were used [17:47] Techrights-sec to amplify people's abilities and output. [17:47] schestowitz-TR they say companies will automate jobs and remove workers [17:47] schestowitz-TR but workers can also automate their own jobs without telling companies [17:49] schestowitz-TR that's what news and syndication do for us [17:49] Techrights-sec yes [17:50] schestowitz-TR social channel busy today, and it's nearly as fast to post there as it is to read and study the news [17:50] Techrights-sec good if it draws the off-topic material out of the main channel [17:52] schestowitz-TR sometiues spare links can be 'weaponised' to change the subject back to tech without saying as much [17:52] schestowitz-TR it changes focus and doesn't admonish anyone [17:52] schestowitz-TR in half an hour I will start catching up with tech news [17:52] schestowitz-TR if I finish by 10pm, I can do articles too [17:52] schestowitz-TR but I realised after the TM ordeal just having the "darn thing" online is good enough [17:52] schestowitz-TR I did not sleep well [17:52] schestowitz-TR and did not tell rianne why until she made breakfast [17:52] schestowitz-TR as that would ruin hers, too [17:57] Techrights-sec ack ● Apr 12 [19:19] schestowitz-TR hours ago it was a lot smaller [19:19] schestowitz-TR so drupalo cache is buiulding up already [19:19] schestowitz-TR the siter runs nicely [19:19] schestowitz-TR and I populate it with stories, still lots to catch up with [19:19] schestowitz-TR I'm tired and rianne will help overnight [19:21] Techrights-sec excellent, backups tested and site running. [19:58] schestowitz-TR [19:53] hmmm... our gemini proxy is offline [19:58] schestowitz-TR [19:53] fixing... [19:58] schestowitz-TR [19:53] first this this happens, since it started 2 months ago [19:58] schestowitz-TR [19:56] fixed [19:58] schestowitz-TR [19:56] need sleep now, back in a few, it's a long nap [19:58] schestowitz-TR [19:56] I'm on shift tonight :/ [19:58] schestowitz-TR I tried nginx restart [19:58] schestowitz-TR no effect [19:58] schestowitz-TR then gemini-proxy [19:58] schestowitz-TR took like 1.5 minutes to restart [19:59] schestowitz-TR and gradually recovereed [19:59] schestowitz-TR no lack of system resources observed [19:59] schestowitz-TR but anyway. shring in case it happens agaion [19:59] schestowitz-TR it wa returning error 503 for all requests ● Apr 12 [20:43] *DaemonFC (~daemonfc@rp7cv6p2a57tu.irc) has joined #boycottnovell ● Apr 12 [23:07] *Techrights-sec has quit (Ping timeout: 2m30s) [23:07] *schestowitz-TR has quit (Ping timeout: 2m30s) [23:07] *libertybox has quit (Ping timeout: 2m30s) [23:07] *Techrights-sec (~quassel@pumv3cb2rfinu.irc) has joined #boycottnovell [23:07] *schestowitz-TR (~acer-box@pumv3cb2rfinu.irc) has joined #boycottnovell [23:07] *libertybox (~schestowitz_log@pumv3cb2rfinu.irc) has joined #boycottnovell