IRC: #boycottnovell @ Techrights IRC Network: Thursday, August 25, 2022

schestowitz__[TR]

and_Linux_Mint.gmi

-TechrightsBN/#boycottnovell-Missing content type. Ignoring.

-TechrightsBN/#boycottnovell-Missing content type. Ignoring.

schestowitz-TR2

Aug 25 05:51

schestowitz-TR2

sorry to have added another item (above), it's not so important, just related to something you said you could not reproduce in amfora

Aug 25 05:51

*DaemonFC has quit (Quit: Leaving)

Aug 25 07:54

*psydruid (~psydruid@jevhxkzmtrbww.irc) has left #boycottnovell

Aug 25 07:58

Techrights-sec

checking

Techrights-sec

that's getting added somewhere after the page leaves our capsule so there's

Techrights-sec

not much to do except file bug reports

Techrights-sec

wait, there is a bug with that part ofthe UTF-8 again

Techrights-sec

It's in the db ok, so that's good.

Techrights-sec

fixed, I think.

Techrights-sec

thanks for spotting that!

schestowitz-TR2

back

schestowitz-TR2

rianne worked yesterday

schestowitz-TR2

so we celebrate her bday today, instead

schestowitz-TR2

44th

schestowitz-TR2

looks likle the utf-8 bug is solved :-)

schestowitz-TR2

I'll try to find something to add in html

Techrights-sec

ok contratulations on her birthday observed

Techrights-sec

ack

Aug 25 08:47

*psydruid (~psydruid@jevhxkzmtrbww.irc) has joined #boycottnovell

Aug 25 08:55

schestowitz-TR2

I've just done a pair of tests

schestowitz-TR2

with LWN and ItsFOSS the title="" part gets champed away

schestowitz-TR2

*chomped

schestowitz-TR2

the test with Red Hat is still there, but I don't know how to reproduce it

Techrights-sec

checking

Techrights-sec

as mentioned the other day there are just over 1000 hosts/domains which are

Techrights-sec

in TM but not in TR. For this to work, the lookup table in the module

Techrights-sec

TuxMachines::ReadOn has to be filled it prior to addng or updating a post

Techrights-sec

It's not feasible in this work flow to have the usual refresh scripts

Techrights-sec

modify the bodies of the posts so if retroactive application is needed, a

Techrights-sec

new script would be needed. Can you check /usr/local/lib/perl5/TuxMachines/

Techrights-sec

for ReadOn.pm and make sure the sites in the lookup table are there? I've not

Techrights-sec

had time to slog through all 1000.

schestowitz-TR2

both sites are missing from that list

schestowitz-TR2

so it seems not like a bug after all

schestowitz-TR2

I could go through the list in camelcase, splitting side the less political and more political domains

Techrights-sec

yes, but there are still the 1000 unkown sites from TM

Aug 25 09:08

Techrights-sec

a different workflow is needed I think

Aug 25 09:08

Techrights-sec

what might be an idea would be to have the add and update scripts make

Techrights-sec

a list of unknown sites and then manually process them as a batch every

Techrights-sec

few days with some kind of retroactive editing (by script) of the existing

Techrights-sec

posts. Ideas?

Techrights-sec

The steps would be

Techrights-sec

1) check the list every few days

Techrights-sec

2) edit ReadOn.pm

Techrights-sec

3) check the changes into Git

Techrights-sec

4) check out into the mirror

Techrights-sec

5) copy manually from the mirror to /usr/local/lib/perl5/

Techrights-sec

6) manually run the retrofit script

Techrights-sec

But several of those steps are quite time consuming, at least in regards to

Techrights-sec

the amount of attention they require to do right

schestowitz-TR2

how about a somewhat backwards approach?

schestowitz-TR2

when I add a domain not in the list

schestowitz-TR2

I then add it to the list fiorst

schestowitz-TR2

and from the pm file it'll perdiodically get pushed to git?

schestowitz-TR2

sooner or later all the still-active sites will have an entry

schestowitz-TR2

in the next 1q0 years we may add 150,000 stories

schestowitz-TR2

but likely from less than 1000 domains

Techrights-sec

then steps 2-6 apply still

Aug 25 09:16

schestowitz-TR2

how did you selct the subset for ReadOn.pm? If scanning the list takes less than a second, then we can join with CamelCase

Aug 25 09:18

schestowitz-TR2

and then keep them synchronised periodically

Aug 25 09:18

schestowitz-TR2

by merging

Aug 25 09:18

*starstreak has quit (Ping timeout: 2m30s)

Aug 25 09:23

schestowitz-TR2

there is another possibility

schestowitz-TR2

I can scan camelcase at my end

schestowitz-TR2

if I find a match, it'll add it automatically

schestowitz-TR2

and then the server side will be a second pass or one that's applicable to a submitted who is not me (usually rianne)

Techrights-sec

I ran a link extractor over all the files in the document root at tm-new

Techrights-sec

Synchronizing with the TR git repository:

Techrights-sec

0) re-synchronize

Techrights-sec

1) check the list every few days

Techrights-sec

2) edit ReadOn.pm

Techrights-sec

3) check the changes into Git

Techrights-sec

4) check out into the mirror

Techrights-sec

5) copy manually from the mirror to /usr/local/lib/perl5/

Techrights-sec

6) manually run the retrofit script

Techrights-sec

the hard parts are steps 2 through 6

Techrights-sec

or at least 2 through 5

Techrights-sec

there's almost no crossover between the two sets so it is going to be

Techrights-sec

unproductive to spend time on synching since it is more effort than just

Techrights-sec

editing the two unrelated sets independently

Techrights-sec

it would not be difficult to log the missing sites as they are found

Techrights-sec

by either the update or the add script; the work comes in when the log

Techrights-sec

is processed and the sites are added to the module's lookup table

Techrights-sec

that's three or four steps, of necessity

schestowitz-TR2

yes, that migth work better

schestowitz-TR2

I've just added some more pages

schestowitz-TR2

days ago I added many video channels to my rss feeds

schestowitz-TR2

I think video will be a growing thing, even if not in googletube

schestowitz-TR2

at least with gulag I have a proxy and can embed with seek time to skip nonsense

Techrights-sec

ack

Aug 25 09:53

schestowitz-TR2

would it speed up the process if I manually add title for now?

Aug 25 09:54

Techrights-sec

it depends, is it faster (over time) to add titles manually or

Aug 25 09:54

Techrights-sec

to do steps 1 - 6 above (over time) ?

Aug 25 09:54

schestowitz-TR2

I think combining both?

schestowitz-TR2

we add 30-50 pages per day, I don't think it'll slow down

schestowitz-TR2

with a TM capsule we might even add a section specific to gemini protocol at some point

Techrights-sec

ack

schestowitz-TR2

If I understand correctly, ReadOn.pm will override anything in title="" if a match is found

Aug 25 09:58

schestowitz-TR2

which is good

Aug 25 09:58

schestowitz-TR2

and if it is empty and no match is found, it removed title="" completely?

Aug 25 09:58

Techrights-sec

it should only create a title attribute if there is not one there or if

Aug 25 10:07

Techrights-sec

there is one but it is empty; perhaps it should not touch empty ones; they

Aug 25 10:07

Techrights-sec

might be empty on purpose

Aug 25 10:07

schestowitz-TR2

yes, I think this is the desirable behaviour

Aug 25 10:08

schestowitz-TR2

this way camelcase will be used only as a fallback

Aug 25 10:08

schestowitz-TR2

I wonder if it is worth extending to all lists, e.g. groups of links

schestowitz-TR2

a la techrights

schestowitz-TR2

it would not be hard

schestowitz-TR2

all it takes is scanning links in <li> and adding title if the domain is recognised

schestowitz-TR2

this already happens in techrights, with a different workflow

Techrights-sec

once the lookup table exists, the rest is not hard to automate, the bottleneck

Aug 25 10:20

Techrights-sec

is the maintenance of the lookup table

Aug 25 10:20

*psydruid (~psydruid@jevhxkzmtrbww.irc) has left #boycottnovell

Aug 25 10:23

*psydruid (~psydruid@jevhxkzmtrbww.irc) has joined #boycottnovell

Aug 25 10:24

Techrights-sec

Techrights-sec

yes the large multinationals have a general desire to eliminate open protocols

Techrights-sec

and open formats; the WWW is the biggest PITA for them in that regard, it

Techrights-sec

has both HTML and HTTP; They don't care much about TLS since the certificate

Techrights-sec

hierarchy in browser and elsewhere has been successfully compromised

schestowitz-TR2

the media does a fine job making itself obsolete too

schestowitz-TR2

partly by failing to ever evolve

schestowitz-TR2

maybe because of managers there

schestowitz-TR2

or the VCs/hedge funds

schestowitz-TR2

how about this:

schestowitz-TR2

I will add some names manually from my end

schestowitz-TR2

let that pile up for a bit

schestowitz-TR2

then, at a later point

schestowitz-TR2

db -> fildump

schestowitz-TR2

grep reddon filedump | cut |sort | uniq

schestowitz-TR2

then you get a list of previously used domains and how they are described

schestowitz-TR2

aided in part at my end by camelcase

schestowitz-TR2

I can easily envision this going on for many years

schestowitz-TR2

in one porotocol/form or another

schestowitz-TR2

I think "apps" will throw www under the bus

schestowitz-TR2

gulag already tried, with amp

schestowitz-TR2

never mind spdy and js etc.

schestowitz-TR2

the media does a fine job making itself obsolete too

schestowitz-TR2

partly by failing to ever evolve

schestowitz-TR2

maybe because of managers there

schestowitz-TR2

or the VCs/hedge funds

mjg59_

spdy turned into http/2?

Aug 25 10:41

mjg59_

Unclear what the complaint is there

Aug 25 10:41

mjg59_

It's just a lower overhead mechanism for negotiating transfers

Aug 25 10:41

*psydruid (~psydruid@jevhxkzmtrbww.irc) has left #boycottnovell

Aug 25 10:45

*psydruid (~psydruid@jevhxkzmtrbww.irc) has joined #boycottnovell

Aug 25 10:46

Techrights-sec

I'm think the second navigation bar in TM can be redone but don;t have

Aug 25 11:03

Techrights-sec

a convenient way to demo the change.

Aug 25 11:03

schestowitz-TR2

the next/prev?

schestowitz-TR2

webp also

schestowitz-TR2

mjg59_: I know

schestowitz-TR2

that's not good

schestowitz-TR2

same for drm

schestowitz-TR2

making old browsersa not compatible

schestowitz-TR2

like they do with the CA cartel

Aug 25 11:05

schestowitz-TR2

they don't care about people with disabilities and the environment

Aug 25 11:05

*DaemonFC (~daemonfc@r6fx9ce6x78p6.irc) has joined #boycottnovell

Aug 25 11:05

Techrights-sec

yes

Aug 25 11:06

schestowitz-TR2

I think we need some ways to lead to older days, e.g. from the same month, wherein there is an index for the day

Aug 25 11:07

schestowitz-TR2

this way nothing is close to being orphned

Aug 25 11:07

schestowitz-TR2

maybe button for "also today" "previous day" "next day"

Aug 25 11:07

Techrights-sec

Rather than having them in the center, as they are now, it would be possibly

Techrights-sec

and improvment to have them justified to the edges. That way one can

Techrights-sec

click forward or backward continuously without having to chase the links back

Techrights-sec

and forth across the line as they get longer or shorter. Right now if

Techrights-sec

prev / next has one short and one long and then one long and one short you have

Techrights-sec

a high risk of clicking on the wrong one

Techrights-sec

LI / UL will do the job

Techrights-sec

no table is needed

schestowitz-TR2

to set apart the arrows you might need deiv or table

schestowitz-TR2

table would be the 1990s style

mjg59_

11:04 < schestowitz-TR2> making old browsersa not compatible

Aug 25 11:10

mjg59_

That seems like an argument for never improving a protocol ever

Aug 25 11:10

mjg59_

Unless we're willing to freeze development then inventing new things that work better does at some point mean that old things stop working

Aug 25 11:11

mjg59_

I'm not aware of anything that serves HTTP/2 but not HTTP/1.1 right now, and I suspect it's going to be a long time until that happens

Aug 25 11:12

mjg59_

But if it does, that's not an attack on old browsers! That's just progress, because people want to implement stuff that works better and will not spend all of their lives supporting stuff that hasn't been updated in over a decade

Aug 25 11:13

mjg59_

Otherwise you're getting into "Why doesn't Linux run on a 386 any more" territory

Aug 25 11:14

mjg59_

(A decision that was made by Linus)

Aug 25 11:15

schestowitz-TR2

btw, I have arindam's public key

schestowitz-TR2

but I don't think we tested enough yet

schestowitz-TR2

so that's on hold for now

schestowitz-TR2

like the image upload thing

schestowitz-TR2

386 is VERY old

Aug 25 11:20

mjg59_

So is HTTP/1.1

Aug 25 11:22

schestowitz-TR2

in falkon, the rhs of the rhs arrow need a little more margins

schestowitz-TR2

it touches the borderline

schestowitz-TR2

but otherwise works well, as expected

schestowitz-TR2

I've added more styling to the readon button

Techrights-sec

checking

Aug 25 11:30

schestowitz-TR2

looks like you reverted back several changes

Aug 25 11:43

Techrights-sec

they're still in Git

Techrights-sec

Git has not been updated since I mentioned the above changed regarding the

Techrights-sec

navigation bar

Techrights-sec

push to git and then pull into the /var/www/tuxmachines.org/ hierarchy

schestowitz-TR2

I did that earlier after I had changed the css

Aug 25 11:49

schestowitz-TR2

adn then saw the changes to navigation, even in live

Aug 25 11:49

Techrights-sec

yes, I had tested them and was in the process of rollingthem out, but

Aug 25 11:51

Techrights-sec

had not pushed to Git yet from here

Aug 25 11:51

Techrights-sec

su -c 'cd /var/www/tuxmachines.org/; git pull origin master' -s /bin/sh git

Aug 25 11:52

Techrights-sec

... * branch master -> FETCH_HEAD

Aug 25 11:52

Techrights-sec

Already up to date.

Aug 25 11:52

Techrights-sec

/var/www/tuxmachines.org/ is only a mirror of what's in Git

Aug 25 11:58

schestowitz-TR2

so I am guesing you pushed that back for a bit

schestowitz-TR2

along with the changes

schestowitz-TR2

as my changes and yours are not in the live site now

schestowitz-TR2

i ran the pull from tm-new after I had modified the css

Techrights-sec

ack

Aug 25 12:06

*DaemonFC has quit (Quit: Leaving)

Aug 25 12:51

Techrights-sec

on the topic ofthe image upload, how has the incron workflow gone? that has

Techrights-sec

been available for testing (on the production site:( though) for some time

Techrights-sec

on the topic ofthe image upload, how has the incron workflow gone? that has

Techrights-sec

been available for testing (on the production site:( though) for some time

*wallacer has quit (connection closed)

*wallacer (~quassel@6bsu33ajs4zs4.irc) has joined #boycottnovell

Aug 25 13:39

schestowitz-TR2

I tried plaacing new files in the uploads dir, expecting something to emerge in the other dir with some html/txt file

schestowitz-TR2

but iirc, that never quite worked yet

schestowitz-TR2

and we were not sure why, then moved on to something morre pressing (at the time)

schestowitz-TR2

I assume you still rework the navigation part

schestowitz-TR2

as atm the arrows are gone, from live at least

schestowitz-TR2

for a moment it was live, with the arrows and the left/right align

schestowitz-TR2

and then it disappeared

schestowitz-TR2

archiving will become more important and navigation to old "content" when we have thousands of nodes in the new site

*psydruid (~psydruid@jevhxkzmtrbww.irc) has left #boycottnovell

Aug 25 17:22

*psydruid (~psydruid@jevhxkzmtrbww.irc) has joined #boycottnovell

Aug 25 17:22

Techrights-sec

the upload script is blocked by a permissions problem; I need to find a way

Techrights-sec

to override any existing permissions and force group-write on the incoming

Techrights-sec

files

Techrights-sec

if they get uploaded as 664 they are fine, if they are uploaded as 644, which

Techrights-sec

is the default on most systems, then they are blocked

Techrights-sec

hmm some other problem with incron

Techrights-sec

incron won't run as any user even though the system log says it has

schestowitz-TR2

b ack, both of us

Aug 25 17:42

schestowitz-TR2

maybe saved ('earned') about 60-90 pounds by patiently hunting

Aug 25 17:42

schestowitz-TR2

that's the "special day out"

Aug 25 17:42

schestowitz-TR2

trams are still a risk of unexpected "Crowding"

Aug 25 17:43

schestowitz-TR2

wow, great job on the navigation bar. really nice, i love it!

schestowitz-TR2

the "core" part of the cms is solid

schestowitz-TR2

even db locking

schestowitz-TR2

can be confusing at times but I communicate with rianne when the lock kicks in to avert conflict

schestowitz-TR2

navigation/archive pages are not urgenjt because for now it's feasible to crawl backwars

schestowitz-TR2

it gets harder months or years down the line