log☇︎
6500+ entries in 0.006s
asciilifeform: phf's item ftr lives also in usa, somewhere in nyc region
asciilifeform: ( spoiler : rubbish-mirror actually loads slightly faster, from europistan, than phf's orig., for 'heavy page' test )
asciilifeform: meanwhile diana_alt's measurement of mirror load in #o.
asciilifeform: trinque ^
asciilifeform: hrm no deedbot ?!
asciilifeform: !!up diana_alt
asciilifeform: in other noose, the fella who first described 'endianism' is dead.
asciilifeform: http://logs.nosuchlabs.com/log/trilema/2019-08-19#1929749 << today <50kB/s...
asciilifeform: ( and, interestingly, specifically fucked re tcp. )
asciilifeform: http://logs.nosuchlabs.com/log/trilema/2019-08-20#1929795 << the measurements strongly suggest this.
asciilifeform bbl:meat.
asciilifeform: ^ dulap incidentally performs considerably better , unsurprisingly, than the pseudo-sadmachine, in re actual page generation on local end.
asciilifeform: meanwhile, loox like lobbes reproduced asciilifeform's orig. observation.
asciilifeform: i.e. takes ~0.068s to travel the 50km or so to asciilifeform's chair from said pseudobox.
asciilifeform: (i.e. all on top of this, is transmission delay from east amerireich, where thing sits.)
asciilifeform: btw for thread-completeness, heavy page loaded locally on the shitbox consumes avg. of 0.2s.
asciilifeform: i expect at some pt mp will say to anyone in l1 who aint running a logger, 'партбилет на стол!'(tm)(r)
asciilifeform: rly what we oughta have is 7+ ~active~ bots/logotrons on 7 continents, then no one will have to grumble 'wai slow'
asciilifeform: BingoBoingo: from this pt i'ma follow the prescription mp gave during last 'wai slow' thrd -- leave it alone, there aint much to be done re to speed it up ( as imho conclusively showed that the pipe is to blame ). will move on to other matters ( import of historic logs ; fix of reported catastrophic bugs, incl. the resync of numeration mp asked for ; and then to get back to ffa ! )
asciilifeform: BingoBoingo: this remains a mystery. i gotta wonder if there's something peculiar re our routing, which gives this effect.
asciilifeform: for n00bz : the cron job script which powers this ; the cron job itself .
asciilifeform: the 'db snapshot' link nao worx. this box will do duty as an (unauthoritative!) 'fast' mirror of db snapshot also, until someone comes up with better.
asciilifeform: keep in mind that bot will not echo log lines cited from rubbish mirror. it is fit strictly for timing experimentation.
asciilifeform: ftr gets ~80kB/s avg. from dulap, there.
asciilifeform: BingoBoingo, lobbes , et al : i'ma leave the rubbish box to run until further notice, and give it cron job that eats db from dulap erry day .
asciilifeform: ( i.e. pretty fast connection reich <-> reich ; palpably slower piz <-> reich )
asciilifeform: ty for the timings lobbes . seems to match up with asciilifeform's and BingoBoingo's pictures
asciilifeform: http://logs.nosuchlabs.com/log/trilema/2019-08-19#1929694 << this is worth expanding on. asciilifeform also gets very fast pings ( never moar than 200msec, to date ) and fast udp. what i suspect is, usg's snoop gear that sits as parasitic toad on south amer's pipe, specifically slows down tcp.
asciilifeform: ( the rest -- largely, hand-copying configs )
asciilifeform: ( of which ~8m spent downloading db snapshot from piz )
asciilifeform: other folx btw are encouraged to perform similar experiment ; whole thing took me approx 35min of meat time, from revving up heathen pseudo-box to posting link here.
asciilifeform: ( in the mirror example, we get it in the reverse direction, but seems to be that same ~0.5s ! )
asciilifeform: BingoBoingo: hard to say for fact, but seems to add up to a picture where's there's a ~0.5s bottleneck b/w south amer. and errywhere else.
asciilifeform brb,teatime
asciilifeform: BingoBoingo, diana_coman, et al ^ as time permits , plox to post load times of this ^ log.
asciilifeform: i'ma switch this thing off in coupla days, once errybody's taken the offered measurement and is satisfied ( i dun want a 'fossilized' logger sitting for idiots to find and think 'they're dead' )
asciilifeform: this experiment also reveals that asciilifeform's logotron will in fact stand up, with no modifications, on a python, flask, pg, etc. plucked out of arbitrary rubbish bin.
asciilifeform: all knobs aside from 'download snapshot' work, so feel free to e.g. walk the 'random' pages etc.
asciilifeform did not bother to sync the clock, so times on shit mirror will vary vs. dulap's
asciilifeform: i suppose for completeness will mention an alt-hypothesis -- somehow nic on dulap is culprit.
asciilifeform: errybody's welcome to play with the mirror ( it's a '1st month -- phreeee!' pseudo-machine , i'ma leave it up for a spell, tho it will , obv., grow no new log lines )
asciilifeform: this suggests that culprit of 'mystery delay' is in fact piz pipe.
asciilifeform: deliberately this setup uses nginx and same (as far as could replicate on the heathen box) stack of proggies as the orig.
asciilifeform: ... from here eats 0.268s.
asciilifeform: other folx welcome to try. e.g. the 'heavy page' : curl http://54.209.217.34/log/trilema/2018-04-18#1802801 > /dev/null
asciilifeform: time curl http://54.209.217.34/log > /dev/null from my chair yields 0.063s.
asciilifeform: oook here's an experiment : asciilifeform set up a mirror of the logotron on a cheap heathen host. ( one of the most rubbish hosters known, lulazon's . hence cannot in fact stand up copy of bot there, fleanode bans conns from it unless sslized. but the db is current. )
asciilifeform: interesting.
asciilifeform: ^ the log bot itself, for instance, thus far has only reconnected when asciilifeform manually cycled it, to update to new ver (last such time, to put phf's uniturd pill in production)
asciilifeform: !quptime
asciilifeform: ... and typically they die on acct of connectivity pause on asciilifeform's end, rather than piz
asciilifeform: piz pipe is not gonna set any speed records. (however, is extremely reliable, e.g. asciilifeform gets ssh sessions that last 3-4 months)
asciilifeform: 'go to war with the pipe you have, not the pipe you wish you had'(tm)(r)
asciilifeform: ( and imho further suggests that pipe is culprit )
asciilifeform: BingoBoingo: that loox realistic.
asciilifeform: BingoBoingo: the 33 logger is off atm
asciilifeform: the logger does not depend on dnsism to work ( can set the domain in /etc/hosts like e.g. mp does )
asciilifeform: BingoBoingo: naked ip also worx (lemme know if you want the 2nd logger on 33 switched on , to try moar )
asciilifeform: diana_alt's, on other hand, is very similar to mine, i.e. no substantial diff b/w main and 'naked'
asciilifeform: ( possibly BingoBoingo's is under load ?? )
asciilifeform: BingoBoingo's output is pretty interesting -- how is it that he gets >2x the wait from ~local~ machine than diana_alt from europistan.
asciilifeform: ty diana_alt , BingoBoingo . (i'ma switch off the 2nd logger for nao, will run it again if anyone requests, later)
asciilifeform: diana_alt: do 3-4 shots via each (main vs 33) and paste plox
asciilifeform: ( keep in mind that the links in the loaded page still point to the original )
asciilifeform: in my own test, there is no substantial detectable diff
asciilifeform: ( diana_alt lemme know after tried, i'ma switch it off, it's an unhygienic thing )
asciilifeform: diana_alt: reasons to suspect the pipe, include this: i have stood up temporarily a raw flask on port 33. try time curl "http://logs.nosuchlabs.com:33/log" > /dev/null
asciilifeform: BingoBoingo: plz perform the simple experiment suggested by diana_alt and tell result.
asciilifeform: ( had not, prior to folx observing 'logger is slow, say wai' , taken the sweat to properly monitor where in the typical page load is time spent and on what )
asciilifeform: previously i chalked this up to 'slow pipe'. now suspect also the proxying proggy.
asciilifeform: the reason why i currently suspect nginx as the culprit, is that i observed very similar delay when loading static (e.g. FG photograph) files via same.
asciilifeform: neither phuctor nor logger is written in such a way as to force the choice of either nginx or apache as the front-side proxy, will eat either just the same. simply requires the appropriate config.
asciilifeform: ( at one pt, long ago, when baked phuctor, asciilifeform had a preference for nginx, but it turned out to be ill-founded . currently both phuctor and log www are served by a nginx . )
asciilifeform: diana_alt: i have plan to move the box to traditional apache, but yet not figured out how to do so w/out unacceptably long disruption of service .
asciilifeform: i get (and on rather slow machine) load time for the 'heavy' example page comparable to the time it takes for the mouse button to go up an' down.
asciilifeform: diana_alt: if you press the vtree and set up the logger on own box, where you happen to be, and import the daily db dump, can then observe the 'native' speed of the thing.
asciilifeform: pipe delay ( piz <-> asciilifeform's chair , cannot be generalized to entire planet ) varies from 0.2-0.4s (for revvup of tcp pipe, that is)
asciilifeform: delay disappears when accessed on localhost at the 'high' (nonpublic) port where the py proggy itself is answering
asciilifeform: so i suspect you will find same
asciilifeform: diana_alt: however, if accessed from localhost on ~public port~ (80) then yes same delay
asciilifeform: diana_alt: i do not currently know, atm i only have access to 1 piz machine. if you have time, plz try from yours and share result.
asciilifeform: when someone sets up this logger outside of piz, i suppose will tell us sumthing re subj.
asciilifeform: diana_alt: fwiw i was not, to date, able to rule out mp's 'overworked pipe' hypothesis .
asciilifeform: diana_alt: there defo is. i've measured up to 0.6s (and all outside of the py proggy per se, i.e. vanishes if accessed at localhost )
asciilifeform: lobbes: http://blog.lobbesblog.com/2019/08/znc2tmsr_etckvvpatch/comment-page-1/#comment-59
asciilifeform: lobbes: possibly it can even be used to bake a phf-style refill/sync system that eats znc.
asciilifeform: lobbes: i'ma try your proggy tomorrow. ideally time finally came to eat all of the back-archives.
asciilifeform bbl:meat
asciilifeform: 90% sure it was this character.
asciilifeform: can't seem to recall, grr, what it called itself
asciilifeform: it was the 1 that ended up with vendetta against ben_vulpes somehow
asciilifeform: that one pretty certain was a 'tits service' candidate who turned out to be some d00d, compl. w/ stubble
asciilifeform: hrm this was defo mentioned. but so far defies shovel.
asciilifeform: aaand here's the other one
asciilifeform: i was off re sprezz.
asciilifeform: the steering wheel, btw, found
asciilifeform: quite possib
asciilifeform: mp_en_viaje: that was in the "alice_m" thrd.
asciilifeform: was translation iirc. where 'but anyone could parallel park using steering wheel! troo sport is to do it without wheel, said the sprezzaturist' or similar
asciilifeform: mp_en_viaje: it was in an old trilema piece, the one about 'sprezzatura'