log☇︎
280000+ entries in 0.172s
trinque: I was sharing the lulz; db makes sense
asciilifeform: afaik reiser is the champ.
asciilifeform: of cpu also, but the box is well-equipped in that respect
asciilifeform: 'moral' of this thread is - phuctor stretches the limits of disk, fs, db, various shoddy duct tape that makes up modern kompyooooting shitsoup
Framedragger: eh i may be back, shit's too interesting :D
Framedragger: i meant that i supplied them to you as one key in one file. but yeah kk
asciilifeform: in old ver of phuctor they lived on fs;
a111: Logged on 2016-07-18 18:08 asciilifeform: i know of no file system that would not choke.
Framedragger: http://btcbase.org/log/2016-07-18#1505027 << well the rfc4880-formatted keys are already in one-file-per-key, in truth ☝︎
asciilifeform: EVERY time.
asciilifeform: this is the v state thread all over again.
asciilifeform: nor am i interested in waiting for months for the conversion.
jurov: but that does not mean you have to completely regenerate all html from scratch every time
asciilifeform: i know of no file system that would not choke. ☟︎☟︎
asciilifeform: because this would entail a page for EVERY key and fp
asciilifeform: well i ain't appending to anything
trinque: but if that'll be nightly, I expect there'll be big farts of RSS at phuctor-o'clock
jurov: asciilifeform: i did not say you have to abandon db!
asciilifeform: jurov: understand, there has to be a db, because ALL mods get bernsteined against ALL mods AND the 8ball.
trinque: asciilifeform: RSS too?
jurov: if alf did csv, he could just keep appending to the static file
Framedragger: asciilifeform: yeah that'd be pretty.. sane
Framedragger: understood. well, so it is. i do recall being able to full text search decently once it loaded. but, okay, browsers suck
asciilifeform: namely, all of the .html will be generated nightly.
asciilifeform: at a certain point i'ma have to make it a batch thing
jurov: i saved sadmods.html to *my* hdd
Framedragger: jurov: oh you mean it as counterargument, it reading from hdd on phuctor. i thought, from local hdd
asciilifeform: which is an order of magnitude slower than simply 'from hd'
Framedragger: some time ago. could have been elinks. and yeah i recall it being slow
jurov: you actually tried lynx? as we are speaking, it claims to read 30MB, at 340KiB/sec, and the keeps getting down ☟︎
Framedragger: works that way
a111: Logged on 2016-07-18 17:09 jurov: and it's questionable why export it as html, when browser can't be used and we have to grep it anyway?
Framedragger: http://btcbase.org/log/2016-07-18#1504926 << in truth, use a sane browser like lynx :) ☝︎
asciilifeform: trinque: the only one i know of that runs continuously without blackhole or other hiccup.
trinque: only reliable trb node eh?
Framedragger: (ah, need to read that damn paper finally)
asciilifeform: box also hosts the only (afaik) 'five nines'-reliable trb node.
Framedragger: ..cause you need to keep the eight-ball in memory, right?
asciilifeform: it has a tremendous qty of ram, without which whole experiment would be quite impossible
asciilifeform: (if it were a commercial thing, it would probably live on a large farm)
Framedragger: does the box have ssd?
asciilifeform: and there is really no cure for this.
asciilifeform: and whole thing is a couplaehundredlines.
asciilifeform: and they aren't consolidatable.
asciilifeform: in practice, that thing grinds ~100+ queries / sec. 24/7
Framedragger: and e,N,IP for the additional 1.82M key ball is in the http://95.85.10.71:8000/all/openpgp/ssh_openpgp_diff_2016-07-13.tar (file at top, directories under contain the openpgp'd versions). hope this makes sense, it's a bit ad hoc
Framedragger: so your original wwwtronic thing would be preserved; i understand and appreciate its elegance
Framedragger: (i mean i'd mirror the thing, or something)
Framedragger: asciilifeform: i implied that i'd be interested to maybe write an api; if everything's in postgres properly indexed, should be fine. hey i'm a masochist, all the better for tmsr!!1
a111: Logged on 2016-07-18 17:38 asciilifeform: Framedragger: do you still have the raw mods somewhere ?
Framedragger: http://btcbase.org/log/2016-07-18#1504950 << you mean mods in the e,N,IP format? yes and they should be on the web, one sec ☝︎
asciilifeform: Framedragger: not only would an api take up more complexity than phuctor at present in its entirety, but the thing barely keeps up as it is.
Framedragger: we need teh api
asciilifeform: you do not need any of the phuctor logic for this
asciilifeform: (a mod with 2 or more ips gets a colour; plot each ip on the traditional 2d grid, and connect with line of that colour.) ☟︎
asciilifeform: it would not take long to snarf them up and 2d plot by ip ☟︎
asciilifeform: Framedragger: do you still have the raw mods somewhere ? ☟︎
a111: Logged on 2016-07-13 18:26 Framedragger: asciilifeform: i have moar ssh keys for ya: http://95.85.10.71:8000/all/openpgp/ssh_openpgp_diff_2016-07-13.tar (diff from that 10M bunch, i.e. only new ones) 920M file, 1.82M new ssh keys.
Framedragger: asciilifeform: mircea_popescu: hey i may be up for setting up some kind of searchable thing with everything dumped into postgres. not sure how much worth vs. time, but could be useful as these stats grow
a111: Logged on 2016-07-18 16:07 asciilifeform: mircea_popescu: it will be an interesting anal piercing moment for the tor aficionados - EVERYBODY gets to 'upgrade'
Framedragger: http://btcbase.org/log/2016-07-18#1504774 << ftr, there's a consensus mechanism, so it's not "everything works or everything's broken" ☝︎☟︎
asciilifeform: http://phuctor.nosuchlabs.com/gpgkey/69420B90B8B1C02C8C0E3F9F591801396FE97A6C87714A63D64C25EA47B5B88E << this last one is interesting. 'usaa' is a bank.
asciilifeform: there are not TWO
asciilifeform: is this so hard to grasp.
asciilifeform: jurov: because there is one proggy.
jurov: and it's questionable why export it as html, when browser can't be used and we have to grep it anyway? ☟︎☟︎
asciilifeform: i'd love to learn what these folks had in common, other than the obvious misfortune.
asciilifeform: sooooo, at the risk of cluttering l0gz, we have the ten winnerz:
jurov: Still. It's just a simple table without js.
jurov: http://phuctor.nosuchlabs.com/sadmods causes firefox-47 to spin for several minutes and then render garbage
jurov: heh, whois 108.163.248.235 times out ☟︎
asciilifeform: 'nobody could have predicted!' that this will turn up!
asciilifeform: there are hundreds of these clusters.
asciilifeform: note, all of this is from not even one complete parcel from Framedragger .
asciilifeform: ALL OVER the net.
trinque: huh, wotpaste wont resolve over here; I shit thee not
asciilifeform: speaking of all of this, did anybody ever crawl the tor exit pubkeys ?
asciilifeform: there are plenty of these.
asciilifeform: consider now this case: http://wotpaste.cascadianhacker.com/pastes/1de0673a-143e-4062-b1f0-3d414525f7f9/ ☟︎
mircea_popescu: then people can search in that.
mircea_popescu: at the very least you could make another page, "ips by factors found"
asciilifeform: having ANY new fields would make the thing 100x more complex.
asciilifeform: we went over this.
mircea_popescu: asciilifeform the one important thing you should add is "search by ip"
asciilifeform: it is a valid point: there is no physical way to distinguish 'all connected to same box' from 'boxes with dupe key'
mircea_popescu: this afaik didn't exist on the open nets afore.
mircea_popescu: well, at least it offers a hierarchy of "in which order to factor keys"
asciilifeform: there isn't much further to push the dupe thing, other than cataloguing the champs
mircea_popescu: alternatively, nobody could foresee the terrorists will use ssh keys as rsa unifying underlying, so they're entirely unprepared for any of this
mircea_popescu: wtf is this.
asciilifeform: i should like to hear the 'innocent', boeckian explanation for the tall piles of dupolade.
mircea_popescu: why misery tho ? you wrote it neh ?
asciilifeform: but doing just about anything to this beast is a misery bordering on self-appendectomy
asciilifeform: as soon as i add this'n'that, it will turn into whorepress.
asciilifeform: it is painful but: i kept the proggy short, and it is - afaik - bug-free.
mircea_popescu: this "middle of the road" thing is bad for both usecases : when you grep it you waste bw on html crud ; meanwhile browsing luser is stuck.
mircea_popescu: if you want a csv version, why not make that. if you're making a html version, should have pages. ☟︎
asciilifeform: my current hypothesis is that enemy was a little more clever than reported by the bocks, and divided dupe keys into equivalence classes
asciilifeform: (the dupes page is a rogue's gallery of these.)
mircea_popescu: asciilifeform http://phuctor.nosuchlabs.com/phuctored << gotta do something about that page.