tmsr - Log 2016-11-19

asciilifeform: i was quite unable to do ANYTHING reliably on the thing when it lost fan control (from the linuxbiosification). possibly was just my unit ? though it had virginally clean fans, fresh grease.

phf: well, the result of staple tmsr exercise of "let me grind these lens myself, oh, wait, turns out the `sand` they use is actually cow shit"

a111: Logged on 2016-11-18 22:03 gabriel_laddel: trinque: I even created a program to meet girls.. no dice thus yet.

mircea_popescu: is that experience speaking ?

a111: Logged on 2016-11-18 22:06 asciilifeform: lol, mephedrone ! i had nfi it existed outside of ex-sov countries

BingoBoingo: mircea_popescu: Of course. Okcupid used to be a waste of time then, OMG run mp scripts and then datez.

asciilifeform: (it is not particularly easier to produce than 'adult' meth, but is considerably weaker)

BingoBoingo: asciilifeform: Prolly Chinese make like rest of fancy trendy drugs because market.

mircea_popescu: lol cool

BingoBoingo: asciilifeform: Well sure, but convenience store industry isn't exactly paragon of law abidingness

asciilifeform: BingoBoingo: most above-board 'generic pharma' in usa is imported from india.

phf: at least that's where the bulk of ketamine came from during the, now looks like mostly over, ketamine years

phf: BingoBoingo: i'm sure some people sourced it that way, but bulk of k came from india, straight out of factories, because at some point it was unregulated there and class whatever here

asciilifeform: 'Consideration is taken for possible conflicts of interest. Financial holdings and sources of income must be disclosed.Any conflicts must be remedied by divestiture, the creation of special trusts, and other actions.' << lel

ben_vulpes: !!up Gaboose yo get a connection that stays up, would you? the join/part spam is entirely unnecessary.

lobbes: heh, that was the second thing I did after learning how to view a directory in non-winblowz (this is even in logs!). Not hard, but laziness most likely is the problem of Gaboose. For all we know, he is a literal dog with a smartpohne, never to be aware of this conversation

mod6: <+mircea_popescu> hence the whole "i want time magazine to tell me how the shutdown relates to me" ie, "i don't want any data (ie, anything about objective reality, outside) i just want commentary, entirely baseless if possible." << haha

mod6: http://btcbase.org/log/2016-11-18#1570311 << he off in like the end of '11. popped back up a time or two in early '12, iirc. ☝︎

a111: Logged on 2016-11-18 22:34 mircea_popescu: you have any idea what happened to vragnaroda ?

deedbot: http://www.contravex.com/2016/11/18/an-exercise-in-wot-gambling-on-very-very-silly-timescales/ << » Contravex: A blog by Pete Dushenski - An exercise in WoT gambling on very, very silly timescales.

mircea_popescu: and in today's installment of the gueto files : hanbot says to woman "nice vest, did you make it yourself ?" and the woman answers...

mircea_popescu: "no, i found it in a plastic bag in the alley behind the hotel where i used to work." ☟︎☟︎

mircea_popescu: in all deadpan honesty, this.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570487 << yea mebbe. ☝︎

asciilifeform: http://archive.is/gZqQJ << in other lulz. 'The tax agency sent a broad request on Thursday to Coinbase, the largest Bitcoin exchange in the United States, asking for the records of all customers who bought virtual currency from the company from 2013 to 2015.'

mircea_popescu: and the obvious response "we have no fucking idea" isn't on the table because coinbase ISNT a bitcoin company.

mircea_popescu: indigence is not a strategy.

mircea_popescu: yea!

BingoBoingo: <asciilifeform> there are always organs to sell. << For solution to this see BingoBoingo strategy. Use substances just enough to erase market value from organs, unless grinding for sausage.

a111: Logged on 2016-11-18 22:58 mircea_popescu: Framedragger hey, i paid a grand via paypal for like 60 btc back in 2012. back then bitcoin was still enjoying the benefit of not having been popularized.

Framedragger: (mandatory framedragger sob about reckless spending of btc back in 2012... :( ) ☟︎

Framedragger: !~later tell gabriel_laddel fd at mkj dot lt , gpg fingerprint E2DF 986D 58A0 D387 6BA1 65FA CC05 10AA FD8A F4B7

mircea_popescu: Framedragger see, but there's a larger point here. i dunno if you followed the recent discussion re nirvana, but in any case : it is specificlaly NOT the intent of the republic to become popular.

mircea_popescu: the idea is for the republic to be imposed, preferably at the point of a sword, and painfully, VERY painfully, depersonalizingly painfully, to the common man.

mircea_popescu: we absolutely do not want for the common man to "see", in his own, common man terms, the "benefits" of the republic, and then "become part of it" and in the process start selling tmsr keychains at hot topic.

Framedragger: mircea_popescu: hmm. okay, i guess i get that this implies a wholly different approach.

mircea_popescu: the battle is for the elites and for the elites strictly. the common man is unwelcome in any capacity outside his physicality.

mircea_popescu: attempts to get the common man involved is how the various socialisms, be they hitler's or stalin's fail.

Framedragger: the http://btcbase.org/log/2016-11-18#1570169 will need to be addressed in due time then, i guess. ☝︎

a111: Logged on 2016-11-18 21:57 mircea_popescu: anyway. the republic isn't poor. but it is very fucking difficult to get proper leverage applied.

mircea_popescu: because the common man consists principally of shit, and as something becomes "popular" it becomes shitty.

mircea_popescu: so no, i don't want joe q mschmucky to "understand" why if he fucks up his payment we keep the txn. or to accept it, or to think it's a good idea.

mircea_popescu: no, i want him to be as upset as he can muster about it ; and then still not actually manage to do anything about it.

mircea_popescu: that is the proper place of the common man : angry powerlessness.

Framedragger: (i wonder if there is a retribution/psychological component to this. but maybe not.)

mircea_popescu: there is - the common man is lazy. the only thing that can support his transition to actual human is the experience of furious impotence.

mircea_popescu: it does not work for all, of course. but if it didn't work it means there was nothing there.

mircea_popescu: right. because this isn't another lollapalooza or w/e.

mircea_popescu: "the republic isn't optional."

mircea_popescu: for the derps, it is mandatory because they are powerless ; and for the elite it is the only viable alternative (and thus also mandatory).

mircea_popescu: because hey, if you can... you must.

Framedragger: (also, if there was one tv series you may want to watch, it'd be "black mirror". i watched their "christmas special" ("white christmas") yesterday, and somehow on an emotional level it made me feel easier about not having much hope in the "populace". the smarter the technological tools that the populace gets to play with, the more they fuck themselves and others up.)

mircea_popescu adds to list.

Framedragger: i don't knot about the "*only*" viable alternative. you yourself mentioned some time ago that it's perfectly normal for other intelligent peeps to have their own WoT networks (which are not connected to tmsr WoT).

mircea_popescu: yes, and they are part of the republic. per definition.

Framedragger: (https://en.wikipedia.org/wiki/White_Christmas_(Black_Mirror) - episodes are disjoint in terms of narrative and actors, and are stand-alone.)

mircea_popescu: just because i'm influential doesn't mean i'm universal. a grass eating quadripede in south america is just as much a herbivore as the common horse, even if they never met.

mircea_popescu: by and large, the notion that the common man may have a say in his usage / fate is coming to a close. it's some weird shit some dudes pulled out of their ass and then argued persuasively a few centuries ago, it was tried in a massive social experiment, and showed to not work in any conceivable implementation. to call this a trend reversal is to entirely miss that the alternative dominates millenia by the hundreds ; "humanism"

mircea_popescu: is nary a spec in this history and soon forgotten like bell bottoms and whatever other fashionable nonsense. 80s hair and 1790s sociopolitics.

mircea_popescu: as this realisation grips the masses, watch for the populist politicians display a turn of heart about the term "future".

mircea_popescu: the same dorks who were all happy with us electoral system up until nov 8th.

mircea_popescu: similarly "it's the way of the future" isn't going to make shiny happy people out of the populist party that used nothing but this all through 1800.

mircea_popescu: and NOW we shall come back to your http://btcbase.org/log/2016-11-19#1570510 : it's easy to misperceive that whatever, the republic, take it or leave it, in 2016. it's easy to think that hey, maybne i;ll make myself a computer that works, or maybe i won't, who cares. in 2016. ☝︎

a111: Logged on 2016-11-19 11:49 Framedragger: (mandatory framedragger sob about reckless spending of btc back in 2012... :( )

mircea_popescu: but the battle is on, and it's the battle for souls. once the door closes there's no redemption.

mircea_popescu: $1k was nothing in 2012 like it is today ; and would have done nothing more for me then than now. what i bought for it was pretty stupid, according to the experts of the time, and doomed to failure. a working computer is pretty stupid, according to the experts of 2016, and obviously doomed to "it can't work".

mircea_popescu: the common man is made out of bad choices, informed by his laziness.

Framedragger: a working computer *may* just not be available in the future, i do believe that fully. not to go all cliche dystopian, but neural implants based on Secure Microsoft Quantum Encryption(R) and the likes may be what people use to "compute" in the future

Framedragger: (and the common man will just have found more tools to assfuck himself with.)

mircea_popescu: lol.

mircea_popescu: was in some 2013 article iirc, "history usually flows in the direction of most fucking common man"

mircea_popescu: in lighter news, found delicious armenian restaurant yest. manned by actual to god armenian. the difference from the local cows is shocking and immediate.

mircea_popescu: if danielpbarron ever visits ima feed him a sarma there :)

mircea_popescu: Framedragger the whole "oh, microsoft secure implants" is really just so much narcissism. as the raped girl angrily if unsuccessfully points out ( http://trilema.com/2013/the-dead-jew-and-the-raped-girl/ ), the peasants could at any point not have been peasants. "could". the pretense that "couldn't" is exactly what kept them in line them, and it's the source of this "secure implants bla bla" wet dream.

mircea_popescu: reality never worked that way to date.

mircea_popescu: no, it simply will be "nobody knows how to turn it on without the talking paperclip, and they can't muster the energy to try and find out". that's it. what, you think argentines fail because they're not connected to the same internet we are ? they're connected, i'm living proof. but to them, it's all netflix.

mircea_popescu: a country of farmers with "vida de noche" which consists of http://btcbase.org/log/2016-11-19#1570491 ☝︎

a111: Logged on 2016-11-19 04:41 mircea_popescu: "no, i found it in a plastic bag in the alley behind the hotel where i used to work."

Framedragger: mircea_popescu: yeah, ok - i guess my point was that it'd be very horrible, but i suppose the chief horror is in the learned-unthinking-ness of masses. the rest is just aftereffects

mircea_popescu: nobody forces them to carry the smartphones hm ?

Framedragger: mircea_popescu: i plan to set up a "phuctor results investigation dashboard". (iirc trinque or someone planned to do sth of the kind, but since this overlaps with the "check distinct banner amounts etc", i may as well do it properly). nothing fancy so as to keep it actually deliverable, but i have a plan.

Framedragger: i was wondering, would S.SNA (or whatever entity) be able to pay for a VPS? 9.6 EUR / mo., payment monthly, my VPS accepts bitcoin.

mircea_popescu: how about you apply for a grant to the foundation and i lean on ben_vulpes / mod6 to approve it ?

mircea_popescu: you need what, .15 btc for a year ?

mircea_popescu: also : mkay is resistive okay. not what you mean here amirite ?

mircea_popescu: alrighty, you write the application, make it short and to the point.

mircea_popescu: then once approved someone can write a qntra piece about the whole thing and lo and behold, crony republicanism!

Framedragger: (also, my initial plan was to ask for a month as i can't predict with absolute certainty actual resource requirements. but i think i have a decent picture of what's needed.)

mircea_popescu: won't be worth anyone's time to dick around with monthlies

mircea_popescu: kinda deals in whole boxes, you know.

mircea_popescu doesn't believe in this whole virtualization thing as implemented by cloud/vps/etc. the only virtualization that makes sense to me is via teh uci.

mircea_popescu: but that infrastructure's not yet ready

Framedragger: it's nice to be able to have a virtual box for cheapsies - can be migrated to bare metal when the time comes.

Framedragger: i see that http://thebitcoin.foundation/tickets/UCI_tickets.html doesn't have an 'owner' field - can sometimes be a useful thing, no?

mircea_popescu: no argument.

mircea_popescu: Framedragger could be, and mod6 is also working on making private ticket trees and other things

mircea_popescu: it is quite possible mod6 's ticket infrastructure eventually turns into the hiring interface we were discussing yest.

Framedragger: mircea_popescu: asking for advice - should i include a note that should additional hosting resources be needed during the 12 month period, an additional grant (it'd include supporting data of course) may be sought? just to be transparent?

Framedragger: (transparent about the fact that hosting resource expectations are preliminary.)

mircea_popescu: not really the place to discuss contingencies i dun think.

mircea_popescu: slippery slope, "and iof the internet runs away i'll try and run after it, and if it rains i;ll wear umbrellas and..."

mircea_popescu: grantwriting is in desperate need of reform.

mircea_popescu: should be judged on terseness not on bureaucratic notions of value ("it's long! and full of platitudes! let's count the platitudes!")

mircea_popescu: lol k

mircea_popescu: not terrible, has all the needed parts except "which shall provide a platform for those interested in analysing RSA keys and the surrounding metadata collected and provided by Phuctor" could benefit from (such as : by x, and y, and z) as it's currently not even vaguely clear what i could do on that platform.

Framedragger: okay - i wanted not to over-commit, but this is indeed pretty damn vague. will think and amend.

mircea_popescu: for starters, explain it to me. so what do i do there ?

asciilifeform: Framedragger: let me know what, if anything, you need on my end. but i must warn, querying the db is ruinously slow.

mircea_popescu: asciilifeform ideally he gets the phucked page once and then follows rss.

mircea_popescu: much to ben_vulpes 's chagrin.

mircea_popescu is amused how the collection of crap pisses off someone particularly. dns, rss, if it ends in s it's shit.

mircea_popescu: asciilifeform suppose he reloads the phucked page every time he gets a rss feed which doesn't include items he already has.

Framedragger: there would be, as per my current plan, two 'portals'. one would expose the db (postgres). current plan: ths would use phppgadmin. it's maintained and stable. user would make use of a read-only db role. so you could run sql queries on the whole thing. "whole thing" = sql schema which

Framedragger: hosts the phuctor data - p, q, e - and metadata - including country codes from geoip where applicable.

asciilifeform: it isn't whole bag though - i had to make manual sql queries, and wait quite a while, to get the stats for the recent qntra piece

asciilifeform: the info re ~unphuctored~ moduli, or relationship b/w moduli and keys, is not in the 'phuctored' page naturally

mircea_popescu: Framedragger what db ?

Framedragger: second 'portal' would be more simplistic and would, first off, be a simple way for me to present some non-gimmicky visualizations, e.g. what asciilifeform suggested some months ago.

asciilifeform: Framedragger: if i put even slightly more load on db, site will grind to a halt

mircea_popescu: so hm

mircea_popescu: so you want to pipe data from phuctor to a vps, and display it there ?

Framedragger: i'm unclear what to do with 'live data feed', but i don't think it's a problem. it could just sync with phuctor at timed intervals.

Framedragger: mircea_popescu: yes, if by pipe you mean, bulk-import into VPS, not torture phuctor's own db 24/7.

mircea_popescu: the part i don't follow is where isn't this a waste of your time ? you seem to be trying to do something akin to "i will create a gui atop this command line". ok... how will you guess aforehand what buttons people want to push ?

Framedragger: mircea_popescu: the first 'portal' would allow users to run read-only sql queries.

mircea_popescu: but grep already allows me to do this

Framedragger: so there would be no decision making needed as regards user friendliness / abstract buttons

mircea_popescu: so if grep already allows me to do this... what are you doing ?

mircea_popescu: me2.

mircea_popescu: well awk but w/e.

Framedragger: well, you wanted to run, say, DISTINCT on banners. it sure would be great to do it in a non-hacky way, and for others to allow to do the same, no?

mircea_popescu: but banners aren't on phuctor page are they ?

Framedragger: again i screwed up re. phrasing. i'd import the banners from the data i have.

asciilifeform: i got a thing that curls http://.....phucked and goes , nmap, fetches ssl certs if 445, etc

mircea_popescu: ok so you aim to take some data from phuctor, integrate it with some data you already have, and perhaps with other data you can obtain, and present it conveniently ? ☟︎

Framedragger: i suppose a more simplistic thing to do would be for me to fish out those banners, convert into decent format if needed, and to give to whoever wants :)

mircea_popescu: this, as an evolutionary superset of "i'll just dump a db of banners and you're more than welcome to match yourselves" ?

mircea_popescu: so like this it makes sense

mircea_popescu: i dun wanna have to resolve record matching every time i want to query the joint set.

mircea_popescu: see ? gotta make sense!

mircea_popescu: asciilifeform if you want to integrate it there. and next week someone observes really Y thing should also be and you're unbound.

mircea_popescu: dja feel mentally flexible enough to deal with that ?

Framedragger: i mean, tbh i should give asciilifeform those banners. VPS DB idea can wait.

mircea_popescu is not against either approach.

asciilifeform: mircea_popescu: not really. nothing stops phuctor from displaying '3.1.3.7 on date X' and '3.1.3.7 on date Y' as separate keys etc

mircea_popescu: well up to you, it's your shitsoup.

mircea_popescu: yeah but by now it includes so much we actually wnat to structure it ;/

mircea_popescu: that's how it starts you know.

Framedragger: i guess another thing is, it would be nice for #trilema folx to be able to test their own phuctor-related hypotheses without having to download all the data. but, it's not as if it's exabytes of data or anything...

mircea_popescu: Framedragger ok but if one actually wants to sql on it, dumping it in a table isn't much work.

mircea_popescu: often though i'm happy with just a bash. i think like once i actually wanted sql syntax

mircea_popescu: and then was too lazy and bashed it anyway.

mircea_popescu: Framedragger if you wanna do data visualisations, the thing to do is the wot explorer. that i actually miss.

asciilifeform: when i reopen the thing ( which is definitely not now, i am sweating now over a long-behindschedule unrelated item coauthored with mircea_popescu ) it will be to speed up the key eater

mircea_popescu subscribes to this view.

Framedragger: okay, i'll sit on it, meanwhile have $afk stuff to do, and i'll update next week re. what i'd like to work on, if anything.

mircea_popescu: enjoy.

Framedragger: ($afk item #1 is "coffee grinder is a bit shit and requires force, i don't want to use force in my mornings.") :)

Framedragger: (also, rereading the convo, yes http://btcbase.org/log/2016-11-19#1570648 is what i meant, and sorry for you having to spell it out for me!) ☝︎

a111: Logged on 2016-11-19 14:30 mircea_popescu: ok so you aim to take some data from phuctor, integrate it with some data you already have, and perhaps with other data you can obtain, and present it conveniently ?

asciilifeform: and the days of 'there are servers, and they serve all-comers' -- are numbered.

asciilifeform: the folx whose chumpnet we blew open, with the debian boxes, i suspect -- trying to make their displeasure known. ☟︎

pete_dushenski: ben_vulpes: after laocoon was getting connect/disconnect blackholed about a week ago i threw down the banhammer as well as manually banning some decently large ip ranges that were acting the fool. now very slowly catching up to full height but down from ~70 connex to ~15.

Framedragger: asciilifeform: seems that i can make it open 80/tcp, but it won't give me any data

asciilifeform: the 'public' needs exactly 1 'service' - an infinitely-long, red hot poker thrust up its collective arse, forever.

Framedragger: 'providing public services' does not necessarily imply 'provide them on the very box which does the important stuff'.. (though i hear you re. your 'ability to provide caching to live feed' concerns..)

Framedragger: still, the permalink-able key pages can be cached and/or served from somewhere else, no?

pete_dushenski: mats: do you see the appeal in the whole autonomous driving thing ? it strikes me as appealing to the same neophilic and inconsiderate mind that wanted to vote shillary in simply because she's a woman and WOULDN'T THAT BE GREAT, not because the consequences had any bearing on the decision making process. frankly the idea that sv-shitware was in total control of my vehicle is frightening. that many millions

pete_dushenski: of lines of code and that many chinese sensors ~will~ fail at some point. and it will be unexpectedly. and catastrophically. ☟︎

Framedragger: asciilifeform: by links break you mean that they are unreachable for extended periods of time? but boxes with cached static content can be armoured against ddos more, no? i guess unless you maintain that this is indeed syn flood or equivalent, which is agnostic to whether content up the stack is dynamic or sttaic...

asciilifeform: i wrote, in the qntra piece, 'examine debianized boxes for nsaware'. now 'owner' will have a chance to clean up before any mass 'examination' takes place. ☟︎

Framedragger: i hear you, examining them ourselves (in some automated fashion or w/e) would have been prudent. "trust the public to do it", uh :/

asciilifeform: ('but,' , said my internal mircea_popescutron, 'nobody had the slightest inclination to examine anything!' -- but this is besides the point)

mod6: <+mircea_popescu> Framedragger if you wanna do data visualisations, the thing to do is the wot explorer. that i actually miss. << me too.

mod6: Framedragger: point taken about 'owner' on tickets. I considered adding a 'assignee' or 'owner' for a given ticket(s), but with the narrow view of the first project (trb), i didn't want to discourage people from thinking about solutions for a given problem just because it had my name on it or something.

mod6: Anyway, now that it seems that private a more rich ticketing system is wanted, these things can be considered for sure. Salud! ☟︎

Framedragger: mod6: sure! maybe "assignee" would have the desired (lesser) connotation, i don't know. coming from some trac feature/bug tracking in distributed teams experience, 'owner' is there interpreted as simply 'person who is ultimately responsible for implementing/fixing this', with other collaborators invited and acknowledged

mod6: Framedragger: aha. yeah, in my experience with ticketing systems ala scrum, it's my observation that if a ticket is "assigned or owned by Jeff, I don't even think twice about it."

Framedragger: fair 'nuff. guess it depends on agreed-upon processes and overall mindsets of team, and so on...

mod6: So I wanted to avoid that. But going forward, I think that'll just some sort of optional field or whatnot. I'm excited to put some work into that as soon as I can here.

Framedragger: mod6: regarding visualizations, i'm just curious, did you have something particular in mind, as in, how do the svg visualizations at http://www.btcalpha.com/wot/trust/?from=mod6&to=mircea_popescu and http://www.btcalpha.com/wot/user/mod6/ look to the eye?

Framedragger: i suppose the idea could be to re-implement that, but using deedbot's view of WoT, and add additional things as desired. ☟︎

Framedragger: asciilifeform: at least with public-static and phuctor boxes being separate, you'd have access to the latter if it were private. (but i guess you could object with "private/undisclosed box on the internet, what is this oxymoron!") ☟︎☟︎

Framedragger: re. visualization, i like stuff like this (mouse over on labels around the circle), but it's a hella lot of JS, and i share the hate towards the latter: http://bl.ocks.org/mbostock/7607999 - what's nice about btcalpha visualization is that it uses by-now standard html5 canvas directives (<path>) with no need for JS. ☟︎

ben_vulpes: Framedragger: if you go down the 'phuctor visualizer/dash' route, you might consider leaning on pg streaming replication ☟︎

ben_vulpes: phf: may be able to chime in on how much load that'd add to the db process but i don't think much

Framedragger: ben_vulpes: oh hmm, i've never used it, very interesting and thanks for the pointer

mats: many affordable non-luxury cars today ship with front and rear-view wide multi-angle cameras

asciilifeform: http://btcbase.org/log/2016-11-19#1570743 << i have, as you can surmise, own comp, that still works ☝︎

a111: Logged on 2016-11-19 16:52 Framedragger: asciilifeform: at least with public-static and phuctor boxes being separate, you'd have access to the latter if it were private. (but i guess you could object with "private/undisclosed box on the internet, what is this oxymoron!")

trinque: Framedragger: ben_vulpes: it probably makes the most sense for me to do the WoT browser

Framedragger: regarding visualization, a more condensed question: if a javascript-using thing were delivered, would this be hated upon (and berated by asciilifeform) and accepted if otherwise good and properly maintained, or hated upon and dismissed (and berated by asciilifeform)? :) ☟︎

mats: i imagine this'd have a lot of applications in, ie, mosul, raqqa, and more modern battlefields of the future

asciilifeform: but it is neither here nor there, the server - falls down whenever enemy wants it to fall down.

Framedragger: and yeah, i guess one should go with svgs, mike_c used <path> and it was fine

asciilifeform: it needs a key eater that doesn't saturate the db capacity 24/7 -- yes. a server that doesn't fall down when washington farts on it -- also yes. 'js visualizations' ??

Framedragger: asciilifeform: well, less so visualizations than easy ways to query and analyse data. but, i agree with mircea_popescu and yourself that concrete merits are to be discussed. maybe it's not needed.

Framedragger: i mentioned js in relation to WoT as it's more applicable there (lots of ready-made libraries for discrete graph visualizations and so on)

ben_vulpes: i too would like more detail in re 'shall provide a platform for those interested in analysing RSA keys'

asciilifeform: the most i can offer to anyone is a static copy of the db. and that is supposing that the box comes back up, and stays up.

asciilifeform: (backups are a monthly affair, any more often would -- again -- grind whole thing to a screeching halt)

ben_vulpes: 'read only sql users to a replica of the phuctor db' is, while an interesting project, not wanted by the people doing most of the analysis afaict

asciilifeform: ben_vulpes: the main thing wanted by 'people doing most of the analysis' is a BOX THAT STAYS UP

ben_vulpes: replication works on the wal, not on the committed db, and so i don't think it would have the load impact you do.

asciilifeform: them who want mig -- are the lucky'uns. all ya need is a bag of money this-wide and this-tall, and here's yer mig.

asciilifeform: ben_vulpes: heathen-facing publicationtron is inherently contradictory thing . ☟︎

Framedragger: ben_vulpes: i'll think about this next week. it may be that it's not really needed, yeah - i agree. and integration of things such as ssh server banners with phuctor keys is something that asciilifeform said he'd be up to do on phuctor's db itself..

asciilifeform: Framedragger: all of this is quite academic if thing cannot be made to reliably stay up.

ben_vulpes: Framedragger: i am also curious to know what kind of requirements you have for a vps that your current loggotron doesn't serve. ☟︎

asciilifeform: (and , for folks with poor reading comprehension, i will repeat - entire box is ~unreachable, trb node, ssh, 80, etc )

mod6: Framedragger: so with regard of the wotperson to wotperson (http://www.btcalpha.com/wot/trust/?from=mod6&to=mircea_popescu) and all ratings to wotperson (http://www.btcalpha.com/wot/user/mod6/); I think we liked those very much as they were. Of course any sort of improvements could be added if they make sense, etc. ☟︎

mod6: I think the idea would be to get back to some sort of analog of what mike_c had in place. And then add improvments as necessary.

mod6: This would be a really great project to work on, we're long overdue to get this working with deedbot, etc.

mod6: <+trinque> Framedragger: ben_vulpes: it probably makes the most sense for me to do the WoT browser << perhaps. i'd be up for anything really at this point.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570685 << it pings with ~2-300ms, however i see no web interface. ☝︎

a111: Logged on 2016-11-19 15:36 asciilifeform: is it just me or does nosuchlabs.com not ping ??

mircea_popescu: 31 packets transmitted, 31 received, 0% packet loss, time 30040ms < you actually can't ping it ?

mircea_popescu: well... so you want me to what, datacenter reboot ?

mircea_popescu: i can tell you what wtf right now : learn not to overload box.

mircea_popescu: weren't you just saying it's barely standing ?

mircea_popescu engages in this exercise.

asciilifeform: the box per se is ultra-responsive, even when 'werker' is firing (i leave a core open)

Framedragger: http://btcbase.org/log/2016-11-19#1570801 << just to confirm that this was trinque saying he'd be up for doing it, and yeah sounds good :) ☝︎

a111: Logged on 2016-11-19 17:30 mod6: <+Framedragger> trinque: fine with me << settled then?

Framedragger: mircea_popescu: (syn flood suspicion because sockets don't respond with anything, even when possible to establish tcp connection. and yes ping does seem to work.)

Framedragger: http://btcbase.org/log/2016-11-19#1570793 << current loggotron also runs on vps, and in itself it requires very few resources. no db use, even. at this point there's a bunch of stuff and other people's sites running on that vps, i don't feel comfortable adding additional load. ☝︎

a111: Logged on 2016-11-19 17:18 ben_vulpes: Framedragger: i am also curious to know what kind of requirements you have for a vps that your current loggotron doesn't serve.

mircea_popescu: asciilifeform the wisdom of having the data in a cheap vps is becomingf ever more apparent.

Framedragger: because 1) other sites' experience may be impacted, and 2) phuctor db would place some load on things. why = because i'd create a few indices, those would hog some memory, and assuming users want to do quite a bit of sorting etc, would take some cpu time as well. just sayin'. nothing scientific.

asciilifeform: mircea_popescu: cheap vps will fall down just as readily when flooded (as will the trb node, mine or anybody's)

asciilifeform: i will point out that, unless the box has been stolen, it is still processing keys at same rate

mircea_popescu: yes, but much easier to a) have a lot b) move around

mircea_popescu: yes, but there are two concerns that are separable : a) flood stops processing and b) flood stops display.

mircea_popescu: phuctor wasn't ever so snappy on display even when it was accessible.

Framedragger: to the point of having a ready-made system image (no, does not imply need to use docker), deployable at vps center in a matter of minutes.

mircea_popescu: and the ONLY thing that interests the shitgnomes is display.

mircea_popescu: they really couldn't, and didn't, give a shit about phuctor working throughout the years it worked.

mircea_popescu: what hurts is you know, omfg, PEOPLE CAN READ!!1

mircea_popescu: hillary clinton is not worried about raping brown babies.

mircea_popescu: she just doesn't want anyone to see it is all.

Framedragger: mircea_popescu: display/processing separation is why i mentioned http://btcbase.org/log/2016-11-19#1570743 ☝︎

asciilifeform: the 1 minus is that the -- already quite costly apparatus -- would cost yet moar.

mircea_popescu: in a sense it is "social responsibility", ie, "the data was provided, what did republic do with it".

mircea_popescu: Framedragger i've not yet got through the log because parsing threw exception on that line i quoted :D

mircea_popescu: nono i was being metaphorical. exception in my head.

Framedragger: asciilifeform: wouldn't be sure re. costs. vps can be $5/$10 a month, and stuff i used for ssh key crawling (scaleway) can bill hourly

asciilifeform: Framedragger: db would have to exist locally on the vps, for the thing to work more or less reasonably in real time

Framedragger: i'm not saying that going for cheapest ad-hoc option is accetabru. just, a display box showing static content needs much less.

mircea_popescu: asciilifeform he just wants the popped stuff.

mircea_popescu: which is k of records * 10kb or such, not the end of world.

Framedragger: even if more than that - all of that shit can be cached, static html pages. maybe i'm oversimplifying.

asciilifeform: 'just popped' means that you can no longer use it, as previously suggested, in place of sks, for instance.

mircea_popescu: aha.

Framedragger: have a way (rss or better version of rss, or whatever) to sync it every $n hours.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570692 << lol if so, more work needed. ☝︎

a111: Logged on 2016-11-19 15:52 asciilifeform: the folx whose chumpnet we blew open, with the debian boxes, i suspect -- trying to make their displeasure known.

asciilifeform: though then you want to see the unpopped subkey siblings of the popped moduli, and start clicking, and you'll get zip.

mircea_popescu: asciilifeform no, those link back to phuctor.

mircea_popescu: it is html after all.

mircea_popescu: so ?

asciilifeform: currently they are generated programmatically. will have to rebake whole thing such that they exist as static texts on disk.

mircea_popescu: any collection of data will have to consist of references to other sources at the edges

asciilifeform: i really ought to have made entire thing a c proggy that shits out static html once in a while.

mircea_popescu: like hourly or such, could work yea.

Framedragger: with regards to vps i could help, if help/hands are needed. i know you have other priority stuff asciilifeform. also, don't know what the meta-priority level here is. (i.e., compared to other projects etc)

asciilifeform: Framedragger: dunno if you read the broadcasts, but we have an actual product rolling off conveyor as we speak.

mircea_popescu: in other wtf : all https://archive.is/http://phuctor.nosuchlabs.com/phuctored are from the same one day in may ; while all https://archive.is/http://phuctor.nosuchlabs.com/ are from the same one day i nseptember.

asciilifeform: my hands presently are quite full with polishing off the prospectus for said item, and www page / invoicetron.

mircea_popescu: this is pretty retarded.

asciilifeform: mircea_popescu: there is an independent snapshot on my blog, also. but also a month old.

mircea_popescu: and all-phyuctor snapshots are like this : 1 from nov 14. three from nov 3 . two from nov 1.

mircea_popescu: fucking worthless, really, there's a total of SIX links to phuctor that went in chan this month ?

mircea_popescu: i.... think not.

asciilifeform: i dunno that anyone other than google and yandex ever made a ~full phuctor~ snapshot.

mircea_popescu: asciilifeform we have a bot run by peterl which supposedly snapshots EVERY LINK IN CHAN

Framedragger: asciilifeform: (instead of doing a more obscure "query-able phuctor-and-stuff db" thing i could help with some kind of phuctor-public-display-vps infrastructure setup. just sayin'. thing's not clear in my head.)

asciilifeform: mircea_popescu: for quite some time, the rss thing did not display clickable links in chan for phuctor due to overflow

mircea_popescu: a damn that's also there.

asciilifeform: Framedragger: the fundamental problem is that i will have to rewrite WHOLE THING for any of this to possibly happen.

mircea_popescu: trinque http://btcbase.org/log/2016-11-17#1568940 ? ☝︎

a111: Logged on 2016-11-17 15:06 mircea_popescu: trinque can deedbot rss parsing be unprincipledly altered so that any succession of alphanum characters in excess of 16 spaces is replaced with first4[...]last4 ?

asciilifeform: mircea_popescu: that would make problem even worse, could no longer search logs for a gpg fp

mircea_popescu: yes you can, by that format.

mircea_popescu: you can't search worth a shit right now because overflow.

mircea_popescu: ie, you don't get to see ip or link. which /.... so search, what's it do.

Framedragger: asciilifeform: why can't a separate box be set up to just crawl through all of phuctor pages, and then determine which of them are 'static' / won't ever change, for starters. and re-query the dynamic ones (at least the /phuctored) every $x amount of time

mircea_popescu: no, not rss overflow. line overflow.

mircea_popescu: if you have a fp or w.e and wanna see go to phuctor.

mircea_popescu: Framedragger your scriba could crawl all links in chan and archive them. phf said a while back he almost has this but i've yet to see it

Framedragger: asciilifeform: and the permalink pages identifiable via fingerprint, are they generated by the flask backend, too?

mircea_popescu: and if there's to there's no loss. ☟︎

mircea_popescu: we fucking need this archival of links in chan, like years ago.

Framedragger: (i thought someone was supposed to retroactively archive all links in all logs of all times?)

mircea_popescu: that someone utterly failed at that task, as push coming to shove proves.

Framedragger: mircea_popescu: right, will get it done. i had started on it, got sidetracked by the python encoding problem, and the got sidetracked by other stuff. need to re-trace, and will first do the archival bit.

mircea_popescu: or saving copies locally, or whatever.

mircea_popescu: ~what you were planning to do above.

Framedragger: (again, many phuctor pages will simply timeout, iirc. but maybe can adjust; and still worth doing.)

mircea_popescu is pretty fucking annoyed that the MOMENT the slightest disturbance in the force occurs, we suddenly discover there was really 0 defense in depth.

mircea_popescu: "oh maybe i have a page from 2005 somewhere"

mircea_popescu: yay for the home team!

mircea_popescu: "oh it's on phuctor and why do i need to do anything", which is how we got "those debian experts are flyeyeing the code so why should i have a clue".

Framedragger: asciilifeform: have you profiled an http request to a permalinkable phuctor page? where's the bottleneck? curious if you could insert a thing into flask which crawls through everything and stores locally.

asciilifeform: and, to continue to rain on the parade, if every www site has to be run like mpex, it will cost. and the range of things that can be provided 'for the public', 'for phreeee', will correspondingly shrink.

asciilifeform: Framedragger: db being hammered 24/7 with 'do we have this hash' 'do we have this fp' 'add this and this' 1000/sec is the bottle. ☟︎☟︎☟︎

a111: Logged on 2016-11-19 16:58 ben_vulpes: Framedragger: if you go down the 'phuctor visualizer/dash' route, you might consider leaning on pg streaming replication

Framedragger: quite sure the diff'ing / updates were thought out thoroughly, i.e. time complexity is constant.

asciilifeform: Framedragger: you do not seem to understand, so i will give illustration: http://www.swapmeetdave.com/Humor/Workshop/Lumber-Car-A.jpg

asciilifeform: we are at the farthest possibly limit of what can be done on one box, at anything like reasonable budget (whether paying the cost of a small european flat for a server for public service is 'reasonable' is separate question) ☟︎

asciilifeform: understand, if phuctor were an american 'corporate' production, it would make use of at least entire RACK of boxes

asciilifeform: because, for instance, the key-eater is a separate process. and has nfi that someone else wants the db.

Framedragger: i have no doubt that a sillicon valley version would be a datacentre of mongodb nodes which constantly fail and corrupt data, and cost millions. :)

asciilifeform: it is a db of ~5 mil KEYS, each of which is from 1 to 20kB, and links, etc.

asciilifeform: and moduli, stored separately, linked bidirectionally to/from keys, ditto factors for same.

Framedragger: i'm sorry but you didn't convince me in regards to the 'amount' of data. > 100mil row postgres with > 100 gb of data in a 8GB ram server ran fine. and while phuctor may be a more demanding beast, shouting '5 mil keys, MILLION!' doesn't convince

asciilifeform: whenever ANYTHING is added , it first has to be searched for in each of these classes of item, in the case that it may already exist there.

Framedragger: i'm thinking whether it'd be worth it to just have a static replica of db-as-it-currently-is, for now. as in for "i want to touch data, there's an outdated html file on loper-os i guess?" cases.

Framedragger: stop web app and other stuff, copy /var/lib/pgsql/data, start web app again, use data to set up separate db.

asciilifeform: Framedragger: you are welcome to a copy of db as soon as i get my hands on it again

Framedragger: asciilifeform: of course. and also don't treat this as high priority, i prolly wont look at it before wednesday anyway. but would be interesting to take a look - and i'd take a look

mircea_popescu: asciilifeform "process fastwerker is killing the box, would you like reboot"

mircea_popescu: and unless maz actuallty reads the logs instead of doing his work, I TOLD YOU SO

mircea_popescu: get out of here. how do you propose came up with name ?

mircea_popescu: Framedragger kvm.

mircea_popescu: dude... renice works half the time.

mircea_popescu: it's not like it offers some sort of hard guarantees.

mircea_popescu: so ?

mircea_popescu: it's a fucking computer.

mircea_popescu: anyway, make a call, do i have it rebooted or let it be for a while and see if it digs itself back out ?

mircea_popescu: such pdp-10 problems we're having in 2016.

asciilifeform: also i will add, 'werker' saturates 15/16 cores for 20 MINUTES of any given runtime.

mircea_popescu: apparently - not.

asciilifeform: so this story (and how the fuck does the monkey know process name ?) holds 0 water.

mircea_popescu: also at issue is something called "fastwerker". that the same thing ?

mircea_popescu: alright.

mircea_popescu: ip-kvm will show you a sort of top.

asciilifeform: but i dunno that anyone other than mircea_popescu had any business knowing that the process were called.

mircea_popescu: well, until you insisted i ask, nobody did. once i ask, they gotta do specific things.

mircea_popescu: sometimes i wonder how you think computers work.

mircea_popescu: it's a fucking admin interface bridged into the fucking bus, what the everloving shit would it care about your derpy os's notions of "users". as if those fucking EVEN WORK irl. ☟︎

mircea_popescu: bejaysus.

asciilifeform: how would mircea_popescu react if one of his gurlz misplaced her undies, and his landlord came and said where they were ?

mircea_popescu: asciilifeform in point of fact i have asked the public force to locate car drunk ho abandoned "dunno where". they did. i didn't throw a shitfit about "o noes surveillance state". this because a) i asked them to do it and b) obviously they just put the number in the stolen cars interface and then a patrol saw it.

mircea_popescu: now stop thrashing about, write better code in general and make the above call so this can go on.

asciilifeform: the code has guaranteed run bounds. so i cannot make any comment re 'in general', there is nothing to fix.

mircea_popescu: there is no such thing as code with guaranteed jack shit on linux. next question.

asciilifeform: let'em reboot. and i will start on the sawing-apart of the werker and wwwtron as soon as my hands are again free.

mircea_popescu: least concern, for srsly.

mircea_popescu: though i must confess syn flood had a better ring to it altogether.

asciilifeform: and idiot monkey ~will~ see 'cpu utilization 95%' and think 'killing the box'

mircea_popescu: you probably ran into a disk or io locks issue.

mircea_popescu: ie, ssh moduli breakage didn't sink phf's lisp-frail stack. but it did sink YOURS

mircea_popescu: mwahaha > 9k

mircea_popescu: aha.

mircea_popescu: i dunno that they actualy bother keeping it for client managed boxes.

asciilifeform: btw werker uses db for approx. 40 seconds of a run, to dump keys, which subsequently all load into memory.

Framedragger: but yeah, i've noticed that sshd works just fine (incl accepting new connections) even if cpu at ~100% and/or no free disk space. there's that. ☟︎

Framedragger: (i remember having use from a super stupid `free > memory.log` cron job every minute or so)

asciilifeform: ever since the theft of the original phuctor machine, i keep scrolling logs on SEPARATE LCD in real time, 24/7/365

Framedragger: by the way, i haven't ever used it, but from reading around it appears that streaming replication may indeed be quite efficient. every time row is inserted, row is sent off to remote replica. but this does not really require cpu. so maybe it wouldn't slow things down further / wouldn't be particularly slow even if db being clobbered 24/7

mircea_popescu: http://btcbase.org/log/2016-11-19#1570707 << well sure, and so will your eyes. ☝︎

a111: Logged on 2016-11-19 16:07 pete_dushenski: of lines of code and that many chinese sensors ~will~ fail at some point. and it will be unexpectedly. and catastrophically.

asciilifeform: incidentally i have machines right here in my house subjected to far harsher loads , 24/7/365, and somehow -- mysteriously -- they never ONCE suffer 'martian' failures.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570724 << well http://qntra.net/2016/11/phuctor-reveals-1-in-2700-ssh-capable-machines-on-the-internet-still-debianized/ was yesterday. this is the internet, gotta move with the minute. ☝︎

a111: Logged on 2016-11-19 16:16 asciilifeform: i wrote, in the qntra piece, 'examine debianized boxes for nsaware'. now 'owner' will have a chance to clean up before any mass 'examination' takes place.

asciilifeform: a 'welded shut box' + dc supplies GB pipe + mains current dc would be mega-product.

mircea_popescu: of course you did ? iirc we discussed processor make etc way back when selecting ?

mircea_popescu: uh. i still wonder how you think computers work.

mircea_popescu: apparently the divergence is winder than previously realised. anyway - ipkvm capable chipsets come with ipkvm.

mircea_popescu: what exactly did you think you were asking when you asked for the dc to kvm in your box and fix it for you ?

mircea_popescu: this costs ~200 an hour you realise.

mircea_popescu: sounds very much like 1998.

mircea_popescu: anyway. in the intervening years there's this new approach that dcs favour because cheaper.

mircea_popescu: it doesn't log in ; nor does it interact with your os.

asciilifeform: (this is not hard, but gotta wonder , what , this is sop in commercial kvm chip nao ?)

mircea_popescu: afaik it can't actually dump ram or do useful debugging. but it can reboot the system, which is you know, a crossed wire.

asciilifeform: i had occasion to install such a machine a few yrs ago, somewhere, it came with 'kvm chipset', but this feature was not advertised. the advertised feature is just that, kvm, where you get a tty prompt.)

mircea_popescu: sort-of. by now they have derpy guis for it.

asciilifeform: physically it ~can~ dump ram, research proj i led at the time investigated how to coax it to do this, among other things

mircea_popescu: not saying it's not possible, but in practice above pay grade of most dc techs.

Framedragger: (this is a case where i am more cynical than asciilifeform: a DC you don't know, what illusions does one have; okay, one could install a sensor which signals if box was 'tampered with'; they could still take box offline, clone memory, set up a replica. etc etc etc.)

mircea_popescu: http://btcbase.org/log/2016-11-19#1570729 << logically public projects can stay ownerless, but private ones should have assignable owner. ☝︎

a111: Logged on 2016-11-19 16:36 mod6: Anyway, now that it seems that private a more rich ticketing system is wanted, these things can be considered for sure. Salud!

asciilifeform: Framedragger: which is why 'comes offline' is enough misbehaviour from my pov.

mircea_popescu: asciilifeform you gotta learn to judiciously allocate your time ; Framedragger the problem isn't so much locking up the box - it's that the box will fuck up, this being "foss" bullshit, and then the owner will be like "i dun wanna pay for a box i can't use, notwithstanding this is what i claimed i want".

Framedragger: asciilifeform: then, i think, box needs to physically reside with someone in your WoT. i'm just saying. maybe cheap slippery slope sophism.

asciilifeform: and i will add that , aside from the login keyz, there are 0 secrets on the box.

mircea_popescu: point in case here. it is beyond even the shadow of the most absurd doubt that alf's code locked the box. but he's willing to spend time fighting the obvious, rather than anything else, because hey, this is a bitter pill to swallow.

mircea_popescu: i'm not for a second saying HE could have done much better / differently.

mircea_popescu: but the point remains, mtbf in linux world is NOT years.

mircea_popescu: and yes, we're woprking on fixing this. the work is wide, and we can't get over, some handsome rovers from town to town etc.

asciilifeform: mircea_popescu: mtbf of the linux boxes at my ~house~ is measured in years... why do you suppose is this.

mircea_popescu: laters.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570742 << that's pretty much exactly the idea. ☝︎

a111: Logged on 2016-11-19 16:45 Framedragger: i suppose the idea could be to re-implement that, but using deedbot's view of WoT, and add additional things as desired.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570744 << works on my system. pretty. can certainly be an alt-view or such, killed nobody. ☝︎

a111: Logged on 2016-11-19 16:57 Framedragger: re. visualization, i like stuff like this (mouse over on labels around the circle), but it's a hella lot of JS, and i share the hate towards the latter: http://bl.ocks.org/mbostock/7607999 - what's nice about btcalpha visualization is that it uses by-now standard html5 canvas directives (<path>) with no need for JS.

mircea_popescu: might discover it fails via resource exhaustion in the very large dataset that is tmsr wot, but who knows. worth a shot.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570755 << yes, but you're doing the payments lol. stale data is no good, but wait-forever project even worse. the trade-offs of resource investment! ☝︎

mircea_popescu: http://btcbase.org/log/2016-11-19#1570756 << js-based thing can not be the thing. it can be an optional expansion on the thing. ☝︎

a111: Logged on 2016-11-19 17:03 Framedragger: regarding visualization, a more condensed question: if a javascript-using thing were delivered, would this be hated upon (and berated by asciilifeform) and accepted if otherwise good and properly maintained, or hated upon and dismissed (and berated by asciilifeform)? :)

Framedragger: re. JS, yeah makes sense. and http://btcbase.org/log/2016-11-19#1570796 << thanks for the feedback! (and i agree regarding comments, preferences make sense) ☝︎

a111: Logged on 2016-11-19 17:24 mod6: Framedragger: so with regard of the wotperson to wotperson (http://www.btcalpha.com/wot/trust/?from=mod6&to=mircea_popescu) and all ratings to wotperson (http://www.btcalpha.com/wot/user/mod6/); I think we liked those very much as they were. Of course any sort of improvements could be added if they make sense, etc.

mircea_popescu: tbh i think javascript is not ever hated in the context of its original domain, "make drawn man move his arms" ; it's whenever it tries to be other things that it draws ire.

Framedragger: sure. "javascript in the backend", etc etc etc.; i mean, it's still a horrible language. but yeah.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570790 << amusingly enough, this is actually true. "i would like to lecture these monkeys in modern psychology" "ok ?" "can you design a shitproof semipermeable membrane that still allows my precious words to reach them ?" "uh. not really. whatever the fuck it is, sooner or later the shit will clog it" ☝︎

a111: Logged on 2016-11-19 17:17 asciilifeform: ben_vulpes: heathen-facing publicationtron is inherently contradictory thing .

BingoBoingo: Framedragger: Wot browser must also maintain existing url structure to retrieve a nick's profile

Framedragger: BingoBoingo: k; but direct this at trinque, unless he gets convinced that he wants to do things sequentially and in payment-system-first order :p

Framedragger: or one could even dare to develop something collaboratively, but the republic would surely segfault then. ☟︎

BingoBoingo: WoT browser is like log viewer, who the fuck cares how many there are so long as there is a non-zero number!

Framedragger: yah but there's also enough of stuff to be done :) if trinque does WoT browser i won't do in parallel just so that there are two

mircea_popescu: Framedragger technically yes you can - make a V root for it, like properly sane people, then he'll just import that / patch it himself when he's ready.

mircea_popescu: we have V specifically so it saves us from this box-owner / code-writer confusion.

mircea_popescu: not that there's anything wrong with running your own service on your own box. but the pill for collaboration exists and is used.

BingoBoingo: There will always be enough stuff to be done in the future. This is not a reason to not make things and move into the done category.

mircea_popescu: learning to write code so that other people ~actually find it better than writing themselves~ is squarely in that http://btcbase.org/log/2016-11-17#1568870 bracket. ☝︎

a111: Logged on 2016-11-17 14:43 Framedragger: (and on a side note, "hang out on #trilema after splitting with gf" has been one of the more constructive choices i've made in my life)

mircea_popescu: and from my pov, V is truly great in the sense that it allows a very simple test for when april next rolls around. phf's viewer trivially allows to see what signatures are actually active in the deployed branches of republican code. join that set with the set of box owners and you have a very good first approximation of the l1.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570931 << and if there's two* i meant lol. ☝︎

mircea_popescu: http://btcbase.org/log/2016-11-19#1570951 << for the record, separate dbs for selects and inserts is the way to go. from experience it can rescue a large project / save 9x% off the hardware costs.the way you do it is that you have a master db copy which is the only one that takes the inserts, and slave dbs which are the only ones that take the selects. replication can be at dedicated sql cluster level or above, slave dbs can ☝︎

a111: Logged on 2016-11-19 18:52 asciilifeform: Framedragger: db being hammered 24/7 with 'do we have this hash' 'do we have this fp' 'add this and this' 1000/sec is the bottle.

mircea_popescu: be marked as dirty after each insert if need be etc. possibly phuctor has grown industrial enough this is actulaly needed.

mircea_popescu: http://btcbase.org/log/2016-11-19#1570960 << for the record, phuctor costs more than what renting house costs in romania. flat - maybe in frankfurt or something. ☝︎

a111: Logged on 2016-11-19 18:55 asciilifeform: we are at the farthest possibly limit of what can be done on one box, at anything like reasonable budget (whether paying the cost of a small european flat for a server for public service is 'reasonable' is separate question)

mircea_popescu: lol. yeah, might work here, it's not clear. the problem, you have to understand, is how integrated the data is. sure a db with however many lines did fine in whatever box. the problem is that everything phuctor has, phuctor uses, and so it's very close to the unmitigated nightmare which is "random access"t

mircea_popescu: in general db optimization / low consumption success stories rest on a very opposite situation - the lines are only ever interesting in one perspective and light only lights one facet at a time sorta things.

mircea_popescu: a similar situation to how compression works great on literature and poorly on (proper) random strings.

Framedragger: this reminds me. you know, sometimes postgres prefers to do sequential read instead of using a reasonable index, because, as it estimates, using index would involve too much seeking etc. *but* with SSD, random access is much much faster. (and btw postgres does not automatically know about seek times in SSDs..)

mircea_popescu: i dunno that alf is a db engineer by trade, so it's entirely possible specific measures could help, especially if they're of the magic number ilk of "set X to Y in config file, we didn't docum,ent this anywhere but its tru!"

Framedragger: anyway, i imagine a bunch of d(a)emons fighting for i/o... and yeah no one is saying that there's a straightforward solution...

mircea_popescu: the entire stack is built pretty much to create this - first, we have a phuctor, and 2mn keys looks like the whole world, and any finds look improbable as shit. then some finds are found, and more keys are fed, so now 50mn looks like the whole world and a few finds a day are expected. BUT THEN a way is found to crack thousands of keys in a week, and well, the echafaudage which held up the original is struggling.

mircea_popescu: whoopdedoo, you push it until it dies by design then you wonder it dies now and again.

deedbot: http://www.contravex.com/2016/11/19/why-you-cant-afford-globalisation-anymore/ << » Contravex: A blog by Pete Dushenski - Why you can’t afford globalisation anymore.

mircea_popescu: http://btcbase.org/log/2016-11-19#1571048 << it's not a matter of "cpu at 100%" nor is it a matter of free disk space. if on that os ssh hangs off eg dbus, and if dbus gets locked out by kernel because "dirty page" or "waiting on journal update" or whatever similar idiocy, your process is stalled. and these are just random examples, so much can go wrong in a modern box it's not even worth my time drawing the broad strokes. ☝︎

a111: Logged on 2016-11-19 19:31 Framedragger: but yeah, i've noticed that sshd works just fine (incl accepting new connections) even if cpu at ~100% and/or no free disk space. there's that.

mircea_popescu: and in other red cups, http://68.media.tumblr.com/f08279648ba09a168f9102da18af85d8/tumblr_mslu6c6xEq1ro2gueo1_1280.jpg

mircea_popescu: *thumbsup*

mircea_popescu: bwahahaha

mircea_popescu: clearly that archive.is thing needs replacement.

Framedragger: (this explains why PeterL's or whoever's thing used to work, but stopped. i think this is recent.)

Framedragger: owait, curl still works. apparently "<h2 data-translate="what_happened">What happened?</h2>\n <p>The owner of this website (archive.is) has banned your access based on your browser\'s signature"

Framedragger: so i'll pretend to be someone else, but clearly this is not tenable long-term.

mircea_popescu: anyway, having scriba simply curl http://qntra.net/2016/11/st-louis-homeless-overdose-on-fake-weed-as-the-great-again-looms/ > 20161119.18 in response to http://log.mkj.lt/trilema/20161119/#18 is both useful and roughly sufficient.

mircea_popescu: then it could bundle all of these together in a base64'd blob each week and deedbot them.

Framedragger: i suppose so. do note that archive.is attempts to retrieve additional resources, including js needed for rendering some sites, etc etc.

mircea_popescu: this isn't a replacement for archive.is, but more of a defense-in-depth measure.

mircea_popescu: i'm still giving phf his space to figure out his feelings re lisp archive.is

Framedragger: okay. i'll first do archive.is as i think i just need to change user-agent, and then some time next week can set up curl + bundling thing.

mircea_popescu: it's metrosexprual.

mircea_popescu: and yes, putting an -A "TMSR agent ; contact X for discussion" on all curls can't hurt anything.

mircea_popescu: as it's exactly the sort of you know, "advertising enigmae" you were talking about yest.

mircea_popescu: in other horror stories, http://wotpaste.cascadianhacker.com/pastes/jt7n2/?raw=true

mircea_popescu: "will this fix my problem ?" "no, but it will give it color."

mircea_popescu: speaking of which, /me walking noticed an interesting flower, long, trumpet like. plucked it, smelled it, very nice smell. checked it out on the internets - it's datura. grows wild here.

mircea_popescu went and washed hands.

mircea_popescu: yeah. "mataperros" here.

mircea_popescu: what roanoke ?

mircea_popescu: really ? i didn't think it grew where it frosts.

mircea_popescu: also i dunno anyone'd wanna try get high on this, iirc mostly scopolamine.

mircea_popescu: d. inoxia i think it was.

mircea_popescu: in any case white flower, plain leaf.

Framedragger: i think some folks in .lt used to (attempt to) get high on it, to obtain some or other state of delirium

mircea_popescu: tropane alkaloids aren't usually abused recreationally, because well... not what people usually think is fun.

Framedragger: huh apparently may still be used in some neopagan 'rituals'. citation needed tho

Framedragger: but then, people take that salvia thing, whatever it's called, and apparently better part of all experiences end up with dissociative-of-not-the-nice-sorts delirium state..

mircea_popescu: i actually planted a bunch in romania, for the flowers.

mircea_popescu: it doesn't log in correctly you know.

mircea_popescu: o nice.

mircea_popescu: pete_dushenski : update for http://bots.contravex.com in order :)

mircea_popescu: !$ archivestats

mircea_popescu: seems to be fine.

Framedragger: mircea_popescu: um. while it will not increase "number of URLs newly archived" if URL is actually not valid as reported by archive.is, but it *will* get increased for the same URL, even if archive.is had already archived it.

mircea_popescu: i dun see the problem either way.

mircea_popescu: lol ?

mircea_popescu: ehehe

Framedragger: wanted to check by going to actual archive.is and seeing if the new url got archived, and when. (all good).

mircea_popescu: https://www.youtube.com/user/HarrisHarrington << this just takes the cake of poptardation. so here's a guy too young to have an undergraduate degree doing self-help posturing over youtube.

mircea_popescu: who the everloving fuck can live in this world where the yearlings think themselves experts in things jesus f christ!

mircea_popescu: that they give each other advice on "how to talk to girls" on the basis of you know, one of them actually once did it / someone once overheard someone doing it is one thing.