BingoBoingo: <asciilifeform> mircea_popescu: so far all i know is that the thing rebooted without sanction, no fewer than 3x. << It breathes ever so slightly better than it did before the opening and fan check
mircea_popescu: i dunno, man. if i ran a moron empire with delusions of "pen devices" etc, it'd do precisely the sort of inept rebooting.
a111: Logged on 2019-01-14 04:15 mircea_popescu: i'd like a computer where i didn't have this sort of problem.
shinohai: I still have nfi why the bullet barf, diana_coman says it has to do with proximity things. Hopefully I'll get some time in game to see if negative effects occur.
shinohai: (Also have companion trb piece, but was waiting for mod6 's keccak regrind)
shinohai: Haven't completed build yet since mod6 published, but have tried the old method which unsurprisingly went fantastic.
shinohai: Cuntoo is simply a joy to use.
hanbot: well, this is my 3rd iirc restart of znc in two days, slightly more interruption than the problem i started using znc on UY1 to fix posed. looks like no prognosis yet eh?
lobbesbot: hanbot: Sent 1 day, 10 hours, and 22 minutes ago: <billymg> mp-wp patches have been updated:
http://billymg.com/2019/01/minor-mp-wp-patch-updates/ -- the only \ No newline at end of file strings you should find in .svg refs patch are from before part of the diff (i.e. file diffed had no newline at the end)
trinque: conspicuous bit is various folks having moved their comms aboard uy1
BingoBoingo: During palm touch tests before cleaning fans the warmest part of the chasis was near the RAID card, by a margin that though small registered on my skin. Do we have a way to instrument the RAID card.
trinque: but you know, pattern-seeking primate amidst randomness
trinque: ftr I don't need a month's comp for a few hours of outage, though a few hours of outage does suck.
mircea_popescu: the one concerning bit is whether indeed pizarro still owns that box or not.
BingoBoingo: trinque: My though on the month is that the money being paid for shared hosting is very real to our customers, and we lack a firm hour count on how many customer uptime hours have been lost.
BingoBoingo: <mircea_popescu> the one concerning bit is whether indeed pizarro still owns that box or not. << This very much concerns me
mircea_popescu: asciilifeform well no, original box had a chain of custody, and a history of predictable behaviour.
trinque: BingoBoingo: signaling my willingness to pay, not my condoning of the outage.
mircea_popescu: this stance is consistent with, inter alia, republican practice -- we moved variously boxes off providers who kept rebooting them "mysteriously"
mircea_popescu: so then as a factual matter, if asciilifeform threw out erry box that rebooted "by itself" for no apparent reason, pizarro would be missing uy1
mircea_popescu: i confess i have nfi what makes you think commodity hardware failed in this case.
mircea_popescu: outside of hard drives, and capacitors on OVER FIFTEEN YEAR OLD motherbopards, i have not witnessed this wonder myself, of failing hardware.
mircea_popescu: i'm confused, you bought used ram ? i seem to recall a discussion...
BingoBoingo: From what I understand the ram came with the chassis
mircea_popescu: weren't you shipping a bunch of new rams to make it ?!
mircea_popescu: i never saw a mobo bust a cap and then boot by itself again tho. besides, he'd see a busted cap i imagine.
mircea_popescu: so to get this straight, your "most likely explanation" points to... ram failure resulting in kernel panic... twice ?
mircea_popescu: (i think the third reboot was actually you guise, or not ?)
mircea_popescu: ie, a fan stoppedf by itself, and then started working again, by itself ?
mircea_popescu: indulge me. so the theory goes that an event with a probability inferior to 1e-4 / day occured three times in two days ?
mircea_popescu: asciilifeform this observation merely begs the question of "why".
mircea_popescu: asciilifeform i did. let me tell you how it behaved : box went down. upon reboot it went down again, in the following manner : every time it was rebooted, within a finite time interval (bout an hour). no exceptions.
mircea_popescu: and then, when i went to clean it, i found it dirty ; as opposed to clean.
mircea_popescu: photo or no photo. did you take your own weight in gunk out of the fans over there ?!
mircea_popescu: i ~also~ find it peculiar your dc wouldn't have alerted you in case of thermal trip. because in general they have sensors.
mircea_popescu: the isle cooler tends to notice if rack x is spewing out 200C
BingoBoingo: I took off a light layer of particulate. When I opened the chassis I found it matched the photos from when the FG were installed.
mircea_popescu: i suppose this is an academic discussion. in any case, i've had warnings re hot boxes from dcs before, it's not a wholly unheard of item. laser sensor costs ~nothing, and hvac management is 60% of what they do for a living.
mircea_popescu: man. cpu doesn't overheat in a vacuum, gimme a break already.
BingoBoingo: <mircea_popescu> i ~also~ find it peculiar your dc wouldn't have alerted you in case of thermal trip. because in general they have sensors. << There was a ground fault alarm tripped in the datacenterś fire supression system over the weekend, but the time doesn's line up with the beginning of this reset crisis.
mircea_popescu: you ever been in one of those parking lots where they have devices telling you how many free spots per isle/level, and red/green light above the individual spots ? without, magically, having a rod up your driver's ass.
mircea_popescu: same fucking thing is the case in ~every dc i eve rsaw, there's a line of sensors above the racks, and can tell whether box is working 30s, 40s or 70s
BingoBoingo: asciilifeform: I asked. If you have some targeted questions I will be happy to ask them.
mircea_popescu: there's a discrete flow of air from each rack that they measure.
mircea_popescu: you'd just notice box went from spewing 50s to spewing 55s suddenly. or w/e.
mircea_popescu: not proposing this is foolproof or anything ; not strictly speaking ~impossible~ thermal trip went unnoticed.
mircea_popescu: but yes, i run systems which had 0 unexpected reboots, and i've thrown out components / replaced / redesigned systems over unexpected reboots.
mircea_popescu: quite well snapped to the peculiar idiocy of a certain band of peculiar idiots.
mircea_popescu: i recall folks asking, and you saying ok, rather than "you know what... i don't even recall who made this kernel, maybe i remake it when i have time befgore oking this"
a111: Logged on 2019-01-14 16:48 asciilifeform: after we get to the bottom of UY1 issue, i'ma make sure that all iron owned by pizarro has asciilifeform-baked kernel in place.
mircea_popescu: do you suppose bios could benefit from a reflash ? if nothing else, to have thermal / crash logging as expected ?
mircea_popescu: "we dunno wtf happened, i guess to a certain mind events centered on jan 13th suspicious as fuck, we have a new kernel and we redid the bios just in case, dunno what more can be possibly done" is, or atleast i guess will have to be, acceptable.
BingoBoingo: I am inclined to get some sleep for the night. asciilifeform if you dream tonight of questions to pose to the datacenter re: their ground fault which mght be informative, please forward them.
BingoBoingo: asciilifeform: When you book your ticket expect more Spanish/Spanglish because I haven't had a sustained spoken conversation in English since early December.
BingoBoingo: Before I tuck in I will say 3 is the lower bound for reset events. Based on mod6's original report I suspect more.
BingoBoingo: Aite, before I tuck in asciilifeform I'll gpggram you all the trivia observations from the weekend trips to the rack to digest with a rested brain.
lobbesbot: BingoBoingo: The operation succeeded.
hanbot: <asciilifeform> hanbot: when was 'this' plox ? << was my whim to start znc back up then after leaving it off for a ~day following
http://btcbase.org/log/2019-01-14#1886701 , no shenanigans implied. i suppose my wordchoice was unfortunate, sorry for alarms.
☝︎ a111: Logged on 2019-01-14 01:17 mircea_popescu: doesn't that look suspicious.
mircea_popescu: this is not even a bad idea, turn iffy situation itno "help drive rk adoption".
BingoBoingo: asciilifeform: I'd like to hit the idle Rockchip with another round of contact cleaning first, but this sounds like a plan.
BingoBoingo: asciilifeform: Will clean it this afternoon. Loving the marketing potential that yes, Rockchip will happily run many services so long as the RAM is minded.
mircea_popescu: a) there's nothing wrong with specialisation (and especially if you figure out how to expand the ram -- which a stock of these gives you incentive to do, ie, specialisation drives competence) ;
☟︎ mircea_popescu: b) the principal moneymaker for pizarro has been its booked stock of iron
mircea_popescu: i meant, pizarro made more money as a financial vehicle, exploiting fx rates, than as an operator.
BingoBoingo: <asciilifeform> mircea_popescu: a rk + disk is about 100bux ea. << There's also a 4GB RAM model which would push the unit price up to ~150 each
mircea_popescu: " this gives 2 1u slots remaining, they can be occupied by colo passengers, will carry rk plants otherwise"
mircea_popescu: that'll take your rk plant to 6 (extant) + 48 additional ?
mircea_popescu: needless to say, a "we're flyting over 50 rks, gotta fill these THAT WEEK, giving everyone 50% off for 3 months" media event / webhosting forum takeover / etc is de rigueur.
BingoBoingo: <asciilifeform> they gave unmatched 'bang per buck' << Especially when the MySQL storage engine is changed to the WP appropriate option
mircea_popescu: have a nice sale page, clearly communicate what's going on, drive to it. what do you have, like 6 weeks ?
BingoBoingo: <asciilifeform> iirc mod6 has expressed a desire to fly the next crate. if he still wants, can haz; otherwise asciilifeform will fly it. << Given the ben_vulpes courier run I would like mod6's first trip here to be lower stakes. Couriering is a skill.
BingoBoingo: Must carry max weight yes, but having more weight already racked does lower the stakes on subsequent trips.
mircea_popescu: BingoBoingo talk to the various webhosting forums etc (with whom you've build by now a relationship, yes ?) how much they want for a site takeover / w/e they do for the big deal advertising.
BingoBoingo: asciilifeform: This time, don't saw your toothbrush. I can put together a reception basket with human sized toothbrush.
mircea_popescu: and sell it like things are sold, atm it's "just a rumour", mentioned here and there, drums up on the usual human-experience-exponential and so on. "anti-usg hosting", come up with some catchy.
mircea_popescu: "hilary's worst nightmare", use the woman's picture all ugly or scared or w/e.
BingoBoingo: It's a relief to get the Pizarro conversation going again instead of having it stuck in just my head
trinque: "fuck hillary" is way more relevant to your most likely customer.
trinque: the "alex jones" crowd is losing hosting left and right
mircea_popescu: yeah, whining about how "red pillers" or w/e the fuck si the term de jour for inept morons/exterminators singing "i have seen the glory of the bloodletting at the zoo" while driving their beat up truck not reading is one thing. make pretty pictures is another thing.
mircea_popescu: asciilifeform the first fucking move is to establish yourself as a domain expert.
mircea_popescu: what the fuck is a Cristian Rodriguez anyway ?! might as well be schmuck mcsmith.
mircea_popescu: "you should have gone with pizarro" "i did this in 2015, where was pizarro ?" "mkay."
mircea_popescu: amazon is fucked anyway, the time to break the usg.web is now.
mircea_popescu: "here, whole conclave of morons ~can do absolutely nothing~". even if you lose money, you lose money in a way they're worth losing.
BingoBoingo: "Starve Amazon/Google/SVCircus" copy tests well
trinque: the "we slay incas" thing would do better with an explanation of wtf that means in-world
mircea_popescu: short explanation. and short words, in big thick font.
BingoBoingo prepping for rack dive, excited by what follows
a111: Logged on 2019-01-15 00:30 asciilifeform: meanwhile, in darkest lulzafrica, 'Today we’re happy to announce that Urbit’s address space, now called Azimuth, is live on the Ethereum blockchain... We want Urbit to be a reliable, durable, permanent computer that’s simple to use. Today Urbit is still a prototype, not a consumer product. But we’re making great progress'
BingoBoingo: In other news I am satisfied the vacant rk is very clean. Our airflow sensor has also been blown out, tested and rehung on the front door.
BingoBoingo: Datacenter cat is also in good health putting fear into the flying rodents
a111: Logged on 2019-01-15 15:37 mircea_popescu: a) there's nothing wrong with specialisation (and especially if you figure out how to expand the ram -- which a stock of these gives you incentive to do, ie, specialisation drives competence) ;
a111: Logged on 2019-01-15 17:36 asciilifeform: the output is n1 * n2 * ... n_n , cuz you represented'em as ~probabilities~
mircea_popescu: but tbh, the "stochastic convergence test" seems to me worth A LOT more than any bs "ent" ultimately meaningless "squares of pi" bs.
☟︎☟︎ mircea_popescu: (ie, you can construct an infinity of rng strings which'll make a given sct "falsely" converge)
☟︎ mircea_popescu re-read the comment section, from back in 2013, chuckled at random moron who perceived he can write himself the option to not engage mp saying things at him because (some variant of) "they do not display the right formalism" right smack drab in the middle of a discussion about some magical means for ~machines~ to recognize equivalent-formalisms through... magic.
mircea_popescu: how ~the fuck~ is "nock" gonna identify-and-replace-with-jets when ginko417 is manifestly incapable of the very same task ? (or rather, for they psychologically inclined : WHY is it ginko417 imagines dealing with a jet is "nock"'s job ?)
☟︎ mircea_popescu: for exquisite bonus lulz, "jet" is what a romanian speaking slut would say to a romanian speaking drunk moron in a romanian speaking bar, meaning "get the fuck lost".
a111: Logged on 2019-01-15 22:10 mircea_popescu: (ie, you can construct an infinity of rng strings which'll make a given sct "falsely" converge)
a111: Logged on 2019-01-15 22:09 mircea_popescu: but tbh, the "stochastic convergence test" seems to me worth A LOT more than any bs "ent" ultimately meaningless "squares of pi" bs.
a111: Logged on 2019-01-15 22:27 mircea_popescu: how ~the fuck~ is "nock" gonna identify-and-replace-with-jets when ginko417 is manifestly incapable of the very same task ? (or rather, for they psychologically inclined : WHY is it ginko417 imagines dealing with a jet is "nock"'s job ?)