log☇︎
209400+ entries in 0.132s
mircea_popescu: asciilifeform i never can remember which of the ex-relevant colonial powers are not in which instruments. eu except britain, nato aparently w/o sweden, but with norway, there's something else without norway and so on
mircea_popescu: a yeah there they are, 50k contingent. lol.
asciilifeform: hey if there can be a 'latvian army' why not a dutch one.
mircea_popescu: meanwhile the two are economically about the same size, but the dutch army would count as a half regiment of the turkish.
mircea_popescu: after all they're both male, right ?
mircea_popescu: in unrelated lulz, turkish-dutch relations at historic low over dutch deciding they have the power to forbid turkish foreign minister visit the turkish consulate in holland. because hey, if it works on random pick-up artist dork, why not on turkish foreign minister.
mircea_popescu: yeah, basic element of the pile of "lalalacanthear" aka "left"
mircea_popescu: asciilifeform the fundamental problem with "human rights" / "our democracy" ie humanism -- if mothers empower sons to escape fatherly punishment, the incentive on the 2nd sons is to be mothers rather than fathers.
ben_vulpes: Framedragger: "if you care about your data integrity, our tool is not for you" ☟︎
asciilifeform: naggum was afaik the first to formally write down this observation, in his perl essays
ben_vulpes: the endless pile of "i would like to perform what i consider a basic operation of type X" "here have a shell script of awk and sed"
Framedragger: (i'll just mention that for persistent data, you are supposed to use bind mounts, not internal docker storage.)
asciilifeform: Framedragger: you will notice that tools which 'invites lazy people to be even more lazy and reckless' proliferate, whereas ones that penalize shaved chimps for being the worthless biowaste that they are, tend to disappear and then have to be excavated from 1km of dirt, or evaporate entirely ☟︎
ben_vulpes: let us not mention the ever-shifting api, the utter failure of to do MOTHERFUCKING GARBAGE COLLECTION, the miserable and useless state in which it leaves disks
Framedragger: ah i may have read it, did it mention DBs, too, as in "why the fuck would you put db in there"
ben_vulpes: "the hft guy" wrote what i consider the canonical beating, mirrors my experience quite exactly
Framedragger: i have some good memories from using bsd jails some years ago. the core concept of isolation (fs, process, network, etc) is not bad. providing integrated interface not a bad thing, either. problem with docker is it doesn't do it in a consistent way, is too bloated, is ~proprietary +/-, and does the abstraction in a way that invites lazy people to be even more lazy and reckless.
ben_vulpes happy to chime in on docker shit parade
Framedragger: currently stealing booze from that inventory. some good old shit in there i tell you
trinque: !~step1 on the road to recovery!
Framedragger: ah trinque up'd himself just to remind me that docker is shit lol
trinque: that's why they love docker; automated jars of shit
mircea_popescu: "oh, nobody uses X anymore". dude... if i wanted to accessorize i'd just read cosmo.
mircea_popescu: problem with these hipster solutions is they're only good for about half a year.
Framedragger: apparently offloads export/computation to neo4j, a hipsta graph db
asciilifeform: forget about python, nobody wants to wait for two weeks for the result.
Framedragger: ah ah right, not bad then
asciilifeform: Framedragger: ben_vulpes already wrote a block & tx parser, his is the closest we have right now to a usable one
Framedragger: https://github.com/behas/bitcoingraph refers to that paper. it has this tool, https://github.com/behas/bitcoingraph/blob/master/scripts/bcgraph-export , for allegedly dumping transactions for given range of blocks. that tool refers to https://github.com/behas/bitcoingraph/blob/master/bitcoingraph/bitcoingraph.py#L128 which has has a shitty python callstack but boils to
mircea_popescu: no, the 180k html files above
asciilifeform: mircea_popescu: you have a bash script that parses tx ?!
asciilifeform: must've used bci or one of whatever other heathentrons existed in those days.
asciilifeform: 'On May 13th 2012 we downloaded the full public record of this system in one of its two major forms, which consisted of about 180,000 HTML files. After parsing and processing these files, we built a graph...'
asciilifeform: or hm, looks like they didn't
asciilifeform: Framedragger: if i had to guess -- probably by munging bdb
Framedragger: maybe not applicable to trb
Framedragger: asciilifeform: i wonder how these folks did it https://eprint.iacr.org/2012/584.pdf
mircea_popescu: phf aha. quite spurious failed civilisation(s), that continent
asciilifeform: ( i , like complete idiot, wanted to 'let's write a quick c proggy like blkcut' )
asciilifeform: nope, and not likely to any time soon, realized that shitoshi left us blocks where you have to PARSE ALL TX TO SPLIT INTO TX motherfucker
asciilifeform: https://archive.org/stream/HarrisonBergeron/Harrison%20Bergeron_djvu.txt << the 20th c. american take on this.
phf: "you want meaning in your life? lol. here's 50 books of meaningless rituals. that you have to perform daily. the smarter you are the more rituals you get. knock yourself out." ☟︎
phf: it does, hence the daily puja part
asciilifeform: i thought philosophy was supposed to distinguish man from rat
phf: indian philosophy seems to be "if everything's fucked, just eat, fuck and do your daily puja"
asciilifeform: (iirc reiser is what i originally suggested for this experiment)
mircea_popescu: no wonder indian diaspora is so fucking happy. gypsy fucking culture through and tyhrough.
asciilifeform: the 1 fs i know of that MIGHT come close, is reiser
mircea_popescu: these great papier mache roofs that work fine as roofs until it finally rains, heh.
mircea_popescu: so "consumer fs is great if you don't use it". hey, check it out, exactly like the us army, or for that matter cia, apparently.
asciilifeform: and you don't need variably-sized turds, or deletion, or defrag
asciilifeform: konsoomer fs is liquishit. esp. when you entirely do NOT fit the profile of 'konsoomer', who sits and creates file and is happy is it takes less time than for the enter key to bounce back up
mircea_popescu: no wonder "cloud computing" and all the rest of the ineptorade.
mircea_popescu: in other lulz, trilema serves the 350kb zuleika story in ~500ms. FILESYSTEM IS ABOUT AS SLOW!
Framedragger: yeah the sarcasm is probably not black enough tbh
mircea_popescu: i think it's innocent sarcasm.
diana_coman: I took that to be very-much-needed-sarcasm ; Framedragger knows best whether it was still innocent hope instead
mircea_popescu: no i meant the epic "justified by the other amazing parts of the fs, and when we look at the other parts we'll see glorious code that works"
mircea_popescu: (denouement : eulora work is pretty much EXACTLY the above two things.)
mircea_popescu: diana_coman ^ i thought you might lulz
Framedragger: i'm sure it's justified by the other amazing parts of the fs, and when we look at the other parts we'll see glorious code that works
mircea_popescu: i guess it's technically just 99.93% huh.
mircea_popescu: Framedragger the mystery of the black box that manages to require 59kb to store 8 x 4byte directories, ie a whooping 99.99% wastage....
Framedragger: but good to have concrete reproducible data to back it up, sure.
Framedragger: mircea_popescu: you sure you want benchmarks? /me thinks it's a lost cause
mircea_popescu: anyway. try ext2 too sometime ?
Framedragger: you're right, the growth *won't* be linear. but...
Framedragger: 59M for 1000tx. *before* symlinks are stored. (granted, they'll be small)
mircea_popescu: think, it's a tree. 1/3 to 1/2 is cut by that
Framedragger: well. if we do linear extrapolation, bout 14400 terabytes for transaction index given 250mil transactions....
mircea_popescu: Framedragger so basically each index is an extra terrabytwe
mircea_popescu: afaik very little of that was done early on.
mircea_popescu: i've not seen any. would be more interesting to test for the hole manually by fuzzing on testnet
Framedragger: mircea_popescu: which means that i don't see how it could work even given mystery-amazing fs performance (...), *space-wise*.
mircea_popescu: the case is -- this probably does not work.
asciilifeform: mircea_popescu: could be interesting to test for double spends 'manually' (using specially written proggy that walks the blox)
mircea_popescu: but understand it's not the case "this - works, replacement might not"
asciilifeform: mircea_popescu: you're talking 'substantial rewrite'.
Framedragger: *59M* for 1000 'transactions', *before* symlinks are even saved. just the folders (7-level-deep folders.)
mircea_popescu: it wouldn't surprise me if a corner case were discovered where THIS permits doublepsend
mircea_popescu: proper doublespent check, not this bs.
a111: Logged on 2017-03-11 03:53 Framedragger will check tomorrow if the insane size was from his shitty c. but actually, probably not - in ext3/ext4, a folder is an inode and an inode points to unique data block - minimum size of which is 4k. given an expansive recursive tree, you get what you get.
Framedragger: http://btcbase.org/log/2017-03-11#1625413 << i will also remind that http://btcbase.org/log/2017-03-11#1625312 which (i forgot this last night) means that in my view, there's no friggin' way eight-level-deep tree structure can hold transactions. every symlink is a file, and on top of that, with 8 levels, most about every transaction will create multiple additional folders ☝︎☝︎
asciilifeform: it isn't clear why to preserve anything else, if this is amputated. it is the very example of 'grandfather's pistol' -- any mistake is a) not necessarily detectable with ANY kind of testing b) potential reactor melt
mircea_popescu: diana_coman ^ i think you might lulz.
mircea_popescu: (note that at no point the preservation of satoshi's indexing scheme was contemplated)
asciilifeform: without gutting and replacing the entire logic of trb.
mircea_popescu: pretty much has to go.
asciilifeform: which prevents the use of ANY sane (fixed-length keys to fixed-lenght values) db !!
mircea_popescu: the insanity of putting such a thing there, as opposed to you know, THE FUCKING WALLET
asciilifeform: and in turn this relies on storing the spend-tx-array (yes) INSIDE the indices db!! http://btc.yt/lxr/satoshi/source/src/main.h?v=makefiles#0713 <<
asciilifeform: sooo mircea_popescu , to revisit upstack , the entire doublespendpreventer mechanism in trb relies on this nonsense , http://btc.yt/lxr/satoshi/source/src/main.cpp?v=makefiles#0855 << is where it marks spent, and http://btc.yt/lxr/satoshi/source/src/main.cpp?v=makefiles#0847 is the doublespendtrap
deedbot: http://qntra.net/2017/03/choo-choo-motherfuckers-trump-train-begins-rolling-over-opposition/ << Qntra - Choo Choo Motherfuckers: Trump Train Begins Rolling Over Opposition
asciilifeform: 'let's make blocks variable length' 'let's make tx variable length' 'let's make tx INDICES variable and UNBOUNDED length' 'because mother dropped me as a baby'
asciilifeform: and which created 1,001 new problems that had no business existing.
asciilifeform: eeeevery single fucking time i sit down and assume that shitoshi did the obvious, simple, correct thing, and build a hypothetical on ~that~, i later open the binder and find that -- guess what
asciilifeform: (when new block comes in, to lengthen one end or the other of the snake tongue, the antecedent blocks get checked O(N), 'manually')
asciilifeform: if trb is in a state of snake tongue, ALL of the affected tx do not belong in the index table
mircea_popescu: anyway, the correct solution has to go along the lines of "nope. only one block."
asciilifeform: the Right Thing, as i see it, is : if a tx is in orphaned block, it does not belong in the index table