log☇︎
2200+ entries in 0.027s
Framedragger: typical small .sql is usually just a set of "INSERT INTO .. VALUES ..", but mircea_popescu is running a large escher megasite, so i'm less certain..
Framedragger: seems mysql does not have a 'binary dump' option. so basically, yes
Framedragger: but i'll check lest i'm talking out of ass
Framedragger: i don't know how it would encode it, but in general, yes. more like, escape nonprintable chars with "\0" i guess
Framedragger: mircea_popescu: .sql is a set of statements which you can run on db to put it back into the state which produced the .sql in question, no? but, if there's mysql specific convention bullshit tho, i wouldn't know :/
Framedragger: mircea_popescu: hm okok. an .sql file should not contain any non-printable chars so that in itself is alarming.. weird
Framedragger: wait how did you end up with that large ass file? sql dump?
Framedragger: sed is only supposed to work on text files but hm.. also, one clunky way would be to hexdump whole file into hex.bin, then work with that
Framedragger: mysqlol
Framedragger: bytes, not lines
Framedragger: head -c 1000 | hexdump -C
Framedragger: oof
Framedragger: i am very interested in i/o of `tail` while it's running. wtf. would apt-get install iotop
Framedragger: should be in repo as `iotop`
Framedragger: (ah it's not installed by default i'm afraid)
Framedragger: what does iotop (under root) say?
Framedragger: mircea_popescu: recently had to tail multigb files, it was *instant* (because, seeks to end of file). seems like a disk prob to me
Framedragger: http://btcbase.org/log/2017-04-06#1639243 << this doesn't seem right. `tail` should work fine, too (it seeks to end of file and then rewinds, should be superfast on arbitrary sized files) ☝︎
Framedragger: k.
Framedragger bbl
Framedragger: !#s dump dom
Framedragger: gabriel_laddel_p: ideally it would also save a full 'rich' version (whole DOM) but without JS, the way archive.is does
Framedragger: mircea_popescu: hm.. okay. wonder why it failed. (i guess in the future consider LONGBLOB for this (and encode/decode as needed), but it wasn't..that large, even.. huh.)
Framedragger: or kiwiirc.com
Framedragger: in which case, may not want to do that till caching is in place, or sth. main thing is to have stats be accessible which is now cached anyway
Framedragger: asciilifeform: i also wonder if phuctor site my come under additional stress now that you removed those 'Disallow' entries from robots.txt :/
Framedragger: pete_dushenski: plox to update bot commands at some point, ty! :)
Framedragger: ^ new (trivial) command. a bunch of URLs so may be useful
Framedragger: !$ phuctor
Framedragger: not a boring day!
Framedragger: well the default for DBs is to store things under /var. /var is under root unless specifically separate partition; or you tell db to store under /home/mircea/dbdata or sth.
Framedragger: mebbe you had a separate /var partition from linux install long ago, mircea_popescu.. this can bite
Framedragger: (mk /stats now updated every 30min, will see how that one goes. http://siphnos.mkj.lt/ updated to include link to the cached copy. will see if this gets indexed by google (main index page already is)) :)
Framedragger: heh :) pretty soviet
Framedragger: i'm waiting for the day that freenode goes down while datacenters with logotrons are experiencing issues. everyone's gonna freak out, there will be a new more urgent push for gossipd, it's gonna be great!
Framedragger: in mysql it's called 'binary log'. dunno if on by default tho
Framedragger: maybe it's going thru full mysql tx log if you have one
Framedragger: anyway http://siphnos.mkj.lt/phuctor-stats/ will continue to rehost phuctor stats (including http://siphnos.mkj.lt/phuctor-stats/phuctored.html), and will see about more lenient update times (5min is excessive anyway)
Framedragger: done ☟︎
Framedragger: okay :D
Framedragger: asciilifeform: phuctor.nosuchlabs.com timing out, do you think this could be related to the cron cacher? (GET /stats every 5min, GET /phuctored every 60min)
Framedragger: nice
Framedragger: (aok. oh well then, light cigar while making DB destruction plans)
Framedragger: mircea_popescu: sorry i forgot or didn't know that you actually in fact restarted it.
Framedragger: ok ugh.
Framedragger: 150? no just the one which is still trying to import large blob (if still running)
Framedragger: (then `FLUSH TABLES` should remove any outstanding locks if still any; but don't take my word for it)
Framedragger: mircea_popescu: well you can still kill the particular mysql process which is handling the query, `show processlist` (may show "Waiting for table metadata lock" under "State" column; "Info" column should display the query in question), then `Kill IDGOESHERE`
Framedragger: just curious, what is it then, myisam?
Framedragger: ftr, useful SO answer (yes, SO): http://stackoverflow.com/a/13155778
Framedragger: there are ways to list/remove locks but i reeeeally dunno if it's a good idea
Framedragger: i guess it's dead-dead, tho
Framedragger: do you still have a running mysql cli session mircea_popescu?
Framedragger: oh god
Framedragger: i wonder if it's due to data type misuse, or just mysqlol
Framedragger: but mebbe you want to keep it running
Framedragger: there's a KILL QUERY
Framedragger: hmh it should at least fail, or sth. is it still running mircea_popescu? can you do `show processlist` with separate mysql client session? (NB, am not a mysql guy)
Framedragger: another pleasant morning of kicking DBs
Framedragger: apparently mysql recommends storing large data/text blobs in separate table
Framedragger: what's the column data type mircea_popescu
Framedragger: i did! i managed to compliment him, direct him to #trilema, and (hopefully) not appear as an idiot in one tweet
Framedragger: so on account of that n-gate guy being reachable via twitter only, and me not wanting to miss any replies, i've actually had to visit twitter lately. my homepage now is http://imgur.com/a/aTcpY and fuck this shit
Framedragger: maybe just some shitty limit in webserver/php/wherever, modifiable
Framedragger: mircea_popescu: you're putting it in mysql aren't you, and making php generate a table or sth?
Framedragger: !#s tmsr wiki
Framedragger: i guess it could host /sadmods and /dupes as well - attempt redownload every few hours? (it will only update the linked cached html in case new download is in fact successful)
Framedragger: will keep an eye on this in case the hasty cron job screws up at some point.
Framedragger: http://btcbase.org/log/2017-04-06#1638854 << k found time to improve this, /phuctored is now being hosted/cached as well (and link to /phuctored on the index stats page links to the cached version) ☝︎
Framedragger: http://btcbase.org/log/2016-12-25#1590428 ☝︎
Framedragger: ah right right, ok
Framedragger: mircea_popescu: if you're planning to rehost, maybe useful (very simplistic, i've just put this into cron for now): http://siphnos.mkj.lt/phuctor-stats/download-stats.sh
Framedragger: yah.
Framedragger: not yet!
Framedragger: i sed'ed the relative urls, as in "<a href="/">Submit GPG Key</a>", to point them to phuctor, etc
Framedragger: btw asciilifeform mircea_popescu i'm rehosting the main '/stats' page here, autoredownload every 5min (handles http timeout cases): http://siphnos.mkj.lt/phuctor-stats/ ☟︎
Framedragger: asciilifeform: MEng here means 'master of engineering' (which can include software engineering, yesyes), not mech
Framedragger: result is large turd
Framedragger: yes in retrospect i did not expect for there to be so many pops lol.
Framedragger: 'MEng' is just diploma title, you get master of engineering for software engineering, too (because reasons)
Framedragger: yeah.
Framedragger: notes! support!
Framedragger: hrm. :) what's the cheapest way to do it.. automate a long-timeout-and-also-retry downloader for /stats and then just re-host the cached downloaded copy? any use in that?
Framedragger: ah, hrm.
Framedragger: heh. well http://nosuchlabs.com/robots.txt does have "Disallow: /gpgkey/" but phuctor.nosuchlabs.com itself should still be indexed i think? ☟︎
Framedragger: :o
Framedragger: mircea_popescu: ahahahaha it does say "MUM" (should be "Mon" of course)
Framedragger: at least the currency will inflate now so that they can export ugly girls cheaper
Framedragger: that is exactly what it means mircea_popescu lol
Framedragger: i dunno. re. VAT from overseas, yeah it's 'teh law', but yknow.
Framedragger: admin fee for collecting the customs fee and mediating between customer and her majesty's revenue and customs. very legit
Framedragger: "this is not my kind of place" "what am i doing with my life" "also i can't answer these questions"
Framedragger: she had a particular unpleasant unhappy look so yeah i think i agree lol
Framedragger: rehosted here: http://fd.mkj.lt/stuff/import-1.jpg && http://fd.mkj.lt/stuff/import-2.jpg ☟︎
Framedragger: (i do believe this is a simple instance of VAT being charged for overseas 'valuable imports', but then this never happened before when shipping via legal retailers etc.) ☟︎
Framedragger: (again, i may have gotten more info by physically presenting myself at a particular delivery office, showing ID and so on, but i wasn't up for that.)
Framedragger: http://btcbase.org/log/2017-03-29#1634033 << that's all i have: http://imgur.com/a/SPFBI (stuff that was stickied on the parcel). i had unfortunately thrown out the 'postcard' from royal mail, but it was a single slip which literally only said "we can't post you this because this got held up. go online and put in a reference number". the latter opened a "PAY NOW" form, and that's it. ☝︎
Framedragger: DaSancho: what brings ye here?
Framedragger: !!up DaSancho
Framedragger: sent query to n-gate (in the sense of reducing meaning to a tweet and pretending that's communication)