(7 . 7)(7 . 14)
(2) 'flask' lib for (1).
(3) 'psycopg2' lib for (1).
(4) 'postgres' (9 or 10).
(5) A WWW server that knows how to proxy.
(5) A WWW server that can serve WSGI applications (e.g. Apache with mod_wsgi installed).
    - If installing mod_wsgi for the first time be sure to set your target
      python version to 2.7 (/etc/portage/make.conf in gentoo/dulap systems)


####################
DB Setup
####################

To use the kit, you will first need to create a user and DB, e.g.:

(17 . 7)(24 . 7)
create user nsabot createdb;
alter role nsabot superuser;
create database nsalog;
grant all privileges on database nsalog to nsabot ;
grant all privileges on database nsalog to nsabot;

... you can take 'super' away from this user after 1st run,
it is needed in order to let him load the pg_trgm indexer
(26 . 6)(33 . 11)
Next, run 'init_db.sh' (alter the constants to match the
names of your postgres user and the DB), this creates the schema.


####################
Importing Logs
####################

Then see 'eat.sh' and the 'eat_dump.py' it uses, re how to
fill your log archive DB. 'eat_dump.py' eats in Phf's classical
format, e.g.:
(41 . 137)(53 . 55)
currently capable of eating config file. Set these to your DB
and PG user.

Now, adjust the constants in 'nsabot.conf' (rename per taste)
to specify your IRC params, name of bot, host at which www
logger will reside, and other knob values.

Adjust the three 'flask' templates in 'templates' subdir to
give the desired look and feel for the www end. Currently we are using
Phf's classic style sheet, with minor modifications.

'reader.py' takes one mandatory command-line argument: full path
to the config above. Same for 'bot.py', which is the IRC bot.

Run these via e.g. nohup ./bot.py & ; nohup ./reader.py &
and let your proxying WWW server know how to reach the latter's port.

For bot.py you will need a registered nick on fleanode (or wherever
it is used.) There are no fleanode-specific hacks in the bot, ergo
it can be stood up behind ZNC (although this has not been tested.)

Certain important features are presently unimplemented, in no order:
(1) Backlinkage.
(2) Search result pagination.
(3) Double-quoted search terms.
(4) Paste archiving.
(5) Multi-headed IRC bot for weather resistance.
(6) Informative eggogology for bot commands.
(7) Automatic synchronization with mirrors

A ZNC log eater is also required, to properly fill in the archives.
This is not yet available at the time of this writing.

###############
Aug. 11 Update:
###############

(1) Multi-line selection is implemented.

(2) User may request export of raw log lines in Phf-classical format.
    E.g. :
    http://logs.nosuchlabs.com/log-raw/trilema?istart=1925000&iend=1925500
See subdir 'logconverters' for scripts to convert ZNC and irssi log formats to Phf's format


###############
Aug. 16 Update:
###############

(1) Bot: added Phf's algo for uniturd processing ('fallback to latin-1').
(2) Bot: May leave IRC password blank in config for use with unregged bots
(3) WWW: 'Checkerboard' colouring; footer links.
(4) WWW: Links in log lines now open in new browser tab (a la Phf's log)
(5) WWW: Can now be loaded 'in reverse gear', http://...../log?rev=1
(6) WWW: 'Random' knob, takes reader to an arbitrary moment in past log.

###############
Sep. 28 Update:
###############

(1) Bot: incorporated reconnector fixes.
(2) Bot: 'seen', 'seen-all', and 'version' knobs implemented.
(3) WWW: up/down arrows for mouse-driven operation on pocket comps
(4) WWW: double-quotes prevent breakup of search query
    (Note: still needs improvement to force matching on word boundaries)
(5) WWW: demarkation of "action" lines
(6) WWW: Raw 'Tape" knob:

e.g. http://logs.nosuchlabs.com/tape?istart=1937934&iend=1937941
returns:

trilema;1937934;1569444908;asciilifeform;achtung panzers! piz pipe down ?!
trilema;1937935;1569444920;diana_coman;seems so
trilema;1937936;1569444957;asciilifeform;paging BingoBoingo !
trilema;1937937;1569444974;diana_coman;well, apparetly he was connected from piz too, lol
trilema;1937938;1569444982;diana_coman;ossasepia.com (pizarro) is down too, yes
trilema;1937939;1569445010;asciilifeform;dulap unreachable for 1st time since year+ ago when bb elbowed the mains cord
trilema;1937940;1569445073;diana_coman;apparently back on
trilema;1937941;1569445079;diana_coman;wb BingoBoingo !

Still needs a variant of 'eater' that will eat these.

###############
Oct. 4 Update:
###############

(1) WWW: Removed ill-conceived 'Tape' knob.
(2) Bot: Added silent-disconnection detector.

Now requires the following value in bot config e.g.:
####################
Configuration
####################

[irc]
disc_t  = 180
Now, adjust the constants in 'nsabot.conf' (rename per taste)
to specify your IRC params, name of bot, host at which www
logger will reside, and other knob values.

This represents the currently-recommended interval: 3 minutes.
If inactivity on the incoming line (incl. pingism) exceeds this interval,
a disconnection is forced. The normal reconnection routine will execute.
Set css_file in the conf file to point to your desired CSS file in 'static' subdir.
Adjust the 'jinja' templates in 'templates' subdir to give the desired look
and feel for the www end IF your CSS changes alone are not sufficient.
Currently we are using Phf's classic style sheet, with minor modifications.

To disable forced disconnects, set disc_t to zero.

####################
Jul. 2020 Update #1:
Running the WWW
####################

(1) Hide by default chans where no activity in days_hide day (set in config.)
(2) Added 'join as guest' link (via 'kiwi' wwwtronic IRC client)
(3) Example Apache-WSGI configs.

####################
Jul. 2020 Update #2:
####################
'reader.py' takes one mandatory argument: full path to the config above.
- When running as a WSGI module this argument needs to be hardcoded in 'reader.py'
- When running locally pass in as a single command-line argument,
  e.g. `./reader.py path/to/config`
- Optionally, when running locally, set FLASK_ENV=development to allow for
  auto-reloading on file changes (see Flask documentation for more info).

(1) Fix unclosed 'table' tag from earlier.
(2) 'Search all chans' button.

####################
Jul. 2020 Update #3:
Running the Bot
####################

(1) Automatically skip empty days in date navigation bar. At the same time, handle empty days correctly when these are requested.
(2) Handle 'dawn of time' case for any given channel, to avoid infinite loop insanity from search engines.
Run bot.by and pass in the path to the same config file as a single command-line
argument, e.g. `nohup ./bot.py path/to/config &`

#####################
Aug. 2020 Update #1 :
#####################

(1) Implemented fetch-by-channel-and-index (i.e. /ilog/chan/lineindex links).
(2) Automatically adjust link targets of #ba and 'btcbase' log citations to point to this logger, using the syntax in (1). Original text of link is preserved. Dates are handled correctly.
(3) Search results now properly paginated, with working 'back' and 'forward' buttons.
(4) Fixed ancient unicode bug in eat_dump.py.
For bot.py you will need a registered nick on fleanode (or wherever
it is used.) There are no fleanode-specific hacks in the bot, ergo
it can be stood up behind ZNC (although this has not been tested.)

#####################
Aug. 2020 Update #2 :
#####################

(1) Additional 'back' and 'forward' buttons at the bottom of search result pages.
(2) Fix era1/2 link diddler regexps to handle all (AFAIK) known variants correctly.
####################
Not Yet Implemented
####################

Certain important features are presently unimplemented, in no order:
(1) Backlinkage.
(3) Double-quoted search terms.
(4) Paste archiving.
(5) Multi-headed IRC bot for weather resistance.
(6) Informative eggogology for bot commands.
(7) Automatic synchronization with mirrors