Sequence scrape steps run every six hours. github 
HERE HERE --> scrape script --> log file HERE --> rollup script HERE --> found script HERE --> activity script
Define NOW as day-time in utc which will label various logs with this particular run. Unix cron runs in local time so this variable changes with the season.
Clean various log files over a week old. This and other utility work is interspersed between other scripts that do the heavy lifting.
Also runs site-web script and slug-web script to build distribution files of the neighbor and link based networks in json and javascript.
Also runs neo-batch script and neo-build script to build and load distribution files of nodes and relations as csv files for neo4j.