Search Index Logs

We'll mine the search index logs for insight as to what is happening in the federation.

Our sitemap scraper runs four times a day. Logs from each run can be viewed online. page plot

pages/search-index-logs

Tip: User browser search (alt/cmd-f) to find sites.

We filter and sort recent logs identifying sites we have successfully indexed. github

http://ward.dojo.fed.wiki/assets/pages/search-index-logs/sites-indexed.html HEIGHT 200

A variety of things can go wrong with sites that prevent successful index updates. We keep trying reporting most recent error today.

http://ward.dojo.fed.wiki/assets/pages/search-index-logs/sites-missing.html HEIGHT 200

We recognize as retired sites gone for good or otherwise not safe to index.

http://ward.dojo.fed.wiki/assets/pages/search-index-logs/sites-retired.html HEIGHT 200

See Sites to be Indexed

We return again to the collection of mostly Ruby scripts that implement federation search motivated by fending off slow decay based on growth and evolution in the federation.

We've applied our interest in assembling large graphs from selected aspect represented as small, overlapping graphs. We've used federation search as a test case. demo

Scan scripts in an asset folder for graph annotations then download to upload for browsing system diagrams.

http://ward.dojo.fed.wiki/assets/pages/search-index-logs/scripts/scan-assets.html HEIGHT 50

pages/search-index-logs/scripts