requirements
This tool requires a web browser that supports webGL. Chrome is the recommended web browser, however, Firefox may also work sporadically.
A modern mac / pc is also recommended for optimal performance.
methodology
This tool was created for the EU Hackathon.
Glasnost .tgz files were uploaded to Amazon EC2 cloud hosting automatically using a script. Summary log files were extracted and distilled into a .csv file. That .csv was uploaded to app engine where it could be further interpreted and analysized.
3.6 million ip geocode data entities were also uploaded to provide fast and unlimited geocode capabilities, with the future and scaling in mind.
The visualizations implemented is inspired by the hackathon's opening ceremony. Specifically, it is addressing the need for simple data that can be easily shared with non-technical people to achieve a better understanding of internet quality.
Technically, every choice was made with the intent of growing glasviz to be an easy to use, easy to extend hub of conversation surrounding this data set as it grows and becomes more relevant.
platform
Much time was spent behind the scenes, creating elements of glasviz that are meant to be building blocks for further collaboratiaon and analysis.
At it's core is easy to maintain code that can be used separately from glasviz that aggregates and interprets glasnost log files. This code is designed to be iterated upon as the data is better understood and make maintaining current interpretations of the data easy. This encourages research to build organically and naturally in a well understood environment.
The globe.js visualization is a modern, visually striking method of displaying information, however, since glasviz is built on app engine, many other visualization libraries could be added to support all sorts of reports.
Data can be easily imported and exported using app engine's built in "bulkloader" allowing portable data sharing among other applications and studies.
A user authentication system is already implemented to allow access to a "data maintenance page" where admins can easily work on the data sets. Using app engine, new collaborators can be added in literally seconds to contribute.
goal
Glasviz aspires to be an open and transparent platform for creating easy to understand visualizations of glasnost information.
The goal of these first visualizations is to create an at-a-glance view of internet quality though global throtttling.
Ultimately, glasviz could be a home for research collaboration, report and visualization storage, and log aggregation leading to wider visibility and consumption of glasnost data.
