On Patterns Of Life: From MacroData to PicoData
source link: http://thunderheadxpler.blogspot.com/2018/05/on-patterns-of-life-from-macrodata-to.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Sunday, May 27, 2018
On Patterns Of Life: From MacroData to PicoData
Insight (or GeoInsight in our case) is lost in the deluge of data that we are acquiring today from everyday sensors that are machine or humanly generated. This project is a set of heuristic Spark based implementations to reveal signals from the movement of ships in and out of the Port of Miami.
The idea is to extract small clean data (PicoData) from the overlap of a massive amount of data (MacroData). The aggregation of "clean" PicoData derived from MacroData trust into the forefront patterns of life.
For example, given the following display of AIS broadcasts:
We can mutate the data to reveal the "clean" influx of ships into the harbor at high tide:
Like usual, you can download all the source code from here.
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK