4

"Any discussion on geospatial analytics will remain incomplete without Goog...

 2 years ago
source link: https://hackernoon.com/any-discussion-on-geospatial-analytics-will-remain-incomplete-without-google-earth-engine
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Shashi Kant

Passionate about advanced data analytics, machine learning, geo-spatial analytics and data visualization

Photo by Richard Gatley on Unsplash

  1. Reminiscences of the Past

    Back in my university days -- around two decades ago --when I heard about Google Earth, I thought of it as an object made for fun.

    My friends and I used it to zoom in on the places of our interest such as our homes, schools, play fields etc. Never did it occur to us that it is so much more than just plain aerial photographs of the earth when looked at from outer space.

    Well… the innocent young minds cannot be blamed. Documentation and community discussions were scant in those days and so was access to the internet. Internet cafes were the only place where you could access the internet.

    1MBPS was the gold standard in those times. Those were the days of Hotmail and Yahoo mail! There was no YouTube.

    40 GB hard disks were considered to be sufficient for personal needs. Fast forward 20 years later, we now have state-of-the-art computation technologies.

    We now talk about Big Data, Artificial Intelligence, Machine Learning, Internet of Things etc. which were incubating in the realms of science fiction.

    With the advancements in data storage technology and reduction in costs, it is now possible to store massive amounts of data. To put things into perspective, 500 hours of videos are being uploaded on YouTube every minute (Statista, 2020).

  2. A Giant Leap

    Satellite imagery is not new. It has been around since 1960. What has changed is the way we process those images.

    Earlier, the workflow was to download the images to your local machine and process it using GIS software. This was really challenging given the fact that high-resolution satellite images are data-heavy.

    Just imagine, how much space would be needed to store the images if you wanted to see analyze changes in precipitation, temperature or cropping patterns etc. over a decade.

    Downloading these images from the source and importing into GIS software is another time-consuming task. Due to these logistical constraints, satellite image visualisation and analysis never really took off until few years back when cloud computing was born.

    Google Earth is a path-breaking innovation in the area of satellite image visualization. It enables us to view satellite imagery, maps, terrain, 3D buildings etc by interacting with a virtual globe.

    Its timelapse feature allows us to experience the fourth dimension of time in which four decades of satellite imagery (24 million satellite photos) have been put together to showcase plant-level changes (Source)).

    A related tool is the Google Earth Engine which makes geospatial analytics lightening fast. All the satellite images are optimized for the cloud. Image processing which used to happen on local machine can now be performed on massive servers which deploy parallel computing to deliver blazing fast performance.

    The satellite data loaded on GEE like platforms has already been processed so it is ready for use in a wide variety of applications. This will open doors for more "big data" applications whereby vast amounts of satellite data over many years can be analyzed to look for subtle patterns that could not have been identified otherwise. The role of machine learning and artificial intelligence will be key in unlocking insights from such vast data stores.

  3. Illustrative use Cases

    The GEE catalog is a one-stop destination for years of satellite imagery and vector files.

    I will list some of the popular datasets here to motivate the possible applications of this platform. This is not anywhere close to exhaustive but is intended to ignite ideas where geospatial analytics can be employed for the greater good.

Sr. No.

Image Description

Utility

DMSP/VIIRS Night lights

Proxy for economic activity

Global human settlement layers

Population count

CHIRPS daily data

Measuring rainfall

Sentinel-1 SAR GRD: C-band

Detection of flooded areas

MODIS Terra Land Surface Temperature Global

Measuring land surface temperature

SRTM Digital Elevation

Measuring terrain elevation and slope

MODIS Terra & Aqua Land Aerosol Optical Depth

Measuring aerosol pollution

MODIS Terra Vegetation Indices

Vegetation indices

Sentinel-5P NRTI NO2: Near Real-Time NO2

Measuring NO2 density in atmoshphere

Global Administrative Unit Layers

Country/State/District level boundaries

Thermal Anomalies & Fire Daily Global

Tracing wildfires

4. Conclusion

Any discussion on geospatial analytics will remain incomplete without Google Earth Engine (GEE).

It is a tool that helps you visualize and analyze satellite images almost in real-time doing away with the inconvenience of downloading data from various space agencies.

It provides programmatic access to petabytes of cataloged satellite images which can be filtered easily using metadata. It also allows using own your own shapefiles for a more customized analysis.

Handling satellite images has never been so easy. GEE enables us to perform computations on these images on the fly. The native programming language for GEE is Javascript, however, Pythonistas can also work with GEE by minor tweaking of the Java codes although Python tutorials /code snippets are still scarce in this domain.


Please check out the code editor of GEE and its documentation to explore the power of GEE. For sample codes in Python illustrating possible use cases, you can check out my blog pieces published on my medium page.

Disclaimer: Views expressed in this blog are personal.

Also published here.


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK