The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geography

Big Data In The Browser


Listen Later

So why would anyone want to put alot of data into a browser? Well, for a lot of the same reasons that edge computing and distributed computing have become so popular.

You get the data a lot closer to the user and you don’t have to pay for the compute ;) 

… this sounds great but as I found out during this conversation it's not as easy as it might seem! 

There are a lot of trade-offs that need to be evaluated when moving data and analytics to the client.

 

Nick Rabinowitz  Senior Staff Software Engineer at Foursquare has a ton of experience with this so he volunteered his time to help us understand more about it.

https://location.foursquare.com/

https://studio.foursquare.com/home



If you are not familiar with the Arrow data format it might be worth checking out

 

Apache Arrow defines a language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware like CPUs and GPUs. The Arrow memory format also supports zero-copy reads for lightning-fast data access without serialization overhead

 

Related podcast episodes that you might find interesting include



H3 grid system

https://mapscaping.com/podcast/h3-geospatial-indexing-system/

The H3 geospatial indexing system is a discrete global grid system consisting of a multi-precision hexagonal tiling of the sphere with hierarchical indexes. H3 is a really interesting approach to tiling data that was developed by UBER and has been open-sourced. 



Hex Tiles

https://mapscaping.com/podcast/hex-tiles/

If you have not heard of the H3 grid system before listen to that episode first before listening to this one it will add a lot of useful context!



Spatial Knowledge Graphs

https://mapscaping.com/podcast/spatial-knowledge-graphs/

Foursquare is moving away from spatial joins and focusing on building a knowledge graph. If you are not familiar with graphs this might be a good place to start, also its interesting to hear the reasons for the move from spatial joins to another data structure.

 

Distribution Geospatial Data

https://mapscaping.com/podcast/distributing-geospatial-data/

This is interesting if you want to understand more about distributed databases and some of the strategies for doing this. It sounds complicated but this episode is a really good introduction! 

 

Cloud Native Geospatial

https://mapscaping.com/podcast/cloud-native-geospatial/

This episode give a solid overview of what cloud-native means and some of the current geospatial cloud native formats out there today

 

I am constantly thinking about how I can make this podcast better for you so if you have any ideas or suggestions please let me know! 

Also, I am thinking of recording a behind-the-scenes episode, is that something you might be interested in? if so what questions do you have? 

 

Some more episodes you might enjoy

 

ESRI, GIS careers, Geospatial Data Science 

QGIS, Geospatial Python, ArcGIS Pro

Google Maps, Geomatics, Cartography

Location Intelligence, Mapping

 

...more
View all episodesView all episodes
Download on the App Store

The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geographyBy MapScaping

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

113 ratings


More shows like The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geography

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,006 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,597 Listeners

99% Invisible by Roman Mars

99% Invisible

26,222 Listeners

Outside/In by NHPR

Outside/In

1,476 Listeners

Uncanny Valley | WIRED by WIRED

Uncanny Valley | WIRED

502 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

530 Listeners

The Daily by The New York Times

The Daily

112,416 Listeners

The Indicator from Planet Money by NPR

The Indicator from Planet Money

9,529 Listeners

DataFramed by DataCamp

DataFramed

269 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Short Wave by NPR

Short Wave

6,539 Listeners

Hard Fork by The New York Times

Hard Fork

5,518 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,938 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

610 Listeners

The Economics of Everyday Things by Freakonomics Network & Zachary Crockett

The Economics of Everyday Things

1,654 Listeners