The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geography

Big Data In The Browser


Listen Later

So why would anyone want to put alot of data into a browser? Well, for a lot of the same reasons that edge computing and distributed computing have become so popular.

You get the data a lot closer to the user and you don’t have to pay for the compute ;) 

… this sounds great but as I found out during this conversation it's not as easy as it might seem! 

There are a lot of trade-offs that need to be evaluated when moving data and analytics to the client.

 

Nick Rabinowitz  Senior Staff Software Engineer at Foursquare has a ton of experience with this so he volunteered his time to help us understand more about it.

https://location.foursquare.com/

https://studio.foursquare.com/home



If you are not familiar with the Arrow data format it might be worth checking out

 

Apache Arrow defines a language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware like CPUs and GPUs. The Arrow memory format also supports zero-copy reads for lightning-fast data access without serialization overhead

 

Related podcast episodes that you might find interesting include



H3 grid system

https://mapscaping.com/podcast/h3-geospatial-indexing-system/

The H3 geospatial indexing system is a discrete global grid system consisting of a multi-precision hexagonal tiling of the sphere with hierarchical indexes. H3 is a really interesting approach to tiling data that was developed by UBER and has been open-sourced. 



Hex Tiles

https://mapscaping.com/podcast/hex-tiles/

If you have not heard of the H3 grid system before listen to that episode first before listening to this one it will add a lot of useful context!



Spatial Knowledge Graphs

https://mapscaping.com/podcast/spatial-knowledge-graphs/

Foursquare is moving away from spatial joins and focusing on building a knowledge graph. If you are not familiar with graphs this might be a good place to start, also its interesting to hear the reasons for the move from spatial joins to another data structure.

 

Distribution Geospatial Data

https://mapscaping.com/podcast/distributing-geospatial-data/

This is interesting if you want to understand more about distributed databases and some of the strategies for doing this. It sounds complicated but this episode is a really good introduction! 

 

Cloud Native Geospatial

https://mapscaping.com/podcast/cloud-native-geospatial/

This episode give a solid overview of what cloud-native means and some of the current geospatial cloud native formats out there today

 

I am constantly thinking about how I can make this podcast better for you so if you have any ideas or suggestions please let me know! 

Also, I am thinking of recording a behind-the-scenes episode, is that something you might be interested in? if so what questions do you have? 

 

Some more episodes you might enjoy

 

ESRI, GIS careers, Geospatial Data Science 

QGIS, Geospatial Python, ArcGIS Pro

Google Maps, Geomatics, Cartography

Location Intelligence, Mapping

 

...more
View all episodesView all episodes
Download on the App Store

The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geographyBy MapScaping

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

112 ratings


More shows like The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geography

View all
WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,643 Listeners

Radiolab by WNYC Studios

Radiolab

43,917 Listeners

This American Life by This American Life

This American Life

90,657 Listeners

SpyCast by SpyCast

SpyCast

1,500 Listeners

StarTalk Radio by Neil deGrasse Tyson

StarTalk Radio

14,115 Listeners

The One You Feed by Eric Zimmer

The One You Feed

2,511 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

592 Listeners

The Daily by The New York Times

The Daily

111,382 Listeners

Up First from NPR by NPR

Up First from NPR

56,005 Listeners

Esri & The Science of Where by Esri

Esri & The Science of Where

40 Listeners

FT News Briefing by Financial Times

FT News Briefing

692 Listeners

1619 by The New York Times

1619

31,660 Listeners

Hard Fork by The New York Times

Hard Fork

5,422 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

28,287 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,220 Listeners