Big Data Hebdo

Metrics :
10500 écoutes en 2017 (moyenne à 617 écoutes)
17 episodes en 2017
(vs 14 en 2016, et 10 en 2015)

Top 2017 :
Episode 38 : SQL is back (Spanner / CockroachDB)
Episode 42 : GDPR dans la pratique
Episode 37 : La bourse ou MongoDB
Episode 43 : DevoxxFr, Kafka, AWS, Microsoft CosmosDB, AML
Episode 36 : AI Apocalypse

Top overall :
Episode 35 : Microsoft U-SQL avec Michel Caradec
Episode 28 : Quelques news de rentrée
Episode 38 : SQL is back
Episode 42 : GDPR dans la pratique
Episode 37 : La bourse ou MongoDB

Les mots les plus cités dans les show notes :
Apache25
Kafka25
Google17
Cloud13
Spark9
Azure6
Summit5
Hadoop5
Spanner4
Cassandra4
MongoDB4
Beam4
Confluent4

Sélection de l’année 2017 (Vincent) :
Kafka
Beam
Spanner / CockroachDB
Google Cloud
Redis (Episode 41 avec Damien Krotkine)

Sélection de l’année 2017 (Alexander) :
MongoDB 3.4 passes Jepsen
The Rise of the Weaponized AI Propaganda Machine
The Continued Rise of Apache Kafka
Deep learning (pas) pour tout le monde
GDPR
Microsoft (et CosmosDB)


Lisez le blog d'affini-Tech
http://blog.affini-tech.com
-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74
Alexander : https://twitter.com/alexanderdeja

Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

Reaper 1.0 Has Been Released!
http://thelastpickle.com/blog/2017/11/14/reaper-10-announcement.html

Dear Cassandra Developers, welcome to Azure #CosmosDB!
https://azure.microsoft.com/en-us/blog/dear-cassandra-developers-welcome-to-azure-cosmosdb/
https://venturebeat.com/2017/11/15/microsoft-updates-cosmos-db-with-cassandra-support-better-availability-guarantees/

Introducing Azure Databricks
https://databricks.com/blog/2017/11/15/introducing-azure-databricks.html?utm_content=63154906&utm_medium=social&utm_source=twitter

Google Cloud Spanner goes multi-region
http://www.zdnet.com/article/google-cloud-spanner-goes-multi-region/

Transactions in Apache Kafka
https://www.confluent.io/blog/transactions-apache-kafka/

KSQL Developer Preview november update
https://www.confluent.io/blog/november-update-ksql-developer-preview-available/

Looking Ahead to Apache Flink 1.4.0 and 1.5.0
https://data-artisans.com/blog/looking-ahead-apache-flink-1-4-1-5

Elasticsearch 6.0: not that new, but quite improved
http://www.zdnet.com/article/elasticsearch-6-0-not-that-new-but-quite-improved/

À la rencontre des « raters », petites mains des « big data »
http://theconversation.com/a-la-rencontre-des-raters-petites-mains-des-big-data-86484
http://books.openedition.org/cdf/5013

The Washington Post Is A Software Company Now
https://www.fastcompany.com/40495770/the-washington-post-is-a-software-company-now

Devoxx 2017
https://www.youtube.com/playlist?list=PLRsbF2sD7JVqZ4RpHYkqSuCNhxumGP5eo


Lisez le blog D'affini-Tech
http://blog.affini-tech.com
-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74
Alexander : https://twitter.com/alexanderdeja

http://beam.incubator.apache.org/
Vous pouvez retouver Jean-Baptiste :
http://blog.nanthrax.net/
https://github.com/jbonofre
https://twitter.com/jbonofre
https://www.linkedin.com/in/jean-baptiste-onofr%C3%A9-a0739317

Lisez le blog D'affini-Tech
http://blog.affini-tech.com
-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74
Alexander : https://twitter.com/alexanderdeja

Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

Kafka

Apache Kafka Goes 1.0
https://www.confluent.io/blog/apache-kafka-goes-1-0/

Getting Started Analyzing Twitter Data in Apache Kafka through KSQL
https://www.confluent.io/blog/using-ksql-to-analyse-query-and-transform-data-in-kafka

Stories from the Front: Lessons Learned from Supporting Apache Kafka
https://www.confluent.io/blog/stories-front-lessons-learned-supporting-apache-kafka/

Apache ZooKeeper and Apache Kafka on Kubernetes StatefulSets & DaemonSets
http://blog.kubernetes.io/2017/09/kubernetes-statefulsets-daemonsets.html
Intro à Kubernetes http://blog.affini-tech.com/tag/kubernetes/index.html

Java

Java 9 Release Now Available!
https://blogs.oracle.com/java/java-9-release-now-available
https://www.oracle.com/java/java9-screencasts.html

The G1 GC in JDK 9
https://www.youtube.com/watch?v=OhPGN2Av44E&feature=youtu.be

New Project: Z Garbage Collector
http://mail.openjdk.java.net/pipermail/announce/2017-October/000237.html


Google Cloud Platform

Extending per second billing in Google Cloud
https://cloudplatform.googleblog.com/2017/09/extending-per-second-billing-in-google.html

Announcing Google Cloud IoT Core public beta
https://cloudplatform.googleblog.com/2017/09/announcing-Cloud-IoT-Core-public-beta.html
https://www.gcppodcast.com/post/episode-101-iot-core/

Scheduling and sampling arrive for Google Cloud Dataprep
https://cloud.google.com/blog/big-data/2017/11/scheduling-and-sampling-arrive-for-google-cloud-dataprep

Creating Custom Interactive Dashboards with Bokeh and BigQuery
https://cloud.google.com/solutions/bokeh-and-bigquery-dashboards

Google Colaboratory
https://research.google.com/colaboratory/unregistered.html


Spark

Databricks Delta: A Unified Data Management System for Real-time Big Data
https://databricks.com/blog/2017/10/25/databricks-delta-a-unified-management-system-for-real-time-big-data.html

TESTER DU CODE SPARK : 1- LA THÉORIE
http://blog.xebia.fr/2017/01/06/tester-du-code-spark-1-la-theorie/

TESTER DU CODE SPARK – 2 – LA PRATIQUE
http://blog.xebia.fr/2017/09/19/tester-du-code-spark-2-la-pratique/

Apache Spark : Utilisation des UDF et Currying
http://blog.affini-tech.com/apache-spark-utilisation-des-udf-et-currying/


Lisez le blog D'affini-Tech
http://blog.affini-tech.com
-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74
Alexander : https://twitter.com/alexanderdeja

Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

En direct du Google Cloud Summit de Paris le 19 octobre 2017 avec William Vambenepe ( https://twitter.com/vambenepe )

GOOGLE CLOUD BIG DATA AND MACHINE LEARNING BLOG
https://cloud.google.com/blog/big-data/

La playlist Youtube ou vous devrez rapidement retrouver les présentations du Summit
https://www.youtube.com/user/googlecloudplatform/playlists

-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74

Cette publication est sponsorisée par Affini-Tech
http://affini-tech.com
https://twitter.com/affinitech
http://blog.affini-tech.com
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

Cassandra : Proposal to retroactively mark materialized views experimental
https://lists.apache.org/thread.html/d81a61da48e1b872d7599df4edfa8e244d34cbd591a18539f724796f@%3Cdev.cassandra.apache.org%3E

Cassandra pluggable storage engine
https://lists.apache.org/thread.html/0540e793ec58eb97d8afe294635279d16e0191f9b613ad3edd710181@%3Cdev.cassandra.apache.org%3E

couchbase
https://www.couchbase.com/products/data-platform

Google Cloud Dataprep - Data Handling Made Easier
https://medium.com/google-cloud/google-cloud-dataprep-data-handling-made-easier-79d7c35fbbe7
et l’épisode que nous avions enregistré sur Trifacta avec Victor Coustenoble :
https://www.spreaker.com/user/vhe74/ep45-trifacta

Provision on-demand Spark clusters on Docker using Azure Batch's infrastructure
https://azure.microsoft.com/en-us/blog/on-demand-spark-clusters-on-docker/

Techs.Rocks : Échangeons entre Tech Leaders
https://www.techs.rocks/

Lisez le blog D'affini-Tech
http://blog.affini-tech.com
-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74
Alexander : https://twitter.com/alexanderdeja

Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

Exactly-once Semantics are Possible: Here’s How Kafka Does it
https://www.confluent.io/blog/exactly-once-semantics-are-possible-heres-how-apache-kafka-does-it/?utm_content=buffer9b1b6&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer
https://blog.ippon.fr/2017/07/11/kafka-0-11-0-%E2%99%A5/


Confluent KSQL
https://www.confluent.io/blog/ksql-open-source-streaming-sql-for-apache-kafka/
https://www.youtube.com/watch?v=A45uRzJiv7I&feature=youtu.be

Kafka + Prestodb.io
https://prestodb.io/docs/current/connector/kafka.html

Streaming SQL in Apache Flink, KSQL, and Stream Processing for Everyone
https://data-artisans.com/blog/flink-streaming-sql-ksql-stream-processing

Kafka Wakes Up And Is Metamorphosed Into A Database
https://www.nextplatform.com/2017/08/30/kafka-wakes-metamorphosed-database/amp/
(Editor’s Note: It would have been far funnier, of course, if Kafka woke up one morning and had been turned into CockroachDB.)

Open sourcing Kafka cruise control
https://engineering.linkedin.com/blog/2017/08/open-sourcing-kafka-cruise-control
https://github.com/linkedin/cruise-control

Yahoo’s New Pulsar: A Kafka Competitor?
https://www.datanami.com/2016/09/07/yahoos-new-pulsar-kafka-competitor/

Apache Beam 2.1
https://beam.apache.org/get-started/downloads/

Apache Beam splittable DoFn
https://beam.apache.org/blog/2017/08/16/splittable-do-fn.html

Instaclustr Dynamic Resizing for Apache Cassandra
https://www.instaclustr.com/instaclustr-dynamic-resizing-for-apache-cassandra/?utm_content=buffer624e7&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer

Riak devs giddy over gambling biz's vow to set code free
https://www.theregister.co.uk/2017/08/25/bet365_to_buy_basho_release_code/?mt=1503782778086

Spark Release 2.2.0
http://spark.apache.org/releases/spark-release-2-2-0.html

[mooc] Specialisation Data-Engineering Google Cloud sur Coursera
https://fr.coursera.org/specializations/gcp-data-machine-learning

[podcast] Y a-t-il un cerveau dans la machine ? une interview de Yann Le Cun, directeur du FAIR
https://www.franceculture.fr/emissions/la-methode-scientifique/y-t-il-un-cerveau-dans-la-machine

[podcast] DREMEL, DRUID AND DATA MODELING ON GOOGLE BIGQUERY' https://www.drilltodetail.com/podcast/2017/6/19/drill-to-detail-ep31-dremel-druid-and-data-modeling-on-google-bigquery-with-special-guest-dan-mcclary

[privacy] comment les apps Figaro, L’Équipe ou Closer participent au pistage de 10 millions de Français
http://www.numerama.com/politique/282934-enquete-comment-les-apps-figaro-lequipe-ou-closer-participent-au-pistage-de-10-millions-de-francais.html

Comment l’intelligence artificielle bouleverse l’industrie des médias
http://www.latribune.fr/opinions/tribunes/comment-l-intelligence-artificielle-bouleverse-l-industrie-des-medias-746917.html

Cédric Villani est chargé d'une mission d'information parlementaire sur l'IA.
http://www.numerama.com/politique/286341-le-gouvernement-fait-appel-a-cedric-villani-pour-une-mission-sur-lia.html


-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74
Alexander : https://twitter.com/alexanderdeja

Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

Nous recevons pour cet épisode Vincent Royer qui vient nous parler d'Elassandra dont il est le créateur.

http://www.elassandra.io/
https://twitter.com/elassandraio

Le github du projet
https://github.com/strapdata/elassandra

La société Strapdata
http://www.strapdata.com

Le talk du C* Summit 2016 : "Elassandra: Elasticsearch as C* Secondary Index"
https://www.youtube.com/watch?v=0WuLZTvA3YM

et les slides associés :
https://fr.slideshare.net/DataStax/elassandra-elasticsearch-as-a-cassandra-secondary-index-rmi-trouville-vincent-royer-independent-c-summit-2016

Instaclustr propose Elassandra
http://www.marketwired.com/press-release/instaclustr-first-to-offer-managed-service-for-elassandra-and-kibana-2217532.htm

Pour suivre Vincent Royer :
https://twitter.com/vroyerv

-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74
Alexander : https://twitter.com/alexanderdeja

Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

Victor Coustenoble nous explique aujourd'hui ce qu'est le "Data Wrangling". Trifacta est un outil de préparation de données intégré dans nos plateformes data favorites.

Pour en savoir plus sur Trifacta c'est ici : https://www.trifacta.com/fr/ et là : https://www.trifacta.com/news-and-press/?language=fr

Vous pouvez retrouver Victor sur sont twitter : https://twitter.com/vizanalytics ou sur Linkedin : https://www.linkedin.com/in/victorcoustenoble/


-------------------------------------------------------------
http://www.bigdatahebdo.com
https://twitter.com/bigdatahebdo
Vincent : https://twitter.com/vhe74

Edité par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )
On recrute ! venez cruncher de la data avec nous ! écrivez nous à [email protected]

Apache BigData
Retour sur Apache BigData

DataStax announces availability of ‘white glove’ managed cloud service
http://diginomica.com/2017/05/23/datastax-announces-availability-white-glove-managed-cloud-service/amp/

CockroachDB 1.0 is Production-Ready
https://www.cockroachlabs.com/blog/cockroachdb-1-0-release/

Local and distributed query processing in CockroachDB
https://www.cockroachlabs.com/blog/local-and-distributed-processing-in-cockroachdb/#


Azure Cosmos DB
https://speakerdeck.com/dharmashukla/azure-cosmos-db-lessons-learnt-from-building-a-globally-distributed-database-from-the-ground-up
https://channel9.msdn.com/Events/Build/2017/KEY01#time=1h27m20s
https://softwareengineeringdaily.com/2017/06/01/cosmosdb-with-andrew-hoh/

A Vision for Making Deep Learning Simple
https://databricks.com/blog/2017/06/06/databricks-vision-simplify-large-scale-deep-learning.html

Spark gets automation: Analyzing code and tuning clusters in production
http://www.zdnet.com/article/spark-gets-automation-analyzing-code-and-tuning-clusters-in-production/
https://www.pepperdata.com/press-releases/pr_052317/

What’s New in Hadoop 3.0 – Enhancements in Apache Hadoop 3
https://www.edureka.co/blog/hadoop-3/

Apache Flink® 1.3.0 and the Evolution of Stream Processing with Flink
https://data-artisans.com/blog/apache-flink-1-3-0-evolution-stream-processing

You are not Google
https://blog.bradfieldcs.com/you-are-not-google-84912cf44afb


Master time with Kibana’s new time series visual builder
https://www.elastic.co/blog/master-time-with-kibanas-new-time-series-visual-builder?blade=tw

Teradata doubles down
http://www.zdnet.com/google-amp/article/teradata-doubles-down/