In the 10th Episode of the StackToHeap podcast, we speak with Lordson from Arjira Tech about the patterns, challenges and solutions that one comes across while setting up a data ingestion and processing platform using Spark.  
We discuss about the data ingestion issues, handling PII data, DSL for onboarding new data sources and using notebooks for orchestrating the Spark jobs.

In the 10th Episode of the StackToHeap podcast, we speak with Lordson from Arjira Tech about the patterns, challenges and solutions that one comes across while setting up a data ingestion and processing platform using Spark. We discuss about the data ingestion issues, handling PII data, DSL for onboarding new data sources and using notebooks for orchestrating the Spark jobs.

In the 10th Episode of the StackToHeap podcast, we speak with Lordson from Arjira Tech about the patterns, challenges and solutions that one comes across while setting up a data ingestion and processing platform using Spark. &nbsp;
We discuss about the data ingestion issues, handling PII data, DSL for onboarding new data sources and using notebooks for orchestrating the Spark jobs.

Data Ingestion and Processing Patterns

StackToHeap is the podcast where I, Manoj Mahalingam, talk to developers in the Indian region to understand the work they are doing, their learning and the major problems they encounter in the industry.

Share Data Ingestion and Processing Patterns

Sign up to save your podcasts

Data Ingestion and Processing Patterns

Data Ingestion and Processing Patterns