Aug 18, 20213 minFlume & Spark Streaming IntegrationIn this post, we will integrate Flume and Spark Streaming. We will use Spark Streaming to process data that we will get from Flume. Flume...
Aug 16, 20212 minSpark Streaming: Streaming Word CountIn last post, we used flume from Hadoop toolset to stream data from Twitter to HDFS location for analysis. In this blog, we are going to...
Jul 3, 20211 minRunning Hive Queries in SparkHive quries can be executed from Spark Shell. Hive comes with Spark Library as HiveContext, which is inherited from SQLContext....