org.apache.spark.streaming.flume

Class FlumeUtils

Object

org.apache.spark.streaming.flume.FlumeUtils

public class FlumeUtils
extends Object

Constructor Summary

Constructors

Constructor and Description
FlumeUtils()

Method Summary

Methods

Modifier and Type	Method and Description
static JavaReceiverInputDStream<SparkFlumeEvent>	createStream(JavaStreamingContext jssc, String hostname, int port) Creates a input stream from a Flume source.
static JavaReceiverInputDStream<SparkFlumeEvent>	createStream(JavaStreamingContext jssc, String hostname, int port, StorageLevel storageLevel) Creates a input stream from a Flume source.
static ReceiverInputDStream<SparkFlumeEvent>	createStream(StreamingContext ssc, String hostname, int port, StorageLevel storageLevel) Create a input stream from a Flume source.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlumeUtils

public FlumeUtils()

Method Detail

createStream

public static ReceiverInputDStream<SparkFlumeEvent> createStream(StreamingContext ssc,
                                                 String hostname,
                                                 int port,
                                                 StorageLevel storageLevel)

Create a input stream from a Flume source.

Parameters:

ssc - StreamingContext object

hostname - Hostname of the slave machine to which the flume data will be sent

port - Port of the slave machine to which the flume data will be sent

storageLevel - Storage level to use for storing the received objects

createStream

public static JavaReceiverInputDStream<SparkFlumeEvent> createStream(JavaStreamingContext jssc,
                                                     String hostname,
                                                     int port)

Creates a input stream from a Flume source. Storage level of the data will be the default StorageLevel.MEMORY_AND_DISK_SER_2.

Parameters:

hostname - Hostname of the slave machine to which the flume data will be sent

port - Port of the slave machine to which the flume data will be sent

createStream

public static JavaReceiverInputDStream<SparkFlumeEvent> createStream(JavaStreamingContext jssc,
                                                     String hostname,
                                                     int port,
                                                     StorageLevel storageLevel)

Creates a input stream from a Flume source.

Parameters:

hostname - Hostname of the slave machine to which the flume data will be sent

port - Port of the slave machine to which the flume data will be sent

storageLevel - Storage level to use for storing the received objects