org.apache.spark.sql.execution

Class LeftSemiJoinHash

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.execution.LeftSemiJoinHash

All Implemented Interfaces:

com.typesafe.scalalogging.slf4j.Logging, java.io.Serializable, scala.Equals, scala.Product

public class LeftSemiJoinHash
extends SparkPlan
implements scala.Product, scala.Serializable

:: DeveloperApi :: Build the right table's join keys into a HashSet, and iteratively go through the left table, to find the if join keys are in the Hash set.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
LeftSemiJoinHash(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys, SparkPlan left, SparkPlan right)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	buildKeys()
SparkPlan	buildPlan()
org.apache.spark.sql.catalyst.expressions.Projection	buildSideKeyGenerator()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
SparkPlan	left()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	leftKeys()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
org.apache.spark.sql.catalyst.plans.physical.Partitioning	outputPartitioning() Specifies how data is partitioned across different nodes in the cluster.
scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution>	requiredChildDistribution()
SparkPlan	right()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	rightKeys()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	streamedKeys()
SparkPlan	streamedPlan()
scala.Function0<org.apache.spark.sql.catalyst.expressions.MutableProjection>	streamSideKeyGenerator()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

executeCollect

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, generateSchemaString, generateSchemaString, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, schemaString, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, makeCopy, map, mapChildren, nextId, nodeName, numberedTreeString, otherCopyArgs, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.BinaryNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface com.typesafe.scalalogging.slf4j.Logging

logger

Constructor Detail

LeftSemiJoinHash

public LeftSemiJoinHash(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys,
                scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys,
                SparkPlan left,
                SparkPlan right)

Method Detail

leftKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys()

rightKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys()

left

public SparkPlan left()

right

public SparkPlan right()

outputPartitioning

public org.apache.spark.sql.catalyst.plans.physical.Partitioning outputPartitioning()

Description copied from class: SparkPlan

Specifies how data is partitioned across different nodes in the cluster.

Overrides:

outputPartitioning in class SparkPlan

requiredChildDistribution

public scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution> requiredChildDistribution()

buildPlan

public SparkPlan buildPlan()

streamedPlan

public SparkPlan streamedPlan()

buildKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> buildKeys()

streamedKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> streamedKeys()

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

buildSideKeyGenerator

public org.apache.spark.sql.catalyst.expressions.Projection buildSideKeyGenerator()

streamSideKeyGenerator

public scala.Function0<org.apache.spark.sql.catalyst.expressions.MutableProjection> streamSideKeyGenerator()

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan