org.apache.datasketches.pig.sampling

Class VarOptSampling

java.lang.Object

org.apache.pig.EvalFunc<T>

org.apache.pig.AccumulatorEvalFunc<org.apache.pig.data.DataBag>

org.apache.datasketches.pig.sampling.VarOptSampling

All Implemented Interfaces:

org.apache.pig.Accumulator<org.apache.pig.data.DataBag>, org.apache.pig.Algebraic

public class VarOptSampling
extends org.apache.pig.AccumulatorEvalFunc<org.apache.pig.data.DataBag>
implements org.apache.pig.Algebraic

Applies VarOpt sampling to input tuples. Implements both the Accumulator and Algebraic interfaces for efficient performance.

Author:

Jon Malkin

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	VarOptSampling.Final

Nested classes/interfaces inherited from class org.apache.pig.EvalFunc

org.apache.pig.EvalFunc.SchemaType

Field Summary

Fields inherited from class org.apache.pig.EvalFunc

log, pigLogger, reporter, returnType

Constructor Summary

Constructors

Constructor and Description
VarOptSampling(String kStr) VarOpt sampling constructor.
VarOptSampling(String kStr, String weightIdxStr) VarOpt sampling constructor.

Method Summary

Modifier and Type	Method and Description
void	accumulate(org.apache.pig.data.Tuple inputTuple)
void	cleanup()
String	getFinal()
String	getInitial()
String	getIntermed()
org.apache.pig.data.DataBag	getValue()
org.apache.pig.impl.logicalLayer.schema.Schema	outputSchema(org.apache.pig.impl.logicalLayer.schema.Schema input)

Methods inherited from class org.apache.pig.AccumulatorEvalFunc

exec

Methods inherited from class org.apache.pig.EvalFunc

allowCompileTimeCalculation, finish, getArgToFuncMapping, getCacheFiles, getInputSchema, getLoadCaster, getLogger, getPigLogger, getReporter, getReturnType, getSchemaName, getSchemaType, getShipFiles, isAsynchronous, needEndOfAllInputProcessing, progress, setEndOfAllInput, setInputSchema, setPigLogger, setReporter, setUDFContextSignature, warn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VarOptSampling

public VarOptSampling(String kStr)

VarOpt sampling constructor.

Parameters:

kStr - String indicating the maximum number of desired samples to return.

VarOptSampling

public VarOptSampling(String kStr,
                      String weightIdxStr)

VarOpt sampling constructor.

Parameters:

kStr - String indicating the maximum number of desired samples to return.

weightIdxStr - String indicating column index (0-based) of weight values

Method Detail

accumulate

public void accumulate(org.apache.pig.data.Tuple inputTuple)
                throws IOException

Specified by:

accumulate in interface org.apache.pig.Accumulator<org.apache.pig.data.DataBag>

Specified by:

accumulate in class org.apache.pig.AccumulatorEvalFunc<org.apache.pig.data.DataBag>

Throws:

IOException

getValue

public org.apache.pig.data.DataBag getValue()

Specified by:

getValue in interface org.apache.pig.Accumulator<org.apache.pig.data.DataBag>

Specified by:

getValue in class org.apache.pig.AccumulatorEvalFunc<org.apache.pig.data.DataBag>

cleanup

public void cleanup()

Specified by:

cleanup in interface org.apache.pig.Accumulator<org.apache.pig.data.DataBag>

Specified by:

cleanup in class org.apache.pig.AccumulatorEvalFunc<org.apache.pig.data.DataBag>

outputSchema

public org.apache.pig.impl.logicalLayer.schema.Schema outputSchema(org.apache.pig.impl.logicalLayer.schema.Schema input)

Overrides:

outputSchema in class org.apache.pig.EvalFunc<org.apache.pig.data.DataBag>

getInitial

public String getInitial()

Specified by:

getInitial in interface org.apache.pig.Algebraic

getIntermed

public String getIntermed()

Specified by:

getIntermed in interface org.apache.pig.Algebraic

getFinal

public String getFinal()

Specified by:

getFinal in interface org.apache.pig.Algebraic