org.apache.nifi.processors.avro

Class SplitAvro

java.lang.Object

org.apache.nifi.components.AbstractConfigurableComponent

org.apache.nifi.processor.AbstractSessionFactoryProcessor

org.apache.nifi.processor.AbstractProcessor

org.apache.nifi.processors.avro.SplitAvro

All Implemented Interfaces:

ConfigurableComponent, Processor

@SideEffectFree
 @SupportsBatching
 @Tags(value={"avro","split"})
 @InputRequirement(value=INPUT_REQUIRED)
 @CapabilityDescription(value="Splits a binary encoded Avro datafile into smaller files based on the configured Output Size. The Output Strategy determines if the smaller files will be Avro datafiles, or bare Avro records with metadata in the FlowFile attributes. The output will always be binary encoded.")
 @WritesAttribute(attribute="fragment.identifier",description="All split FlowFiles produced from the same parent FlowFile will have the same randomly generated UUID added for this attribute") @WritesAttribute(attribute="fragment.index",description="A one-up number that indicates the ordering of the split FlowFiles that were created from a single parent FlowFile") @WritesAttribute(attribute="fragment.count",description="The number of split FlowFiles generated from the parent FlowFile") @WritesAttribute(attribute="segment.original.filename ",description="The filename of the parent FlowFile")
public class SplitAvro
extends AbstractProcessor

Field Summary

Fields

Modifier and Type	Field and Description
static AllowableValue	BARE_RECORD_OUTPUT
static java.lang.String	BARE_RECORD_OUTPUT_VALUE
static AllowableValue	DATAFILE_OUTPUT
static java.lang.String	DATAFILE_OUTPUT_VALUE
static PropertyDescriptor	OUTPUT_SIZE
static PropertyDescriptor	OUTPUT_STRATEGY
static AllowableValue	RECORD_SPLIT
static java.lang.String	RECORD_SPLIT_VALUE
static Relationship	REL_FAILURE
static Relationship	REL_ORIGINAL
static Relationship	REL_SPLIT
static PropertyDescriptor	SPLIT_STRATEGY
static PropertyDescriptor	TRANSFER_METADATA

Constructor Summary

Constructors

Constructor and Description
SplitAvro()

Method Summary

Modifier and Type	Method and Description
java.util.Set<Relationship>	getRelationships()
protected java.util.List<PropertyDescriptor>	getSupportedPropertyDescriptors() Allows subclasses to register which property descriptor objects are supported.
protected void	init(ProcessorInitializationContext context) Provides subclasses the ability to perform initialization logic
void	onTrigger(ProcessContext context, ProcessSession session)

Methods inherited from class org.apache.nifi.processor.AbstractProcessor

onTrigger

Methods inherited from class org.apache.nifi.processor.AbstractSessionFactoryProcessor

getControllerServiceLookup, getIdentifier, getLogger, getNodeTypeProvider, initialize, isConfigurationRestored, isScheduled, toString, updateConfiguredRestoredTrue, updateScheduledFalse, updateScheduledTrue

Methods inherited from class org.apache.nifi.components.AbstractConfigurableComponent

customValidate, equals, getPropertyDescriptor, getPropertyDescriptors, getSupportedDynamicPropertyDescriptor, hashCode, onPropertyModified, validate

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.nifi.components.ConfigurableComponent

getPropertyDescriptor, getPropertyDescriptors, onPropertyModified, validate

Field Detail

RECORD_SPLIT_VALUE

public static final java.lang.String RECORD_SPLIT_VALUE

See Also:

Constant Field Values

RECORD_SPLIT

public static final AllowableValue RECORD_SPLIT

SPLIT_STRATEGY

public static final PropertyDescriptor SPLIT_STRATEGY

OUTPUT_SIZE

public static final PropertyDescriptor OUTPUT_SIZE

DATAFILE_OUTPUT_VALUE

public static final java.lang.String DATAFILE_OUTPUT_VALUE

See Also:

Constant Field Values

BARE_RECORD_OUTPUT_VALUE

public static final java.lang.String BARE_RECORD_OUTPUT_VALUE

See Also:

Constant Field Values

DATAFILE_OUTPUT

public static final AllowableValue DATAFILE_OUTPUT

BARE_RECORD_OUTPUT

public static final AllowableValue BARE_RECORD_OUTPUT

OUTPUT_STRATEGY

public static final PropertyDescriptor OUTPUT_STRATEGY

TRANSFER_METADATA

public static final PropertyDescriptor TRANSFER_METADATA

REL_ORIGINAL

public static final Relationship REL_ORIGINAL

REL_SPLIT

public static final Relationship REL_SPLIT

REL_FAILURE

public static final Relationship REL_FAILURE

Constructor Detail

SplitAvro

public SplitAvro()

Method Detail

init

protected void init(ProcessorInitializationContext context)

Description copied from class: AbstractSessionFactoryProcessor

Provides subclasses the ability to perform initialization logic

Overrides:

init in class AbstractSessionFactoryProcessor

Parameters:

context - in which to perform initialization

getRelationships

public java.util.Set<Relationship> getRelationships()

Specified by:

getRelationships in interface Processor

Overrides:

getRelationships in class AbstractSessionFactoryProcessor

Returns:

Set of all relationships this processor expects to transfer a flow file to. An empty set indicates this processor does not have any destination relationships. Guaranteed non null.

getSupportedPropertyDescriptors

protected java.util.List<PropertyDescriptor> getSupportedPropertyDescriptors()

Description copied from class: AbstractConfigurableComponent

Allows subclasses to register which property descriptor objects are supported. Default return is an empty set.

Overrides:

getSupportedPropertyDescriptors in class AbstractConfigurableComponent

Returns:

PropertyDescriptor objects this processor currently supports

onTrigger

public void onTrigger(ProcessContext context,
                      ProcessSession session)
               throws ProcessException

Specified by:

onTrigger in class AbstractProcessor

Throws:

ProcessException