package process
- Alphabetic
- Public
- Protected
Type Members
- abstract class AbstractLazyParameterInterpreterFunction extends AbstractRichFunction with LazyParameterInterpreterFunction
- abstract class AbstractOneParamLazyParameterFunction[T <: AnyRef] extends AbstractRichFunction with OneParamLazyParameterFunction[T]
- trait BasicFlinkSink extends FlinkSink with ExplicitUidInOperatorsSupport
This is basic Flink sink, which just uses single expression from sink definition
- trait CustomizableContextInitializerSource[Raw] extends AnyRef
- trait CustomizableTimestampWatermarkHandlerSource[Raw] extends AnyRef
- class FlinkContextInitializingFunction[Raw] extends RichMapFunction[Raw, Context]
- trait FlinkCustomJoinTransformation extends AnyRef
Join functionality is not complete, many things are not implemented yet - validation context passed to both BranchExpression and JoinContextTransformationDef should be taken from incoming branches - cannot test&generate test data from other branches
Join functionality is not complete, many things are not implemented yet - validation context passed to both BranchExpression and JoinContextTransformationDef should be taken from incoming branches - cannot test&generate test data from other branches
Additionally, a lot of refactoring should be done - removing tree structures - should CustomNode and Join be sth different in ConfigCreator
Some important TODOs are marked with TODO JOIN
- case class FlinkCustomNodeContext(jobData: JobData, nodeId: String, timeout: FiniteDuration, convertToEngineRuntimeContext: (RuntimeContext) => EngineRuntimeContext, lazyParameterHelper: FlinkLazyParameterFunctionHelper, exceptionHandlerPreparer: (RuntimeContext) => ExceptionHandler, globalParameters: Option[NkGlobalParameters], validationContext: Either[ValidationContext, Map[String, ValidationContext]], typeInformationDetection: TypeInformationDetection, componentUseCase: ComponentUseCase, nodeDeploymentData: Option[NodeDeploymentData]) extends Product with Serializable
- Annotations
- @silent("deprecated")
- trait FlinkCustomStreamTransformation extends AnyRef
- class FlinkLazyParameterFunctionHelper extends Serializable
- trait FlinkSink extends Sink with Serializable
Implementations of this trait can use LazyParameters
- trait FlinkSource extends Source
Source with methods specific for Flink
- trait FlinkSourceTestSupport[Raw] extends SourceTestSupport[Raw]
Support for test mechanism for typical flink sources.
Support for test mechanism for typical flink sources.
- Raw
- type of raw event that is generated by flink source function. This is needed to handle e.g. syntax suggestions in UI (in sources with explicite @MethodToInvoke).
- class LazyParameterFilterFunction extends AbstractOneParamLazyParameterFunction[Boolean] with FilterFunction[Context]
- trait LazyParameterInterpreterFunction extends AnyRef
LazyParameterInterpreter is used to evaluate LazyParamater[T].
LazyParameterInterpreter is used to evaluate LazyParamater[T]. It has to be tied to operator's lifecycle to avoid leaking of resources. Because of this if you need to evaluate parameter, you always need to mixin this trait. Please note that exception thrown during LazyParameter evaluation should be handled - e.g. be wrapping in handling/collect methods
- class LazyParameterMapFunction[T <: AnyRef] extends AbstractOneParamLazyParameterFunction[T] with FlatMapFunction[Context, ValueWithContext[T]]
- trait OneParamLazyParameterFunction[T <: AnyRef] extends LazyParameterInterpreterFunction
- abstract class RichLifecycleFunction extends AbstractRichFunction
- class RichLifecycleMapFunction[T, R] extends RichLifecycleFunction with MapFunction[T, R]
- trait StandardFlinkSource[Raw] extends FlinkSource with CustomizableContextInitializerSource[Raw] with CustomizableTimestampWatermarkHandlerSource[Raw] with ExplicitUidInOperatorsSupport
Source providing standard logic for transforming a
DataStreamSource[Raw]
intoDataStream[Context]
using customizable ContextInitializer and TimestampWatermarkHandler.Source providing standard logic for transforming a
DataStreamSource[Raw]
intoDataStream[Context]
using customizable ContextInitializer and TimestampWatermarkHandler.- Raw
- type of raw event that is generated by flink source function.
Value Members
- object FlinkCustomStreamTransformation
- object StandardFlinkSourceFunctionUtils