blob: 70b6e5f07d927a5745ea0a9f3af879fe098d401b [file] [log] [blame]
{
"unversionedId": "pipeline-elements",
"id": "version-0.64.0-pre-asf/pipeline-elements",
"title": "Overview",
"description": "Data ProcessorAggregationPerforms different aggregation functions Documentation Docker Container Code on GithubData ProcessorBoilerplate RemovalRemoves boilerplate and extract fulltext from HTML Documentation Docker Container Code on GithubData ProcessorBoolean CounterIncreases a counter on each change of a boolean value Documentation Docker Container Code on GithubData ProcessorBoolean InverterInverts the boolean value of the selected field Documentation Docker Container Code on GithubData ProcessorBoolean TimerMeasures how long a boolean measure does not change Documentation Docker Container Code on GithubData SinkBuffered REST PublisherOnce a given amount of events is reached, events are posted to the given REST interface. Documentation Docker Container Code on GithubData ProcessorCSV Metadata EnricherEnriches an event with additional fields from a Documentation Docker Container Code on GithubData ProcessorCalculate DurationCalculates the time between two timestamps. Documentation Docker Container Code on GithubData ProcessorChunker (English)Segments given tokens of a text into different chunks Documentation Docker Container Code on GithubData ProcessorComposeMerges two event streams Documentation Docker Container Code on GithubData SinkCouchDBStores events in an Apache CouchDB database. Documentation Docker Container Code on GithubData ProcessorCount ArrayCounts the size of list items. Documentation Docker Container Code on GithubData SinkDashboard SinkVisualizes data streams in the StreamPipes dashboard Documentation Docker Container Code on GithubData SinkData LakeStores events in the StreamPipes data lake. Documentation Docker Container Code on GithubData ProcessorDistance CalculatorCalculates the distance between two geo points Documentation Docker Container Code on GithubData SinkEclipse DittoPublishes events to Eclipse Ditto. Documentation Docker Container Code on GithubData SinkElasticsearchStores data in an elasticsearch cluster Documentation Docker Container Code on GithubData SinkEmail NotificationEmail service to send notifications emails Documentation Docker Container Code on GithubData ProcessorEvent CounterCounts the number of events within a time window. Documentation Docker Container Code on GithubData ProcessorEvent RateComputes current event rate. Output is a number representing events per second. Documentation Docker Container Code on GithubData ProcessorField ConverterConverts a string value to a number data type Documentation Docker Container Code on GithubData ProcessorField HasherHashes the value of a field using various hash functions. Documentation Docker Container Code on GithubData ProcessorField MapperReplaces one or more field with a new field and computes a hash value of these fields Documentation Docker Container Code on GithubData ProcessorField RenamerReplaces the runtime name of an event property with a custom defined name. Documentation Docker Container Code on GithubData ProcessorFrequency CalculationCalculates the frequency of the event stream Documentation Docker Container Code on GithubData ProcessorFrequency ChangeDetects when the frequency of the event stream changes Documentation Docker Container Code on GithubData ProcessorGeneric Image ClassificationClassification Description (Generic Model) Documentation Docker Container Code on GithubData ProcessorGoogle Maps GeocoderGeocodes a placename to a latitude/longitude combination Documentation Docker Container Code on GithubData ProcessorImage EnricherEnriches an image with a bounding box of given coordinates Documentation Docker Container Code on GithubData SinkInfluxDBStores events in an InfluxDB. Documentation Docker Container Code on GithubData SinkIoTDBStores events in a IoTDB database. Documentation Docker Container Code on GithubData SinkJMS PublisherPublishes events to a JMS topic Documentation Docker Container Code on GithubData SinkKafka PublisherPublish events to Apache Kafka Documentation Docker Container Code on GithubData ProcessorLanguage DetectionDetects the language of a written text. Documentation Docker Container Code on GithubData ProcessorLanguage DetectionDetects the language of a given text Documentation Docker Container Code on GithubData ProcessorMathPerforms calculations on event properties (+, -, , /, %) Documentation Docker Container Code on GithubData ProcessorMeasure Time Between Two SensorsRequires two booleans and measures the time between two signals Documentation Docker Container Code on GithubData ProcessorMeasurement Unit ConverterConverts a unit of measurement to another one Documentation Docker Container Code on GithubData ProcessorMerge By EnrichMerges two event streams by adding properties of one stream to the other Documentation Docker Container Code on GithubData ProcessorMerge By TimeMerges two event streams by timestamp Documentation Docker Container Code on GithubData ProcessorName FinderFinds a name in given Tokens of one document Documentation Docker Container Code on GithubData SinkNotificationPublish a notification to the StreamPipes UI. Documentation Docker Container Code on GithubData ProcessorNumerical FilterNumerical Filter Description Documentation Docker Container Code on GithubData ProcessorNumerical Filter (Siddhi) Documentation Docker Container Code on GithubData ProcessorNumerical Text FilterFilters numerical and text values. Documentation Docker Container Code on GithubData SinkOPC-UAWrites values in an OPC-UA server Documentation Docker Container Code on GithubData SinkOneSignalSend Push Message to OneSignal-Application Documentation Docker Container Code on GithubData ProcessorPart of Speech (English)Takes in a stream of tokens and appends a tag at the end of the word corresponding to the part of speech Documentation Docker Container Code on GithubData ProcessorPeak DetectionDetect peaks in time series data Documentation Docker Container Code on GithubData SinkPostgreSQLStores events in a Postgres database. Documentation Docker Container Code on GithubData ProcessorProjectionOutputs a selectable subset of an input event type Documentation Docker Container Code on GithubData SinkPulsar PublisherPublish events to Apache Pulsar Documentation Docker Container Code on GithubData ProcessorQR Code ReaderDetects a QR Code in an image Documentation Docker Container Code on GithubData SinkREST PublisherPosts events to a REST interface Documentation Docker Container Code on GithubData SinkRabbitMQ PublisherForwards events to a RabbitMQ broker Documentation Docker Container Code on GithubData ProcessorReverse GeocoderFinds the nearest place based on latitude and longitude Documentation Docker Container Code on GithubData ProcessorSentence Detection (English)Splits a text up in sentences Documentation Docker Container Code on GithubData ProcessorSequence DetectionMerges events from two event streams, when the top event arrives first and then the bottom event Documentation Docker Container Code on GithubData ProcessorSize MeasureMeasures the size of an event in Bytes, KB or MB Documentation Docker Container Code on GithubData SinkSlack NotificationSlack bot to send notifications to Slack Documentation Docker Container Code on GithubData ProcessorSpatial Grid EnrichmentGroups spatial events into cells of a given size Documentation Docker Container Code on GithubData ProcessorSplit ArrayOutputs an event for each entry of a list. Documentation Docker Container Code on GithubData ProcessorStatic Google Maps GeocoderGeocodes a fixed placename to lat/lng coordinates and Documentation Docker Container Code on GithubData ProcessorStatic MathPerforms calculation on an event property with a static value (+, -, , /, %) Documentation Docker Container Code on GithubData ProcessorStream Stop DetectionTriggers an event when the input data stream stops sending events Documentation Docker Container Code on GithubData ProcessorTask DurationComputes the time difference between two events Documentation Docker Container Code on GithubData ProcessorText FilterText Filter Description Documentation Docker Container Code on GithubData ProcessorThreshold DetectorWhen threshold rule is fulfilled true is appended Documentation Docker Container Code on GithubData ProcessorTimestamp EnricherAppends the current time in ms to the event payload Documentation Docker Container Code on GithubData ProcessorTimestamp ExtractorExtracts a timestamp into its individual time fields. Documentation Docker Container Code on GithubData ProcessorTokenizer (English)Segments a text into different tokens Documentation Docker Container Code on GithubData ProcessorTransform to booleanTransforms a string or number to a boolean Documentation Docker Container Code on GithubData ProcessorTrendDetects the increase of a numerical field over a customizable time window. Example: A temperature value increases by 10 percent within 5 minutes. Documentation Docker Container Code on GithubData ProcessorTrigonometry FunctionsPerforms Trigonometric functions on event properties Documentation Docker Container Code on GithubData ProcessorURL DereferencingAppend the html page as a string to event Documentation Docker Container Code on GithubData ProcessorValue ChangedOutpus an event every time a specific field changes. Documentation Docker Container Code on GithubData ProcessorWord CountCounts words on continuous text-based streams Documentation Docker Container Code on Github",
"source": "@site/versioned_docs/version-0.64.0-pre-asf/pipeline-elements.md",
"sourceDirName": ".",
"slug": "/pipeline-elements",
"permalink": "/docs/0.64.0-pre-asf/pipeline-elements",
"draft": false,
"tags": [],
"version": "0.64.0-pre-asf",
"lastUpdatedBy": "Author",
"lastUpdatedAt": 1539502055,
"formattedLastUpdatedAt": "Oct 14, 2018",
"frontMatter": {
"id": "pipeline-elements",
"title": "Overview",
"sidebar_label": "Overview",
"original_id": "pipeline-elements"
}
}