{
  "unversionedId": "pipeline-elements",
  "id": "version-0.64.0-pre-asf/pipeline-elements",
  "title": "Overview",
  "description": "Data ProcessorAggregationPerforms different aggregation functions  Documentation  Docker Container  Code on GithubData ProcessorBoilerplate RemovalRemoves boilerplate and extract fulltext from HTML  Documentation  Docker Container  Code on GithubData ProcessorBoolean CounterIncreases a counter on each change of a boolean value  Documentation  Docker Container  Code on GithubData ProcessorBoolean InverterInverts the boolean value of the selected field  Documentation  Docker Container  Code on GithubData ProcessorBoolean TimerMeasures how long a boolean measure does not change  Documentation  Docker Container  Code on GithubData SinkBuffered REST PublisherOnce a given amount of events is reached, events are posted to the given REST interface.  Documentation  Docker Container  Code on GithubData ProcessorCSV Metadata EnricherEnriches an event with additional fields from a  Documentation  Docker Container  Code on GithubData ProcessorCalculate DurationCalculates the time between two timestamps.  Documentation  Docker Container  Code on GithubData ProcessorChunker (English)Segments given tokens of a text into different chunks  Documentation  Docker Container  Code on GithubData ProcessorComposeMerges two event streams  Documentation  Docker Container  Code on GithubData SinkCouchDBStores events in an Apache CouchDB database.  Documentation  Docker Container  Code on GithubData ProcessorCount ArrayCounts the size of list items.  Documentation  Docker Container  Code on GithubData SinkDashboard SinkVisualizes data streams in the StreamPipes dashboard  Documentation  Docker Container  Code on GithubData SinkData LakeStores events in the StreamPipes data lake.  Documentation  Docker Container  Code on GithubData ProcessorDistance CalculatorCalculates the distance between two geo points  Documentation  Docker Container  Code on GithubData SinkEclipse DittoPublishes events to Eclipse Ditto.  Documentation  Docker Container  Code on GithubData SinkElasticsearchStores data in an elasticsearch cluster  Documentation  Docker Container  Code on GithubData SinkEmail NotificationEmail service to send notifications emails  Documentation  Docker Container  Code on GithubData ProcessorEvent CounterCounts the number of events within a time window.  Documentation  Docker Container  Code on GithubData ProcessorEvent RateComputes current event rate. Output is a number representing events per second.  Documentation  Docker Container  Code on GithubData ProcessorField ConverterConverts a string value to a number data type  Documentation  Docker Container  Code on GithubData ProcessorField HasherHashes the value of a field using various hash functions.  Documentation  Docker Container  Code on GithubData ProcessorField MapperReplaces one or more field with a new field and computes a hash value of these fields  Documentation  Docker Container  Code on GithubData ProcessorField RenamerReplaces the runtime name of an event property with a custom defined name.  Documentation  Docker Container  Code on GithubData ProcessorFrequency CalculationCalculates the frequency of the event stream  Documentation  Docker Container  Code on GithubData ProcessorFrequency ChangeDetects when the frequency of the event stream changes  Documentation  Docker Container  Code on GithubData ProcessorGeneric Image ClassificationClassification Description (Generic Model)  Documentation  Docker Container  Code on GithubData ProcessorGoogle Maps GeocoderGeocodes a placename to a latitude/longitude combination  Documentation  Docker Container  Code on GithubData ProcessorImage EnricherEnriches an image with a bounding box of given coordinates  Documentation  Docker Container  Code on GithubData SinkInfluxDBStores events in an InfluxDB.  Documentation  Docker Container  Code on GithubData SinkIoTDBStores events in a IoTDB database.  Documentation  Docker Container  Code on GithubData SinkJMS PublisherPublishes events to a JMS topic  Documentation  Docker Container  Code on GithubData SinkKafka PublisherPublish events to Apache Kafka  Documentation  Docker Container  Code on GithubData ProcessorLanguage DetectionDetects the language of a written text.  Documentation  Docker Container  Code on GithubData ProcessorLanguage DetectionDetects the language of a given text  Documentation  Docker Container  Code on GithubData ProcessorMathPerforms calculations on event properties (+, -, , /, %)  Documentation  Docker Container  Code on GithubData ProcessorMeasure Time Between Two SensorsRequires two booleans and measures the time between two signals  Documentation  Docker Container  Code on GithubData ProcessorMeasurement Unit ConverterConverts a unit of measurement to another one  Documentation  Docker Container  Code on GithubData ProcessorMerge By EnrichMerges two event streams by adding properties of one stream to the other  Documentation  Docker Container  Code on GithubData ProcessorMerge By TimeMerges two event streams by timestamp  Documentation  Docker Container  Code on GithubData ProcessorName FinderFinds a name in given Tokens of one document  Documentation  Docker Container  Code on GithubData SinkNotificationPublish a notification to the StreamPipes UI.  Documentation  Docker Container  Code on GithubData ProcessorNumerical FilterNumerical Filter Description  Documentation  Docker Container  Code on GithubData ProcessorNumerical Filter (Siddhi)  Documentation  Docker Container  Code on GithubData ProcessorNumerical Text FilterFilters numerical and text values.  Documentation  Docker Container  Code on GithubData SinkOPC-UAWrites values in an OPC-UA server  Documentation  Docker Container  Code on GithubData SinkOneSignalSend Push Message to OneSignal-Application  Documentation  Docker Container  Code on GithubData ProcessorPart of Speech (English)Takes in a stream of tokens and appends a tag at the end of the word corresponding to the part of speech  Documentation  Docker Container  Code on GithubData ProcessorPeak DetectionDetect peaks in time series data  Documentation  Docker Container  Code on GithubData SinkPostgreSQLStores events in a Postgres database.  Documentation  Docker Container  Code on GithubData ProcessorProjectionOutputs a selectable subset of an input event type  Documentation  Docker Container  Code on GithubData SinkPulsar PublisherPublish events to Apache Pulsar  Documentation  Docker Container  Code on GithubData ProcessorQR Code ReaderDetects a QR Code in an image  Documentation  Docker Container  Code on GithubData SinkREST PublisherPosts events to a REST interface  Documentation  Docker Container  Code on GithubData SinkRabbitMQ PublisherForwards events to a RabbitMQ broker  Documentation  Docker Container  Code on GithubData ProcessorReverse GeocoderFinds the nearest place based on latitude and longitude  Documentation  Docker Container  Code on GithubData ProcessorSentence Detection (English)Splits a text up in sentences  Documentation  Docker Container  Code on GithubData ProcessorSequence DetectionMerges events from two event streams, when the top event arrives first and then the bottom event  Documentation  Docker Container  Code on GithubData ProcessorSize MeasureMeasures the size of an event in Bytes, KB or MB  Documentation  Docker Container  Code on GithubData SinkSlack NotificationSlack bot to send notifications to Slack  Documentation  Docker Container  Code on GithubData ProcessorSpatial Grid EnrichmentGroups spatial events into cells of a given size  Documentation  Docker Container  Code on GithubData ProcessorSplit ArrayOutputs an event for each entry of a list.  Documentation  Docker Container  Code on GithubData ProcessorStatic Google Maps GeocoderGeocodes a fixed placename to lat/lng coordinates and  Documentation  Docker Container  Code on GithubData ProcessorStatic MathPerforms calculation on an event property with a static value (+, -, , /, %)  Documentation  Docker Container  Code on GithubData ProcessorStream Stop DetectionTriggers an event when the input data stream stops sending events  Documentation  Docker Container  Code on GithubData ProcessorTask DurationComputes the time difference between two events  Documentation  Docker Container  Code on GithubData ProcessorText FilterText Filter Description  Documentation  Docker Container  Code on GithubData ProcessorThreshold DetectorWhen threshold rule is fulfilled true is appended  Documentation  Docker Container  Code on GithubData ProcessorTimestamp EnricherAppends the current time in ms to the event payload  Documentation  Docker Container  Code on GithubData ProcessorTimestamp ExtractorExtracts a timestamp into its individual time fields.  Documentation  Docker Container  Code on GithubData ProcessorTokenizer (English)Segments a text into different tokens  Documentation  Docker Container  Code on GithubData ProcessorTransform to booleanTransforms a string or number to a boolean  Documentation  Docker Container  Code on GithubData ProcessorTrendDetects the increase of a numerical field over a customizable time window. Example: A temperature value increases by 10 percent within 5 minutes.  Documentation  Docker Container  Code on GithubData ProcessorTrigonometry FunctionsPerforms Trigonometric functions on event properties  Documentation  Docker Container  Code on GithubData ProcessorURL DereferencingAppend the html page as a string to event  Documentation  Docker Container  Code on GithubData ProcessorValue ChangedOutpus an event every time a specific field changes.  Documentation  Docker Container  Code on GithubData ProcessorWord CountCounts words on continuous text-based streams  Documentation  Docker Container  Code on Github",
  "source": "@site/versioned_docs/version-0.64.0-pre-asf/pipeline-elements.md",
  "sourceDirName": ".",
  "slug": "/pipeline-elements",
  "permalink": "/docs/0.64.0-pre-asf/pipeline-elements",
  "draft": false,
  "tags": [],
  "version": "0.64.0-pre-asf",
  "lastUpdatedBy": "Author",
  "lastUpdatedAt": 1539502055,
  "formattedLastUpdatedAt": "Oct 14, 2018",
  "frontMatter": {
    "id": "pipeline-elements",
    "title": "Overview",
    "sidebar_label": "Overview",
    "original_id": "pipeline-elements"
  }
}