{
  "unversionedId": "pipeline-elements",
  "id": "version-0.66.0/pipeline-elements",
  "title": "Overview",
  "description": "Data ProcessorAbsenceDetects whether an event does not arrive within a specified time after the occurrence of another event.  Documentation  Docker Container  Code on GithubData ProcessorAggregationPerforms different aggregation functions  Documentation  Docker Container  Code on GithubData ProcessorAndDetects whether an event co-occurs with another event within a given time.  Documentation  Docker Container  Code on GithubData SinkApache KafkaConsumes messages from an Apache Kafka broker  Documentation  Docker Container  Code on GithubData SinkApache PulsarConsumes messages from an Apache Pulsar broker  Documentation  Docker Container  Code on GithubData ProcessorBoilerplate RemovalRemoves boilerplate and extract fulltext from HTML  Documentation  Docker Container  Code on GithubData ProcessorBoolean CounterIncreases a counter on each change of a boolean value  Documentation  Docker Container  Code on GithubData ProcessorBoolean InverterInverts the boolean value of the selected field  Documentation  Docker Container  Code on GithubData ProcessorBoolean TimerMeasures how long a boolean measure does not change  Documentation  Docker Container  Code on GithubData SinkBuffered REST PublisherOnce a given amount of events is reached, events are posted to the given REST interface.  Documentation  Docker Container  Code on GithubData ProcessorCSV Metadata EnricherEnriches an event with additional fields from a  Documentation  Docker Container  Code on GithubData ProcessorCalculate DurationCalculates the time between two timestamps.  Documentation  Docker Container  Code on GithubData ProcessorChunker (English)Segments given tokens of a text into different chunks  Documentation  Docker Container  Code on GithubData SinkCoindesk Bitcoin PriceThe current bitcoin price from the Coindesk API.  Documentation  Docker Container  Code on GithubData ProcessorComposeMerges two event streams  Documentation  Docker Container  Code on GithubData SinkCouchDBStores events in an Apache CouchDB database.  Documentation  Docker Container  Code on GithubData ProcessorCount AggregationPerforms an aggregation based on a given event property and outputs the number of occurrences.  Documentation  Docker Container  Code on GithubData ProcessorCount ArrayCounts the size of list items.  Documentation  Docker Container  Code on GithubData ProcessorCreates JTS PointCreates a JTS Point from Latitude and Longitude values  Documentation  Docker Container  Code on GithubData SinkDashboard SinkVisualizes data streams in the StreamPipes dashboard  Documentation  Docker Container  Code on GithubData SinkData LakeStores events in the StreamPipes data lake.  Documentation  Docker Container  Code on GithubData ProcessorDistance CalculatorCalculates the distance between two geo points  Documentation  Docker Container  Code on GithubData ProcessorEPSG CodeAdds a corresponding EPSG Code to the Geo-Event  Documentation  Docker Container  Code on GithubData SinkEclipse DittoPublishes events to Eclipse Ditto.  Documentation  Docker Container  Code on GithubData SinkElasticsearchStores data in an elasticsearch cluster  Documentation  Docker Container  Code on GithubData SinkEmail NotificationEmail service to send notifications emails  Documentation  Docker Container  Code on GithubData ProcessorEvent CounterCounts the number of events within a time window.  Documentation  Docker Container  Code on GithubData ProcessorEvent RateComputes current event rate. Output is a number representing events per second.  Documentation  Docker Container  Code on GithubData ProcessorField ConverterConverts a string value to a number data type  Documentation  Docker Container  Code on GithubData ProcessorField HasherHashes the value of a field using various hash functions.  Documentation  Docker Container  Code on GithubData ProcessorField MapperReplaces one or more field with a new field and computes a hash value of these fields  Documentation  Docker Container  Code on GithubData ProcessorField RenamerReplaces the runtime name of an event property with a custom defined name.  Documentation  Docker Container  Code on GithubData SinkFile SetReads the content from a local file.  Documentation  Docker Container  Code on GithubData SinkFile Streamnull  Documentation  Docker Container  Code on GithubData ProcessorFrequency CalculationCalculates the frequency of the event stream  Documentation  Docker Container  Code on GithubData ProcessorFrequency ChangeDetects when the frequency of the event stream changes  Documentation  Docker Container  Code on GithubData SinkGDELTGlobal Database of Society  Documentation  Docker Container  Code on GithubData ProcessorGeneric Image ClassificationClassification Description (Generic Model)  Documentation  Docker Container  Code on GithubData ProcessorGoogle Maps GeocoderGeocodes a placename to a latitude/longitude combination  Documentation  Docker Container  Code on GithubData SinkHTTP SetRegularly poll an HTTP endpoint  Documentation  Docker Container  Code on GithubData SinkHTTP StreamContinuously fetched events from an HTTP REST endpoint.  Documentation  Docker Container  Code on GithubData SinkIEX Cloud NewsFetches news for a given company (10 news / minutes maximum)  Documentation  Docker Container  Code on GithubData SinkIEX Cloud Stock QuotesLive stock data provided by the IEXCloud API  Documentation  Docker Container  Code on GithubData SinkISS LocationCurrent Location of the International Space Station (ISS)  Documentation  Docker Container  Code on GithubData ProcessorImage CropperCrops an image based on given bounding box coordinates  Documentation  Docker Container  Code on GithubData ProcessorImage EnricherEnriches an image with a bounding box of given coordinates  Documentation  Docker Container  Code on GithubData SinkImage Upload (Set)  Documentation  Docker Container  Code on GithubData SinkImage Upload (Stream)  Documentation  Docker Container  Code on GithubData SinkInfluxDBStores events in an InfluxDB.  Documentation  Docker Container  Code on GithubData SinkInfluxDB Set AdapterCreates a data set for an InfluxDB measurement  Documentation  Docker Container  Code on GithubData SinkInfluxDB Stream AdapterCreates a data stream for an InfluxDB measurement  Documentation  Docker Container  Code on GithubData SinkIoTDBStores events in a IoTDB database.  Documentation  Docker Container  Code on GithubData SinkJMS PublisherPublishes events to a JMS topic  Documentation  Docker Container  Code on GithubData SinkKafka PublisherPublish events to Apache Kafka  Documentation  Docker Container  Code on GithubData ProcessorLanguage DetectionDetects the language of a written text.  Documentation  Docker Container  Code on GithubData ProcessorLanguage DetectionDetects the language of a given text  Documentation  Docker Container  Code on GithubData SinkMQTTnull  Documentation  Docker Container  Code on GithubData SinkMQTT PublisherPublishes events to a MQTT topic  Documentation  Docker Container  Code on GithubData ProcessorMathPerforms calculations on event properties (+, -, , /, %)  Documentation  Docker Container  Code on GithubData ProcessorMeasure Time Between Two SensorsRequires two booleans and measures the time between two signals  Documentation  Docker Container  Code on GithubData ProcessorMeasurement Unit ConverterConverts a unit of measurement to another one  Documentation  Docker Container  Code on GithubData ProcessorMerge By EnrichMerges two event streams by adding properties of one stream to the other  Documentation  Docker Container  Code on GithubData ProcessorMerge By TimeMerges two event streams by timestamp  Documentation  Docker Container  Code on GithubData SinkMySQL Set AdapterCreates a data set from an SQL table  Documentation  Docker Container  Code on GithubData SinkMySql Stream AdapterCreates a data stream for a SQL table  Documentation  Docker Container  Code on GithubData SinkNETIO MQTT M2MConnect a NETIO power plugs over MQTT  Documentation  Docker Container  Code on GithubData SinkNETIO http JSONConnect a NETIO REST power plug  Documentation  Docker Container  Code on GithubData SinkNSW Traffic CamerasTraffic camera images produced by NSW Australia  Documentation  Docker Container  Code on GithubData ProcessorName FinderFinds a name in given Tokens of one document  Documentation  Docker Container  Code on GithubData SinkNotificationPublish a notification to the StreamPipes UI.  Documentation  Docker Container  Code on GithubData ProcessorNumerical FilterNumerical Filter Description  Documentation  Docker Container  Code on GithubData ProcessorNumerical Filter (Siddhi)  Documentation  Docker Container  Code on GithubData ProcessorNumerical Text FilterFilters numerical and text values.  Documentation  Docker Container  Code on GithubData SinkOPC UAReads values from an OPC-UA server  Documentation  Docker Container  Code on GithubData SinkOPC-UAWrites values in an OPC-UA server  Documentation  Docker Container  Code on GithubData SinkOneSignalSend Push Message to OneSignal-Application  Documentation  Docker Container  Code on GithubData SinkPLC4X S7Connect directly to your PLC  Documentation  Docker Container  Code on GithubData ProcessorPart of Speech (English)Takes in a stream of tokens and appends a tag at the end of the word corresponding to the part of speech  Documentation  Docker Container  Code on GithubData ProcessorPeak DetectionDetect peaks in time series data  Documentation  Docker Container  Code on GithubData SinkPostgreSQLStores events in a Postgres database.  Documentation  Docker Container  Code on GithubData ProcessorProjectionOutputs a selectable subset of an input event type  Documentation  Docker Container  Code on GithubData SinkPulsar PublisherPublish events to Apache Pulsar  Documentation  Docker Container  Code on GithubData ProcessorQR Code ReaderDetects a QR Code in an image  Documentation  Docker Container  Code on GithubData SinkREST PublisherPosts events to a REST interface  Documentation  Docker Container  Code on GithubData SinkROS BridgeConnect Robots running on ROS.  Documentation  Docker Container  Code on GithubData SinkRabbitMQ PublisherForwards events to a RabbitMQ broker  Documentation  Docker Container  Code on GithubData SinkRandom Data Simulator (Set)Publishes a bounded stream of random events  Documentation  Docker Container  Code on GithubData SinkRandom Data Simulator (Stream)Publishes a continuous stream of random events  Documentation  Docker Container  Code on GithubData ProcessorReverse GeocoderFinds the nearest place based on latitude and longitude  Documentation  Docker Container  Code on GithubData ProcessorSentence Detection (English)Splits a text up in sentences  Documentation  Docker Container  Code on GithubData ProcessorSequenceDetects a sequence of events.  Documentation  Docker Container  Code on GithubData ProcessorSequence DetectionMerges events from two event streams, when the top event arrives first and then the bottom event  Documentation  Docker Container  Code on GithubData ProcessorSingle Trajectory CreatorCreates a trajectory from JTS point events  Documentation  Docker Container  Code on GithubData ProcessorSize MeasureMeasures the size of an event in Bytes, KB or MB  Documentation  Docker Container  Code on GithubData SinkSlackSubscribes to a Slack channel  Documentation  Docker Container  Code on GithubData SinkSlack NotificationSlack bot to send notifications to Slack  Documentation  Docker Container  Code on GithubData ProcessorSpatial Grid EnrichmentGroups spatial events into cells of a given size  Documentation  Docker Container  Code on GithubData ProcessorSpeed CalculatorCalculates the speed of two latlng pairs in kilometers per hour  Documentation  Docker Container  Code on GithubData ProcessorSplit ArrayOutputs an event for each entry of a list.  Documentation  Docker Container  Code on GithubData ProcessorStatic Distance CalculatorCalculates the distance between a fixed location and a moving location  Documentation  Docker Container  Code on GithubData ProcessorStatic Google Maps GeocoderGeocodes a fixed placename to lat/lng coordinates and  Documentation  Docker Container  Code on GithubData ProcessorStatic MathPerforms calculation on an event property with a static value (+, -, , /, %)  Documentation  Docker Container  Code on GithubData ProcessorStatistics SummaryCalculate simple descriptive summary statistics  Documentation  Docker Container  Code on GithubData ProcessorStream Stop DetectionTriggers an event when the input data stream stops sending events  Documentation  Docker Container  Code on GithubData ProcessorString CounterIncreases a counter on each change of a string value.  Documentation  Docker Container  Code on GithubData ProcessorString TimerMeasures how long a string value does not change  Documentation  Docker Container  Code on GithubData SinkTI Sensor Tagnull  Documentation  Docker Container  Code on GithubData ProcessorTask DurationComputes the time difference between two events  Documentation  Docker Container  Code on GithubData ProcessorText FilterText Filter Description  Documentation  Docker Container  Code on GithubData ProcessorThreshold DetectorWhen threshold rule is fulfilled true is appended  Documentation  Docker Container  Code on GithubData ProcessorTimestamp EnricherAppends the current time in ms to the event payload  Documentation  Docker Container  Code on GithubData ProcessorTimestamp ExtractorExtracts a timestamp into its individual time fields.  Documentation  Docker Container  Code on GithubData ProcessorTokenizer (English)Segments a text into different tokens  Documentation  Docker Container  Code on GithubData ProcessorTransform to booleanTransforms a string or number to a boolean  Documentation  Docker Container  Code on GithubData ProcessorTrendDetects the increase of a numerical field over a customizable time window. Example: A temperature value increases by 10 percent within 5 minutes.  Documentation  Docker Container  Code on GithubData ProcessorTrigonometry FunctionsPerforms Trigonometric functions on event properties  Documentation  Docker Container  Code on GithubData ProcessorURL DereferencingAppend the html page as a string to event  Documentation  Docker Container  Code on GithubData ProcessorValue ChangedOutpus an event every time a specific field changes.  Documentation  Docker Container  Code on GithubData SinkWikipedia EditsContinuously publishes recent Wikipedia edits  Documentation  Docker Container  Code on GithubData SinkWikipedia New ArticlesContinuously publishes articles created on Wikipedia  Documentation  Docker Container  Code on GithubData ProcessorWord CountCounts words on continuous text-based streams  Documentation  Docker Container  Code on Github",
  "source": "@site/versioned_docs/version-0.66.0/pipeline-elements.md",
  "sourceDirName": ".",
  "slug": "/pipeline-elements",
  "permalink": "/docs/0.66.0/pipeline-elements",
  "draft": false,
  "tags": [],
  "version": "0.66.0",
  "lastUpdatedBy": "Author",
  "lastUpdatedAt": 1539502055,
  "formattedLastUpdatedAt": "Oct 14, 2018",
  "frontMatter": {
    "id": "pipeline-elements",
    "title": "Overview",
    "sidebar_label": "Overview",
    "original_id": "pipeline-elements"
  }
}