| <!-- |
| ~ Licensed to the Apache Software Foundation (ASF) under one |
| ~ or more contributor license agreements. See the NOTICE file |
| ~ distributed with this work for additional information |
| ~ regarding copyright ownership. The ASF licenses this file |
| ~ to you under the Apache License, Version 2.0 (the |
| ~ "License"); you may not use this file except in compliance |
| ~ with the License. You may obtain a copy of the License at |
| ~ |
| ~ http://www.apache.org/licenses/LICENSE-2.0 |
| ~ |
| ~ Unless required by applicable law or agreed to in writing, |
| ~ software distributed under the License is distributed on an |
| ~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY |
| ~ KIND, either express or implied. See the License for the |
| ~ specific language governing permissions and limitations |
| ~ under the License. |
| --> |
| |
| --- |
| title: "Create Dataset, upload data to it and use it in Workflow" |
| weight: 20 |
| --- |
| |
| This tutorial goes through the process of preparing data by creating dataset and creating a workflow to analyze data resided in the dataset using Texera. |
| |
| More specifically, we are going to create a dataset named `Sales Dataset` which contains a file about the sales data of different types of merchandises for several countries. And the workflow will calculate the average sales per item type across different countries in Europe from the [CountrySalesData.csv](statics/files/CountrySalesData.csv) (Make sure the downloaded file is in `.csv` file extension). The sales data has been downloaded from [eforexcel.com](http://eforexcel.com/wp/downloads-18-sample-csv-files-data-sets-for-testing-sales/) and has 100 rows of data. |
| |
| We will first be creating a dataset and uploading the sales data to it. Then we will be creating a workflow on Texera Web UI to |
| 1. read the data from the file; |
| 2. filter the relevant data based on keywords; |
| 3. perform an aggregation. |
| |
| **1. Upload data by creating a Dataset** |
| * Go to the Dataset tab and click the `dataset creation` icon to start creating the datasaet |
| * Name the dataset as `Sales Dataset`, drag and drop the `CountrySalesData.csv` to the file uploading area |
| * Click `Create`, the dataset we just created, along with the preview of `CountrySalesData.csv` is shown. |
|  |
| |
| **2. Read data in Workflow** |
| * On the left panel, go to the `environment` tab and click `Add Dataset` to add the `Sales Dataset` to current workflow. `CountrySalesData.csv` will be available to be previewed and loaded to the workflow. |
| ' |
| * Drag and drop a `CSV File Scan` operator. On the right panel, input the file name `CountrySalesData.csv` and select the path from the drop down menu |
| * Run the workflow, you should be able to see the loaded sales data. |
|  |
| |
| |
| **3. Add operators to analyze data** |
| * Drag and drop a `Filter` operator to keep only the sales data in `Europe` |
|  |
| |
| * Drag and drop a `Aggregate` operator to get the average sold units group by `Item Type` |
|  |
| |
