#Functional Test cases
TestCase ID | Test Page | Test Case Description | Test Case Steps | Test Data | Expected Result | Actual Result | Test Result | Jira Bug ID |
---|---|---|---|---|---|---|---|---|
0101 | login page | invalid corp id - check user cannot login the system with invalid corp id. | 1. Input invalid corp id. 2. Input password. 3. click ‘log in’ button. | 1. login failed. | Passed | |||
0102 | login page | invalid password - check user cannot login the system with invalid password. | 1. input valid corp id. 2.input invalid password 3.click ‘log in’ button. | 1. login failed. | Passed | |||
0103 | login page | valid corp id and passoword - check user can login the system with valid corp id and password. | 1. Input the corp id and password. 2 click ‘log in’ button. | 1. login succesfully | Passed | |||
0104 | login page | remember password | 1. Input the corp id and password. 2. select ‘remember password’. 3.click ‘log in’ button. 4. close the brower. 5. open the brower again. 6. visit the griffin page. | 1.the id and password are valid. 2.‘remember password’ is checked. 3.logged in the griffin homepage. 4.the brower is closed. 5.the brower is reopened. 6.the griffin homepage is opened, instead of the login page. | Passed | |||
0105 | login page | not remember password | 1. Input the corp id and password. 2. unselect ‘remember password’. 3.click ‘log in’ button. 4. close the brower. 5. open the brower again. 6. visit the griffin page. | 1.the id and password are valid. 2.‘remember password’ is unchecked. 3.logged in the griffin homepage. 4.the brower is closed. 5.the brower is reopened. 6.the login page is opened. | Passed | |||
0201 | main page | menu bar - check all links in the menu work. | 1. click ‘health’. 2. click ‘models’. 3.click ‘Data profiling’. 4. click your username -> ‘API Docs’. | 1.show ‘health’ page. 2.show ‘models’ page. 3.show ‘data profiling’ page 4.open new page for API page. | Passed | |||
0202 | main page | menu bar - search | 1.input a word in the search box. 2.do search. | 1. show search result. | unimplemented | |||
0203 | main page | menu bar - user profile | 1. click username -> ‘user profile’ | 1. show user profile page | unimplemented | |||
0204 | main page | menu bar - setting | 1. click username -> ‘setting’ | 1. show setting page. | unimplemented | |||
0205 | main page | right side - DataAssets | 1. click ‘*** DataAssets’ link | 1.show the data assets page. | Passed | |||
0206 | main page | right side - DQ Metrics | 1. click ‘*** DQ Metrics’ link. | 1. show DQ Metrics page | Passed | |||
0207 | main page | right side - health percentage | 1. check the pie for the health percentage. | 1. show the health percentage. | Passed | |||
0208 | main page | right side - issue tracking | 1. click ‘issue tracking’ | 1. show ‘issue tracking’ page | unimplemented | |||
0209 | main page | right side - statistics for the DQ data. | 1. check the DQ data with the name, last updated time, and the data quality. 2. show more for one item, check the dq trend chart. 3. click the chart. 4. close the zoomed-in chart. | 1.show all the dq data. 2.show the latest dq trend chart for the item. 3.the dq chart is zoomed in. 4.the zoomed-in chart is closed. | Passed | |||
0210 | main page | right side - report issue. | 1. click ‘Report issue’ | 1. open the jira page. | Passed | |||
0301 | health page | heatmap | 1. open ‘heatmap’ tab. 2. check the data quality metrics heatmap. 3. click inside the heatmap. | 1.show the heatmap. 2.all the data are shown successfully. 3.show the metrics page. | Passed | |||
0302 | health page | Topology | 1. open ‘Topology’ tab. 2. check the data. | 1. show topology. | unimplemented | |||
0303 | health page | check the UI layout when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1. display the page correctly. | Passed | |||
0401 | metrics page | check metrics data | 1. check the dq charts for the metrics. 2. click one chart. | 1. all the data in the dq charts are correct. 2. the chart is zoomed in. | Passed | |||
0402 | metrics page | Download Sample | 1. click ‘download sample’. | 1. the sample is downloaded to the local path. | unimplemented | |||
0403 | metrics page | Profiling | 1. click ‘profiling’ | 1. show ‘profiling’ | unimplemented | |||
0404 | metrics page | check the UI layout when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1. display the page correctly. | Passed | |||
0501 | models page | check the models data | 1. check all the columns are correct or not. 2. click one model name. | 1. all the data are correct. 2. show more information of the model. | Passed | |||
0502 | models page | edit model | 1. click ‘edit’ icon. | 1. open the edit page. | unimplemented | |||
0503 | models page | delete model | 1. click ‘delete’ icon for one model. 2. confirm to delete the model. | 1. open delete confirmation page. 2. the model is removed from the models table. | Passed | |||
0504 | models page | subscribe | 1. click ‘subscribe’ icon for one model. | 1. open subscribe page | unimplemented | |||
0505 | models page | table paging | 1. click other pages in the models table. | 1.all the data in other pages are show correctly. | Passed | |||
0506 | models page | create DQ model | 1. click ‘create DQ model’ button | 1. open ‘create DQ model’ page. | Passed | |||
0507 | models page | check the UI layout when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1. display the page correctly. | Passed | |||
0601 | create dq model - accuracy | create accuracy | 1. click ‘models’ -> ‘create DQ model’ -> ‘Accuracy’ 2.choose the source. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3.select one or more attributes, e.g. uid, site_id. 4. click ‘next’. 5. choose the target. Select a schema, e.g. ‘appollo -> Bullseye -> adchoice_user_pref’. 6. select one or more attributes, e.g. user_id, scope. 7. click ‘next’. 8. select a primary key, e.g. Bullseye.achoice_user_pref.user_id. 9. select ‘Map To’ exactly. 10. select a source field for each target. 11. click ‘next’. 12. input the required information, e.g. model name ‘atest’, notification email ‘aa@ebay.com’. 13.click ‘submit’. 14. confirm to save. | source schema: ‘apollo -> Sojorner -> sog_search_event’. Source attributes: uid, site_id. target schema: ‘appollo -> Bullseye -> adchoice_user_pref’. target attributes, e.g. user_id, scope. primary key: Bullseye.achoice_user_pref.user_id. model name: ‘atest’, notification email: ‘aa@ebay.com’. | 1. open ‘create accuracy’ page. 2. the source shcema is selected. The corresponding attributes are shown in the attributes table. 3. the source attributes are selected. 4. go to ‘choose target’ step. 5. the target schema is selected. The corresponding attributes are shown in the attributes table. 6. the target attributes are selected. 7. go to ‘mapping source and target’ step. 8. the PK is selected. 9. exactly map to the source. 10. the source field is selected for each target. 11. go to ‘configuration’ step. 12. the required info are input correctly. 13. open a confirmation page. 14. the new model ‘atest’ is created. It is shown in the models table | Passed | ||
0602 | create dq model - accuracy | show error message if no source attribute is selected. | 1. click ‘models’ -> ‘create DQ model’ -> ‘Accuracy’. 2. click ‘next’ | 1. open ‘create accuracy’ page. 2. show error message to select at least one attribute. | Passed | |||
0603 | create dq model - accuracy | show error message if no target attribute is selected. | 1. click ‘models’ -> ‘create DQ model’ -> ‘Accuracy’ 2.choose the source. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3.select one or more attributes, e.g. uid, site_id. 4. click ‘next’. 5. in the ‘target’ step, click ‘next’. | source schema: ‘apollo -> Sojorner -> sog_search_event’. Source attributes: uid, site_id. | "1. open ‘create accuracy’ page. 2. the source shcema is selected. The corresponding attributes are shown in the attributes table. 3. the source attributes are selected. 4. go to ‘choose target’ step. 5. show error message to select at least one attribute. | Passed | ||
0604 | create dq model - accuracy | show error message if ‘map fields’ is not set. | 1. click ‘models’ -> ‘create DQ model’ -> ‘Accuracy’ 2.choose the source. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3.select one or more attributes, e.g. uid, site_id. 4. click ‘next’. 5. choose the target. Select a schema, e.g. ‘appollo -> Bullseye -> adchoice_user_pref’. 6. select one or more attributes, e.g. user_id, scope. 7. click ‘next’. 8. no selection. click ‘next’. 9. select a primary key. click ‘next’. | source schema: ‘apollo -> Sojorner -> sog_search_event’. Source attributes: uid, site_id. target schema: ‘appollo -> Bullseye -> adchoice_user_pref’. target attributes, e.g. user_id, scope. primary key: Bullseye.achoice_user_pref.user_id. | 1. open ‘create accuracy’ page. 2. the source shcema is selected. The corresponding attributes are shown in the attributes table. 3. the source attributes are selected. 4. go to ‘choose target’ step. 5. the target schema is selected. The corresponding attributes are shown in the attributes table. 6. the target attributes are selected. 7. go to ‘mapping source and target’ step. 8. no PK is selected. 9. show error message. | Passed | ||
0605 | create dq model - accuracy | show error if the configuration is invalid | 1. click ‘models’ -> ‘create DQ model’ -> ‘Accuracy’ 2.choose the source. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3.select one or more attributes, e.g. uid, site_id. 4. click ‘next’. 5. choose the target. Select a schema, e.g. ‘appollo -> Bullseye -> adchoice_user_pref’. 6. select one or more attributes, e.g. user_id, scope. 7. click ‘next’. 8. select a primary key, e.g. Bullseye.achoice_user_pref.user_id. 9. select ‘Map To’ exactly. 10. select a source field for each target. 11. click ‘next’. 12. input invalid value for each field, e.g. model name ‘a test’, notification email ‘aa’. | source schema: ‘apollo -> Sojorner -> sog_search_event’. Source attributes: uid, site_id. target schema: ‘appollo -> Bullseye -> adchoice_user_pref’. target attributes, e.g. user_id, scope. primary key: Bullseye.achoice_user_pref.user_id. model name: ‘a test’, notification email: ‘aa’. | 1. open ‘create accuracy’ page. 2. the source shcema is selected. The corresponding attributes are shown in the attributes table. 3. the source attributes are selected. 4. go to ‘choose target’ step. 5. the target schema is selected. The corresponding attributes are shown in the attributes table. 6. the target attributes are selected. 7. go to ‘mapping source and target’ step. 8. the PK is selected. 9. exactly map to the source. 10. the source field is selected for each target. 11. go to ‘configuration’ step. 12. show error for invalid value. | Passed | ||
0606 | create dq model - accuracy | check the link to add new data asset. | 1. click the link for adding new data asset. | 1. go to the ‘register data asset’ page. | Passed | |||
0607 | create dq model - accuracy | check the UI layout for all the steps when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1.all the steps in the page can be shown correctly. | Passed | |||
0701 | create dq model - validity | check dq model with validity type can be created. | 1. click ‘models’ -> ‘create DQ model’ -> Validity 2.choose the target. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3.select one attribute, e.g. uid. 4. click ‘next’. 5. choose one validity model, e.g. unique count. 6. click ‘next’. 7. input valid value for the configuration fields. e.g. model name ‘avalidity’, email ‘aa@b.com’. 8. click ‘submit’ 9. click ‘save’. | schema: ‘apollo -> Sojorner -> sog_search_event’. Attribute: uid. validity model: unique count. model name: ‘a validity’, email: ‘aa’. | 1. open ‘create validity’ page. 2. the target schem is selected. The corresponding attributes are shown in the attributes table. 3. the attribute is selected. 4. go to ‘select model’ page. 5. the validity model is selected. The description of the model is shown as well. 6. go to ‘configuration’ step. 7. all the value are valid. 8. open a confirmation page. 9. the new model ‘avalidity’ is created successfully. it is shown in the models page. | Passed | ||
0702 | create dq model - validity | show error if no target is selected. | 1. click ‘models’ -> ‘create DQ model’ -> Validity 2. not choose the target. 3. click ‘next’. | 1. open ‘create validity’ page. 2. no target schem is selected. 3. show error. | Passed | |||
0703 | create dq model - validity | show error if any field is invalid. | 1. click ‘models’ -> ‘create DQ model’ -> Validity 2.choose the target. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3.select one attribute, e.g. uid. 4. click ‘next’. 5. choose one validity model, e.g. unique count. 6. click ‘next’. 7. input invalid value for the configuration fields. | schema: ‘apollo -> Sojorner -> sog_search_event’. validity model: unique count. Attribute: uid. model name: ‘a validity’, email: ‘aa’. | 1. open ‘create validity’ page. 2. the target schem is selected. The corresponding attributes are shown in the attributes table. 3. the attribute is selected. 4. go to ‘select model’ page. 5. the validity model is selected. The description of the model is shown as well. 6. go to ‘configuration’ step. 7. show error for the invalid value. | Passed | ||
0704 | create dq model - validity | check the UI layout for all the steps when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1.all the steps in the page can be shown correctly. | Passed | |||
0801 | create dq model - anomaly detection | check the dq model with anomaly detection can be created. | 1. click ‘models’ -> ‘create DQ model’ -> Validity 2.choose the target. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3. click ‘next’. 4. choose one statistical techniques, e.g. bollinger bands detection. 5. click ‘next’. 6. input valid value for the configuration fields. e.g. model name ‘anomaly’, email ‘aa@b.com’. 7. click ‘submit’ 8. click ‘save’. | schema: ‘apollo -> Sojorner -> sog_search_event’. statistical techniques: bollinger bands detection. model name ‘anomaly’, email ‘aa@b.com’. | 1. open ‘create validity’ page. 2. the target schem is selected. The corresponding attributes are shown in the attributes table. 3. go to ‘select model’ page. 4. the validity model is selected. The description of the model is shown as well. 5. go to ‘configuration’ step. 6. all the value are valid. 7. open a confirmation page. 8. two new models, ‘anomaly’ with ‘anomaly detection’ type, and ‘Count_anomaly_1’ with ‘validity’ type are created successfully. They are shown in the models page. | Passed | ||
0802 | create dq model - anomaly detection | show error if no target is selected. | 1. click ‘models’ -> ‘create DQ model’ -> Validity 2. not choose the target. 3. click ‘next’. | 1. open ‘create validity’ page. 2. no target schem is selected. 3. show error. | Passed | |||
0803 | create dq model - anomaly detection | show error if any field is invalid. | 1. click ‘models’ -> ‘create DQ model’ -> Validity 2.choose the target. Select a schema, e.g. ‘apollo -> Sojorner -> sog_search_event’. 3. click ‘next’. 4. choose one statistical techniques, e.g. bollinger bands detection. 5. click ‘next’. 6. input invalid value for the configuration fields. | schema: ‘apollo.Sojorner. sog_search_event’ model name: ‘a nomaly’, email: ‘aa’. | 1. open ‘create validity’ page. . the target schem is selected. The corresponding attributes are shown in the attributes table. 3. go to ‘select model’ page. 4. the validity model is selected. The description of the model is shown as well. 5. go to ‘configuration’ step. 6. show error for the invalid value. | Passed | ||
0804 | create dq model - anomaly detection | check the UI layout for all the steps when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1.all the steps in the page can be shown correctly. | Passed | |||
0901 | create dq model - publish DQ data directly | check the dq model with publish type can be created. | 1. click ‘models’ -> ‘create DQ model’ -> publish DQ data directly. 2.input valid value for the configuration fields. 3. click ‘submit’ 4. click ‘save’. | model name ‘apu’, organization ‘hadoop’, email ‘aa@b.com’. | 1. open ‘create validity’ page. 2. all the value are valid. 3. open a confirmation page. 4. the new model ‘apu’ is created successfully. It is shown in the models page. | Passed | ||
0902 | create dq model - publish DQ data directly | show error if any field is invalid. | 1. click ‘models’ -> ‘create DQ model’ -> publish DQ data directly. 2.input invalid value for the configuration fields. | model name ‘a pu’, email ‘aa’. | 1. open ‘create validity’ page. 2. show error for the invalid value. | Passed | ||
0903 | create dq model - publish DQ data directly | check the UI layout for all the steps when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1.all the steps in the page can be shown correctly. | Passed | |||
1001 | data assets | check the data assets information | 1. check all the columns are correct or not. 2. show more for an asset. | 1. all the data are correct. 2. show the schemas of the asset. | Passed | |||
1002 | data assets | edit asset | 1. click ‘edit’ icon for an asset, e.g. ‘abc’. 2. edit the schema description and sample. 3. click ‘submit’. 4. confirm to save. 5. in the asset table, show more for the asset ‘abc’. | 1. open the edit page. 2. the schema description and sample are valid. 3. open a confirmation page. 4. the asset info are saved. 5. the schema info are updated. | Passed | |||
1003 | data assets | delete asset | 1. click ‘delete’ icon for an asset, e.g. ‘abc’. 2. confirm to delete the asset. | 1. open delete confirmation page. 2. the asset is removed from the table. | Passed | |||
1004 | data assets | table paging | 1. click other pages in the table. | 1.all the data in other pages are show correctly. | Passed | |||
1005 | data assets | check the UI layout when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1. display the page correctly. | Passed | |||
1101 | register data asset | check data asset can be registered. | 1. click ‘register data asset’ in the ‘data assets’ page. 2. input valid value. 3. click ‘submit’. 4. confirm to save. | asset name: ‘atest’, type: ‘hdfsfile’, HDFS path: ‘/var’, data folder pattern: ‘16-06-01’, platform: ‘Apollo’, organization: ‘GPS’, schema: name ‘dmg’, type ‘string’ | 1. open ‘register data asset’ page. 2. all the value are valid. 3. open a confirmation page. 4. the new asset is registered successfully. It is shown in the assets table. | Passed | ||
1102 | register data asset | show error if any field is invalid. | 1. click ‘register data asset’ in the ‘data assets’ page. 2. input some invalid value. 3. click ‘submit’. | asset name: ‘a test’, type: ‘hdfsfile’, HDFS path: ‘/var’, data folder pattern: ‘16-06-01’, platform: ‘Apollo’, organization: null, schema: name ‘dmg’, type ‘string’, | 1. open ‘register data asset’ page. 2. some value are invalid. 3. show error for the invalid value. | Passed | ||
1103 | register data asset | check the UI layout when the page is zoomed in and out. | 1.zoom in the page. 2.zoom out the page. | 1. display the page correctly. | Passed |