Various test reports help you evaluate the performance of your computational parser setup. Then, you can have Testbed texts that you use for regression tests to make sure the parser continues to work as expected.
Running tests does not change any of the analyses in the Word Analyses area. That is, it does not change FLEx's ideas about the number of successful analyses, or failed parses, or user approved/disapproved analyses.
A report window appears each time you use any of these Parser menu options:
Run Tests On Current Text
Run Tests On Genre
The Choose Genre dialog box opens so you can choose a genre. Then, then test is run on any text with that genre metadata.
Run Tests On All Texts
In each case, the report shows the results of that check. Results data include the number of words parsed, parse time, and so on, as described in tool-tips.
Here are things you can do:
Click a column heading to sort the results based on that column. You can use Shift+click on another column to have a secondary sort.
Click the Save Report button, type a brief comment, and then click OK.
Your comment appears next to the Save Report button and also in the Comment column in the Parser Test Reports dialog box.
To edit a comment, click Save Report again and retype the comment.
Click the Show button to see the analyses for the word in the Word Analyses tool.
Click the Try A Word button for a word to open it in the Try a Word dialog box. It gives you the option to see a detailed trace of the parsing process.
To see the Parser Test Reports window, on the Parser menu, point to Run Tests and then click Show Test Reports.
In this case, you see a table. Each row is a separate test report.
Here are things you can do:
Select () one row, and then click the Show Report button.
This opens that particular test report. Then in that test report, click the Show button to see the analyses for the word in the Word Analyses tool.
Select () one row, and then click the Save Report button.
This opens a dialog box where you can enter a comment about the particular report. Click the OK button to save the report.
Select () two rows, and then click the Compare button.
This opens a Diff table which shows the difference between two test reports.
The older report is subtracted from the newer report.
Select () one or more rows. Then, click the Delete # Reports button.
Informative tool-tips appear when you hold your mouse pointer over most buttons and column headers.
Typically, the number that appears with a red color means there is a problem. A negative number means the number went lower (down).
Here is an example from a Diff table:
In this example for the word "coche" the number of No Parses shows a negative value, that is good; the number of Failed Analyses went up, that is not good.
You might want to get more help.
Related Topics