In this article
Instant Analytics is a "standard" simplified report that you as the survey designer can create for any launched survey. The general layout of the report is preset and cannot be changed.
The report is intended to enable the user to quickly view the survey status, quota information and responses, and interactively perform cross-tab analysis on the data. You can also save reports and export the raw data.
Once you have created the report, Professional users will be able to access it via a link on the survey overview page. If changes are made to the survey, for example new questions are added, then when you compile the survey you can also select to update the report. The data presented in the tables and charts in the report is updated automatically as respondents reply to the survey.
You can create "versions" of the report by specifying which interview statuses and questions are to be displayed and then saving a copy of the report.
Note: The Instant Analytics report only accepts data from the Production database. So until some respondents have replied to your survey, the tables and graphs in the report will be empty.
Instant Analytics is not currently supported in Safari.
Instant Analytics can handle up to 100000 responses, including all statuses except "Not answered", with a limit of 2000 questions per survey. If the survey has less than 100 000 responses then you will be able to select the Update Instant Analytics Report box in the Launch Survey page.
In the event the Exclude from reporting property has been set for questions in the survey, these questions will also be excluded from the IA report.
IA reports can include a maximum of 200 open text or open text list questions. In the event a survey with more than the maximum is launched with the IA report option selected, the launch will abort with an error message. If this occurs, you must open questions you wish to exclude and select the Exclude from Reporting option, until you have fewer than 200 such questions.
Creating and Viewing the Instant Analytics Report
Once the Instant Analytics report for a survey is created, if changes are later made to the survey these will be carried through to the report when the survey is re-launched.
You can create or regenerate the report without launching the survey. To do this:
- In the Surveys list, click the Reports button
for the appropriate survey,
or
In the survey's Overview page, click theReports button towards the right end of the Status area title bar.
- In the drop-down menu that opens, click Generate Instant Analytics.
- Click Generate report or Cancel.
A confirmation dialog opens.
Figure 1- The generate report confirmation dialog
Once the report has been created for a survey, you can view the report at any time by:
- Going to the Surveys list page and clicking the Reports button
then selecting Open Instant Analytics.
- Going to the survey's Overview page and clicking theReports button
The report will open in a new window.
Note: The Instant Analytics report only accepts data from the Production database. So until some respondents have replied to your survey, the tables and graphs in the report will be empty.
Printing Data from the Responses and Verbatims Tabs
You can print out the response charts and verbatims from the Instant Analytics report.
- Using the Questions navigator towards the upper-left corner of the page, check/uncheck and rearrange the questions as necessary to achieve the report layout you need (go to Viewing Questions for more information).
- In the menu bar, click Print.
- Make the printer settings as required.
- Click Print.
A standard printer selection dialog opens.
Instant Analytics Settings
The Settings menu allows you to apply rating statistics, significance testing, select whether you show the results as counts, percentages or both, and show or hide the totals.
Figure 2 - The Settings options
If the survey has a weight model for use with the IA report (the model must be named IAWeight), then the option Show weighted data will also be available in the menu. If no IA weight model is available, the menu option will not be listed.
Rating Statistics allows you to show only the specified number of elements in the table. For example, if you select Top 2, only the top 2 elements will be displayed, or if you type 5 in Top N, only the top 5 elements will be displayed. The other elements will be removed from the table.
Figure 3 - The Rating Statistics options
You can also perform Significance Testing on the results - select Significance Testing and choose a suitable confidence level. The higher the confidence level, the more certain you can be that there really is a difference in the two groups being tested. For example, 90% confidence means that there is a 10% chance that a difference in scores could have been found purely through the effects of sampling.
Figure 4 - Selecting a confidence level
Most of the statistical tests are based on standard t tests that assume that the two samples being compared are independent of each other. When the columns of a table are formed from the categories of a multi question, data from the same case can be present in both of the columns being tested. This is known as overlapping data, and it means that the two samples cannot be considered independent. Overlapping Samples should be used when the columns to be tested contain data that are not independent. A separate algorithm “Choi-Stablein” should then be used to calculate the significance test.
The settings in this menu will be maintained in saved reports and exports. Once the functionality is enabled and a banner is applied to create a table, Significance Testing will automatically highlight applicable table cells in green, and letters will indicate the comparable columns. Note that this feature uses the same column proportional T-test as Reportal, but is limited to a single level of confidence.
Check or uncheck the options as required. Note that you must have at least one of the counts and percents options checked; you cannot uncheck both.
Layout
The layout of the Instant Analytics report is preset and cannot be changed. The tab bar can contain up to four tabs. The Overview and Responses tabs will always be visible; the Quotas and Verbatims tabs will only appear if the survey contains quotas and verbatim questions respectively.
If you have Administrator permission to your system then you can add a logo to the upper-right corner of the report page. To do this, in Professional Authoring, go to the Home > Company > Company Settings menu item and then to the Branding page. Once here, add the URL to your logo file into the IA Report Logo field, then save the changes.
Weighting
You can apply weighting to the data presented in the Instant Analytics report to adjust the data presented in the report such that it reflects the "real world" situation. IA will only support one weight model, and this must be specially created and named for IA. In the IA report, the weighting will only be applied to the data displayed in the Responses tab. When the report is initially opened, the default setting will be that no weighting is applied to the data.
Note: You must be in Professional Authoring to set up Weighting.
To create a weight model for use with Instant Analytics:
- With the survey open in Professional Authoring, go to the Reporting > Weighting menu item.
- Create a new weight model (refer to the separate Professional Authoring documentation for details), and name the model IAWeight.
- After setting the weight model up as required, launch/re-launch the survey.
The Weight Model List page opens.
Important
The Instant Analytics functionality will only recognize the weight model if the model is named correctly.
Only the name of the weight model can be IAWeight; the weight model ID must be different and must be in all lower case. If you also use the weight model name as the weight model ID then an error will be generated.
To apply the weight model to the data in the report:
- Open the IA report and go to the Responses tab.
- Go to the Settings menu.
- Select the Show weighted data option.
If the survey has a weight model for use with the IA report (the model must be named IAWeight), then the option Show weighted data will be available in the menu . If no IA weight model is available, the menu option will not be listed.
Figure 5 - The Settings menu when a weight model is available
The report is updated and the weighted data is displayed.
You can save the weighted and unweighted versions of the report under different names. To do this, display the data as required (weighted or unweighted), click the down-arrow beside the Save button, select Save As and give the report a suitable name.