Check the results of additional questions (Comments)
This article explains the settings required to check the results of Additional Questions (Comments) and how to check them.
Overview
Preview of the Additional Questions (Comments) Results Screen
Image | Additional Questions (Comments): Free text responses, AI-based sentiment classification, and classification by frequent themes
Types of Response Data for Additional Questions
There are four types of response data for additional questions.
The method for checking differs depending on the type of response data. See the table below for details.
Table | Types of Response Data for Additional Questions and How to Check Them
|
Response Format |
Response Data Type |
Data Scope | How to Check |
User Roles That Can View |
|||
Results |
CSV |
System |
Admin- |
Action Plan |
|||
Common |
Additional Questions Response List Response data for all additional questions See here for details on the response list |
Organization/Attribute selected during setup |
|
● |
● |
● |
|
| Choice |
Additional Questions (Choice) Data Compilation of response rates and averages (※1) See here for details on choice-type results |
Overall (company-wide) Organizational unit/Attribute |
● |
● |
● |
● |
● |
|
Additional Questions (Choice) Time-lapse Comparison Data Comparison with past surveys is possible (※3) |
Overall (company-wide) Organizational unit/Attribute |
|
● |
● |
● |
|
|
| Comments |
Additional Questions (Comment) Data AI-compiled results (※4) |
Overall (company-wide) | ● |
● |
● |
● |
|
| Organizational unit/Attribute |
|
● |
● |
● |
|
||
※1 Displaying averages requires setup in advance. This can only be configured for questions with a "Single Choice" response format. See "Register, edit, or delete additional questions" for details.
※2 Action Plan Managers can only view the results for the departments assigned to them in "Action Plan Manager Settings" or "View Permissions Settings". To view the results, set "Publish Results to Action Plan Managers" to "Published" in the additional question publication settings. For details on how to configure this, see here.
※3 Separate settings are required. See "Check the results of additional questions (Choice)."
※4 Separate settings are required. See "Compiling Additional Questions" in this article.
Compiling Additional Questions
To check AI-compiled results, you need to compile additional questions results separately from the Engagement Survey results compilation.
|
To use the AI compilation feature, you need to download the "Additional Questions Response List File" (all response data for both choice-type and Comments questions) and finalize the responses. |
① Click "Compile Questions"
② Select the "Questions" to compile
③ Select the "Organizational Unit/Attribute" to compile and click "Next"
|
You can select and compile up to 5 "Organizational Units/Attributes" per question, and additional compilations can be added later until the limit is reached. However, once a compilation has started for an "Organizational Unit/Attribute," it cannot be changed. |
④ Review the details and click "Start Compilation"
※ Compilation may take some time if there is a large amount of data.
⑤ Check the compilation completion email
When compilation is complete, an Additional Questions (Comments) Compilation Completion Email will be sent to the user who initiated the compilation.
Checking AI-Compiled Results
There are two ways to check the AI-compiled results.
Checking on the Results Screen
※ Only Overall (company-wide) is applicable.
Click "Results & Improvement" ▶ "View Additional Questions Results"
The "Additional Question Results Here" button is displayed only on the Results List screen.
If the button is not displayed, click "Results/Improvement" again and check the Results List screen.
1. Understanding trends by question using sentiment classification × frequent themes
You can check the number of responses by sentiment classification and by "Frequent Theme" for each question in graph form.
Sentiment Classification: AI classifies all response comments into three categories: "Positive," "Negative," and "Neither."
Frequent Theme Extraction and Classification: AI analyzes all response comments, extracts up to 10 themes mentioned across many comments, and classifies them by theme.
|
|
2. Understanding details via the "AI Summary" for each frequent theme
You can view a summary (AI Summary) of response comments for each frequent theme, separated by Positive and Negative.
Checking via File
※ Overall (company-wide) and up to 5 organizational units/attributes selected at compilation are applicable.
The Additional Questions (Comments) data file includes the following two items.
Sentiment and Theme Classification List of Response Comments
You can check the "Response Comment," "Sentiment Classification," and "Frequent Theme" for each respondent.
|
These are the same as the attributes displayed in the Additional Questions Response List File. See "What organization and attribute items are displayed in the list file of additional question responses?" for details. |
Summary List
You can check the "Number of Response Comments" and the "Count" and "Summary" by sentiment classification for each frequent theme.
|
The organizations/attributes selected when compiling additional questions are displayed. |
How to Download
① On the Additional Questions Results Screen ▶︎ Click "Download"
② Click "Select Questions" for Additional Questions (Comments) Data
③ Select a question
|
Questions currently being compiled will be inactive and cannot be selected. |
④ Click "Download"
Detailed Specifications
About the AI Compilation Method
AI compilation includes "Sentiment Classification," "Frequent Theme Extraction and Classification," and "Summary." See below for the detailed compilation methods.
Sentiment Classification
| Sentiment | Classification Method |
| Positive | Comments containing positive emotions such as gratitude, satisfaction, trust, and praise. |
| Negative | Comments containing negative emotions such as dissatisfaction, criticism, concerns, and problem-raising. Expressions indicating requests or expectations may be classified as Negative even without explicit emotional language. |
| Neither | Comments that contain no emotional expression and consist only of factual explanations or sharing of situations. |
|
If a single comment contains both positive and negative content, it may be classified under both Positive and Negative. |
Frequent Theme Extraction and Classification
| Compilation Process | Description |
| Theme Extraction | All response comments are analyzed, and taking into account the context of the question text, frequently occurring topics are extracted as frequent themes. Content with similar meanings but different expressions is grouped under the same theme, and up to 10 representative themes for the overall data are displayed. ※ Responses that contain no substantive content, such as "Nothing in particular," are not included in the compilation. |
| Classification into Themes | The applicable theme is determined based on the content of each comment. Comments are classified not only when there is explicit language, but also when context suggests the comment applies to a theme. |
|
If a single comment contains multiple points, it may be classified under multiple themes. |
Summary
Based on content applicable to each "Sentiment" and "Frequent Theme," the overall trends in comments are summarized. If a single comment contains multiple topics or sentiments, only the applicable portions are extracted and summarized. Up to 3 summaries are displayed per combination of "Sentiment" and "Frequent Theme," and summaries may not be displayed when the number of comments is small.
About Data Reflection
After downloading the Additional Questions Response List File, if you make corrections to result data or changes to organization/attribute settings, the impact on additional questions results will differ. See the table below for details.
Table | Data Reflection by Target and Scenario
| Target | Result Data Correction | Organization/Attribute Name Change | Organization/Attribute Deletion |
| Additional Questions Response List File | × Not reflected | ◯ Reflected | × Not reflected |
| Additional Questions (Comments) Data File | × Not reflected | ◯ Reflected | × Not reflected |
| Additional Questions Results Screen (Comments) | × Not reflected | ◯ Reflected | × Not reflected |
About Result Display When the Number of Respondents Falls Below the Minimum
If the number of respondents for the applicable organization/attribute falls below the specified minimum, results will not be displayed on the Results Screen or in any files.
However, if the number of respondents for that organization/attribute meets the minimum, results will be displayed even if the actual number of responses to Comments questions falls below the minimum.