Quickly and effortlessly generate initial summaries from your Remesh Conversation. Summarize is a new feature that leverages a large language model (LLM) from OpenAI, the creators of ChatGPT. The LLM technology is used to power a new approach to qualitative analysis and enhance the Remesh experience.
Included in this Article
- How it works
- Reviewing & Accepting Summarize Terms
- Where to find Summarize
- Filter by segment when using Summarize
- Question-level Summaries
- Conversation-level Summary
- Providing Feedback
- Frequently Asked Questions
How it Works
First, Remesh Summarize generates a summary for each open-end question, covering Ask Opinion, Branch Opinion, and Ask Experience. The system selects key responses to summarize from each question that optimize for the spread of thought, overall performance, and technical limitations around LLMs. This selection process currently uses existing analysis algorithms like Highlights for Ask Opinion, Branch Opinion, and Thematic Clusters for Ask Experience, with others to come.
Next, Remesh Summarize creates a comprehensive Conversation-level summary based on the individual question summaries. Users are able to create new slices of Conversation-level summaries by selecting their own set of questions.
When a user lands on the page, they see the individual and default Conversation-level summaries.
Reviewing & Accepting Summarize Terms
In order for any user within a Workspace to use this feature, a Workspace Admin must review and approve Summarize terms. Read more about how to enable this feature here.
Where to find Summarize:
- After logging into Remesh, navigate to the Conversation you want to analyze
- Select Summarize from the top navigation
Filter by segment when using Summarize
By generating AI-powered text summaries of responses from specific segments, you can better understand your target audience in seconds. This applies to question-level and Conversation-level summaries.
Whether you’re generating summaries at the question level or Conversation level, you can find the Segment filter dropdown menu on the top-level page.
When filtering by segment, there may be time delays. The blue checkmark icon indicates that the data should populate quickly. Segments with a “~60s” clock icon have data that may require some loading time.
Users will be able to review question-level summaries for each open-end on the left side of the screen. Each question summary can be quick-copied.
Summaries for Ask Opinion and Branch Opinion questions are based on Highlight responses by default to give you a snapshot of the spread of opinion.
Alternatively, you can choose to base these summaries on the Top % Agree responses or Bottom % Agree responses. The Top % Agree will generate summaries that showcase the general consensus, while the Bottom % Agree will shift the focus to less common viewpoints that could uncover hidden insights.
To create summaries based on Top % Agree or Bottom % Agree, click the right dropdown menu on the top-level page (next to the segment filter). Choose Top % Agree or Bottom % Agree. Your summaries will be update based on your selection.
Summaries for Ask Experience questions are always based on central responses from each Thematic Cluster.
Users are also able to review a default Conversation-level summary on the right side of the screen. New summaries can be generated based on a custom selection of questions that the user selects. Requests for summaries should take no longer than a minute, with most being faster than 15 seconds. For Conversation-levels, three Summary Formats are available using the drop-down menu above the summary text. These reflect the length of the summary outputs.
Paragraph: The default format, around a single paragraph
Half-Page Summary: A few paragraphs
Bullet Point Summary: Individual bullet point instead of paragraph
A feedback mechanism accompanies this feature, with gathered feedback used to improve the overall feature. Users are encouraged to apply a Thumbs Up or Thumbs Down and an optional further explanation for each Conversation-level summary. Users can apply another set of Thumbs Up or Thumbs Down and comments if they change their minds.
Frequently Asked Questions
- Why can’t I access the Summarization feature?
In order to access this feature:
- Your team must be part of the Beta group (contact your Admin to request participation!)
- A Workspace Admin must accept new “Remesh Summarize” specific Terms of Service
- A Workspace Admin must grant Non-Admin users access
- I selected different questions to include in the summary, why isn’t the summary text changing?
In order to generate a new summary, you must both select the questions you want included and click the regenerate button 🔁.
- How do I copy the summary text to paste into my presentations?
Simply click on the ‘Click to Copy’ button to copy the summary text to your clipboard.
- Can I cut by Segment (demographic)?
Yes, you can generate summaries for specific demographic Segments.
- Does this work for Merged Conversations?
Currently, Summarize doesn’t work for merged Conversations — but look for this enhancement in the future!
- Are there different summary methods (beyond Highlights and Thematic Clusters), or ways to customize the summary?
Yes. For Ask Opinion and Branch Opinion questions, you can choose to base summaries on the responses with either the highest % Agree scores or the lowest % Agree scores. Choosing these options will provide a summary of the general consensus, rather than an overview of diverse responses.
- Does this work on previously run Conversations?
Yes, you can use Summarize for previously run Conversations. Please note that there will be some initial loading time the first time you access your past Conversation.
- Beyond Summaries, will you be showing any recommendations or next action steps?
It's currently under investigation