Medallia user guide

Medallia Post Conversation Survey

Prerequisites

Before enabling the Medallia post conversation survey, brands must have Medallia Conversational surveys and/or Web surveys pre-configured within Medallia. In addition, a Messaging_Survey account configuration needs to be enabled for your account. Please reach out to your customer success manager or professional services team to enable this feature.  

Enablement and Access

The Medallia post conversation survey is now GA. If you are interested in enabling this for your brand, please complete the self-service setup available for Medallia via Integration Hub or contact your customer success manager for additional support with the setup. 

Glossary

Key features and components

Medallia Overview

The Medallia post conversation survey enables brands to collect feedback and measure their success from the consumers after conversations have taken place. The survey can be delivered in a conversational experience to drive higher completion rates and provide consumers with the best experience possible. The survey could also be delivered as a link to a web survey to get more detailed feedback that may not be suitable for conversational style feedback.

Brands can tailor the survey to their needs, including both custom questions and free text questions, as well as the ability to determine specific rules between the questions. This can all be done within Medallia.

Why use the Medallia Post Conversational Survey?

For brands that currently use Medallia as their preferred customer experience platform, this solution offers an out-of-box integration to capture signals from chat and messaging via Medallia surveys, so that the data and reporting can all reside within Medallia. It enables brands with frictionless customer experience management by capturing all customer touchpoints in one central place. Brands can also drive up response rates by enabling the survey immediately after the conversation, and by creating rules in Medallia to ensure the same customer is not surveyed more than once within a given period.

Survey Flow & Configuration

As soon as a messaging conversation ends (either via the agent or via the consumer) the post conversation survey will be triggered. The survey is always triggered based on the last skill of the conversation.

There are two options/types of Medallia surveys:

• One-way survey/Feedless survey
• Two-way survey/Feeded or Conversational survey

The one-way survey is delivered by the Conversational Builder bot.

The conversational survey is sent by a third-party bot that needs to be set up with Medallia.

Note: This bot has a user type “Agent” with the permission “view agent conversations” and a new user with the role must be used for this purpose.

The bot sends a greeting message and begins to send the survey questions as configured by the brand in Medallia. Upon each consumer response, the bot will send the following question based on the logic defined for the survey.

Brands will configure the full experience of the survey and the bot. This will include the bot name, avatar, questions and answers, and the look and feel.

The survey questions and answers are based on structured content and regular text messages, so brands can create the experience they want in the Medallia survey design.

Survey triggering

• Once the conversation is ended by the consumer or by the agent, the survey will automatically trigger (no need for the agent to transfer or perform any action to trigger the survey).
  • The survey will not be triggered on autoclose.
  • If the skill is not configured with any survey, the survey will not be triggered (the survey is always triggered based on the last skill of the conversation).
• Only conversations with assigned skills will be able to trigger a survey. If a conversation is “unassigned” then no survey will be triggered.

The consumer will be asked to choose from a list of answers, with the exception of “free text” type questions.

Consumer Errors

If the consumer types in free text that is not recognized as a valid answer, the bot will send an error message (configurable in Medallia) and resend the last question, asking the consumer to choose from the specified answers. After x attempts (configurable in Medallia) of an unrecognized consumer response, Medallia will send the next question out to the consumer in order to avoid frustration.

Opting out of the Survey

The brand will be able to configure a specific opt-out keyword in Medallia to enable consumers to opt-out of the survey. Once this exact phrase is typed in the conversation, the bot will send the response back to Medallia where the opt-out will be recorded and the survey will be closed. The user will be presented with a static thank you message. Please note, the opt-out keyword should not be the same as the opt-outs used for SMS. If the same keyword is used, the user will not be able to interact with LivePerson over SMS for other intended interactions.

Closing a Survey (survey outcomes)

The survey can be closed during various scenarios:

1. Survey completed - the consumer has completed all the questions required.
2. Survey timeout - The survey expiration is configurable in Medallia. However, there is a site setting value used to close any survey opened for more than x amount of seconds (configurable) in LivePerson. This LivePerson setting closes the conversation at expiration and takes precedence over the Medallia expiration timeout setting.
3. Survey quarantine - the consumer may not receive the survey at all in the event that the user has taken the survey in the last x days (configurable by the brand in Medallia). If the quarantine rules are not set in Medallia, then the survey will be sent to the consumer.

The brand cannot currently configure the initial welcome and closing message that will be sent to the consumer in the EAP phase. This will be part of the GA solution.

Any message sent by the consumer after the survey has been closed will open a new messaging conversation with the brand.

Self-Serve Configuration

The configuration of the third-party bot and the Medallia adaptor can now be completed in a completely self-service way.  Brands can now also specify the Medallia surveys that need to be associated with specific skills in LivePerson. For more information on how to setup the Medallia integration, please refer to the Configuration section below. 

All questions configured in Medallia are configurable by the brand. In Medallia, brands can configure:

• Multiple Choice Questions: Brands can configure multiple choice questions.
  • These questions will initially not support ‘quick replies’. Brands will only be able to customize the text as well as the look and feel (in terms of branding).
• Free text questions: requesting the consumer to give their free feedback.
• Statements: Currently, the statements configured by brands in Medallia cannot be passed back to LivePerson via the third-party bot. As such, brands may have to include the initial welcome message in the content of the first questions.

Within Medallia, the brand is able to determine the logic between the questions, meaning different answers can trigger different questions to follow.

Language support Brands can customize the survey to fit any language in Medallia. The brand will write survey questions and answers in the language they so choose. Each skill in LivePerson is associated with a unique survey and therefore, for every language, a unique skill must exist in LivePerson.

Supported Messaging Channels

Phase I: Web Messaging, In-app Messaging, SMS, Whatsapp and other messaging channels will be supported. Email is not supported or intended to be used for Conversational surveys.

• Continuity between these channels will be supported the way they are for messaging today.
• If a consumer scrolls up in the conversation thread, they will see all the previous messaging conversations as well as the surveys from the past interactions.
• Mobile: During the survey, the bot messages will apply the same push notification behavior that the brand has configured for messaging.

Brands using the Messaging Window API (instead of the in-app SDK) will need to make the relevant adjustments to support the new survey.

Agent/Consumer Experience

Agent Experience

While the survey is being answered by the consumer, the agent/agent manager is unable to perform any action on the conversation, including the following actions:

• Resume
• Transfer
• Takeover

Real-time KPI bar:

The CSAT for the Medallia surveys is not updated in real time. The CSAT will be updated after the survey completion and sync to the Medallia Experience Cloud. This process is triggered after a specific time interval that is customizable in Medallia. Please expect an interval of a minimum of 30 minutes for this to be updated.

In the event that the brand does not want the agent to see the survey questions and responses, there is a setting in the agent profile that could be changed to govern whether or not the agent has permission to view the survey feedback.

Agent Widget SDK: Survey conversation lines will be available via the widget SDK, so that the widget can bind to get the full transcript lines that will include the survey questions and answers.

Consumer Experience

The survey experience is seamless to the end consumer. The consumer will be presented with questions and acceptable responses that can be entered or typed in manually. Consumers will be able to provide text and emoji input if Medallia is configured to receive such feedback. Images are currently not supported.

Configuration

The Medallia post conversation survey can now be enabled via the self-service onboarding via iHub. If you are interested in enabling this for your brand, you may follow these steps for a self-service onboarding or you may please submit this form or contact your CSM for further assistance with the setup process.

In order to setup this integration, please follow the following steps below.  Start by navigating to the left navigation menu in Conversational Cloud. Select Integration Hub -> Integrations -> Medallia setup. 

Step 1: Start the setup process and provide Medallia the LivePerson details you see in your account in the Enable step. This is required to setup the LivePerson channel in Medallia Conversations.

Once this is complete, the LivePerson channel will need to be setup in Medallia Conversations. For more information on how to setup a LivePerson channel in Medallia, please reference the following documentation.

Step 2: Once the channel is setup in Medallia, you may now establish a connection from LivePerson to Medallia by including the details from the Medallia LivePerson Channel.

Once the connection is established with Medallia, you may test the channel and proceed to the next steps.

Step 3: Assign the LivePerson skills to the Medallia Survey

Step 4: Setup the Third-Party Bot with the specific skills you would like to enable the Medallia for. Please note, this step has to be completed to enable the Medallia surveys.

You may first access the Conversational AI from the Conversational Cloud left navigation menu. Please select Third-Party Bots.

Then select the “Add bot” button.

Choose the type of bot “Survey Bot” 

Then select an Agent user specific to Medallia that will be used for the survey interactions. You can create a new third-party bot user for this purpose. This user could be named according to what the brands would like the customers to see i.e. Medallia_survey_bot or any other name. This user will need to have an Agent role assigned and the medallia_survey_bot profile associated with the user as defined below.

The Survey App ID should be input from the client id field in the iHub setup step “Activate third-party bot connector”.  You may choose to add specific skills or can leave this blank to allow the flexibility of the Third Party Bot to be used for any new skills added via iHub.

The client ID and secret should be input from the iHub setup step “Activate third-party bot connector”. 

Step 5: Launch the Medallia Survey Integration 

Go back to the Medalia setup in iHub. The last step just confirms your setup and will start to send the associated Medallia surveys for the skills that were selected as part of the setup process. 

Reporting

Reporting will initially all reside within Medallia. This includes the Responses feed, Text Analytics and other reporting leveraged by the brand in Medallia. Medallia can pull all the customer and agent data associated with the conversation that may be needed by the brand.

Analytics Builder

• Built-in metrics: CSAT(attributed to last agent/skill). This will be normalized to a scale of 1-5. Note: All KPIs are measured on closed surveys. Surveys in progress are not shown in the reporting metrics.
• Open Connections Data Bar: CSAT KPIs to include both old and new CSAT results combined.
• Data APIs: Messaging Interactions API - survey raw data exposed via metadata (no search)

Metrics

No metrics for the product currently. However, stay tuned for metrics that will be tracked in the product in the GA release.

Limitations

1. The NPS score and FCR will not be presented in the real-time KPI bar in the Agent workspace or in the Agent Manager workspace.
2. Currently, the reporting will need to be accessed within Medallia.
3. Currently, there is no mechanism for brands to disable the survey once a specific threshold of responses has been received.