Amplify Chat / Assistant Metrics Dictionary
Amplify Chat / Assistant Metrics are only available to Bullhorn Amplify customers.
Amplify Chat / Assistant Metrics give you visibility into how your team uses Amplify Chat and Amplify Assistant, so you can track adoption and engagement and see how Chat / Assistant activity relates to submissions and placements.
The metrics and ratios listed in this article are used in the Amplify Dashboards: Chat / Assistant Tab. The Targetable? column indicates whether the metric can be used as a target. See Targetable and Non-Targetable Metrics for more information.
What Counts as Chat / Assistant Activity
Amplify Chat and Amplify Assistant activity is recorded as Conversations. A Conversation is a series of messages between a user and the LLM, and only the Conversation is counted, not each individual message.
- Chat (Global): Conversations started from the Amplify Chat window, which can span multiple records and data sources.
- Assistant (On a Record): Conversations started on a Candidate, Client Contact, Job, Company, Placement, Lead or Opportunity record.
Metrics that include Chat/Assistant Assisted count records where the Candidate, Client Contact or Job had Chat/Assistant activity within the last 3 months.
For details on Amplify Chat and Amplify Assistant, see Amplify Chat and Using Amplify Assistant.
Conversation Metrics
Conversation metrics track the Conversations started in Amplify Chat and Amplify Assistant within the selected timeframe.
| Metric Name | Targetable? | Description |
|---|---|---|
|
Chat/Assistant: New Conversations |
Yes |
A count of new Conversations started in the selected timeframe in Amplify Assistant and / or Amplify Chat. A Conversation is a single thread of back-and-forth exchanges between a user and the LLM. It can be initiated by opening a new Chat window, selecting a saved prompt, or entering an ad hoc prompt. The total number of individual messages within the Conversation is not considered for New Conversations. |
|
Chat/Assistant: Global |
Yes |
A count of Global (aka Chat) Conversations started in the selected timeframe. A Conversation is a series of messages between the user and the LLM. Each individual message is not counted. |
|
Chat/Assistant: On Record |
Yes |
A count of On Record (aka Assistant) Conversations against Candidates, Client Contacts, Jobs, Companies, Placements, Leads or Opportunities started in the selected timeframe. A Conversation is a series of messages between the user and the LLM. Each individual message is not counted. |
|
Chat/Assistant: Saved Prompts |
Yes |
A count of Conversations started by selecting a saved prompt, in Amplify Assistant or Amplify Chat, in the selected timeframe. Only prompts saved in Prompt Studio are counted. Prompts that a user saves at their own individual level in Chat are not included. |
User Activity Metrics
User activity metrics track how many users are active in Amplify Chat and Amplify Assistant, how often, and how many messages they send within the selected timeframe.
| Metric Name | Targetable? | Description |
|---|---|---|
|
Chat/Assistant: Unique Users |
Yes |
A count of unique users who started new Conversations in Amplify Assistant and / or Amplify Chat within the selected timeframe. |
|
Chat/Assistant: Unique User Days |
Yes |
A count of distinct calendar days on which a user had at least 1x interaction with Amplify Assistant and / or Amplify Chat within the selected timeframe, reported as a sum across all active users. If a user sends multiple messages in a single day, that day counts once. This metric shows how consistently and how often users engage with Amplify Assistant and / or Amplify Chat. |
|
Chat/Assistant: User Messages |
Yes |
A count of user messages entered in Amplify Assistant and / or Amplify Chat within the selected timeframe. This metric counts each individual message, so it includes the initial saved or ad hoc prompt as well as any follow-up messages entered by the user. It does not count responses given by the LLM. |
Chat / Assistant Assisted Metrics
Assisted metrics track the submissions and placements created within the selected timeframe where there had been Chat/Assistant activity beforehand.
| Metric Name | Targetable? | Description |
|---|---|---|
|
Internal Subs: Chat/Assistant Assisted |
Yes |
The total number of Shortlists / Internal Submissions created in the selected timeframe where the Candidate, Client Contact or Job had activity via Amplify Assistant and / or Amplify Chat within the 3 months prior. |
|
CVs / Client Subs: Chat/Assistant Assisted |
Yes |
The total number of CVs Sent / Client Submissions created in the selected timeframe where the Candidate, Client Contact or Job had activity via Amplify Assistant and / or Amplify Chat within the 3 months prior. |
|
Placements: Chat/Assistant Assisted |
Yes |
The total number of Placements created in the selected timeframe where the Candidate, Client Contact or Job had activity via Amplify Assistant and / or Amplify Chat within the 3 months prior. |
Ratios
Chat / Assistant ratios compare Chat / Assistant metrics. Chat Impact and % Saved vs Ad Hoc Prompts are displayed as a percentage, rounded to the nearest whole number. Chat/Assistant: Avg User Messages per Convo is displayed in Normalized format. Ratios cannot be used as targets.
| Metric Name | Targetable? | Description |
|---|---|---|
|
Chat Impact |
No |
The proportion of total placements where the Candidate, Client Contact or Job had Chat/Assistant activity within the prior 3 months. Ratio: Placements: Chat/Assistant Assisted ÷ Total Placements. |
|
% Saved vs Ad Hoc Prompts |
No |
The proportion of new Conversations that were started by selecting a saved prompt. Ratio: Chat/Assistant: Saved Prompts ÷ Chat/Assistant: New Conversations. |
|
Chat/Assistant: Avg User Messages per Convo |
No |
The average number of user messages entered for each new Conversation, displayed in Normalized format, which reduces the number of Conversations to 1 (for example, 1.72:1 means 1.72 user messages for each Conversation). Ratio: Chat/Assistant: User Messages ÷ Chat/Assistant: New Conversations. |
Conversation Attributes
The following attributes describe individual Conversations in the Chat / Assistant dashboard panels. They appear as column headings in the Chat/Assistant: All Conversations in Timeframe with Summaries panel, and as breakdowns in other panels. They are not metrics, so they have no Targetable? setting.
| Attribute | Description |
|---|---|
|
Owner |
The user who had the Conversation. Shown in the All Conversations grid. This column label is a system default. |
|
Created Date |
The date the Conversation was started. Shown in the All Conversations grid, in YYYY-MM-DD format. |
|
Amplify Conversations Conversation Title |
A short title for the Conversation. For Conversations started from a saved prompt, this is the name of the prompt. For other Conversations, it is a title generated from the Conversation. Shown in the All Conversations grid. |
|
Amplify Conversations Source |
The place the Conversation was started: Global Chat, or the type of record the Amplify Assistant was opened on (for example, Candidate Record or Job Record). Shown in the All Conversations grid, and as the breakdown in the Conversations by Source panel. |
|
Amplify Conversations Prompt Name |
The name of the saved prompt used to start the Conversation. Blank for Conversations that were not started from a saved prompt. Shown as the rows of the Saved Prompt Scoreboard. |
|
Amplify Conversations Summary |
An AI-generated summary of the Conversation. Not all Conversations have a summary. Shown in the All Conversations grid. |