Amplify Screening FAQ

This article answers common questions about using Amplify Screening, from setting up screener engagements and inviting candidates to screening, to interpreting scores and reviewing your metrics.

Having trouble with Screener? Check out Amplify Screening Troubleshooting for help resolving common issues.

Screening Questions

What happens if a job with existing screening questions re-enters an automation with the Add Questions step?

When a job re-enters a job-based automation with the Add Questions step, all existing screening questions are automatically deleted and regenerated based on the current step configuration. This applies to pre-screening questions, post-screening questions, and AI-generated questions.

If I copy an automation with a configured Add Questions step, will the settings carry over?

No. When you copy an automation that includes an Add Questions step, the step’s settings are not copied. You’ll need to reconfigure them in the new automation.

What happens when I edit the Add Questions step in an active automation?

Editing the Add Questions step in an active job-based automation will automatically pause the automation. Your changes will be applied to future records once the automation is reactivated.

Screener Engagement Setup

If I have Notify Candidates of Closed Jobs enabled on the screener engagement, what happens if a candidate tries to take a screening for a closed job?

The candidate will see a message that the job is closed and won’t be able to complete the screening. No screening details (such as Score, Status, Duration, Summary, Experience Rating, or Feedback) will be recorded, but the attempt will still count as Started and Completed in engagement metrics.

What happens if I have Notify Candidates of Closed Jobs enabled on the screener engagement, but no Closed Job Statuses entered?

If Notify Candidates of Closed Jobs is enabled in the screener settings, but there are no statuses entered in the Closed Job Statuses field, candidates will be unable to access the screener and will see the following error message:

"An error occured, please try again or contact Bullhorn Automation Support if the error persists".

To resolve this issue, go into your screener engagement settings and make sure you have at least one status entered in the Closed Job Statuses field.

If I enable the “Allow Retakes” setting for my Screener Engagement, how is this communicated to candidates?

It isn’t automatically communicated. If you enable Allow Retakes, you’ll need to let candidates know yourself. We recommend mentioning this (along with the number of allowed retakes) in your Welcome Message or Instructions so candidates understand they have the option to retry.

If "Optimized for Multilingual" is enabled, do I need to rewrite my screener questions in multiple languages?

No. When Optimized for Multilingual is enabled, the generated Voice Screener questions are automatically translated.

Keep in mind that custom chat questions added before the voice screening are always shown exactly as written and are not translated.

Why aren’t my custom chat questions translated when I enable "Optimized for Multilingual?"

Custom questions always appear as written by the user. This is to ensure recruiter-provided details remain consistent.

If "Optimized for Multilingual" is enabled, can candidates choose a different language than their browser default?

Yes. Candidates can override the detected browser language using the dropdown.

If "Optimized for Multilingual" is enabled, will recruiters receive summaries and transcripts in the candidate’s language?

Yes, unless you select Always Generate Summary in English, in which case all summaries and transcripts are provided in English.

Is the Screener compatible with Bullhorn Recruitment Cloud?

Customers using Bullhorn Recruitment Cloud can use Submission-based screening engagements to evaluate candidates based on their job applications.

Inviting Candidates to Screen

How do I send a screener engagement?

Screener engagements can be sent to candidates as part of an automation via the Send Engagement automation step when building candidate or submission-based automations. For a step-by-step guide, see Adding the Screener Engagement to an Automation

Do screening invitation links expire?

Invitations to complete a screening currently expire after 30 days, which is consistent with the expiration period for survey and chat engagement links.

What’s the time window for candidates to retake a screening?

Candidates have up to 30 days to complete a retake, as the original screening link expires after 30 days.

It’s important to note the difference between a retake and returning to an incomplete screening:

  • Retake: The candidate has completed a screening and chooses to start over from the beginning. Retakes can be done anytime within the 30-day window.

  • Incomplete: The candidate started the screening but didn’t finish it. In this case, they can return and complete the same session within one hour of dropping off.

Scoring and Metrics

How is the screening score calculated?

By default, the Amplify Screener score is created by reviewing both the candidate’s Bullhorn profile and resume as well as their interview responses. It looks for key factors such as:

  • Job-specific knowledge and skills: How well their answers demonstrate the technical abilities needed for the role

  • Leadership and teamwork (if applicable): Potential for collaboration or leading others

  • Problem-solving skills: Ability to think critically and suggest solutions

All of these elements are combined into a single score between 0 and 100, giving you a fair, consistent, and objective view of how well a candidate fits the role. Learn more about the default scoring here: Understanding Your Candidate's AI Screening Score.

In addition to this default scoring, you can also add additional scoring instructions to fine-tune how the AI evaluates candidates. For example, you can ask it to place more weight on must-have skills or to reduce scores for unanswered questions. Learn more about additional scoring instructions here: Amplify Screener Additional Scoring Instructions.

What do the different screening statuses mean?

Statuses mean the following:

  • Invited: This means the candidate has received a screening engagement through the Send Engagement step.

  • Complete: This means the candidate started the screening and continued through all the screening questions, and the candidate has provided a response to each question, even if that response is a non-answer, such as "no answer" or "pass." For a screening to be considered complete, it's not necessary for the candidate to have participated in the Q&A portion.

  • Incomplete: This indicates the candidate began the screening but it was considered 'Incomplete' based on the definition explained below.

The ATS won't show the screening status unless a submission record for the candidate and job already exists. A submission to the job record is only completed if the candidate completes a screening.

When does the Screener consider a Screening "Incomplete"?

The screener determines whether a screening is complete based on whether all job-related questions have been asked and answered, rather than the quality of the answers provided.

  • Complete Screenings: A screening is considered complete when all questions have been asked and the candidate has provided a response to each question, even if that response is a non-answer, such as "no answer" or "pass."

    The quality of answers is still taken into account in the scoring process, so candidates who provide more in-depth answers will naturally receive higher scores than those who provide non-answers like "no answer" or "pass."

  • Incomplete Screenings: A screening is deemed incomplete in three scenarios:

    1. The candidate exits before completing all questions

    2. The candidate did not provide a verbal response to any screening questions

    3. If a candidate requests to "skip to the end" and the agent agrees to that request (which is rare but possible), resulting in the agent not asking all the job questions.

    A score and a screening summary will not be generated if the screening is incomplete.