Executive Summary

PyjamaHR’s AI screening features allow you to automate candidate evaluation by setting up custom screening criteria and question topics for both application forms and AI interviews. This guide explains how to configure these criteria, optimize your screening process, and avoid common pitfalls—ensuring you only spend time on the most qualified candidates.

Detailed Overview

What is AI Screening in PyjamaHR?

AI screening in PyjamaHR refers to the automated evaluation of candidates using configurable criteria and question topics. This includes:
- Screening Questions: Custom questions added to job applications to filter candidates based on must-have qualifications.
- AI Recruiter Interviews: Automated interviews where the AI asks and assesses candidates based on your defined criteria and topics.

Why Use AI Screening?
- Save time: Automatically filter out unqualified candidates.
- Consistency: Ensure all candidates are evaluated against the same standards.
- Scalability: Efficiently manage high applicant volumes (e.g., 100+ per job).
- Data-driven: Get objective fitment scores and summaries.

Integration with Other Features
- Works with Resume Match Scores, Auto-Reject flows, and Candidate Pipelines.
- Screening criteria can trigger candidate movement to Rejected or Shortlisted pipelines.
- AI Recruiter reports integrate with your candidate dashboard.

Step-by-Step Guide: Configuring AI Screening Criteria and Question Topics

Prerequisites

You must have permission to create or edit jobs.
For AI Recruiter, ensure your plan includes this feature.

1. Access the Job Card

Go to the Jobs section.
Click on the job you want to configure.

2. Open Screening Configuration

For application form questions: Go to the Screening Questions section.
For AI Recruiter: Click Configure AI (top right of the job card).

3. Add or Edit Screening Criteria

Screening Questions:
- Click Add Question.
- Choose the question type:
- Yes/No (recommended for knockout/auto-reject logic)
- Multiple Choice (can be used for filtering, but see limitations below)
- Numeric (for experience, salary, etc.)
- Single Line (not filterable—see Common Issues)
- Mark questions as Mandatory if required.
- For knockout logic, use Yes/No and set up auto-reject (see Advanced Usage).
AI Recruiter Criteria:
- In Configure AI, enter your screening requirements in the provided text box.
- Specify key skills, experience, and any must-have criteria.
- Add specific question topics or even exact questions you want the AI to ask.
- (Optional) Assign weights to topics if available.
Custom AI Interview Questions:
- Enter detailed requirements or paste your custom question in the criteria box.
- Note: For long or complex questions, keep them concise for best candidate experience.

4. Save and Publish

Click Save or Update.
Publish or update the job posting.

5. (Optional) Clone Jobs for Reuse

To reuse screening questions, clone an existing job. All screening questions will be copied over.

Screenshots to Include:
- Job card with “Configure AI” button highlighted.
- Screening Questions section with “Add Question” dialog.
- Example of AI Recruiter criteria input box.

Advanced Usage & Best Practices

Power User Tips

Use Yes/No Questions for Knockout Filtering: Only Yes/No and Multiple Choice questions can be used for filtering and auto-reject. Single Line and Single Choice are not filterable.
Mandatory Questions: Mark critical questions as mandatory to ensure candidates cannot skip them.
Auto-Reject Flows: Set up auto-reject for Yes/No questions to automatically move unqualified candidates to the Rejected pipeline.
AI Interview Customization: In “Configure AI,” specify not just skills but also the exact scenario or question you want the AI to ask. Example: “Describe your approach to diagnosing complex performance issues in distributed systems.”
Clone Jobs to Save Time: Since there’s no question repository yet, cloning jobs is the fastest way to reuse question sets.

Optimization Strategies

Keep Questions Concise: Long or complex questions may confuse candidates or reduce response quality.
Combine Criteria: Use a mix of screening questions and AI interview topics for layered filtering.
Monitor Filtering Logic: If using Multiple Choice, be aware that current filters may apply AND logic (all selected options must match), not OR logic.

Integration with Other Workflows

Resume Match Score: Combine screening questions with AI resume matching for a two-layer filter.
Candidate Pipeline: Use screening criteria to auto-move candidates to Rejected or Shortlisted stages.
Bulk Actions: After filtering, use bulk actions to move or email candidates.

Do’s and Don’ts

Do:
- Use Yes/No for knockout questions.
- Make critical questions mandatory.
- Regularly review and update your screening criteria.
- Clone jobs to reuse question sets.

Don’t:
- Use Single Line or Single Choice questions if you need to filter candidates.
- Expect auto-advancement between stages—AI Recruiter highlights top candidates but does not move them automatically.
- Overload candidates with too many or overly complex questions.

Troubleshooting & Common Issues

Common Problems and Solutions

1. Screening Filters Not Working
- Symptom: “No screening filters available for this job” or filters not showing.
- Cause: Only Yes/No, Multiple Choice, and Numeric questions are filterable. Single Line and Single Choice are not.
- Solution: Edit your screening questions to use supported types.

2. Candidates Skipping Mandatory Questions
- Symptom: Candidates apply without answering mandatory questions.
- Cause: Questions not marked as mandatory, or a platform glitch.
- Solution: Double-check that questions are set as mandatory. If issue persists, contact support with job ID and screenshots.

3. Auto-Reject Not Working
- Symptom: Unqualified candidates not moved to Rejected pipeline.
- Cause: Auto-reject only works with Yes/No questions.
- Solution: Convert relevant questions to Yes/No and enable auto-reject.

4. AI Interview Not Asking Specific Questions
- Symptom: AI interview does not ask your custom scenario.
- Cause: Question not clearly specified in “Configure AI” criteria.
- Solution: Enter the exact question or scenario in the criteria box.

5. Screening Answers Not Showing on Candidate Profiles
- Symptom: Screening answers missing for some candidates.
- Cause: Data sync issue, especially with external job boards (e.g., LinkedIn).
- Solution: Usually fixed for new candidates; old data may be unrecoverable. Contact support if ongoing.

6. Cloning Jobs Deletes or Fails to Update Questions
- Symptom: Editing or deleting one question affects all questions.
- Solution: Report to support with job ID and screen recording.

7. Filtering Logic Not as Expected
- Symptom: Multiple Choice filters apply AND logic instead of OR.
- Solution: Be aware of current logic; request Boolean/OR logic as a feature if needed.

Comprehensive FAQ

1. What types of screening questions can be used for filtering?
Only Yes/No, Multiple Choice, and Numeric questions can be used for filtering and auto-reject.

2. Can I create custom AI interview questions?
Yes, specify your custom question or scenario in the “Configure AI” criteria box. The AI will use this as a basis for the interview.

3. Can I reuse screening questions across jobs?
There is no repository yet, but you can clone jobs to reuse questions.

4. Why aren’t my screening filters working?
Check that your questions are of a supported type (not Single Line or Single Choice).

5. How do I set up auto-reject for unqualified candidates?
Use Yes/No questions and enable auto-reject (knockout) logic.

6. Can the AI Recruiter automatically move candidates to the next stage?
No, AI Recruiter highlights top candidates but does not auto-advance them.

7. Can I assign weights to AI interview topics?
You can specify importance in the criteria box; explicit weighting may not be available in all plans.

8. Why are candidate answers missing from profiles?
This can happen due to sync issues with job boards. Usually fixed for new candidates; old data may not be recoverable.

9. Can I filter candidates based on resume match score and screening answers together?
Yes, use both filters in the candidate dashboard.

10. What if I want to use custom case studies or assessments?
Custom case studies are available under custom plans. Contact support for setup and pricing.

11. Can I edit AI-generated questions for non-tech roles?
Currently, editing is limited for non-tech roles. Contact support for updates or custom options.

12. How do I ensure candidates cannot skip mandatory questions?
Mark questions as mandatory. If issues persist, contact support.

13. Why do some filters not reduce the candidate count as expected?
This may be due to filter logic or unsupported question types. Review your screening setup.

Resume Match Score: Combine with screening questions for layered filtering.
Auto-Reject Flows: Set up for Yes/No questions.
Candidate Pipeline Management: Move candidates based on screening results.
Bulk Actions: Email or move filtered candidates in bulk.
Custom Assessments: Available under custom plans.

Recommended Next Steps:
- Review your current screening questions for filter compatibility.
- Clone jobs to standardize your screening process.
- Contact support for advanced customizations or if you encounter persistent issues.

Still need help?
If you encounter issues not covered here, contact PyjamaHR Support with your job ID, screenshots, and a description of the problem for fastest resolution.

By following this guide, you’ll ensure your AI screening criteria and question topics are set up for maximum efficiency—saving you time and helping you focus on the best candidates.

How to Configure AI Screening Criteria and Question Topics in PyjamaHR