Executive Summary
PyjamaHR’s AI screening features allow you to automate candidate evaluation by setting up custom screening criteria and question topics for both application forms and AI interviews. This guide explains how to configure these criteria, optimize your screening process, and avoid common pitfalls—ensuring you only spend time on the most qualified candidates.
Detailed Overview
What is AI Screening in PyjamaHR?
AI screening in PyjamaHR refers to the automated evaluation of candidates using configurable criteria and question topics. This includes:
- AI Recruiter Interviews: Automated interviews where the AI asks and assesses candidates based on your defined criteria and topics.
Why Use AI Screening?
- Save time: Automatically filter out unqualified candidates.
- Consistency: Ensure all candidates are evaluated against the same standards.
- Scalability: Efficiently manage high applicant volumes (e.g., 100+ per job).
- Data-driven: Get objective fitment scores and summaries.
Integration with Other Features
- Works with Resume Match Scores, Auto-Reject flows, and Candidate Pipelines.
- AI Recruiter reports integrate with your candidate dashboard.
Step-by-Step Guide: Configuring AI Screening Criteria and Question Topics
Prerequisites
For AI Recruiter, ensure your plan includes this feature.
1. Access the Job Card
Go to the Jobs section.
Click on the job you want to activate the AI Recruiter in.
2. Click on Activate AI
Then, Click Configure AI (top right of the job card).
3. Add or Edit Screening Criteria
AI Recruiter Criteria:
In Configure AI, enter your screening requirements in the provided text box.
Specify key skills, experience, and any must-have criteria.
Add specific question topics or even exact questions you want the AI to ask.
(Optional) Assign weights to topics if available.
Custom AI Interview Questions:
Enter detailed requirements or paste your custom question in the criteria box.
Note:
For long or complex questions, keep them concise for best candidate experience.
If you want the AI Recruiter to ask the exact questions that you have mentioned in the screening criteria, switch on the toggle as shown in the image and then hit the Save button.
Advanced Usage & Best Practices
Power User Tips
AI Interview Customization: In “Configure AI,” specify not just skills but also the exact scenario or question you want the AI to ask. Example: “Describe your approach to diagnosing complex performance issues in distributed systems.”
Optimization Strategies
Keep Questions Concise: Long or complex questions may confuse candidates or reduce response quality.
Combine Criteria: Use a mix of screening questions and AI interview topics for layered filtering.
Do’s and Don’ts
Do:
- Regularly review and update your screening criteria.
Don’t:
- Use Single Line or Single Choice questions if you need to filter candidates.
- Expect auto-advancement between stages—AI Recruiter highlights top candidates but does not move them automatically.
- Overload candidates with too many or overly complex questions.
Troubleshooting & Common Issues
Common Problems and Solutions
. AI Interview Not Asking Specific Questions
- Symptom: AI interview does not ask your custom scenario.
- Cause: Question not clearly specified in “Configure AI” criteria.
- Solution: Enter the exact question or scenario in the criteria box and turn on the Ask screening criteria questions exactly as written toggle > Save
Comprehensive FAQs
Can I create custom AI interview questions?
Yes, specify your custom question or scenario in the “Configure AI” criteria box. The AI will use this as a basis for the interview if you don't turn on Ask screening criteria questions exactly as written check box
2. Can the AI Recruiter automatically move candidates to the next stage?
No, AI Recruiter highlights top candidates but does not auto-advance them.
3. Can I assign weights to AI interview topics?
You can specify importance in the criteria box; explicit weighting may not be available in all plans.
4. What if I want to use custom case studies or assessments?
Custom case studies are available under custom plans. Contact support for setup and pricing.
Related Features & Next Steps
Candidate Pipeline Management: Move candidates based on screening results.
Bulk Actions: Email or move filtered candidates in bulk.
Custom Assessments: Available under custom plans.
Related Articles:
- How to Set Up Auto-Reject Flows
- Using Resume Match Scores for Candidate Filtering
- Cloning Jobs and Reusing Screening Questions
- Troubleshooting Candidate Data Sync Issues
Still need help?
If you encounter issues not covered here, contact PyjamaHR Support with your job ID, screenshots, and a description of the problem for fastest resolution.
By following this guide, you’ll ensure your AI screening criteria and question topics are set up for maximum efficiency—saving you time and helping you focus on the best candidates.

