Executive Summary

PyjamaHR’s AI scoring features—Resume Match and AI Recruiter—help you quickly identify the best-fit candidates by automatically evaluating resumes and interview responses against your job requirements. Understanding how these scores are calculated, what factors influence them, and how to interpret and use them will help you streamline your hiring process, reduce manual effort, and make more informed decisions.

Detailed Overview

What Is AI Scoring in PyjamaHR?

PyjamaHR uses AI-driven algorithms to analyze candidate resumes and interview responses, generating scores that reflect how well each candidate matches your job requirements. The two main scoring features are:

Resume Match Score: Assesses how closely a candidate’s resume aligns with the job description, focusing on key responsibilities, primary and secondary skills, experience, and education.
AI Recruiter Job Fitment Score: Evaluates candidate responses in AI-conducted interviews, factoring in your configured screening criteria and weighted topics.

These scores are visible in each candidate’s profile and are designed to help you prioritize candidates efficiently, especially when dealing with high application volumes.

Why Use AI Scoring?

Save Time: Instantly surface top candidates without manual screening.
Reduce Bias: Standardized scoring based on your job criteria.
Improve Quality: Focus on candidates who best fit your needs, even in large applicant pools.
Integrate with Workflow: Use scores alongside filters, screening questions, and manual review for a holistic evaluation.

How Does AI Scoring Integrate with Other Features?

Resume Match Score appears in candidate profiles and can be used as a filter in your candidate list.
AI Recruiter uses your screening criteria (set in the “Configure AI” section) to conduct interviews and generate job fitment scores and summaries.
Filters allow you to combine AI scores with other criteria (e.g., experience, answers to screening questions) for advanced candidate sorting.

Step-by-Step Guide: Using and Understanding AI Scoring

1. Setting Up Resume Match Scoring

Prerequisites:
- Job must be created and published in PyjamaHR.
- Resume Match is available for all jobs on Premium plans; for older jobs, scores may need to be manually populated by support.

Steps:
1. Create or Edit a Job Posting
- Clearly define key responsibilities, primary and secondary skills, and required experience.
- Tip: The more specific your job description, the more accurate the AI scoring.

Star Mark Key Skills
- In the job setup, use the “star” feature to highlight primary and secondary skills. These are heavily weighted in the scoring.
View Resume Match Scores
- Go to the candidate list for your job.
- Each candidate will display a Resume Match Score in their profile.
- Screenshot callout: Show candidate list with Resume Match Score column.
Filter Candidates by Score
- Use the Resume Match filter to narrow down candidates above a certain score threshold.
- Combine with other filters (e.g., experience, screening question answers) for more precise shortlisting.
Review Score Details
- Click into a candidate profile to see which skills and experiences contributed to their score.
- Note: The score is based on overall alignment, not just keyword matching.

2. Configuring AI Recruiter Scoring

Prerequisites:
- AI Recruiter feature must be enabled (additional charge).
- Screening criteria must be set up in the “Configure AI” section.

Steps:
1. Set Screening Criteria
- In the “Configure AI” section, define the topics and questions you want the AI to assess.
- Assign weights to each topic to indicate importance (e.g., “Technical Skills” 40%, “Problem Solving” 30%, etc.).
- Screenshot callout: Show Configure AI screen with weighted topics.

Send AI Interview Invites
- Select candidates to invite for AI interviews.
- The AI will conduct interviews based on your criteria.
Review AI Recruiter Scores
- After interviews, view the Job Fitment Score, Resume Match Summary, and Communication Score in each candidate’s report.
- Use these scores to identify “AI Picks”—top candidates recommended by the system.
Combine with Manual Review
- Use AI scores as a starting point, but review candidate profiles and interview summaries for a holistic assessment.

Advanced Usage & Best Practices

Power User Tips

Refine Job Descriptions: The more detailed your job requirements and skill lists, the more accurate the Resume Match Score.
Use Star Marking Strategically: Only star the most critical skills—over-starring can dilute the score’s effectiveness.
Balance Scores with Context: Don’t rely solely on the score; review the candidate’s full profile and experience.
Leverage Filters: Combine Resume Match Score with other filters (e.g., experience, education, screening answers) for advanced candidate sorting.
Iterate and Improve: If too many candidates are scoring “High,” revisit your job description and star-marked skills to increase selectivity.

Do’s and Don’ts

Do:
- Use AI scores as a guide, not the sole decision-maker.
- Regularly update job descriptions and screening criteria for accuracy.
- Combine AI scoring with manual review for best results.

Don’t:
- Expect AI to filter out all unqualified candidates automatically—manual review is still needed.
- Overload the job description with too many skills or requirements.
- Ignore candidates with lower scores if they have unique or unconventional backgrounds.

Troubleshooting & Common Issues

Common Issues and Solutions

Issue: Resume Match Score not visible for a job
Solution:
- For new jobs, ensure you’re on a Premium plan.
- For older jobs, contact support to manually populate scores.

Issue: Too many candidates scoring “High”
Solution:
- Refine your job description and reduce the number of star-marked skills.
- Ensure primary and secondary skills are clearly differentiated.

Issue: Resume Match Score seems inaccurate (e.g., high score but missing key skill)
Solution:
- The score considers overall alignment, not just one skill. Review the full profile and score breakdown.
- If critical skills are missing, adjust your job description or star-marking.

Issue: Filters not updating candidate count
Solution:
- Known issue with filter logic; contact support if filters do not work as expected.

Issue: AI Recruiter not sending interviews only to qualified candidates
Solution:
- Currently, you must manually select candidates to invite for AI interviews.

Issue: Unable to filter by certain screening questions
Solution:
- Some question types (e.g., Single Choice) may not be available in filters due to current limitations. Contact support for updates.

When to Contact Support

Resume Match Scores not appearing after setup.
Filters not functioning or missing screening questions.
Need to manually populate scores for older jobs.
Suspected scoring errors or inconsistencies.

Comprehensive FAQ

1. What factors influence the Resume Match Score?
The score is based on alignment with key responsibilities, primary and secondary skills (star-marked), experience, and education as defined in the job description.

2. How can I make Resume Match Scores more selective?
Refine your job description and limit the number of star-marked skills to only the most essential.

3. Why do some candidates with missing key skills still score high?
The AI considers the overall profile, including experience and related skills, not just exact keyword matches.

4. Can I filter candidates by Resume Match Score?
Yes, use the Resume Match filter in the candidate list.

5. Are Resume Match Scores available for all jobs?
For Premium plans, yes. For older jobs, scores may need to be manually populated by support.

6. How do AI Recruiter scores work?
Scores are based on your configured screening criteria and weighted topics in the “Configure AI” section.

7. Can I assign different weights to skills or topics?
Yes, in the “Configure AI” section for AI Recruiter interviews, you can assign weights to each topic.

8. Does the AI automatically move candidates between stages?
No, you must manually review and move candidates. The AI highlights top candidates (“AI Picks”) for your review.

9. Can I save filter configurations for repeated use?
Currently, saving filters is a requested feature and not yet available.

10. Why are some screening questions missing from filters?
Some question types (e.g., Single Choice) may not be filterable due to current limitations.

11. How do I troubleshoot if scores aren’t appearing?
Check your plan, ensure the job is set up correctly, and contact support if needed.

12. Can I see why a candidate received a specific score?
Yes, review the candidate’s profile for a breakdown of matched skills and experience.

Screening Questions: Combine with AI scoring for more targeted filtering.
Filters: Use Resume Match and other filters together for advanced sorting.
AI Recruiter: Set up weighted topics and screening criteria for more precise interview scoring.
Candidate Reports: Review AI-generated summaries and fitment scores after interviews.

Recommended Next Steps:
- Review and update your job descriptions for clarity and specificity.
- Use star-marking judiciously to highlight only the most critical skills.
- Experiment with filters and AI scores to optimize your shortlisting process.
- Contact support for help with manual score population or troubleshooting.

Still have questions?
If you encounter issues not covered here, reach out to PyjamaHR Support with your job ID and a description of the problem for fast resolution.

This article is based on real customer conversations and reflects the latest workflows and best practices for AI scoring in PyjamaHR as of June 2024.

Understanding AI Scoring Methodology and Weights in PyjamaHR: How Resume Match and AI Recruiter Scores Work