Executive Summary
PyjamaHR’s Skill Test and Assessment feature enables you to evaluate candidates efficiently with AI-generated or custom questions across 400+ skills. This guide covers everything you need to know to create, configure, and optimize new assessments—whether you want to use AI-generated questions or explore custom options. Learn how to avoid common pitfalls, troubleshoot issues, and get the most out of your candidate testing workflow.
Detailed Overview
What Is the Skill Test/Assessment Feature?
The Skill Test/Assessment feature in PyjamaHR allows recruiters and hiring managers to screen candidates with standardized, skill-based tests. These can be generated using PyjamaHR’s extensive AI-powered question bank or, for advanced users and custom plan holders, by adding your own questions (e.g., MCQs, case studies).
Key Use Cases:
- Screening large candidate pools for technical and non-technical roles
- Standardizing evaluation across multiple hiring stages
- Reducing manual effort in candidate shortlisting
- Integrating assessments with job postings and candidate pipelines
Integration Points:
- Assign tests directly from candidate profiles or job pipelines
- View results in the Reports tab
- Use with AI Interview and screening filters for a holistic evaluation
Step-by-Step Guide: Creating a New Skill Test or Assessment
Prerequisites
You must have the necessary test credits (check under “My Plans” in your user profile).
Only users with appropriate permissions (Admin, Recruiter, Hiring Manager) can create tests.
For custom questions/case studies, you must be on a custom plan.
1. Access the Tests Section
Navigate to the “Tests” tab in the top navigation bar.
Click on “Create Test” (If the button is disabled, see Troubleshooting below).
Screenshot suggestion: Highlight the “Tests” tab and “Create Test” button.
2. Select Test Type and Skills
Choose the role or skill area (e.g., Full Stack Developer, Accounting SPOC, English Communication).
Select skills from the dropdown. If a skill is missing, clarify if it’s a tech or non-tech role (some skills may not be available for non-tech roles).
Screenshot suggestion: Show skill selection dropdown.
3. Configure Questions
AI-Generated Questions:
Select the number of questions per skill and difficulty level (up to 20 per difficulty per skill; max 60 per skill).
You can regenerate questions as many times as needed.
For a 45-question test, distribute questions across multiple skills and difficulty levels.
Custom Questions (Custom Plan Only):
Contact support to enable this feature.
You can add your own MCQs or case studies (e.g., financial analyst scenarios with real data).
For case studies, you can provide your own content for full control.
Screenshot suggestion: Show question configuration screen.
4. Review and Finalize
Scroll down to the bottom right and click “Continue”.
If you can’t see the button, try zooming out your browser (Ctrl + -) or set screen size to 100%.
Review the test summary and make any final edits.
Click “Create” to finalize the test.
Screenshot suggestion: Highlight “Continue” and “Create” buttons.
5. Assign the Test
Assign the test to candidates from the job pipeline or candidate profile.
Set test expiry and duration as needed.
Candidates will receive an email with the test link.
Advanced Usage & Best Practices
Power User Tips
Bulk Assignments: Assign tests to multiple candidates at once from the pipeline.
Regenerate Questions: Use the regenerate feature to ensure question variety for different batches.
Expiry Management: If a candidate’s test expires, revoke and resend using the three-dot menu.
Test Credits: Monitor your credits in “My Plans” and purchase more as needed (contact support for bulk or custom pricing).
Customization & Integration
Custom MCQs/Case Studies: Available only on custom plans (one-time fee + per-assessment cost).
API Integration: API access is available for bulk test purchasing, not for triggering tests externally.
Reports & Analytics: Access detailed candidate performance in the Reports tab.
Do’s and Don’ts
Do:
- Double-check skill selection and question content before publishing.
- Use screen zoom/refresh if UI elements are missing.
- Contact support for bulk test credits or custom question needs.
Don’t:
- Attempt to clone or rename published tests (not currently supported).
- Expect to edit questions for non-tech roles unless on a custom plan.
- Share tests without confirming you have sufficient credits.
Troubleshooting & Common Issues
1. Can’t See “Create Test” or “Continue” Button
Solution: Zoom out your browser (Ctrl + -) or set screen size to 100%. Refresh the page.
If unresolved: Share a screenshot with support or request a Zoom/Google Meet call.
2. Test Not Uploading or Freezing
Solution: Try reducing screen size, refreshing, or clearing browser cache.
If unresolved: Contact support for a live troubleshooting session.
3. Test Shows 0 Questions or Is Blank
Solution: This may be a temporary bug. Raise a ticket with support and avoid sharing the test until resolved.
4. Cannot Clone or Rename a Test
Current Limitation: Once published, tests cannot be cloned or renamed. Plan carefully before finalizing test names.
5. Custom Questions Not Available
Solution: Only available on custom plans. Contact support for upgrade options.
6. Candidate Assigned Wrong Test
Solution: Revoke the test using the three-dot menu and assign the correct one.
7. Test Credits Not Sufficient
Solution: Purchase more credits via “My Plans” or contact support for bulk purchases.
8. Test Expiry Issues
Solution: Revoke and resend the test if a candidate’s test expires before completion.
Comprehensive FAQ
1. Can I create my own test with custom questions?
Yes, but only on a custom plan. Contact support for details and pricing.
2. How many questions can I add per test?
Up to 20 per difficulty level per skill (max 60 per skill). Distribute across skills for larger tests.
3. Can I edit or clone a test after publishing?
No, currently you cannot edit, clone, or rename a test once published.
4. What if the “Create Test” button is missing or disabled?
Try zooming out, refreshing, or clearing cache. If unresolved, contact support.
5. Can I assign a test to a candidate more than once?
Yes, revoke the previous test and resend as needed.
6. How do I purchase more test credits?
Go to “My Plans” in your profile or contact support for bulk purchases.
7. Can I integrate tests with external tools via API?
API access is only for bulk test purchasing, not for triggering tests externally.
8. What if a candidate receives the wrong test?
Revoke the test and assign the correct one.
9. Can I add case study or scenario-based questions?
Yes, on custom plans. You can provide your own content for full control.
10. Why can’t I find certain skills when creating a test?
Some skills may not be available, especially for non-tech roles. Contact support if a key skill is missing.
11. What happens if a test shows 0 questions or is blank?
This is a known issue—raise a ticket with support and do not share the test until fixed.
12. How do I view candidate test results?
Go to the Reports tab to see detailed scores and analytics.
13. Can I revoke a test after it’s been sent?
Yes, as long as the candidate hasn’t started the test.
14. What if I run out of test credits mid-campaign?
Purchase additional credits or contact support for urgent needs.
15. Can I use the same test for multiple job roles?
Yes, but you cannot clone or rename tests, so plan accordingly.
Related Features & Next Steps
AI Interview: Combine skill tests with AI interviews for comprehensive candidate evaluation.
Screening Questions: Use alongside application form filters for better shortlisting.
Reports & Analytics: Analyze candidate performance and export results.
Bulk Actions: Assign tests to multiple candidates in one go.
Custom Plan Upgrades: Contact support to enable custom questions or case studies.
Recommended Next Steps:
- Review your current test credits and plan for upcoming hiring needs.
- Explore AI Interview and screening filters for a holistic hiring workflow.
- Contact support for custom test requirements or bulk credit purchases.
Related Articles:
- Assigning Tests to Candidates
- Understanding Test Reports and Analytics
- Setting Up AI Interviews
- Managing Test Credits and Billing
Final Notes
This guide is based on real customer experiences and the latest PyjamaHR platform capabilities. If you encounter any issues not covered here, reach out to support with screenshots and detailed descriptions for the fastest resolution.
Your feedback helps us improve—please share your suggestions for future updates!