Assessments Protocol

Rubber Skill Development Council

Assessment Protocol – Rubber Skill Development Council

This assessment protocol document outlines generic framework for assessment of trainees being trained on National Occupational Standards as designed by Rubber Skill Development Council (RSDC). This document should be used as a reference reading material to understand and follow the assessment process that will be followed to assess the skill knowledge of the trainees.

This document should be used by assessors, trainees, training institutions, industry bodies, corporate, government affiliated bodies and others as guiding tool of assessment process being followed.

  1. Identification of KSAs (Knowledge-Skills-Abilities) of a candidate and module mapping

The different occupations listed in the NOSs of the Rubber Skill Development Council deal with different stages of Rubber Manufacture and Processing Technology. Although the technical knowledge required for these occupations are different, these jobs entail a specific set of common aspects which have been listed below.

Job Aspects
Material/Equipment Handling
Operational Know-how
Ensuring Safety
Quality Assurance
Problem Identification & Resolution
Problem Escalation
Reporting & Documentation

The set of KSAs (Knowledge-Skills-Abilities) required in a candidate for him/her to be able to perform well on job are detailed below.Assessment tools will be available in multiple languages like English, Hindi, Telegu, Tamil, Gujrati, Marathi etc.

Knowledge-Skill-Abilities Proposed Module What will the module check?
1.      Domain Knowledge Rubber Technology specific module Will check for technical know-how of all the aspects of the job that the candidate is supposed to perform.
2.      Situation Handling Situational Judgment Test Will check for the ability to handle critical situations at job.
3.      Analytical Ability Contextual Reasoning Will check the ability to identify cause for problems, interpret data and results and suggest improvements.
4.      Applied Skills Assessor driven assessments/ Simulations Will check the ability of the test taker if he knows “how” to do required tasks as part of the job role. Questions will be asked by a subject matter expert who will evaluate the practical knowledge of the test taker. Questions will include situations which the trainee will face in a real job and tasks which trainee would have to perform while on the job

 

  1. Assessment Timelines
    • Existing Job Role
S.No. Process description Stakeholder Timeline Remarks
1 TP share the start date and end date with no. of trainees to be shared under the specified job role TP T  
2 TP to share the assessment date to conduct assessment at the training centre TP T Assessment date can end day of training + 5 days
3 RSDC accept the assessment date once the assessment fees is collected RSDC t+1  
4 RSDC shares a tentative plan of assessment with Assessment agency with location and tentative dates and number of candidates RSDC t+1
5 10 days prior to the day of assessment, the details of the trainees are shared with the assessment body AA Y – 10
6 Assessment agency shares the details of the assessor with RSDC and schedules an interview in case of a new assessor who needs to be interviewed AA Y – 5  
7 Assessment agency makes all arrangements for travel and logistics for assessor AA Y – 3
8 Assessment agency to arrange a vigillence officer to supervise the assessment at TP centres AA Y – 3  
9 Assessor reaches the training centre location on the day of assessments AA Day of Assessment

= y

Assessor to reach the assessment centre before 9 am on the day of assessment
10 TP make necessary arrangements for assessor to conduct the assessment TP Y  
11 Assessor conducts the assessment in accordance with the assessmnet guidelines and question bank as per the job role AA Y  
12 AM will be responsible to put details in SDMS AA y+2  
13 RSDC will also validate the data and result received from the assessment agency RSDC y+ 3  
14 Any fees to the assessment agency will be paid once RSDC validates and approve the results received RSDC y + 7  

 

  • New Job Role
S.No. Process description Stakeholder Timeline Remarks
1 TP share the start date and end date with no. of trainees to be shared under the specified job role TP T  
2 TP to share the assessment date to conduct assessment at the training centre TP T Assessment date can end day of training + 5 days
3 RSDC accept the assessment date once the assessment fees is collected RSDC t+1  
4 RSDC to share curriculum and courseware with the assessment agency RSDC t+1
5 Development of assessment guideline and question bank as per the job role AA t+35 AA will prepare set of question papers job role wise
6 Validation and approval of question bank by assessment sub-committee RSDC t+38  
7 Assessment agency shares the details of the assessor with RSDC and schedules an interview in case of a new assessor who needs to be interviewed AA Y – 5  
8 Assessment agency makes all arrangements for travel and logistics for assessor AA Y – 3  
9 Assessment agency to arrange a vigillence officer to supervise the assessment at TP centres AA Y – 3  
10 Assessor reaches the training centre location on the day of assessments AA Day of Assessment

= y

Assessor to reach the assessment centre before 9 am on the day of assessment
11 TP make necessary arrangements for assessor to conduct the assessment TP Y  
12 Assessor conducts the assessment in accordance with the assessmnet guidelines and question bank as per the job role AA Y  
13 AM will be responsible to put details in SDMS AA y+2  
15 RSDC will also validate the data and result received from the assessment agency RSDC y+ 3  
16 Any fees to the assessment agency will be paid once RSDC validates and approve the results received RSDC y + 7  

Abrev:
TP – Training Partner
AA – Assessment Agency
RSDC – Rubber Skills Development Council
t – Day of commencement of training
t + 1 – Implies one day after the day of commencement of training
y – Day of assessment

Assessment framework for a Trainee, Trainer and Assessor

  • Trainee Evaluation

With uniformity and setting of National Occupational Standards (NOS), for different Jobs Roles the assessment of candidates will be at NOS level. Assessment criterion has been defined for each NOS and it includes both theoretical and practical skills on which the candidate will be assessed. The question suite which will be used to check the skills of the trainee would include

  • Theoretical test suite – Will include multiple choice questions, pictorial question, etc. which will test the trainee on his theoretical knowledge of the subject
  • Practical Knowledge suite – Practical knowledge can be tested through Assessor driven evaluation, Situational Judgment Tests and Simulations. A mix of the three would be able to evaluate the trainee on his practical knowledge of the QP
  • Assessor Evaluation

The underlying responsibility of the assessor would be to operationalise the process of on-site assessment of the trainees taking overall care of the process of evaluation. The evaluation will be focused on evaluating if the candidate knows how to perform the required tasks as part of his job role.

Sourcing

For sourcing the assessors, Assessment Agency will reach out to the Industry experts, Academicians, Members of industry bodies and others to volunteer for the role of an assessor. Following general guidelines would apply to all people who volunteer to be an assessor.

General Guidelines

  1. Assessor should be familiar with the process of assessment
  2. Assessor should have complete knowledge of the content of assessment, examination methodology and operational aspects and have atleast 7-8 years of experience.
  3. Assessor should be Manager and above in terms of designation
  4. Assessor should be fluent in the language of assessment
  5. Assessor should be impartial in assessing the trainees
  6. Assessor should not indulge in any malpractice during assessment

Sourced volunteers who would adhere to the above guidelines would go through the process of evaluation as described below.

Evaluation Process

Assessor needs to be competent in order to conduct assessments and its foundation is based on foundation provided by education, training and experience. These skills of the assessor needs to be evaluated as per the following methods

  1. Technical knowledge assessment – Technology enabled assessment of the assessor to evaluate his theoretical knowledge and the same will act as an objective benchmark which needs to be cleared by the assessor to move to the next stage. Assessor evaluation will be of a higher difficulty when compared to trainee evaluation.
  2. Interview – SSC to hold the formal interview and evaluate the assessor to bring the assessor on-board
  3. Online Assessment – Assessor has to give an online assessment made by RSDC
  4. Orientation – Assessor has to go through orientation program organized by Assessment Agency

Training & Orientation of assessor and certification

Post assessor empanelment assessors would need to undergo training for 4-16 hours. The training of assessors will cover the following points

  1. Occupational Standards Overview – This module of the training would give an overview to the assessors on the overall framework of QP evaluation. Assessor shall be given a NOS and PC level overview of each QP as applicable. Overview on the assessment framework of evaluation shall be shared with the assessor with explanation.
  2. Assessment Technology Overview – This module of training will give an overview to the assessor on how technology will be deployed for the assessment. Assessor will be trained on the following
  3. Use of delivery mediums (Tablets, computer etc.) which will be used to both deliver the questions and to give marks to the candidates
    1. Overall structure of assessment and objectivity of the marking scheme
  1. Sample assessment exercise basis the sample question bank to take an assessor through entire process of assessment

Basis the selection process which an assessor needs to clear and post selection training completion, an assessor will be certified and allocated a unique identification number by RSDC.

Assessor role and responsibility for conducting Practicals

Assessor will ask the candidates to perform certain pre – defined tasks (which will be delivered to the assessor using a tablet) and then assessor will evaluate if the candidate is able to perform the designated task in step-wise manner. Evaluation will be on pre defined objective criterion which will ensure standardization across assessor evaluations.

Assessors will play a vital role in successfully delivering assessments. The effectiveness and credibility of the certification would depend on competence, professionalism and integrity of the assessors.

An effective system needs to be in place to ensure the competence of assessors by establishing, implementing and maintaining procedures for qualifying and monitoring the performance and competence of the assessors involved. In particular, SSC and Assessment agency shall review the performance and competence of assessors in order to identify and streamlines any gaps in the process.

  1. Process Details

For conducting assessments, assessment agency will be working with SSC empanelled Assessors and coordinate with them to deliver assessments in a timely manner.

The process will be broadly classified as the following

  1. Test takers will be administered a technology driven test which will be taken on a tablet
  2. Test takers will give the practical assessment which will be conducted by the Assessor

Practical Test – Delivery Mechanisms

Assessor will be carrying tablet which he will use as a delivery mechanism which will aid the assessor in the process of assessment.

Assessment of the trainees will be solely based on the NOS of QP that the candidate is being assessed for. A preloaded question bank, which will be delivered to the assessor using a tablet which proctor will be carrying, will be used by the assessor to ask the questions from the candidate.

Assessor will also use the tablet to give his judgment, based on responses to his questions given by the candidate. Thus score generation also will be an automated process, basis the assessment of the candidate done by the assessor.

5.3 SOP – Assessment Delivery team

These instructions will be followed by the project coordinators (Proctors) for all Assessment Events managed by Assessment agency. Understated are the guidelines that have to be followed by the Project coordinator when conducting the drive at the venue. The event consists of Testing of candidates. The sequence of events is as follows:

Infrastructure Mapping

The project coordinator will be responsible for infrastructure mapping at the venue. The closure should include the following:

  1. Identifying all necessary equipments and carry the required number of tablets for the event in advance.

Tablets

  • To be fully charged
  • Excellent Working Condition
  • Questions papers has to be pre-loaded as the language requested for TP
  • Video Recording of the practical assessment

Event Day

Pre-event Checklist:

The coordinator has to report at the venue at 8:00 am on the event day. The Project Coordinator has to make sure that:

  1. Testing room is available with proper seating arrangement for candidates to appear for the knowledge assessment
  1. Machinery, equipments and tools on which the candidate has been trained on and which are part of NOS should be available to test the candidate on his applied skills

The event will start with an introductory overview delivered by the Assessors. Once the introduction gets over, the students will be divided into groups for assessment The Coordinator has to ensure that the following things are already in place. They are:

  1. Have the exact no. of candidates ready to move into the knowledge based assessments
  2. The instructions for taking the test are clearly written on the board in the lab or shared with the candidates verbally
  3. Re-check if the stationary is available in the testing area.

Once the students are in the testing area, coordinator would have to run through the instructions for the students to take the test.

Post Testing Work Flow:

  1. After the students are in the labs and the test in underway, the Project Coordinator has to ensure that all remaining batches of candidates are also ready to be tested
  2. Escort the candidates from the knowledge based assessment area to practical assessment area, after the batch finishes their testing.
  3. Once the first batch has moved out of the knowledge based assessment area, the second batch must be taken from the main waiting area and seated in the respective seats for their knowledge based assessment.

All the above mentioned points have to be repeated till all the candidates have undergone their testing

5.4 Result Compilation and storage

Once the testing of candidates is completed, the results have to be synched with the central servers. The same has to be done as soon as internet availability is possible.

Duration by which the test results will be shared with the SSC will depend on the medium of delivery of the test

  1. Test results will be shared with the SSC within 2 days of date of assessment

Data for the assessments will be stored for 10 years as per norms laid down.

5.5 Event Team composition

Subject Matter Expert and Project Coordinator

Event team will comprise of a Subject Matter Expert who is chosen from the industry to act as an assessor for the practical part of the assessment. He will be accompanied by Project coordinator (Proctor) who would be responsible of operational execution of the assessment in the early stages of engagement. He will have mandate of managing all the infrastructural requirements and operations for the assessment.

This will be contingent on number of trainees per batch.

  1. Question Types and Assessment Content overview

The questions across these modules can be of various formats: Multiple Choice Questions,  Touch/Click-based, Drag-and-drop, Assessor-Evaluation-based, etc. They can also be delivered in the bilingual format.

6.1.1 Multiple Choice Questions

Will check the theoretical knowledge of the test taker on skills he has learnt in training. For each question addressed to the test taker, the best option among two or more options would have to be chosen which appears to the test taker as the best option.

6.1.2 Audio/Video Based

To eliminate the read and write ability requirement of the test taker audio/video tests design will ensure that test taker is able to attempt the test and get assessed for skills in rubber industry without having knowledge of reading.

Video based questions also add diagrams, machine photographs and questions based on the same, checking on theoretical knowledge of test taker on machinery and tools he will be using for practical purposes

6.1.3 Touch/Click Based

Questions addressed to the test taker will not require him to have any technical knowledge to use the computer/tablet to give the assessment. Questions will be touch/click based making it very simple and easy for the test taker to select the right options

6.1.4 Situational Judgment Test

SJTs have the capability to evaluate practical intelligence in real world work situations. They are a combination of cognitive, personality and domain knowledge. There are already tools available for sales, client servicing, retail, management, HR, etc. Further development is in progress for Rubber specific roles in different functions as well.

6.1.5 Drag-and-drop

Simulations will be addressed as questions to test taker to check the practical knowledge. Drag and drop type questions are one type of simulation questions where in test taker will need to arrange the items on screen in the right order. Similar simulation based questions will be testing the test taker on practical knowledge.

6.1.6 Assessor Evaluation-based

Pre-defined rubrics and set question bank will ensure an objective evaluation of test takers on their practical knowledge. Assessors will be testing candidates on their practical skills but the marking will be driven by an objective framework which will maintain standardization of marking scheme.

6.2 Assessment Structure

The weightage of content of the theoretical and practical assessments will be 60% and 40% respectively.

Passing Criteria

Passing criteria would be

NSQF Level Technical Non- Technical
1, 2 & 3 50 50
4 and Above 70 60

 

Duration of Assessment*

Theoretical Assessment: 1 hour

Practical Assessment: 15 minutes

*Depends on the Job role

6.3 Content Design

 6.4 Content Creation process

 As part of content creation question bank will be generated for each of the NOS to access the candidates on NOS based criterion.

Question bank will be a repository of questions from which backend technological system will randomly select certain questions which will in turn be addressed to the candidates. As questions will be chosen by technological system in a random order, different sets of question papers will appear in front of candidates.