Occ. Code 1412300
SENIOR PERSONNEL EXAMINER, GRADE 18
New York State Department of Civil Service
Classification Standard
NATURE OF WORK
Senior Personnel Examiners develop tests of basic abilities or of knowledges, skills and abilities in assigned occupational specialties to provide appropriate selection measures for merit system administration. Incumbents analyze jobs, determine appropriate selection measures, develop test plans, prepare test items, analyze test results, and make recommendations for test scoring and setting of pass points. They conduct or assist in the conduct of ethnic and validation studies of tests.
Positions are located only in the Division of Testing Services, Department of Civil Service.
CLASSIFICATION CRITERIA AND DISTINGUISHING CHARACTERISTICS
Typical of this class is the full performance level operation, within assigned occupational specialties, in the following areas:
Test assignments usually entail standard procedures, established precedents and guidelines with periodic supervisory review. Selection measures are generally multiple-choice written tests, job-sample performance tests and evaluation of training and experience. Periodically there may be written essay tests. The preparation of written test items generally requires a knowledge of proper grammar and exposition, with a structured presentation of information appropriate for the candidate population. Although specialized knowledge of a given subject matter area is not required, incumbents are expected to develop an general knowledge of job content in assigned occupational specialties. At this level, incumbents utilize a working knowledge of statistical practices and procedures to analyze test results and to identify significant discrimination indices, sub-test inconsistencies and item score variations. They may assist in the supervision of Trainees and others in the routine aspects of the job, usually on a lead examiner basis.
Associate Personnel Examiners typically head an examining unit and supervise a small group of Senior Personnel Examiners and Trainees in the development, processing, analysis and evaluation of merit system selection devices; and may personally handle the more complex test assignments.
Within the Division of Testing Services, positions performing similar examining tasks in areas requiring specialized subject matter knowledge are classified in titles such as Senior Engineering Examiner and Senior Legal Examiner.
Positions which perform various personnel activities in an operating agency, such as classification, recruitment, placement and provision of employee services are classified as Senior or Associate Personnel Administrator. Other positions in the Civil Service Department responsible for central guidance and control in the areas of labor relations, staff development, personnel administration and merit system administration are classified under a variety of specialized titles.
TYPICAL ACTIVITIES, TASKS AND ASSIGNMENTS
The listing in this section is illustrative and is not intended to be all-inclusive.
Develops test plans for State and local jurisdiction examinations in assigned occupational specialties.
- Reads, compares, analyzes and evaluates available job descriptions, job analyses and past examination history pertinent to a given specialty in order to become familiar with the positions. May engage in research of recent developments in the field, methods of testing and job analysis in other jurisdictions, etc. Initiates action to obtain additional information required by contacting Staffing Services, Classification and Compensation, Municipal Service Division and operating agencies representatives.
- Attends conferences with operating agency personnel and other Civil Service representatives to determine whether available job information is current, accurate and adequate for the purpose of developing test plans and tests.
- Directs or assists in the gathering of data for pertinent job analyses by means of field visits, use of questionnaires, review of literature and comparison of job data in order to determine the critical knowledges, skills and abilities required to perform the job; and the level of performance required of both satisfactory and superior incumbents. May develop the job analysis questionnaires, interview incumbents and their supervisors at on-site locations, read consolidated job descriptions and compose and write related correspondence.
- Prepares written narrative reports of the results of conferences, meetings and related actions to document each step of the examination process. Discusses findings, evaluations and recommended actions with supervisor.
- Recommends type of selection device to be used (multiple choice, essay written test, evaluation of training and experience, oral examination, etc.) and areas to be covered.
- Performs statistical analysis to determine that the selection device is designed to test for necessary knowledges, skills and abilities. Compares individual job tasks of the position and the required knowledges, skills and abilities to perform the tasks against the test measures for these requirements to include means of testing, rubrics used and test item coverage. Indicates what further validation and ethnic analysis is planned.
- Prepares and recommends examination scope and examination date for supervisor review and approval.
Executes approved written test plans to meet established professional standards of test construction and deadline schedules.
- Reviews, analyzes and evaluates past examinations for the given class.
- Analyzes current test plan to determine which sub-tests should be sub-contracted to another section. Confers and as required negotiates with other examiners to supply sub-test(s) that adequately cover the subject matter area at the level of difficulty indicated by the job information.
- Based on job knowledge and test plan, selects items from section files for written tests. Analyzes prior use of item, item content and makes an evaluation as to suitability for current use.
- As appropriate, contacts outside subject matter experts in order to persuade them to write questions in their specialty area.
- Writes items in areas not adequately covered after selection of material in files and the submission of items from the subject matter experts.
- Reviews test items to see that they are appropriate for the position, at the required level of difficulty, correct, conform to recognized standards of professional testing and that the language used is at the required level of difficulty. Edits items as necessary.
- Analyzes items and language used for possible disparate impact based on knowledge of cultural differences. Evaluates available ethnic information from past examination of test items.
- Submits final selection of test items to supervisor for review and approval.
- Routes approved test items for appropriate processing by pertinent support activities.
- Prepares examination instructions, headsheets, formats, and special instructions as required.
- Reads and reviews test material to ensure it is correct, accurate and in proper order prior to reproduction.
- Reviews and checks test definitions for accuracy and to ensure that the type of statistical information required for test analysis is indicated.
- Prepares written listing of tentative key answers for examinations involving pre-rating review.
- Prepares requests for prior approval of key answers by the Civil Service Commission, after analysis of past usage of items, for review by supervisor.
- Prepares and routes scoring instructions to Rating Section.
Analyzes written test results to assure equitable rating of test items and to recommend a pass point in accordance with established procedures.
- Analyzes computer output of test results to determine if questions are correctly keyed, and for possible indications of a problem in a particular item.
- May compute or analyze fundamental statistics on item difficulty, discrimination indices and sub-test consistencies.
- Analyzes format, construction and language of problem items, evaluates findings and submits recommendations for appropriate action.
- Reviews and analyzes candidates written appeals to given test items to determine nature and substance of appeals. May contact subject matter experts for their opinion on an appeal. Investigates as appropriate and evaluates each appeal.
- Writes a narrative report for each item appealed, recommending dismissal, rekeying, double keying, or deleting, and documenting reasons for recommendations.
- Submits recommendations for final key answers with applicable supporting documents to supervisor for review.
- Routes approved keys to Rating Section for appropriate scoring.
- Upon receipt of final computer output, prepares prescribed distribution memorandum form. Consults with representatives of other Civil Service activities on vacancy information and pass point recommendation. May also contact operating agency personnel for their pass point recommendation.
- Recommends pass point based on an analysis of the written test, number of vacancies, geographical distribution of vacancies and candidates, scores distribution, and the recommendation of the concerned Civil Service staffing activity. Submits recommendations with suggested scoring formula to supervisor for review and approval.
- Prepares final approved key listing to be used in computational review. Arranges for typing, proofreads and distributes per established procedure.
- May prepare written narrative report documenting steps taken, conclusions reached, and recommendations, based on an analysis of test results.
Develops criterion measurements of job performance in order to evaluate test effectiveness and validity.
- Reviews data obtained by current job analysis, including required knowledges, skills and abilities to perform the critical tasks.
- Evaluates appropriateness and feasibility of using as criteria:
1. Objective and measurable aspects of the job such as production records and work sample data.
2. Subjective measures such as supervisory ratings.
- May confer with operating agency personnel and others for alternate criterion measures.
- Designs and develops questionnaires, rating scales and related devices for measuring criterion performance considering critical factors of measurement theory.
- Arranges for the completion and return of needed data by operating agencies.
- Scores and processes criterion measurement data. Establishes norms for evaluating results.
Conducts validity studies using data from test performance and data from criterion measurement.
- Obtains correlation coefficient and other quantitative measures of relationships between test data and criterion data.
- Evaluates correlation using appropriate statistical tests.
- Prepares narrative and tabular reports of findings and makes appropriate recommendations for future test examinations.
May assist in the supervision of subordinate examiners in the routine aspects of the job.
- Explains routine procedures, their execution sequence and related deadline schedules.
- Insures that test material and candidate data are appropriately safeguarded.
- Assists in reviewing work in progress, evaluating work development and recommending training program to unit head.
Prepares correspondence to candidates and others on pertinent matters relating to the examination process. Reviews and rates training and experience applications from local jurisdictions. May search, compile and prepare material and data to be used in various reports and studies, or in the preparation of court casework. May coordinate arrangements for the administration of special examinations.
RELATIONSHIPS WITH OTHERS
The nature of the tasks and activities requires frequent oral and written communications and periodic face-to-face contact with certain categories of people. There are periodic conferences with agency personnel administrators, program specialists, Staffing Services, Classification and Compensation representatives and others on the adequacy of job information, scope and subject matter areas to be covered and related examination questions. In such sessions Senior Personnel Examiners strive to focus on common problem areas, to motivate users to communicate their requirements clearly and produce factual information, to exchange ideas and findings, and to obtain agreement on schedules and on actions to be taken. At times, incumbents conduct on-site interviews of employees and their supervisors in order to develop current job information, and may attend functions of professional groups and others to further the interchange of current developments of mutual concern. In addition, they periodically contact subject matter experts in order to persuade them to write needed test items or to review test areas and candidate appeals in their area of expertise.
Within the Division of Testing Services incumbents frequently confer with examiners from other units to provide or to obtain appropriate sub-tests and to resolve related questions.
NATURE OF SUPERVISION
Employees in this class are normally supervised by an Associate level examiner heading an examining unit, who makes assignments, reviews work in progress and on completion for conformance with established guidelines and schedules. Generally, incumbents operate with relative independence in the fact finding and negotiating stages of examination preparation for areas in which they have developed sufficient familiarity, with supervisory review of the execution stage (test plans, tests, scoring keys, pass points, appeals, etc.) and other recommendations.
Senior Personnel Examiners may assist in the supervision of subordinate examiners in the routine aspects of the job explaining work procedures, reviewing work progress, and recommending areas for improvement.
JOB REQUIREMENTS
- Working knowledge of the principles and techniques of test construction.
- Working knowledge of the concepts underlying the job analysis process as related to testing.
- Working knowledge of applicable Civil Service Law, Rules and Regulations, and department policies, procedures, goals and objectives relating to testing.
- Working knowledge of fundamental statistical techniques and practices.
- Working knowledge of test analysis, validation, and evaluation techniques.
- Working knowledge of the examination process and related execution sequences.
- Good knowledge of vocabulary, grammar and exposition.
- Working knowledge of cultural aspects of testing and affirmative action.
- Ability to locate, read, comprehend and select from a wide variety of written material.
- Ability to write clearly and precisely.
- Ability to orally communicate examination needs and information effectively.
- Ability to evaluate whether job data is adequate to produce valid tests.
- Ability to conduct job audits with employees and others and to conduct or participate in conferences for the purpose of gathering information to produce valid tests.
- Ability to identify critical factors in a given job and determine which can be feasibly tested.
- Ability to prepare appropriate test plans and to select tests for specific situations.
- Ability to establish rapport with others for the purpose of negotiations and to facilitate the exchange of pertinent information.
- Ability to apply basic statistical techniques in the analysis of test items, sub-tests and tests.
- Ability to identify significant factors in support of determinations, reach logical conclusions based on analysis of developed data and make pertinent recommendations.
- Ability to search, compile and prepare data on a variety of examination matters.
- Ability to evaluate the effectiveness of given tests.
MINIMUM QUALIFICATIONS
Satisfactory completion of one year as a Personnel Examiner Trainee 2.
NOTE: Entry into the formal training program leading to an appointment to the Senior level requires possession of a Bachelors Degree.
Reviewed: 11/04
NOTE: Classification Standards illustrate the nature, extent and scope of duties and responsibilities of the classes they describe. Standards cannot and do not include all of the work that might be appropriately performed by a class. The minimum qualifications are those which were required for appointment at the time the Classification Standard was written. Please contact the Division of Staffing Services for current information on minimum qualification requirements for appointment or examination.