Occ. Code 3538000

STATE EDUCATION PSYCHOMETRICIAN, M-3

New York State Department of Civil Service

Classification Standard

BRIEF DESCRIPTION OF CLASS

          Positions in this class develop and analyze standardized State tests administered to students in Kindergarten through Grade 12 enrolled in New York State public, nonpublic, and charter schools.  Incumbents supervise data analysis and prepare reports analyzing psychometric methodologies.  They also provide technical expertise in the design, analysis, and scaling of student assessments.             

          These non-competitive positions are classified at the State Education Department.

DISTINGUISHING CHARACTERISTICS

STATE EDUCATION PSYCHOMETRICIAN: managerial level; develop standardized State tests and supervise research staff in data analysis, research studies, and preparation of reports under the general direction of the Director, Division Education Testing.   

RELATED CLASSES

Director, Division Educational Testing, leads and directs the implementation of the Board of Regents policies related to educational testing.  The one position class is responsible for overseeing and coordinating the responsibilities of the Office of State Assessment, which include test development, test administration and test operations/contracts.  It supervises Supervisor Education Testing, State Education Psychometrician, and test development and evaluation staff.

Associate and Supervisor Education Testing, develop test blueprints (content and process specifications, formats, etc.) for new or significantly revised state examinations and testing programs; provide oversight, coordination and supervision to examination committees and item writers; and perform field and office work in the development, analysis, construction, and administration of educational tests.  They may participate in the preparation of Requests for Proposals, evaluation of proposals submitted by contractors, and oversight of work performed by contractors.

Associate in Education Research, plan and conduct data analysis and research projects for use by the management of the State Education Department in policy and program planning and evaluation.  Subject matter includes basic issues in curriculum content, assessment, institutional accountability, administration, organization, finance, school personnel management, and/or evaluation of the effectiveness of the education program in various subject matter and geographic areas.  Studies of professional licensure are also conducted.  Incumbents function at the advanced performance or first supervisory level.  Assignments typically involve complex data analysis and research projects presenting greater difficulties in planning and execution, in formulating conclusions and making recommendations, and in presenting conclusions and recommendations to higher level staff and senior management.

Associate in Educational Planning and Evaluation, provide administrative or program support to units within the State Education Department.  Assignments may include one or more of the following: coordinating the development or preparation of statewide plans or reports; conducting policy or analytical studies; preparing reports on educational issues; and preparing data collection instruments or report forms to audit and evaluate program effectiveness.  Incumbents function at the advanced performance or first supervisory level and perform assignments involve broader program responsibilities than Assistant in Education Planning and Evaluation.     

ILLUSTRATIVE DUTIES

· Advise on test development process for various New York State student testing programs, and supervise the scaling of tests.

· Make recommendations to modify the New York State testing program based on scaling results.

· Provide psychometric analysis to test development teams and senior management for the New York State testing program. 

· Oversee the development of test specifications, performance level descriptions, passage selection, item writing and review criteria, and other documents to ensure procedural validity. 

· Inform the Office of State Assessment and senior management of the continued use of procedural validity documents in the test design and development process.

· Coordinate with the Office of Bilingual Education and World Languages to address accountability issues required by the United States Department of Education.

· Ensure quality and measurement fidelity of test items and work with vendors, NYSED staff, and external content experts.

· Propose and conduct research studies.

· Document the development and administration of standardized State tests including: test development, reliability and validity, scaling and equating, standard setting, and score reporting.

· Research and prepare reports for the Technical Advisory Committee (TAC) on issues or topics for discussion related to State tests.

· Present various documents and issues to the TAC and document recommendations of the TAC.

· Oversee external benchmarking and predictive validity.  Based on analysis, make recommendations of modifications to the New York State testing program.

· Serve as spokesperson for the SED testing program as needed, and advise the Commissioner of Education and the Board of Regents on technical issues.

· Participate in stakeholder task forces charged with formulating new or revised policy drafts.

· Oversee and manage work of external vendors developing statistical methodologies for determining educators effects on student academic growth.

· Develop Requests for Proposals and Requests for Qualifications, and determine and confirm scope, time, and cost for external vendor projects. 

· Prepare and make formal presentations, written reports, and provide guidance on technical material or issues, including controversial findings.

· Develop data-driven policy memos providing recommended solutions and options for enhancement of accountability (State growth and institutional) systems.

· Supervise professional staff, and provide oversight and direction to analysts on statistical analysis.

MINIMUM QUALIFICATIONS

Open-Competitive: Masters degree and specialization in tests and measurements, psychometrics, and/or educational assessment, and six years of professional experience supporting large scale assessment programs, including program design, test development, data collection, data analysis, scaling, equating, and standard setting.   

Substitution:  A Ph.D. in any of the above specializations may be substituted for three years of required experience. 

Date:  5/18

NOTE: Classification Standards illustrate the nature, extent and scope of duties and responsibilities of the classes they describe. Standards cannot and do not include all of the work that might be appropriately performed by a class. The minimum qualifications above are those which were required for appointment at the time the Classification Standard was written. Please contact the Division of Staffing Services for current information on minimum qualification requirements for appointment or examination.