Charles University is now implementing the new system to evaluate research outputs produced by the university employees, academics and researchers. Its goal is to gather correct and verifiable information on the quality of the University’s research activities, to support the growth of a wide range of research fields pursued at its faculties and institutes in accordance with international standards, and to reinforce the University’s position as a significant European research institution. Based on this information, recommendations and actions will be taken in order to secure further growth of quality research and to promote these research fields pursued at the University which are comparable in quality with that of the leading European universities and research institutions, and to contribute to their further growth and development. The implemented system of evaluation will be carried on independently of the state-level evaluation system.
What is being evaluated is a quality of research areas and fields pursued at Charles University in comparison to international standards. In case the particular field is pursued at more than one institutes of Charles University, it will be evaluated separately in relation to the particular institute. Also, faculties and institutes of Charles University will be evaluated with respect to the overall background and quality of research.
The data for evaluation come from a few different sources:
1) Every constituent part of Charles University will work out an evaluation self-report concerning its mission, vision, goals, research and staff politics, financial resources available, awards received, state of research, its applications and impact, position of research fields and areas with other comparable international institutions, future prospects, etc.
3) Records of research activity, including lists of personae conducting research, research outputs, grants, project, licenses, programs of study, students/graduates statistics.
3) Peer reviews of selected research outputs.
4) On site visits (in case of need to clarify / fill-in some information)
There are three main organizational units responsible for the evaluation process: 1) Research Output Evaluation Board; 2) Expert Panels; 3) Reviewers.
1. Research Evaluation Board
The Board is primary organizational unit responsible for the evaluation process. It is responsible for setting the parameters of evaluation, and control of the process as to its principles, rules, and organization. It decides potential debatable issues, pays on site visits, and is responsible (in coordination with the expert panels representatives) for evaluating the research status on the level of University’s constituent parts, and for working out the final report which it then passes on to the University Rector.
2. Expert Panels
There are four expert panels for the particular research areas: (a) Humanities (HUM); (b) Social Sciences (SOC); (c) Natural Sciences (SCI); (d) Medicine (MED). The responsibility of expert panels is primarily to secure the process of peer reviews (select reviewers for the particular research outputs) and to elaborate the evaluation of research areas and fields based on the supplied data (see above). In case of need to fill-in further details and information, the panel members will visit the evaluated constituent part on site.
From April to June 2019, the expert panels’ task will be to distribute the collected research output to individual reviewers.
From January to May 2020, the expert panels will elaborate a report evaluating the quality of research fields pursued at the University based on the peer reviews and other data.
3. Peer reviewers
Perhaps the most crucial piece of data for the complex research output evaluation are peer reviews of the selected output. Reviewers are international experts in their field, nominated by University’s faculties and institutes, and appointed by the Board. Each reviewer will be responsible for assessing 10-20 research outputs maximum.
The time for elaboration of peer reviews is estimated to span from July 2019 to January 2020.
Expert panels will elaborate reports evaluating research areas and fields at university level based on all the provided data. The final outcome of the process will be the Evaluation Report concerning the quality of research performance at University’s faculties and institutes prepared by the Board.
March 1 – June 2019. Start of the evaluation process. The Board will manage initial settings and finalize the parameters of the evaluation process. Institutes and faculties of the University will select scientific output to be evaluated and supply the lists of research fields pursued thereof along with other data (for the purposes of statistics). The expert panels will distribute research outputs to reviewers. Deadline for data collection: July 25, 2019.
July 2019 – January 2020. Elaboration of bibliometric analyses and peer reviews.
January – May 2020. On site visits and elaboration of reports evaluating research areas and fields by the expert panels. The evaluated constituent parts have then time to express comments and concerns upon the submitted reports.
June – October 2020. On site visits and elaboration of reports evaluating university’s constituent parts by the Board. The evaluated constituent parts have then time to express comments and concerns upon the submitted reports.
November – December 2020. Evaluation report finalization.
December 22, 2020. Final deadline.