Tubegraph

Pathologies of the Polish scientific assessment system

6 min read

From: mk_thisisit

The Polish scientific assessment system, particularly its point-based approach, has been identified as having significant pathologies that negatively impact the quality of Polish science. This system assesses scientists and their work based on points awarded for published articles, with each journal title assigned a specific point value [00:51:30].

Core Issues and Manifestations

The core problem lies in the arbitrary and often random assignment of points [00:53:14]. This has led to several critical issues:

  • Arbitrary Point Allocation Very good, internationally recognized journals sometimes have very few points, while journals of questionable quality receive many [00:53:36]. This includes niche Polish journals having the same point value as globally recognized publications like Science or Nature [00:38:37], [00:45:51].
  • Focus on Quantity Over Quality The system incentivizes scientists to accumulate as many points as possible, leading to a race for publications rather than genuine scientific discourse or groundbreaking research [00:06:09], [00:06:17]. Some Polish scientists have published 100-200 papers in just two or three years [00:23:44], which is physically impossible for original work, especially for those with teaching or administrative duties [00:11:55].
  • “Papers” Phenomenon A specific pathology in Polish academic jargon is the creation of “papers,” referring to groups of scientists who collectively publish very similar articles en masse, often citing each other, in lesser-known journals that are paradoxically well-scored in Poland [00:00:06], [00:12:48]. These journals often publish anything for a fee, effectively acting as advertisement platforms [00:13:14], [00:13:17]. An article can be rated highly (e.g., 140 points) with “practically no editorial control, without a review” [00:00:17], [00:13:35].
  • Inappropriate Specialization Papers might appear in completely unrelated disciplines, such as mechanical engineering articles cited in immunology or ancient history journals, raising significant suspicion [00:12:30].

Professor’s Protest Experiment

A Polish professor explicitly trolled the system to highlight its flaws [00:00:39], [00:05:01]. He sent a series of “senseless” articles to several scientific journals highly ranked by the Ministry of Science [00:01:22], [00:01:42].

  • Content of Articles These included topics like young Karol Wojtyla’s hobby of collecting matches, and the influence of Catholic radio broadcasts on youth moral attitudes [00:02:01], [00:02:09]. Despite being nonsensical and linguistically incorrect [00:04:54], several were accepted for printing after seemingly serious reviews [00:01:46].
  • Unexpected Acceptance The articles were accepted despite the author being a chemist, with co-authors including a musicologist with a doctorate in theoretical physics and a master’s degree in the economics of socialism [00:04:08]. Editors verified author qualifications and considered them suitable [00:03:15].
  • Public Reaction When the true authors were revealed, a “bomb went off” in Poland, with virtually all Polish media reporting on the comical situation [00:03:37], [00:04:33]. The articles garnered approximately 660 points in the system [00:02:37], which would typically represent several years of serious scientific work [00:02:47].

Consequences of the System

The point-based system has several negative consequences for Poland’s development in the scientific community and its scientists:

  • Frustration and Demotivation It causes frustration and disappointment among scientists [00:09:37]. Younger colleagues are forced to adapt to the system to secure scholarships and development opportunities, spending time discussing which journal to send to for maximum points rather than engaging in scientific discussions [00:06:03].
  • Decline in Quality It may lead to a sharp decline in the quality of science practiced in Poland, as scientists opt for easier publication in low-quality niche journals that count the same as top-tier international publications [00:10:57].
  • Hindrance to International Collaboration The emphasis on “national science” — a concept previously associated with the Soviet Union — discourages scientists from operating in an international environment, which is crucial for the free exchange of ideas, data, and research [00:09:56].
  • Misguided Assessment The system inappropriately compares and lumps together scientists from vastly different fields (e.g., surgeons and medieval Portuguese literature experts), making meaningful comparative assessment impossible [00:15:21].

Comparison with Western Systems

In Western scientific communities, achievements are assessed based on successes, such as publications in the best conferences or journals like Nature, rather than an arbitrary point system [00:07:58].

Proposed Changes and Current State

There is recognition of the problem within the scientific community and at the ministerial level [00:00:30].

  • Minister’s Intentions The Minister of Science and Higher Education acknowledges the issue and states that the evaluation system must change, with discussions ongoing across academic centers [00:25:58], [00:26:10].
  • Shift in Evaluation Philosophy Future changes, possibly through amendments to the Act on Higher Education, aim to redefine the philosophy of evaluating Polish science and universities [00:26:38]. The focus should shift from points for patents to points for the implementation of patents, as many current patents are merely “reinventing the wheel” to gain points [00:26:55], [00:27:08].
  • New Department of Innovation The Ministry established a Department of Innovation to promote and commercialize scientific achievements, emphasizing a supportive role for the scientific community [00:28:00].
  • Challenges in Implementation Despite discussions, little has changed practically [00:15:01]. While international bibliometric systems exist to classify journals independently, adopting an “inheritance of prestige” principle from journals is also flawed, as even good journals can publish poor work [00:16:25].
  • Need for Cooperation There is a call for greater cooperation between institutes and universities to effectively utilize existing expensive equipment and avoid redundant purchases [00:32:44].

The pathologies of the assessment system contribute to broader challenges and potential in Polish science and technology:

  • Export of Polish scientific talent and its consequences The system’s flaws, coupled with inadequate remuneration and lack of support for young scientists, contribute to the brain drain of Polish intellectuals, experts, and technology creators [00:18:18], [00:19:12], [00:29:41]. While beneficial for global science, this is a clear loss for Poland’s economy and education system [00:20:05].
  • Public Perception and Popularization There is a perceived decline in public interest and respect for science in Poland [00:21:10]. While science festivals exist, they are insufficient [00:22:00]. The Polish education system and educational reform at lower levels can actively “kill” interest in science by focusing on rote learning instead of practical applications or interesting phenomena [00:22:31]. Scientists themselves often lack time for popularization due to administrative burdens and the need to chase points [00:24:32].
  • Risk Aversion in Funding Polish institutions tend to be risk-averse in funding breakthrough projects, leading innovative scientists to seek opportunities abroad [00:30:24]. The National Centre for Research and Development (NCBR) should be an institution that invests in innovative, at-risk solutions [00:31:10].
  • Gender Imbalance There is a notable gender imbalance in scientific leadership roles, with women being “exotic” as rectors and predominantly men managing scientific projects [00:34:39]. While no direct discriminatory policies exist, the Minister believes women’s increasing activity will naturally lead to more female leaders over time [00:35:17].

Graph View

Backlinks