Artificial intelligence-enabled medical diagnostic tools are ensuring greater accuracy in cancer screening and detection, helping doctors arrive at more precise diagnoses and enhancing treatment quality.

Zhejiang University recently introduced an AI-powered universal pathology assistant called OmniPT, which integrates vision and language models for human-computer interaction. 

The model is being used at the First Affiliated Hospital of Zhejiang University School of Medicine's department of pathology, focusing on high-incidence cancers such as gastric, colorectal and cervical. The hospital in Hangzhou, the capital of Zhejiang province, is the first clinical institution in China to use an AI-powered pathology assistant.

OmniPT has achieved a number of breakthroughs in laboratory tests, including in cancer classification, grading, vascular and neural invasion identification and the discovery of markers that indicate the future course of the disease, the hospital said. Analyses and predictions by OmniPT have been 80 to 90 percent accurate across cancer types.

Most patients and their families are unfamiliar with the details of pathology examinations — work performed on tissue samples or cells in a lab, and pathologists generally do not interact directly with patients.

When biological samples from a patient are sent to a lab, experts go through an intense process to understand the pathological changes and the nature of the disease in the specimen at hand.

The role of the pathologist is to help reach an accurate diagnosis through the application of rigorous empirical standards. China, however, faces a severe shortage of pathology professionals.

"Many people may know that pediatricians are in short supply, but pathologists are even more rare. Currently, our country needs 150,000 to 200,000 pathologists, but there are only about 30,000 officially registered," said Zhang Jing, chair of the pathology department and vice-president of the Yuhang branch of the hospital.

Apart from this massive gap, there are also regional imbalances. While cities like Beijing, Shanghai and Hangzhou may be facing less severe shortages, the situation is dire in remote areas, he added.

Additionally, the long training period only complicates the situation as young pathologists often lack the required depth of experience.

Against this backdrop, OmniPT, developed by Professor Song Mingli's team from Zhejiang University's College of Computer Science and Technology in collaboration with the First Affiliated Hospital, is facilitating fast, accurate clinical diagnosis.

By leveraging human-computer interaction and centering on the needs of pathologists, OmniPT significantly improves diagnostic efficiency and quality, and helps alleviate the shortage of professionals.

"It serves as an assistant to pathologists by handling repetitive tasks so that they can focus on final judgment," Zhang said.

He provided an example of counting mitosis, which is a critical task when diagnosing gliomas, a kind of tumor that can be found in the brain or spinal cord.

"It can take at least 30 minutes to an hour to count a single pathology slide under a high-power microscope," he said.

"OmniPT, however, can complete this task in less than 10 seconds. Its computational capabilities allow it to analyze the findings in far greater detail than manual work. When it encounters 10 uncertain mitotic figures, it reports to a pathologist like me to make the final judgment," Zhang added.

In collaboration with the hospital, Song's team has focused on clinical needs. OmniPT accelerates the evaluation of samples on slides, particularly details that might be overlooked by fatigued doctors. OmniPT handles more than 90 percent of repetitive tasks, leaving only a small fraction for pathologists to assess.

"It assists us, but it doesn't drive us. We drive it. By leveraging AI in our interactions, we can solve challenging problems in pathology — particularly for people in remote regions or those with less experienced doctors. It greatly improves efficiency, reduces costs and helps us avoid errors," Zhang said.