Google created a augmented reality microscope capable of detecting cancer

Recently, in a talk at the annual American Association for Cancer Research meeting, Google researchers presented a prototype of an AR microscope capable of diagnosing patients.

The process of analyzing biological tissues to look for signs of cancer - and if so, how much and what kind - of pathologists is an extremely time-consuming process. And Google thinks this process can be accelerated if deep learning tools are applied. But in many places, the application of AI technology is not feasible. Therefore, the search giant believes that the simple and easy-to-use microscope they are developing can offer certain benefits to research groups with limited budget - like clinics. and small-scale laboratories, or developing countries.

Google said the glasses could "help speed up and spread the application of deep learning tools to pathologists around the world".

AR microscope helps detect cancer of Google.

This is a conventional optical microscope, which is used by many global pathologists. Google just "adjusted" a bit to integrate into AI technology and augmented reality (AR ). First, neural networks are trained to detect cancer cells in human tissue images. Then, when a disk containing human tissue is placed into a microscope, the image that the researcher sees through the glass will be transferred to the computer. At this time, AI algorithms will detect cancer cells in the tissue, and localize the cells in the image obtained from the microscope (as shown below). All of these operations are carried out in real time and fast enough to continue analysis when the pathologist moves the disk to look at another part of the human tissue.

Now the Google team has demonstrated the ability of this microscope to detect breast cancer and prostate cancer, suggesting that the system is quite accurate in the tasks it takes on. But Google said the microscope could also be used to detect other types of cancer, as well as other infectious diseases such as tuberculosis and malaria. It can also be used to display other data, or comments on the currently displayed images.

AI algorithms will detect cancer cells in tissue, and localize these cells in microscopic images.

"Of course, the usefulness of optical microscopes has been proven in many industries, not just the pathology, and we believe that AR microscopes can be adapted to many other applications. each other in the health care industry, life science research and material science " - Google said.

This study is currently being evaluated, and Google said a further study will be conducted to address the increased performance and address the shortcomings of the current system. The company concluded: "We are excited to continue to explore how this AR microscope can help promote machine learning applications to bring positive impacts around the world." .