Looking deeper into the the shared embedding space, it has clinically meaningful structure:

🟢 Subtypes cluster together

🟤 Inflammatory dermatoses separate cleanly from melanocytic lesions

Slide embeddings mirror text embedding organization, showing alignment across thin them.

Quantitative gains over image-only aMIL classifiers:

📊 Dermatopathology (52 subclasses, 3,388 eval slides): ~4–6% relative improvement

📊 GI pathology (102 subclasses, 7,857 eval slides): ~8–10% relative improvement

🔬 Moving Beyond Pixels: Advancing Multimodal Pathology

Pathology AI has long relied on images alone. What happens when you add language?

We combined PLUTO-4 vision embeddings with rich histological descriptions to build a joint vision-language space for disease classification, mising.
🧵 #AI #MachineLearning #Pathology #MultimodalAI #FoundationModels

Beyond public benchmarks, PLUTO-4 shows real-world impact —
🩺 ~10 % improvement across multiple PathAI products, with strong gains in dermatopathology specimen classification.

These advances bring us closer to robust, generalizable FMs for pathology applications.
#Dermatology #HealthcareAI

Large-scale multi-node training is often communication-bound.
We optimized ViT-G training with DDP + GPUDirect RDMA, tuning parameters (bucket_cap_mb, gradient_as_bucket_view) to saturate InfiniBand bandwidth.

Result: 3× throughput improvement and near-linear scaling across 4 H200 nodes.

Comparison of Patch-Sizes

🧩 4S (FlexiViT) lets us tune patch size per task

ps-8 excels at tasks needing fine-grained features (ex: nuclear segmentation)
ps-16 suits coarse pattern tasks (Gleason patterns)
#FlexiViT #FoundationModels

PLUTO-4 is trained on a diverse dataset of 551,164 WSIs from 137,144 cases across 50 institutions.

The dataset spans 40+ organs, 60+ diseases, and 100+ stain variants, capturing real-world variation in tissue, staining, and scanning systems.

🚀 Excited to share PLUTO-4, our new state-of-the-art foundation models for pathology! 🔬

We’re seeing SoTA performance across multiple public benchmarks (EVA and HEST) — surpassing other leading pathology foundation models. (1/6)
#AI #MachineLearning #Pathology thcareAI

🔍 Interpretable concepts found using SAE
- SAE trained on PLUTO embeddings disentangled polysemantic features. Single dimensions captured distinct concepts:
✅ Cell types (e.g., cancer cells, red blood cells)
✅Geometric features (e.g. edge of tissue)
✅ Artifacts (surgical ink)

Feature evolution across layers

- SAEs trained on PLUTO’s intermediate layers revealed:

Early layers → Low-level color/texture features 🎨
Later layers → Pathology-relevant biological features 🔬 (e.g., monosemantic plasma cell dimension).

Monosemantic representations
- Single SAE dimensions correlate with counts of single cell types. For example, SAE-1736 represents plasma cell abundance exclusively

- The findings generalized to:
✅ Out-of-domain datasets (CPTAC)
✅ Different stains (H&E, IHC)
✅ Various scanners

🧠 Background and why does this matter?
- Each dimension in PLUTO embeddings represents multiple characteristics of the image, making interpretability difficult.

- We trained SAEs to reveal mono-semantic features—dimensions representing single, interpretable biological concepts.

We sat down with VP of Product, Ben Glass, to discuss how #AI-powered #pathology is revolutionizing fibrosis quantification in #oncology and to learn more about the development of PathAI’s latest product: PathExplore™ #Fibrosis

Read More: linkedin.com/pulse/discussi…
#PathTwitter

We're proud to launch PathExplore™ Fibrosis, a groundbreaking #AIPathology algorithm that quantifies fibrosis, collagen, and fiber morphology directly from H&E whole-slide images.

Read the announcement: pathai.com/resources/path…
#PathTwitter #Pathology

🌴 PathAI will attend and present at the #ORIEN Scientific Summit! Join us at the upcoming event hosted by @AsterInsights alongside top #oncology researchers and academic #cancer centers that are fueling the next era of #CancerResearch. #AI #PathTwitter

asterinsights.com/orien-scientif…

PathAI is proud to announce Dr. Eric Walk’s recognition on the #PharmaVoice100 list! Learn more about our Chief Medical Officer and his award.

Learn more: pathai.com/resources/path…
#PathTwitter #Pathology #AI #biopharma #biotech

Our Co-Founder and CEO, Andy Beck will be speaking at the MIT #AI Conference! This event brings together thought leaders and innovators to explore the transformative impact of artificial intelligence across various industries. #MITAI2024 #PathTwitter

PathAI is excited to announce a new #partnership with @Clario combining AI-powered #digitalpathology & endoscopy solutions geared towards enhancing #drugdevelopment for inflammatory bowel disease & other GI disorders. #PathTwitter #pathology

Learn more: pathai.com/resources/clar…

We rise together! Thanks for organizing this remarkable event @CityYearBoston

Last week, the global PathAI team came together at our #Boston headquarters for an inspiring week of collaboration and growth. We shared groundbreaking innovations from across departments, explored the future of #AI in healthcare, and took time to give back to the local community

Thank you for meeting with us at #ESMO2024!

We had a fantastic time meeting up with our colleagues from across the world to talk about the future of #digitalpathology to fuel the next generation of #cancerresearch & #drugdevelopment.

View our events: lnkd.in/eTVsBzUN

We’re halfway through #ESMO24! Stop by our booth to learn how you can leverage #AI powered #digitalpathology for oncology #drugdevelopment & #cancerresearch.

💻 See live demos of the platform by visiting us at booth 643a

We’re thrilled to announce that the PathExplore™ TCGA Research Dataset is now available across additional #cancer disease indications to elevate histopathology #realworlddata to new heights.

Learn more about #RWD and access the dataset: pathai.com/leveraging-rea…

🚀We launched MET Predict on AISight®! This AI-powered tool identifies NSCLC tumors w/ METex14 or MET amplification directly from H&E slides Learn more: pathai.com/resources/path…

MET Predict & AISight are for research use only. Not for use in diagnostic procedures.
#PathTwitter

🚀PathAI Collaborates with GoldPath Labs to Elevate #DigitalPathology Capabilities with AISight® Image Management System.

Read the press release here: pathai.com/resources/path…

#PathTwitter #pathology

Unlock the potential of the IHC Explore™ platform! Transform #Immunohistochemistry (#IHC) slide images into precise, data-driven insights for next-gen #biomarker development.

Demo the AI #pathology products today info.pathai.com/pathai-demo-th….
#PathTwitter

PathAI’s AISightⓇ Dx Image Management System is CE-marked for primary diagnosis in Europe! Read the full press release to learn how we’re advancing healthcare with our AI-driven digital pathology platform pathai.com/resources/path…

Access the new Liver Explore™ demo: Enhance #mechanismofaction insights and quantify disease changes in #MASH & #liverdisease w/ quantitative, spatial characterization of tissue & fibrosis microarchitecture. #PathTwitter

Demo:info.pathai.com/pathai-demo-th…

Experience AI-powered #pathology: Demo IHC Explore™ platform and extract structured and standardized cell, tissue, and stain data. Transform IHC whole slide images into quantitative insights for next-generation #biomarker development
Access here: info.pathai.com/pathai-demo-th…

We caught up with PathAI scientists to hear their perspective on the impact of our recent @NatureMedicine publication entitled “#AI-based automation of enrollment criteria and endpoint assessment in #clinicaltrials in liver diseases”

Read the article: nature.com/articles/s4159…

PathAI CEO, Andy Beck, shares in the #AACR journal, #CancerDiscovery how the effectiveness of #AI tools in #pathology depends on the infrastructure & implementation surrounding them; also sharing that the most valuable tools are well-integrated into clinical workflows.

🚀 Exciting news! AISightⓇ Version 2.10 is here! 🚀

Packed with features to boost your lab's efficiency:
🔍 Expanded scanner support
⚙️ New Customizable platform settings
💡 Advanced AI workflows in Quality Control
Read more: bit.ly/3McmhIt

#AI #Healthcare #Innovation

The ability to rapidly predict molecular phenotypes directly from H&E whole-slide images using #aMIL, along with understanding these predictions using human-interpretable features, may provide an approach for the development of #biomarkers for precision medicine. #PathTwitter

We’re headed to #ECP2024 in Florence, Italy! Visit booth L145 to learn about our cutting edge digital and AI pathology solutions. Schedule a demo here: info.pathai.com/pathai-at-ecp-…

Read the news here
pathai.com/resources/path…

We’re thrilled to launch AIM-MASH on AISightⓇ, assisting pathologists with ensuring reproducibility & scalability for MASH assessments! Read our press release here
#PathAI #MASH #AISight #DigitalPathology

AIM-MASH is for research use only. Not for use in diagnostic procedures

Visualize H&E-based immune phenotype in high-resolution. Supercharge your immuno-oncology research with PathExplore™ IOP. Identify, quantify, and classify TILs & their spatial distribution within the tumor microenvironment (TME). Try out the demo today! share.hsforms.com/1jjBoO1ajRWSnR…

ICYMI: Interested in learning more about the future of #pathology? In this podcast, PathAI CEO Andrew Beck details how #AI & #digitalpathology will transform #RealWorldData, drug development, and the future of #healthtech.

Listen to the #podcast: lnkd.in/eATsuzeE

🔎Discover how digital and #AI strategies are revolutionizing #pathology. Our latest #blog post explores the benefits, from enhancing diagnostic accuracy to improving patient outcomes.

📝Read here: pathai.com/resources/the-…
#PathTwitter

Partner with us: Are you ready to unlock and boost your #realworlddata with quantitative histopathology?

Whether you are looking to license your own #RWD or enrich your cohort with #AI-powered #pathology, there’s a solution for your program. #PathTwitter pathai-20482459.hs-sites.com/real-world-dat…

There are many different data modalities that can be utilized to accelerate research and #drugdevelopment. In our #RealWorldData blog, we dive into the unique benefits of #pathology + clinico-genomic RWD.

Read more: pathai-20482459.hs-sites.com/real-world-dat…

#AI #bigdata #PathTwitter

Real-world data is revolutionizing #healthcare, #biomarker discovery, drug development & more.

But RWD is missing a crucial element - histopathology. In our latest blog, we detail how RWD can be enhanced with AI-powered #pathology to unlock new insights.
pathai-20482459.hs-sites.com/real-world-dat…

Next week, PathAI scientist @SeanGrullon will be presenting at four workshops at @icmlconf #ICML2024

Stop by and hear how #MachineLearning was used to develop the new #pathology-centric #FoundationModel PLUTO for quantitative histopathology at scale. icml.cc/virtual/2024/e…

This structure captured subtle aspects of patches from WSIs including cell morphological subtypes, tissue geometry and collagen alignment, and even tissue preparation characteristics such as small amounts of surgical ink–shown in the figure below

#AI #MachineLearning #ML

Yesterday, a team of PathAI scientists published “Interpretability analysis on a pathology #foundationmodel reveals biologically relevant embeddings across modalities.”

📰Read the preprint here: arxiv.org/abs/2407.10785
#pathology #PathTwitter #AI #deeplearning

Thrilled to have our CMO, Dr. Eric Walk, present at the #AWSSummit in NYC! He showcased how PathAI is revolutionizing precision medicine with AI & our cutting-edge AISight™ platform (AISight™ is for RUO).

Exciting times ahead for digital #pathology & #AI! #Healthcare

Stay up to date with PathAI innovations, announcements, publications & more.

Whether you're a pathologist or simply passionate about the future of medicine, our newsletter is your gateway to understanding how #AI is revolutionizing #pathology.

Sign up: share.hsforms.com/1AJR8R-jPSmaun…

🎆 Happy #IndependenceDay from PathAI 🎇

As we celebrate the #4thofJuly we reflect on the freedoms we enjoy individually and as a collective, and how they enable the work we do. Thank you for partnering with us to innovate #pathology.

🔥 Kick off summer with a Fireside Chat on #DigitalPathology featuring our CEO, Andy Beck!

Join Andy and an incredible lineup of #GoogleCloud experts, partners, and customers at the #Healthcare and Life Sciences Summer Camp. #AI

Sign up here: lnkd.in/ecV5VK_R

Did you know that quantification of nuclear morphology is available as part of the PathExplore™ suite of algorithms?

Here it is in action! Access our demo so you can see all of the capabilities of AI-powered #pathology has to offer: share.hsforms.com/1jjBoO1ajRWSnR…

Our recent article published in #NPJPrecisionOncology details the development of our pan-tissue, #AI-powered #digitalpathology pipeline for segmentation, identification, and classification of nuclear features directly from H&E whole-slide images.
nature.com/articles/s4169…

We’re #hiring! Our team is passionate about solving big challenges in healthcare and transforming the field of #pathology with artificial intelligence.

We are looking for new team members to join us on our mission! #AI #newpositions pathai.com/careers/#OpenP…

Our Chief Growth Officer, Nick Brown & Kristie Dolan, SVP & GM for @QuestDX discuss our ongoing collaboration. Together, we'll enhance #pathology operations w/ our AISightⓇ platform, focusing on innovation & improving patient outcomes.

Learn more: 360dx.com/clinical-lab-m…

Our Chief Medical Officer, Eric Walk MD, FCAP, was recently interviewed by Diagnostics World about the future of #AI and #pathology in #healthcare.

Read more: lnkd.in/eg3m_QnS
#digitalpathology

Our latest AI #pathology product PathExplore™ IOP was featured in #ClinicalOncologistDaily

Read more about utilizing #AI for characterizing immune phenotypes by quantifying the spatial distribution of TILs within the TME.

View the feature: lnkd.in/em_YBf36

🎉 We’re thrilled to be recognized as one of #Boston's Best Places to Work by @BosBizJournal!

This honor is a testament to the dedication and passion of our incredible PathAI team nationwide. Thank you for making our company an extraordinary place to work #BBJBPTW @BosBizEvents

Thanks for visiting us at #EASLCongress 2024! It was fantastic reconnecting with partners and engaging with new friendly faces in the liver space.

We look forward to seeing you at #EASLCongress 2025!
#EASL

🚀 PathAI’s AISight Version 2.9 is here! 🚀

New features include:
-Real-time remote collaboration
-Enhanced communication & record-keeping
-Improved workflow efficiency
-Detailed artifact detection

Read more: pathai.com/resources/path…
#AI #Healthcare #Innovation #PathAI

Today, we announce the close of the sale of PathAI’s diagnostic laboratory division to @QuestDX. We are excited for the future of #AI-powered #digitalpathology helping improve patient lives. pathai.com/resources/ques…

Thanks for visiting us at #ASCO24! It was great to catch up with our partners, learn about the latest #cancerresearch, and present our new posters & products, PathExplore™ IOP and IHC Explore™

Download our collateral pack: share.hsforms.com/1mcYaCsqmRpKvA…

See you next year at #ASCO25