MAIRA 2 (finetuned from Vicuna 7B, RAD DINO) MAIRA 2 is a multimodal transformer designed for the generation of grounded or non grounded radiology reports from chest X rays. MAIRA 2 has been built for research purposes only and is being shared to facilitate comparison and further research. 📌 Note: For original model weights, refer to microsoft/maira 2. 📃 Original paper: MAIRA 2: Grounded Radiology Report Generation. 🔬 Experimental Usage in Libra's repo This model checkpoint is intended for experimental use and can be tested directly within the Libra repository . For better benchmarking, we recommend using the official test set from X iZhang/MIMIC CXR RRG. Key Modification To enable the re trained vision encoder during inference and to follow the MAIRA 2 behaviour — using feature maps from the Dinov2Backbone (i.e., hidden states with LayerNorm applied, instead of raw hidden states ) — make sure to apply the following configuration: [!NOTE] This setting is specifically designed for findings section generation from a single frontal view Chest X ray. It is not applicable to grounding tasks or settings involving multiple image inputs. Use case: Findings generation without grounding ❗…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy