Multimodal VolumeRenderer

Jonas Waage

Implemented features

DVR and MIP rendering of PET data

This is a view toggled by choosing PET-ACTIVATION as "technique" in volumeshop. The rendering renders pet intesity either as DVR of MIP as can be chosen from the parameter "PET-rendering". The rendering is restricted by a slider which only allows PET values above a certain threshold through. Withing the range defined by this slider, values are mapped from green to red. Since this range is dynamic, it is sometimes hard to interpret the exact values, but it is much simpler to see subtle differences in PET intesity change. The DVR rendering makes the green values completely transparent and the red values opaque. This is done since the PET is largely green values surrounding red ones, and it gives the ability to look at more of the PET activation at the same time.

MRI with PET coloring in context of skull

The view is toggled by choosing PET-CONTEXT as a technique. The rendering renders whatever comes first of PET intensity(on MRI data), or bone. If there is PET intensities above a certain level occluded by bone, this is guaranteed to be seen, since the bone will be made transluet based on a parameter "bone opacity".

To help even more on the interpretation of position, the bone is rendered with contours and cool to warm shading, especially contours is really well suited, since it shows the features of the skull even at low opacities, so even if the bone opacity is low, the contours still show some of the shape of the occluding bone. From the bone rendering specularity is omitted, this is due to its interference with the speculatiry from the MRI rendering making interpretation of the brain harder, and its very white color which made it disturbing to look at while occluding other features. While speculatiry might help a bit on the realism of the skull itself, it is only context in this case and should therefore be turned of in my opinion. The skull can be changed by means of a transfer function, but this in my opinion a rather superfluous function at this moment, as the realistic grey coloring along with cool to warm shading makes it very distinct from the brightly colored PET data. Toon shading is also provided, but it does not really do anything to or from as far as enhancing the interpretatin of the rendering.

This view also supports restriction of both MRI and CT data in the Y direction. Allowing the user to look at PET activation inside the brain, or to peel away a certain part of the skull. This feature has only been implemented in the Y direction, but it is of course simple to expand to other directions as well.

First hit DVR of MRI data with PET coloring

The view is toggled by choosing PET-BRAIN as a technique. The rendering requires a certain amount of bone to be passed before rendering the chosen MRI with PET coloring. This view also supports restriction of MRI data in the Y direction. Allowing the user to only look at PET activation inside the brain, or to peel away a certain part of the skull. This feature has only been implemented in the Y direction, but it is of course simple to directions as well. The user can also restrict the PET to only be above a certain value using the PET threshold earlier mentioned.

Interface

The interface currently allows for adjustments of the values mentioned above. It also allows tuning of the cool to warm shading and other values(like contour thickness) some of which are remains from the VolumeShop plugin I used as a basis for this. Removing a lot of this functionality is really hard, since some of it has rather long reaching effects which needs to be taken into account. It was simply not sensible for me to use my time removing these features, as I would end up breaking my own additions. Therefore I ask for the parameters see-through, cropping-box, bounding-box, MIP/DVR(float box) to be left alone.