Mixed Reality for Crime Scene Investigation

Expert Profile

Dr. Jurrien Bijhold is a Forensic Scientist in Leiden University of Applied Science (FORENSIC ICT). He is presently working as a lecturer and researcher on situation assessment problems like the investigation of a crime scene. He completed his study in physics and computer science. He did many investigations for police and courts. He mainly used virtual and augmented reality as a tool for sharing knowledge, his experiences, remote co-operations, and organizing workflow. He chooses data analysis for learning from assessments that have been performed in the past. He used blockchain technology for organizing the use of case files. He always enjoyed the creative part of investigations and projects like the uses of multimedia and serious gaming. In 1998-2009 he worked in forensic investigations in the field of Image Analysis, biometrics, Photogrammetry, and 3D-Crime scene reconstruction and visualization. In 2009-2012, he is the coordinating scientist of the crime scene investigation of the Hauge Project. 

  Foreground

In crime scene investigation, this world could exist of virtual trace markers placed in a real crime scene or some real traces on real-world surfaces in a virtual crime scene for training CSI skills. In this lecture, a brief explanation of the technology is given, and a number of applications are demonstrated with HoloLens.       

Mixed Reality       

Mixed Reality combines the element of both augmented reality and virtual reality, real-world and digital object interaction. 

Augmented reality adds digital elements to a live view by using the camera on a smartphone. It takes place in a physical world with information or objects added virtually. Mixed Reality-glasses such as the HoloLens can offer an experience in which a virtual world is superimposed on the real world. 

HoloLens

HoloLens is a pair of mixed reality smart glasses which is manufactured by MICROSOFT. HoloLens was the first head-mounted display that run the Windows Mixed Reality platform under the Windows 10 computer operating system.  HoloLens is an augmented reality or “mixed reality” device it used to observe, scan, and give a 3-D virtual display of a whole scene. It uses multiple sensors, advanced optics, and holographic processing that blends flawlessly with its location. These holograms can be used to display information mixed with the real world or a virtual world. They generate realistic images, sounds, and various sensations by which the users experience a spectacular imaginary world.

Figure 1- HoloLens

Structure of HoloLens

1. HoloLens is an adjustable and cushioned inner headband it can be movable in an upward and downward manner or in the backward or forward direction.
2. The front part is consisting of sensors and hardware which include the processor, camera and projection lenses.
3. The visor (a front piece of the lens) is tinted and a pair of transparent combiner lenses is fitted which give a displayed image of the scene in the lower half.
4. A 3-D audio speaker is attached along the bottom edges of the side. Two pairs of buttons (Display Brightness Button) above the left ear and (Volume Buttons) above the right ear is present on the top edge.
5. Adjacent buttons are made differently such as concave and convex as users can easily identify them by touching them.
6. At the end of the left arm, a power button and row of five small LED nodes is used to indicate the status and battery level of the system.
7. A 3.5mm audio jack is also located along the bottom edge of the right arm.

Figure 2- Various Parts of the HoloLens  

Role of HoloLens in Crime Scene Investigation

 A crime scene is a place where a particular crime has been committed and we can find physical evidence that can relate the crime scene to its suspect or perpetrator. The first person who arrives at a crime scene is the police officer who can secure and protect the scene from curious onlooker so that no one touch any object or thing present at the crime scene otherwise it becomes difficult for the investigator to reconstruct the scene.

The further thing is to communicate with the people present at that time on the scene and observe or recognize each and every aspect related to crime then find trace evidence.

        Figure 3 - 3-D Pattern of the Crime Scene by using HoloLens 

1. The primary concern on the scene of the crime for the investigating officer is the contamination and destruction of physical evidence. At the time of incidence mostly people are curious to know the story. By using Microsoft HoloLens, the officers in the field can place virtual markers, trace 3-D objects and collect multimedia evidence as well as audio and video evidence by eliminating the risk of disturbing the physical evidence at the crime scene.
2. The main motive of HoloLens is to give accurate and tangible evidence and virtually transport officers back to the crime scene by highlighting every aspect and giving a genuine and understanding view of the scene. 
3. Depending upon how long the investigation goes it will valid for up to days, months, and even years also.
4. The ability of the HoloLens is to scan the whole scene in a 3-D version. This can reduce the process of cross-examination as every aspect is easily visualized by the officers. It will help to reconstruct a crime scene.
5. This also means the mapped-out AR crime scene could be used as evidence when the case goes to trial.

Conclusion

As per my understanding at the end, I would like to conclude that Microsoft HoloLens is a tool which play a major role in reconstructing crime scene. It gives a virtual 3-D image of the whole scene in the same manner. Due to contamination of evidences at crime scene it will be difficult for the officers to reconstruct the whole scene while HoloLens scan whole scene, observe and display 3-D virtual image of the crime scene. It is applicable in the courtroom also.

Note: All the images used are for educational purposes only. for removal, kindly email us to sifsinstitute@gmail.com

For more details of the session you can see the session recording at our YouTube Channel Forensic365