BA/PA: Integrating Mixed Reality and Numerical Simulation for Virtual Haptic Visualization of Stress Contours

Project Description:

This project aims to develop a mixed reality (MR) application that simulates the deformation and stress contours of a cantilever beam in a semi-real-time scenario. As a pilot study, a one-ended cantilever beam is considered, allowing users to push the tip and observe the resulting stress contours. The MR application will be accessible via smartphones or Meta Quest 3, enabling users to visualize stress distributions on the beam as they apply forces in real time.

The simulation will utilize precomputed deformation data obtained from finite element method (FEM) using COMSOL Multiphysics. Unity will serve as the platform for creating the MR environment and handling user interactions. Additionally, a wearable finger force sensor will be designed to accurately sense and measure the applied force. The primary objective is to create an immersive and accurate representation of the physical behavior of a cantilever beam under various load conditions, providing an engaging user experience.

Tasks and Duties:

o   Literature Review:

·       Conduct an extensive review of existing literature on this field

o   Simulation Data Preparation

·       Perform 3d modeling using COMSOL Multiphysics in a stationary domain.

·       Define material properties and apply boundary conditions.

·       Simulate the beam under various loads and export deformation data.

o   Unity Development

·       Develop the MR application in Unity that visualizes the beam deformation using grided mesh.

·       Implement scripts to handle user interactions and apply corresponding deformations to the virtual beam.

·       Develop color mapping techniques to visualize stress contours on the beam.

o   Hardware design:

·       Design and Fabricate a Wearable Finger Force Sensor (Haptic feedback for extreme force)

·       Define the measurement range and accuracy required for the force sensor.

·       Determine compatibility requirements with the MR application and hardware.

o   Data Communication

·       Implement a real-time data communication system to update the mesh.

·       Write scripts to receive user input and map it to the closest precomputed deformation data.

·       Implement interpolation logic to smoothly transition between precomputed states.

·       Update the mesh vertices in Unity to reflect the deformation based on user input.

o   Testing and Calibration

·       Conduct usability testing to ensure the MR interaction is intuitive and responsive.

o   Documentation and Presentation:

·       Create presentation materials summarizing the project objectives, methodologies, and outcomes for final reporting.

Requirements:

Interested in COMSOL Multiphysics or Similar FEM Software.

Keen interest in programming, particularly in C.

Basic Knowledge of Developing Applications for VR/MR Platforms.

Knowledge of Arduino and Microcontroller.

Contact Person: Dr. Mohammad Sadeghi (mohammad.sadeghi@tuhh.de)

Desired starting date: As Soon As Possible