An Augmented reality framework  for Sensor Data Visualizations 

Name: Raffaele De Amicis
Affiliation: EECS
Phone: (541) 737-0741
Knowledge Required: Experience with object-oriented programming and data structures. Familiarity with program language alike C++, javascript, C# is required.
Preferably familiar with (or ramp quickly) on either, CESIUM, Unity/C# or Unreal Engine/C++. 3D Graphics experience required by at least one member of the team.
Motivation: By 2050, 70% of the world population will live in cities. Today, already 50% lives in an urban environment and produces more than 75% of all C02 emissions. Finding intelligent and efficient ways to develop cost-effective and reliable structures capable to be more resilient to man-made and natural disasters and reduce their impact on the environment, it is an imperative.

The latest generation of 3D Urban Information Models (UIM) and Building Information Models (BIM), created from accurate urban-scale geospatial information, can be used to create smart web services based on geometric, semantic, morphological and information at urban scale level, which can be used to improve decision-making to develop cost-effective and reliable structures .

The proposed research project capitalizes on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality (AR) and simulations, to investigate their potential to link scientific abstractions (data and models) with tangible experiences of the built environment. This will contribute to advancing conceptual frameworks for investigating how different ways of linking digital information with physical artefacts influence interaction, cognition and meaning-making.

Dr. De Amicis will commit to spending at least one hour per week to interact with the students during the duration of the project. Additionally, they will guide, support and help the project team to pursue a manuscript/poster/presentation to disseminate the project results.

Mike Premi of Intel Corporation will be available to co-mentor students involved in this project with regard to Hardware, Software and Development Environments.

Jump onboard!
Description: Data in buildings, obtained from smart meters, sensors and networked devices, now enables dynamic analysis of indoor climate conditions, performance of structural elements, and even human behavior of occupants in buildings. This can provide more and more accurate, information about the characteristics and performance of buildings, allowing models to be developed that are far more adaptable than those used in current building simulation modelling tools, by identifying the interdependence of different performance indicators (e.g. structural efficiency and serviceability; durability and maintainability; thermal and acoustic comfort; whole building energy performance).

Immersive visualization systems are transforming interaction paradigm, literally, the user can be placed “inside” the data, rather than above it.

This research project proposes to implement a full-scale real-time Sensor Data Visualizations Framework, with the purpose of contributing to the body of knowledge on the structural and durability performance of structural systems.

The following hybrid (physical-digital) user scenarios will form the research platform:

Augmented visualization of sensor data; i.e., through the AR app, the visitor accesses to sensor data (e.g., temperature, moisture content, vibrations, deformations, etc.) related to an observed element in the building, extrapolating information about building performance (e.g., durability, stability, etc.);

Interactive inquiry of scientific data; i.e., the visitor navigate into the digital model of the building and its associated sensor network, to extrapolate and interpret data collected, using a multi-touch table and/or a wall dashboard.
Objectives: The specific objectives are to

1- To develop the middleware management services platform that will ensure seamless data collection and ingestion, via interoperable standards like CityGML and BIM.

2- To implement an efficient visualization tool capable to acquire, visualize , monitor, analyze the data collected .
Deliverables: • Data exchange System architecture - Report
• Database modelling and implementation - Report
• Data integration platform modelling and implementation - Report
• Human Behavior data collection tool - Report
• Virtual and Augmented Reality Structure Monitoring Visualizations SW
Other comments: Raffaele de Amicis, Associate Professor of Virtual and Augmented Reality at the Department of Electrical Engineering and Computer Science, OSU ( will mentor students involved in this project.
Mike Premi of Intel Corporation will be available to co-mentor students involved in this project with regard to Hardware, Software and Development Environments.

Dr. Raffaele de Amicis is the Principle Investigator for the following projects in the area of SmartCity:
• i-Scope -interoperable Smart City services through an Open Platform for urban Ecosystems
• SUNSHINE - Smart UrbaN ServIces for Higher eNergy Efficiency

Mariapaola Riggio, Assistant Professor of Wood Design and Architecture at the Department of Wood Science and Engineering, OSU ( will co-mentor students involved in this project. Dr. Riggio can commit to spending one hour per week in one-to-one mentoring of a student assigned to this project during the duration of the project. The student will be interacting with Dr. Riggio lab group that consists of 2 PhD students, and 3 MS students. Depending on the progress of the project, she will guide and help the student to pursue a manuscript/poster/presentation to disseminate the project results.

Dr. Mariapaola Riggio is the Principle investigator for the following projects in the area of smart structures:
SMART-CLT – “Structural health Monitoring And post-occupancy peRformance of mass Timber buildings”
Living Lab @ Peavy Hall: Structural Health performance of mass timber buildings

   D. Kevin McGrath
   Last modified: Fri Oct 20 09:31:13 2017