The following descriptions are the steps necessary to develop a Windows app for the Moverio.
The following steps indicate the procedures for introducing the Windows SDK to a personal computer equipped with Windows 10.
Download Visual Studio 2019 from the following website. (The most recent version as of May 2019 is Visual Studio 2019)
Start the Visual Studio Installer and follow the instructions to install Visual Studio 2019.
Start the Visual Studio Installer. Add and install "Universal Windows Platform development", ".NET desktop development", and "Desktop development with C++" at the Workloads page. See the website below for the procedure details.
Check the Visual Studio documentation from Microsoft.
This documentation indicates how to develop apps for desktop computers. Select the workloads that match the type of apps you are developing.
See the following website for the procedure details.
The Moverio is a smart glass equipped with a see-through (transparent) display. To use the display control from a Windows desktop app, you can use the System.IO.Ports.SerialPort namespace from the Windows standard COM port access API, and then control can be performed by sending dedicated commands.
You can use dedicated commands to control the brightness of the display, and switch between 2D/3D display mode. You can adjust the brightness of the display by using the dedicated commands and by using the auto adjust method according to the brightness of the surroundings. The Side-by-Side method for displaying 3D content is also supported.
For more information please refer to the related information.
Since the Moverio has a see-through display, the visibility of the images on the screen may be affected by the brightness of the surroundings. To view the displayed images clearer, please increase the display brightness if you are in a bright environment, and decrease it if you are in a dark environment.
To adjust display brightness, use the System.IO.Ports.SerialPort (Windows standard COM port access API) to execute a dedicated command "setbright xx" (specify a value 0 to 20 for "xx".) The Display brightness can be adjusted through 21 levels from 0 to 20. Execute the "setbright 50" dedicated command to specify automatic mode as the display brightness adjustment mode.
You can also execute the "getbright" dedicated command to obtain the current display brightness.
The Moverio display supports the Side-by-Side method for displaying 3D content. If you want to display 3D content in the Moverio using the Side-by-Side feature when managing operations from the app, then use the System.IO.Ports.SerialPort from the Windows standard COM port access API to execute the "set2d3d 0" (2D display mode) dedicated command or the "set2d3d 1" (3D display mode) dedicated command.
The side by side method places images on the left and right of the screen.
When creating images using the Side-by-Side method, place the left eye image and the right eye image on the left and right sides of the image respectively.
For example, when creating a 1280 × 720 (HD size) Side-by-Side image, place a 640 x 720 image for the left eye and a 640 × 720 image for the right eye as shown in the following figure to build the Side-by-Side image.
If you want to switch between 2D/3D display mode, then use the System.IO.Ports.SerialPort from the Windows standard COM port access API to execute the "set2d3d 0" (2D display mode) dedicated command or the "set2d3d 1" (3D display mode) dedicated command.
You can also use the "get2d3d" dedicated command to obtain the current 2D/3D display mode. The command returns 0 when 2D/3D display mode is in 2D display mode, and returns 1 when in 3D display mode.
The Moverio is equipped with a see-through type display that allows the wearer to superimpose images over their real-time surroundings. To superimpose the image of an object you want to display in the Moverio over the wearer's real-time surroundings, you can create an image that makes use of the see-through display by setting the background of the object you want to display in black.
See following table on the available brightness adjustment range.
|model||brightness adjustment range|
|BT-35E||0 to 20|
|BT-30C||0 to 20|
The Moverio is equipped with a variety of sensors that detect movement, direction, and environment. For sensor control from a Windows desktop app, you can use the standard Sensor API for control. The sensor data is used to calculate the head movement of the user, and the brightness of the surrounding environment.
Please refer to the related information.
The Moverio is equipped with various types of sensors. These sensors consist of both hardware and software-based sensor types. Hardware-based sensors include acceleration, magnetic field, angular velocity, and surrounding ambient light. Software-based sensors are virtual sensors that derive values output by single or multiple hardware-based sensors. Software-based sensors can calculate items such as rotation vectors and gravity.
|SENSOR_TYPE_ACCELEROMETER_3D||Hardware||Measures the acceleration of the Moverio, including gravity, along the three axises (X, Y, and Z) in [G].||Motion detection (slanting ...)|
|SENSOR_TYPE_COMPASS_3D||Hardware||Measures the surrounding magnetic field along the three axises (X, Y, and Z) in [mG].||Position detection|
|SENSOR_TYPE_GYROMETER_3D||Hardware||Measures the angular velocity of the Moverio along the three axises (X, Y, and Z) in [deg/s].||Motion detection (rotation ...)|
|GUID_SensorType_GravityVector||Software||Measures the acceleration of gravity along the three axises (X, Y, and Z) in [m/s²].||Motion detection (slanting ...)|
|GUID_SensorType_LinearAccelerometer||Software||Measures the acceleration along the three axises (X, Y, and Z) with gravity removed in [m/s²].||Used for detecting tapping, walking, and similar actions|
|SENSOR_TYPE_AGGREGATED_DEVICE_ORIENTATION||Software||Measures the Moverio orientation in quaternions.||Head tracking|
See the following websites for detailed information.
The coordinate system for the Moverio acceleration sensor is different from the coordinate system of all other sensors. When wearing the Moverio, the X axis of the acceleration sensor indicates leftward movement, the Y axis indicates downward movement, and the Z axis indicates the direction of the user's line of sight. The X axis for all other sensors apart from the acceleration sensor indicates a rightward movement, the Y axis indicates upward movement, and the Z axis indicates the direction toward the user.
The Moverio can be connected with CTIA-compliant earphones and microphone to listen to a sound source or for having a voice conversation, or similar functionality. For audio control from a Windows desktop app, you can use the Core Audio API, which is a Windows standard audio control API. This API can be used to output a sound source to the earphones, input sound from a microphone, or set parameters to both the earphones and microphones.
Please refer to the following related information.
The Moverio allows you to use Core Audio APIs to listen to a sound source from the connected earphones. See the following website for detailed information.
The Moverio allows you to use Core Audio APIs to input a sound from connected microphones. See the following website for detailed information.
The Moverio allows you to use Core Audio APIs to specify various parameters for the connected earphones and microphone. See the following website for detailed information.
The Moverio allows you to use Core Audio APIs to temporarily stop earphone output and microphone input (mute setting). See the following website for detailed information.