arminms / holimoli

Molecular holograms for Microsoft HoloLens

G'day, eh... I'm Armin!

I am an HPC/ARC Scientific Software Developer.

• 😄 Pronouns: He/Him
• 🔭 Currently working on gol2p, g3p and sq3p
• ❤️ Coffee, Cooking, Swimming, Music, Movies
• 🎮 XBox

👋 About me

• HPC Technical Consultant at SHARCNET
• Based at Ontario Tech University
• Background in bioinformatics and in-silico drug design

holimoli's Issues

Refactoring initial transformation of the molecule

• finding a scaling factor to fit molecule in a box with dimensions of 1m x 1m x 1m and storing it in a member variable named m_scaling
• adding m_scaling to m_modelConstantBufferData
• superimposing longest axis of the molecule on y axis
• removing m_scaling from m_modelConstantBufferData once it is incorporated into modelTranform#9
• adding normalsToWorld matrix to ModelConstantBuffer structure for calculating normals without scaling

Playing click sound for anchoring molecule

• making WaveBank file containing at least clicking sound using XWBTool and putting in Assets
• updating HoliMoliMain.h and HoliMoliMain.cpp to intialize a WaveBank instance and play the click sound before calling PositionHologram() function

Removing DirectXTK submodule and add it as NuGet package

• removing DXTK submodule by the way mentioned here
• removing references to the library in the VS solution
• adding DXTK as NuGet package
• using CommonStates for switching to wireframe mode

Activating voice commands

• reacting to 'bigger' and 'smaller' commands by making the molecule bigger or smaller
• reacting to 'closer' and 'farther' commands by placing the molecule closer or farther
• reacting to 'faster' and 'slower' commands by rotating the molecule faster or slower
• handling degradation in voice quality
• reacting to 'reset' by setting all the above parameters to initial values
• handling DeviceLost and DeviceRestored signals to have voice commands working after being suspended

HoliMoli logo

• development of HoliMoli logo as an SVG file and adding to Assets folder
• replacing StoreLogo.png with the new one
• replacing LockScreenLogo.scale-200.png with the new one
• replacing Square44x44Logo.scale-200.png with the new one
• replacing Square44x44Logo.targetsize-24_altform-unplated.png with the new one
• replacing Square150x150Logo.scale-200.png with the new one
• replacing SplashScreen.scale-200.png with the new one
• replacing Wide310x150Logo.scale-200.png with the new one
• making a folder named Templates under Assets and transfer all .psd templates and .svg to it
• adding all the assets built by action script
• making a web version of the logo with black outline around white objects
• putting logo in the README.md

Lighting changes based on the position of the viewer

Error X3703 'main': vs_2_0 does not support minimum-precision data

Hi, I tried to compile and run HoliMoli using VS2015 Enterprise Update 3 with what I believe are all up to date stuff for HoloLens development but got this in the Error List window.

Error X3703 'main': vs_2_0 does not support minimum-precision data

When I clicked on the error, it points to this line (line 27) in the file SimpleLightingPixelShader.hlsl

min16float4 main(PixelShaderInput input) : SV_TARGET

Removing DRAW_SAMPLE_CONTENT preprocessor from the code

Using size of the object in screen space for geometric LOD

Try using speech synthesis rather than recorded voice if the quality is good

Adding simplified Blinn-Phong BRDF lighting

• adding pixel shader file
• changing other shaders
• updating constant buffers code in .cpp files

Associating HoliMoli with the Store

Rendering atoms using actual vdW radii

• adding vdWRadii.h and vdWRadii.ipp
• adding vdw as a float to VertexPositionColor and rename it to VertexPositionColorVdw
• updating HullShader.hlsl and SpinningMoleculeRenderer to use vdw

Adding dependencies as submodules

• adding Maral as a submodule in the HoliMoli/Dependencies folder
• adding relative path of Maral to Include Directories of project
• adding Boost as a NuGet package
• checking a short Maral code
• adding DirectX Tool Kit DirectXTK as a submoldule in the HoliMoli/Dependencies folder

Showing FPS for performance assessments

• make a sprite font and put it in assets folder
• using DirectXTK::CommonStates for state management

Adding support for spatial mapping

• adding RealtimeSurfaceMeshRenderer.h, RealtimeSurfaceMeshRenderer.cpp, SurfaceMesh.h, SurfaceMesh.cpp, SurfaceVPRTVertexShader.hlsl, SurfaceVertexShader.hlsl and GetDataFromIBuffer.h files
• updating package.appxmanifest to allow spatial mapping capability
• updating HoliMoliMain.h and HoliMoliMain.cpp to use spatial mapping

Rendering a CPK representation of the molecule read from the PDB site

• renaming SpinningCubeRenderer class to SpinningMoleculeRenderer, including filename
• adding hull shader
• adding domain shader
• putting atomic coordinates and colors read from the PDB file into vertex buffer
• changing the default front face culling to D3D11_CULL_NONE for correct rendering
• deploying a dynamic tessellation factor in the hull shader: YouTube video

Adding atomic colors for the whole periodic table