Kinect Multi-point SDK project

Created Release: dsf mouse wrapper library

jeffman1 — Thu, 13 Jun 2013 13:40:22 GMT

This c++ code wraps around the unmanaged c++ code to provide better capabilities with the Kinect code and avoid any entanglement's with writing dsf code directly and instead: tell it how many devices, initialize them, and send an input report to the OS with the details of how far to move the mouse device or use clicking features.

Updated Wiki: Home

jeffman1 — Sun, 02 Jun 2013 20:28:05 GMT

Project Description
This project entails making the kinect sdk work with the multi-point mouse sdk and mouse mischief and other multimouse applicartions (its really a multimouse implementation of kinect mouse). Allowing the use of a kinect as multiple mice. (4 - 6 people per kinect * number of people in classroom).

This project is for an educational classroom/non-profit and full source disclosure setting until status changed on dsf runtime being redistributable for commercial usage (includes contracting scenarios not related to educational usage or testing of programming for a future device driver). This is Microsoft's terms on the license for dsf so if you wish to know more please ask them permission. The kinect portion can be used for commerical purposes but the vbscript code is limited to non-commerical usage only.

The kinect needs to be used for more then just gaming right? Well i have started a project that allows people to use the multi-point sdk with the kinect sdk and mouse mischief. Please read the kinect nui api or kinect general forums for updates on code changes until this site is fully setup.

This project is designed for the microsoft kinect for sdk v1,multi-point sdk, and mouse mischief powerpoint for windows. Please download them before proceeding to help with the project as you would need them to see if the code is working. This project will also work with smart notebook in the future as I work on it.

Current problems to get this into a working setup program exe to distribute are (updated on 6/2/2013):
1. Identifying users with current code(updated to final stages).
2. Get working with multipoint (should do this even if i dont code directly into multipoint as long as Kinect multipoint program from this project is running in the background).

3. Convert to vb.net the vbscript that does the device emulation since I have it working now.

Update(6/2/2013):

Currently converting to vb.net the dsf emulation script in vbscript. I have it mostly working except the mouse devices are not recognized correctly right now. I think I might have not done the hexadecimal values correctly but it may be a simple change in one of the subs that is wrong. If you find the solution before me upload it or post in the discussions area.

Update(5/21/2013):

Sorry to take so long on releasing an update for the Kinect project but I had some hiccups with the multiplayer code acting like it had glitch's at first. I have released a new source code update that works well with 2 players consistently identifying them separately but together when necessary. Thanks for sticking with me community! This code will help anyone trying to emulate a device with the Kinect just change the device emulated in the vbscript to meet your requirements. Still in decision about converting the vbscript code to vb.net so the mouse devices can have input sent directly to them (will more then likely do this conversion before releasing v1.0).

Update (5/14/2013):

I have updated code that is still in the works for the Kinect section (will be v0.95 when I upload it). Please email for latest code link as I post the most stable versions on here but current in progress builds I provide the link to people helping me code.

I got permission to use the kinect mouse code on codeplex for modification.

To donate to this project/future projects anything wheter from $1 to anything you want it would be appreciated and you never know I might just appear in your project asking to help every project(okay maybe not every project but if i receive a donation Im more likely to be encouraged to start more projects):

The emulator code is dsf(device simulation framework) from microsofts ddk(driver development kit) so you need to ask permission before including inside a commerical project. In addition, I recommend if you do get permission that you donate a fair something above if it involves any modification of the code in this project.

Remember to visit this site for updates and download the newest one. With community involvement, I can invest time into a possible emulator driver to keep from having to use the vbscript (requires device driver experts to invest the time).

Im thinking about updating the emulator to also do http://smarttech.com 's smartboard for educational and government entities that use this board but will come out with a full stable release for mouse emulator first with an installer.

I love xna and kinect projects so if someone needs help on one please email me.

Updated Wiki: Home

jeffman1 — Sun, 02 Jun 2013 20:14:55 GMT

3. Convert to vb.net the vbscript that does the device emulation since I have it working now.

Update(6/2/2013):

Currently converting to vb.net the dsf emulation script in vbscript. I have it mostly working except the mouse devices are not recognized correctly right now.

Update(5/21/2013):

Update (5/14/2013):

I love xna and kinect projects so if someone needs help on one please email me.

Updated Wiki: Home

jeffman1 — Sun, 02 Jun 2013 20:13:08 GMT

3. Convert to vb.net the vbscript since I have it working now.

Update(5/21/2013):

Update (5/14/2013):

I love xna and kinect projects so if someone needs help on one please email me.

Created Release: DSF mouse simulation code in vb.net

jeffman1 — Sun, 02 Jun 2013 20:11:16 GMT

This is a vb.net source conversion that of the vbscript dsf code converted to vb.net. I am still working on getting the mouse devices to install correctly but once I get that code section working I will merge this code with the other section. I wanted to improve the code for the people that are following me.

Updated Wiki: Home

jeffman1 — Thu, 23 May 2013 11:54:02 GMT

Project Description
This project entails making the kinect sdk work with the multi-point mouse sdk and mouse mischief and other multimouse applicartions (its really a multimouse implementation of kinect mouse). Allowing the use of a kinect as multiple mice. (4 - 6 people per kinect * number of people in classroom).

This project is for an educational classroom/non-profit and full source disclosure setting until status changed on dsf runtime being redistributable for commercial usage (includes contracting scenarios not related to educational usage or testing of programming for a future device driver). This is Microsoft's terms on the license for dsf so if you wish to know more please ask them permission. The kinect portion can be used for commerical purposes but the vbscript code is limited to non-commerical usage only.

The kinect needs to be used for more then just gaming right? Well i have started a project that allows people to use the multi-point sdk with the kinect sdk and mouse mischief. Please read the kinect nui api or kinect general forums for updates on code changes until this site is fully setup.

This project is designed for the microsoft kinect for sdk v1,multi-point sdk, and mouse mischief powerpoint for windows. Please download them before proceeding to help with the project as you would need them to see if the code is working. This project will also work with smart notebook in the future as I work on it.

Current problems to get this into a working setup program exe to distribute are (updated on 5/21/2013):
1. Identifying users with current code(updated to final stages).
2. Get working with multipoint (should do this even if i dont code directly into multipoint as long as Kinect multipoint program from this project is running in the background).

Update(5/21/2013):

Update (5/14/2013):

I love xna and kinect projects so if someone needs help on one please email me.

Updated Wiki: Home

jeffman1 — Tue, 21 May 2013 23:41:49 GMT

Project Description
This project entails making the kinect sdk work with the multi-point mouse sdk and mouse mischief and other multimouse applicartions (its really a multimouse implementation of kinect mouse). Allowing the use of a kinect as multiple mice. (4 - 6 people per kinect * number of people in classroom).

This project is for an educational classroom/non-profit and full source disclosure setting until status changed on dsf runtime being redistributable for commercial usage (includes contracting scenarios not related to educational usage or testing of programming for a future device driver). This is Microsoft's terms on the license for dsf so if you wish to know more please ask them permission. The kinect portion can be used for commerical purposes but the vbscript code is limited to non-commerical usage only.

The kinect needs to be used for more then just gaming right? Well i have started a project that allows people to use the multi-point sdk with the kinect sdk and mouse mischief. Please read the kinect nui api or kinect general forums for updates on code changes until this site is fully setup.

This project is designed for the microsoft kinect for sdk v1,multi-point sdk, and mouse mischief powerpoint for windows. Please download them before proceeding to help with the project as you would need them to see if the code is working. This project will also work with smart notebook in the future as I work on it.

Current problems to get this into a working setup program exe to distribute are (updated on 5/21/2013):
1. Identifying users with current code(updated to final stages).
2. Get working with multipoint (should do this even if i dont code directly into multipoint as long as Kinect multipoint program from this project is running in the background).

Update(5/21/2013):

Sorry to take so long on releasing an update for the Kinect project but I had some hiccups with the multiplayer code acting like it had glitch's at first. I have released a new source code update that works well with 2 players consistently identifying them separately but together when necessary. Thanks for sticking with me community! This code will help anyone trying to emulate a device with the Kinect just change the device emulated in the vbscript. Still in decision about converting the vbscript code to vb.net so the mouse devices can have input sent directly to them (will more then likely do this conversion before releasing v1.0).

Update (5/14/2013):

I love xna and kinect projects so if someone needs help on one please email me.

Created Release: kinecmultipoint 0.95 (May 21, 2013)

jeffman1 — Tue, 21 May 2013 23:31:59 GMT

This release fixes some issues with multiplayer and gets two players to work consistently together. However, when the release reach's 1.0 I will release it with a setup package for people to have an easier time installing it. Please continue to use the executable in the zip file under the bin/debug folder. Hope my code comes in handy for Kinect enthusiasts!

Released: kinecmultipoint 0.95 (May 21, 2013)

Tue, 21 May 2013 23:31:59 GMT

Updated Wiki: Home

jeffman1 — Tue, 14 May 2013 16:56:37 GMT

Project Description
This project entails making the kinect sdk work with the multi-point mouse sdk and mouse mischief and other multimouse applicartions (its really a multimouse implementation of kinect mouse). Allowing the use of a kinect as multiple mice. (4 - 6 people per kinect * number of people in classroom).

This project is for an educational classroom/non-profit and full source disclosure setting until status changed on dsf runtime being redistributable for commercial usage (includes contracting scenarios not related to educational usage or testing of programming for a future device driver). This is Microsoft's terms on the license for dsf so if you wish to know more please ask them permission. The kinect portion can be used for commerical purposes but the vbscript code is limited to non-commerical usage only.

The kinect needs to be used for more then just gaming right? Well i have started a project that allows people to use the multi-point sdk with the kinect sdk and mouse mischief. Please read the kinect nui api or kinect general forums for updates on code changes until this site is fully setup.

This project is designed for the microsoft kinect for sdk v1,multi-point sdk, and mouse mischief powerpoint for windows. Please download them before proceeding to help with the project as you would need them to see if the code is working. This project will also work with smart notebook in the future as I work on it.

Current problems to get this into a working setup program exe to distribute are:
1. Identifying users with current code(final stages - early beta).
2. Get working with multipoint (should do this even if i dont code directly into multipoint as long as Kinect multipoint program from this project is running in the background).

Update (5/14/2013):

Update (2/13/2012): project is almost ready for deployment to an installer. Next, I will next emulate the smartboard and see if I can make actual drivers so people can use the emulator code for commerical production environments.

I love xna and kinect projects so if someone needs help on one please email me.

Updated Wiki: Documentation

jeffman1 — Thu, 09 May 2013 22:20:21 GMT

Kinect Multi-point project

Overview

Update (5/9/2013): I have removed DELMID environment variable from the mix (can be re-added if you wish to use file mode for sending coordinates to vbscript). Added Player0XCoords/Player0YCoords environment variable for testing x,y coordinates of player 1, Player1XCoords/Player1YCoords environment variable for testing x,y coordinates of player 2, and so on. Added USERNUM environment variable which tells the vbscript how many devices to initialize. Please change the environment variables as needed for your classroom.

Update (3/28/2013): I have decided to use environment variables for the number of mouse devices (numdevs) and the boolean value for destroying all devices (killdevs). In addition, now I have a new check for DELMID environment variable which just looks for:

1. True - deletes the *.mid file and waits until the program is finished recreating it and returns the status to false to continue.

2. False - does nothing unless already in the loop and then exits continues accepting program input.

This source will be uploaded soon! I will leave in the files for anyone that needs backwards compatibility. I still need to work on the kinect code but the above enhancements will be in kinectmultpoint v0.9.

I have just updated today 2/7/2013 the program files to include a new version of vbscript file combined with updated kinect code. Note: the shell command in module is commented out to vbscript file so that you do not inadvertly trigger the vbs file during program execution until the Kinect code is tested some more.

Follow the instructions and help below but you might need a special program to find the devices input report or report descriptor if you wish to emulate your own device (go to usb.org to find out about generic devices).

The mouse data file contains data for movement movement and is constantly being written to by main kinect program and read by vbscript.

Note: the bolded section below is now optional but I will still include it in the vbscript file for backwards compatibility.

Here is the structure of the file that initializes setup for the script once executed and tells the script when to stop responding to input and kill all the devices (*.mdc file):

1. Number of mouse devices to create (limited to 40 but any user can change this limitation in the vbscript file).

2. Boolean value on wheter to destroy and remove the emulated devices (false until the program is closed).

In addition, here are the mousedata file file contents (*.mid file):

'line1

x position here (relative to last position)

'line 2

y position here (relative to last postion)

'line 3

leftclickstatus (true or false)

'line 4 (not used right now)

might have for right click in future (true or false)

'next lines repeat for each mouse device

Current limitations on amount of players is 40 but change the array subscript number for all arrays to something higher then 40 if need be in the vbscript file. Also, change needs to be done on the port hot plugging procedures because they only support 20 users or players. Note: to do so might require an external powered usb hub because of the massive power Kinect and more then likely a big main power supply to the computer.

Other:

use shell in vb.net to softhehcicfg /REMOVE and INSTALL under the program files\dsf\softehci folder.

For example,

InputReport(0) = CByte(1)

InputReport(1) = CByte(0)

InputReport(2) = CByte(0)

InputReport(3) = CByte(0)

InputReport(4) = CByte(0)

The mouse is down in this sample and the mouse is at x,y coordinates (0,0).

For reference on the dsf code:

BUTTON X Y WHEEL PAN

InputReport(0) = CByte(mouse click converted to hex here) - Button state of mouse (0- down and 1- up but you already knew that)

InputReport(1) = CByte(x coordinates converted to hex here) - x coordinates of mouse on screen (relative)
InputReport(2) = CByte(y coordinates converted to hex here) - y coordinates of mouse on screen (relative)

InputReport(3) = CByte(0) - default value for wheel that never changes. - mouse wheel value only for advanced coders/users that want to change mouse wheel value.

InputReport(4) = CByte(0) - default value for pan that never changes. - mouse screen pan values for advanced coders/users only!

Also, remember for button state must go up and down states both for mouse_click subs in vb.net or other multimouse programs to function/register it as a click (which is you holding down the mouse and releasing) properly.

Excuse me if i get a little rough in this conversation with the wdk guys but here is a link to where they divulge more about the input report and i believe talked about left and right mouse clicking but not for sure:

http://social.msdn.microsoft.com/Forums/ar/wdk/thread/3470662f-e51e-424d-b540-25975a56f2c8

I think 0 and 1 are the states for the left mosue click but im not for sure about a right mouse click but this is still a work in progress or I might leave it out but wdk team might be able to tell you how to put it back in or post above might have info to help you.

Thought i would post the above for anyone wondering how to test the mouse emulation script.

Updated Wiki: Documentation

jeffman1 — Thu, 09 May 2013 22:19:17 GMT

Kinect Multi-point project

Overview

Update (5/9/2013): I have removed DELMID environment variable from the mix (can be re-added if you wish to use file mode for sending coordinates to vbscript). Added Player0XCoords/Player0YCoords environment variable for testing x,y coordinates of player 1, Player1XCoords/Player1YCoords environment variable for testing x,y coordinates of player 2, and so on. Added USERNUM environment variable which tells the vbscript how many devices to initialize.