CL

Introducing the // DUO

2013-02-17T08:39:44-08:00

[youtube]7hAQECvLIGM[/youtube]

We are proud to introduce our latest project. We call it DUO and it’s a high precision, low latency 3D sensor that enables brand new forms of interaction.

Built from the off-the-shelf and readily available components, DUO provides an easy and inexpensive way for you to get involved in the latest and exciting field of Human Computer Interaction.

The powerful and original image processing algorithms behind the magic of DUO are all developed and built by our team of researchers and computer scientists. We developed a unique solution to a very hard problem and are looking forward to getting feedback from the community. DUO uses a minimal amount of CPU and provides ultra smooth and robust tracking of fingers, hands and other objects in 3D space.

We are currently in a process of launching our first Kickstarter campaign. This will allow us to quickly bring the DUO sensor to life and get it into your hands. We would love to see many new and exciting ways that you will use DUO in your own projects. A successful Kickstarter project will allow us to provide the DUO as a DIY kit that you can build on your own and customize it in any way you choose. Beyond Kickstater, we are actively looking for community & commercial contributors and if you are interested please create a new account on our site or contact us.

Stay tuned for more updates on our progress.

Image Scrambled on CL NUI DEVICE TEST APP

2011-05-30T11:01:08-08:00

Hello,
When I run the CL NUI Test app the image on both displays is scrambled. All the functionality works fine though.

I’ve included an attachment of what it looks like.

Thank you for your help.
Alex

Windows Kinect Driver/SDK - CL NUI Platform Release!!! * Updated *

2010-11-17T02:48:08-08:00

Updates: The CL NUI Platform Official 1.0 Release; now supports multiple Kinect cameras, signed driver and much more…

You can review the updates here to get started using the SDK Samples and more.

~~~ Nov 16th ~~~

We are proud to release the first preview release of the new CL NUI Platform which consists of an SDK, API and a stable driver for Microsoft’s new Kinect Hardware (Xbox NUI Audio, NUI Camera, NUI Motor and Accelerometer) devices on Windows machines.

To start we have a WPF/C# (.NET 3.5) Visual Studio 2010 Sample Applications as well as C API (CLNUIDevice.h, DLL, LIB) and plan on extending the SDK similar to our CL Eye SDK which has Samples for C/C++/C#, Java and DirectShow.

Learn more about the platform or download the latest installer to get started…

Video/Screenshot of the Sample WPF Application - 2 Cameras 640x480@30FPS, NUI Motor/Accelerometer and LED Control:

[youtube]YczQ-o26Rdk[/youtube]

An overview of the platform:

The CL NUI API:

//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
//
// This library is part of CL NUI SDK
// It allows the use of Microsoft Kinect cameras in your own applications
//
// For updates and file downloads go to: http://codelaboratories.com/get/kinect
//
// Copyright 2010 (c) Code Laboratories, Inc.  All rights reserved.
//
//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
#pragma once
#include <windows.h>

#define IMPORT(type) extern "C" __declspec(dllimport)## type __cdecl

//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
// NUIDevice  API
//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
// Device enumeration
IMPORT(int) GetNUIDeviceCount();
IMPORT(PCHAR) GetNUIDeviceSerial(int index);

//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
// CLNUIMotor  API
//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
// Motor instance type
typedef void *CLNUIMotor;

// Library initialization
IMPORT(CLNUIMotor) CreateNUIMotor(PCHAR serial);
IMPORT(bool) DestroyNUIMotor(CLNUIMotor mot);

// Motor control
IMPORT(bool) SetNUIMotorPosition(CLNUIMotor mot, SHORT position);

// Get accelerometer data
IMPORT(bool) GetNUIMotorAccelerometer(CLNUIMotor mot, SHORT &x, SHORT &y, SHORT &z);

IMPORT(bool) SetNUIMotorLED(CLNUIMotor mot, BYTE value);
//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
// CLNUICamera API
//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
// Camera instance type
typedef void *CLNUICamera;

// Library initialization
IMPORT(CLNUICamera) CreateNUICamera(PCHAR serial);
IMPORT(bool) DestroyNUICamera(CLNUICamera cam);

// Camera capture control
IMPORT(bool) StartNUICamera(CLNUICamera cam);
IMPORT(bool) StopNUICamera(CLNUICamera cam);

// Camera video frame image data retrieval
IMPORT(bool) GetNUICameraColorFrameRAW(CLNUICamera cam, PBYTE pData, int waitTimeout = 2000);
IMPORT(bool) GetNUICameraColorFrameRGB24(CLNUICamera cam, PBYTE pData, int waitTimeout = 2000);
IMPORT(bool) GetNUICameraColorFrameRGB32(CLNUICamera cam, PDWORD pData, int waitTimeout = 2000);

// Camera depth frame image data retrieval
IMPORT(bool) GetNUICameraDepthFrameRAW(CLNUICamera cam, PUSHORT pData, int waitTimeout = 2000);
IMPORT(bool) GetNUICameraDepthFrameCorrected12(CLNUICamera cam, PUSHORT pData, int waitTimeout = 2000);
IMPORT(bool) GetNUICameraDepthFrameCorrected8(CLNUICamera cam, PBYTE pData, int waitTimeout = 2000);
IMPORT(bool) GetNUICameraDepthFrameRGB32(CLNUICamera cam, PDWORD pData, int waitTimeout = 2000);
///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////// 

Thanks and please share any videos of it in use or feedback while getting started with the CL NUI Platform.

AlexP

Trouble with connection

2011-02-02T11:19:02-08:00

Note sure if there is a forum for this.. but i wanted to chime in and ask about this software.
I have installed the software, and run the CL Nui Device Test… i get to move the device,set the led’s and it knows its serial number, but based on the demos i see on this site, iw ould be exacting to see the video of the camera and depth info being displayed where i get all black.. what is the normal state of information that we are expecting here

im trying use the kinect as my web cam!!!

2011-02-17T01:16:56-08:00

everything is working correctly. now im trying to make it my default cam. i dont have a cam on my laptop at all. so what do i to get it started i dont have a clue. the test worked perfectly. but i wanna use the cam for oovoo, video chatting and the Kinect isnt found. someone please help me

New to computer graphics

2011-01-30T14:01:07-08:00

Im trying to build a basic application that captures video from the kinect RBG to the screen. I was able to to get the serial number of the camera out, and how many devices where connected. Im using OpenCV to output my video, but Im running into a problem. I guess you can say i dont understand or what not but here it is.

int _tmain(int argc, _TCHAR* argv[])
{

    int KinectCount;
    unsigned int timeStamp;
    char *KinectSerial;
    char *KinectRBG = 0;
    bool startCapture = true;
    CLNUICamera KinectCamera; 
 
    KinectCount = GetNUIDeviceCount();
    KinectSerial = GetNUIDeviceSerial(0);
    KinectCamera = CreateNUICamera(KinectSerial);     

    cout << "Cameras connected: " << KinectCount << endl;
    cout << "Camera SN: " << KinectSerial << endl;

    IplImage *KinectRBG = cvCreateImageHeader(cvSize(640,480), 8, 3);

    cvNamedWindow("Kinect RGB",1);    
    
    while (cvWaitKey(10) < 0)
    {

        GetNUICameraColorFrameRGB24(KinectCamera,[color=green] KinectRBG[/color], 500);
                                 //this function calls for a pbyte value in the second parameter. my question is how can i create such value
                                 // I've seen different examples and i think is a image value that includes HxWxColor resolution but Im not sure can   //any one give me a hand THANKS                    



     /* cvSetData(image, rgb, 640*3);
      cvCvtColor(image, image, CV_RGB2BGR);
      cvShowImage("RGB", image);*/
    }
    system("pause"); 

Heap error at StopNUICamera using CLNUIDevice.dll rev 1.0.0.1210

2011-01-18T08:33:27-08:00

A very smart work.

But .... maybe still green for c++ usage ? ( I hate to say that, but early adopter are unfortunately adopter or early bugs)

Like a few other members on the forum, calling StopNUICamera(camera).
give an error that resist to various test.
” First-chance exception at 0x77776fd8 in KinectInputBasicD.exe: 0xC0000005: Access violation reading location 0x8100424a.
HEAP[KinectInputBasicD.exe]: HEAP: Free Heap block 267488 modified at 2676e4 after it was freed
Windows has triggered a breakpoint in KinectInputBasicD.exe.

This may be due to a corruption of the heap, and indicates a bug in KinectInputBasicD.exe or any of the DLLs it has loaded.
“

Looks like I got it sometime multiple time before final exit (pressing “continue” in Vsdebugger), like if a static map or something stay improperly purged because previous called did crash.
I did reboot to purge driver & dll static if any but stay.

Sample seems to work fine. (or crash silently)

I test it single thread, so I am sure that StopNUICamera(camera) is called once loop to display buffer is stopped gracefully

Aside of that every thing went well before this call (I got images and depths display it etc ...)

sequence of call (simplified) was
GetNUIDeviceCount();
GetNUIDeviceSerial(0);
CreateNUICamera(pSerialID);
StartNUICamera(pCamera);
loop
GetNUICameraColorFrameRGB24(pCamera, frame, 500)
StopNUICamera(pCamera); <<<——Where it badly handle a heap object
DestroyNUICamera(pCamera);

Out of idea
- Wrong init sequence ?
- A DLL issue ? or a driver issue ? (looks like a kind of persistence exist)
- Is there a debug version of the dll stub CLNUIDevice.lib (and dll) ?
(that at least I narrow the call that make the early delete or free)

Thanks

Help!! Executing sample source code for kinect applications

2010-12-27T22:10:43-08:00

Hi there,

after checking out most of the kinect related posts, I am super excited to run few codes myself to see how the kinect actually work. I must say, I am a complete nube in visual studio and c# but I really would like to learn. I have been trying to run some of the source codes posted by many experts in this site in the Visual studio 2010 IDE, but I am getting a errors and the programs are not running for me. I installed the CLNUI device test exe file and it works fine on my 32 bit PC, but I cant run the source codes. Can anybody please help me learn how can I run the sample codes in VS C# posted by others to see the kinect’s functionality.

I have been trying to run the KinectData project in visual studio 2010 but cant seem to get it at all. Any help in get me started in this would be utterly appreciated.

Regards

Arefin

kinect multitouch in windows 7

2010-11-28T07:03:18-08:00

We wont multitouch on windows 7. if you merge this https://code.google.com/p/tuiokinect/ + this http://multitouchvista.codeplex.com/

you can modify this http://code.google.com/p/wiituio/

CL Studio Live 1.0.0.1010 Release

2010-10-10T22:25:17-08:00

Here we are wrapping up the last bits and pieces getting ready for a big release…
We have worked hard to bring you this awesome program that is a product of many hours of experimenting and playing with the latest CPU/GPU technology out there…
Please be patient as we are almost there.
Hope you’ll have fun using the CL Studio Live as we had developing this great program.
Looking forward to all your good feedback.