Kinect v2 Community Projects

bogart

One of the great strengths of the original Kinect sensor was the community that gathered around it almost by happenstance.  The same thing is currently happening with the Kinect for Windows v2 – even though the non-XBox version of the hardware is still yet to be released.  Going into this v2 release, Microsoft took the prescient stance of reaching out to creative coders, researchers and digital agency types (that’s me) to give them pre-release versions of the hardware to start playing with.

Here are just a few of the things they’ve come up with:

wieden-kennedy/Cinder-Kinect2 – Stephen Schieberl’s Kinect v2 wrapper for Cinderlib

englandrp/Kinect2-Data-Transmitter – a Unity3D plugin for Kinect v2

rfilkov/kinect2-unity-example-with-ms-sdk – another Unity3D plugin for Kinect v2 (also, I believe, using the Data Transmitter strategy)

OpenKinect/libfreenect2 – Josh Blake, Theo Watson, et. al.’s open source drivers for Kinect v2 (in progress, but this will allow it to run on operating systems other than Windows 8 – for instance, on a Mac)

https://github.com/MarcusKohnert/Kinect.ReactiveV2 – a reactive library for Kinect v2

https://github.com/DevHwan/K4Wv2OpenCVModule – OpenCV bridge for Kinect v2

http://k4wv2heartrate.codeplex.com/ – Dwight Goins’ sample implementation of heart rate detection using Kinect v2

… and then there are twice as many in the works I’ve heard about through the grapevine.

The walled garden approach to software doesn’t work anymore and the Microsoft Kinect for Windows team seems to have embraced that in a big way.  Not only are people experimenting with the new hardware but they are even making their code publicly available – free as in beer type available – in order to foster the community. 

This is a philosophical stance that in some ways harkens back to one of Bill Gates’ early intuitions when he was building the Microsoft Corporation.  At some point, he realized that he couldn’t be the smartest person in the room forever.  What he could do, though, was to gather the best people he could find and drive them to be their best.  He would contribute by clearing the roadblocks and guiding these people toward his goals.  This, more or less, was also how Steve Jobs went about adding value to his company and to contemporary culture.

The community currently building up around Kinect v2 is like that but with a difference.  The goal isn’t to lead anyone in a particular direction.  Instead, the objective is to open up tools / toys to allow people to discover their own goals.  Each community member contributes to something bigger than herself by making it possible for other people to do something new and original – whether this turns out to be an app, an art installation, a better way of shopping, an improved layout for visualizing spreadsheets – whatever.

So what’s so bad about walled gardens?

Quite simply, they stifle innovation.  The Microsoft I’d grown used to in the double naughts was all about best practices and guidelines and “components” and sealed classes. 

Ultimately, Microsoft did everything it could to minimize support calls.  Developers were given a certain way to do things – whether this was a good way or not – and if they went off the reservation (sorry, left the walled garden) they were typically on their own: no callbacks from MS and a lot of abuse on support forums asking ‘wtf are you doing that for?’

And I can understand all that — support calls suck – but the end result of this approach was that innovation started occurring more and more outside of Microsoft platforms.  Microsoft, in turn, became a ‘use case’ culture.  Instead of opening up their APIs like everyone else was doing, their most common response to requests was ‘what’s your use case’ followed by ‘we’ll get back to you on that.’

The logic of this was very simple.  Microsoft in the 00’s was about standardization of programming practices.  If you’re the sort of person who wants to innovate, however, you don’t want to do the ‘standard’ – by definition you don’t want to do what everyone else is doing.  So you looked for platforms with open APIs and tried to find ways to do things with the APIs that no one else was doing, i.e., you hacked those APIs.

And Microsoft, traditionally, hasn’t liked people using their products in ways they are not intended to be used – they haven’t liked hacking.

The original Kinect sensor changed all that.  It took a moment, but as videos started showing up all over the place showing people using a hacked driver to read the Kinect sensor streams, the Grinch’s heart grew three sizes that day.  MS was getting instant street cred by simply letting people do what they were doing anyways and giving a thumbs up to it.  Overnight, Microsoft was once again recognized as an innovative company (they always have been, really, but that wasn’t the public perception).

Which is why v2 of libfreenect is so exciting.  It’s a project that will, ultimately, allow you to use the Kinect on a Mac.

To put things into context, PrimeSense (the provider of the depth technology behind Kinect v1) got bought out by Apple last year.  PrimeSense’s alternative, open source library + drivers for Kinect, OpenNI, was suddenly put in jeopardy and an announcement was circulated that the OpenNI site was coming down in April, 2014.  So…

The anti-Microsoft is currently bringing OpenNI inside its walled garden.  Meanwhile Microsoft is providing devices to the people writing libfreenect, which will allow people to use Kinect devices outside of Microsoft’s not-so-walled garden. 

How do you like them Apples?

Ten 2014 Tech Trend Haiku

blade-runner-billboard

2014 has seen a proliferation of articles about tech trends — this is, as it were, the trend in tech trends.  News outlets, consultancies, and the random web page all feel an urgency about putting their two cents in. 

Even as more voices are being heard about what to expect in the near future (or more accurately, the ‘intimate future’), what is actually said seems to be getting shorter and shorter.  Moreover, what is being said seems to be getting recycled year over year.

Where near future predictions used to be long and thoughtful, intimate future predictions have become terse and uniform. This process is known to economists as the process of commoditization. What was once crafted is now generic, easily digestible, and able to be mass produced: predictions in 140 characters or less.

This trend of writing about tech trends seems to be running out of steam, however.  Repetition and terseness are sure signs of an exhausted meme.  They are last year’s fashion.

This is a shame, as they clearly once had a purpose in informing, inspiring and entertaining us. In an attempt to revive the genre, I’ve taken the trend to its logical conclusion: the tech trend Haiku. 

Surveillance culture
Watches your clicks and your votes.
— Learn to embrace it.

The Quantified Self
Takes the means of surveillance
Back from government.

Technology and
Fashion allow me to find
My socks. Wherables.

The revolution
Will be tweeted on an app
You’ve never heard of.

"Drones on leashes shoot
Aerial photos" — creepy.
Drone on, drone, drone on …

All things great and small
Will have unique addresses:
Internet of things.

New studies show tech
Cripples attention span and

 

A 3-D printer
Printed itself from old parts.
The circle of life.

Reality augmented
Through tinted glasses. Only
Virtually real.

Self-driving cars are
A placeholder for our hearts’
desire: flying cars.

The Open Office and Panopticism

open office plan

The magazine Fast Company has recently been on a tear critiquing the modern “open office” design ubiquitous in white collar businesses.  Several studies have found that marginal improvements in communication are offset by stress and productivity loss due to noise and lack of privacy.  Satisfaction levels for people who work in offices with doors that close are significantly higher.

How did we get to this place?  Open office plans arose sometime in the late 90’s as a response to the jokes about cubicle culture and densification which dehumanized the office worker while squeezing every  square footage out of usable office space. Open plans were intended to be more humanizing and to encourage social interactions, bringing the serendipity of water cooler conversation to the worker’s desk simply by lowering the height of cubicle walls and introducing a few plants.

Cubicles, in their turn, were also once seen as a humanizing and egalitarian effort.  Instead of low-valued employees being doubled or tripled up in fluorescent-lighted rooms while high-valued employees got more desirable windowed private offices, cubicles broke down the divide and gave more or less the same amount of space to middle managers as well as the people under them (corner offices still go to executives).  Moreover, to the extent that metaphors make up the furniture of our minds, we collectively moved away from the notion of smoky closed rooms as the space where decisions were made and generally redesigned our workspaces to emphasize transparency and equality.

This general trend towards greater and greater openness is captured in the name: “open office”.  Like some dystopic novel or Orwellian word game, we have somehow been placed in a position of seeking out and realizing our own discontent.  With only a little exaggeration, it resembles Michel Foucault’s notion of fascism as a force the leads us “to desire the very thing that dominates and exploits us.”  Fortunately for us, we’re only talking here about furniture fascism and it’s only middle- and upper middle-class white collar workers who are standing in for the exploited masses.

Even office workers have the right to have Foucault speak for them, however.  Were Foucault to perform a genealogical \ archeological analysis of the problematic of the contemporary open plan office, it might go something like this:

The initial move involved a misdirection concerned with repression.  Middle managers were seen as repressing their employees with a feudal style architecture that crowded office workers into shared spaces while they were allowed the luxury of having their own space.  Because of the preponderance of this repressive hypothesis, the ur-father from Freud’s Civilization and Its Discontents, now embodied in the middle-manager, could only be brought down by giving everyone her own version of the manager’s office: the modern cubicle.

There are two sides to these sorts of power dynamics, though.  On their side, managers were driven to the new office plans by their own bad conscience and desire not to be seen as authoritarian figures – they, as much as anyone else, bought into the repressive hypothesis.  On the other hand, bureaucratic movement requires expediency and expertise to justify change – this was provided by consultants more than happy to explain the cost-cutting that would be afforded by replacing office walls with removable cubicle walls.  On top of this, they touted the benefits of being able to put up new cubicles or remove old ones in response to fluctuations in the workforce.

Dilbert

The argument from economic necessity led to something Scott Adams, the creator of Dilbert, identified as “densification.”  Over time and as if by a natural law, cubicles became increasingly smaller.  Because the change was gradual it was difficult to notice.  Nevertheless, the cost savings produced by “densification” – a cost savings eerily reminiscent of Marx’s analysis of surplus value – could be touted each quarter as middle managers and executives justified their own value to the company. 

When employees began to complain more regularly about densification as they stood around the water cooler, it was quickly observed that through a trompe l’oeil.  The gradual densification could no longer be plausibly denied once cubicle walls had reached the point where they were taller than they were wide.  This awareness of densification, it was discovered, could be resolved by simply making the walls shorter and consequently making the perspectival distortion caused by densification less obvious.  All one had to do then was bring in a few architects to pretty things up and provide an aesthetic explanation for the changes.

Hence was born the movement toward greater openness and collaboration – as well as the eventual removal of water coolers.  As by products of this transition, we also saw the introduction of headphones into the workplace, the rise of music players, the increase in the fortunes of Apple, the proliferation of online music streaming services and eventually the necessity of workplace broadband, now considered in some circles a human right,  to pump all this music into our headphones to drown out the conversations of our neighbors in the open office.

What caused all this to happen?  Recall that for Foucault the repressive hypothesis is at best false and at worse a misdirection.  Management did not get together and plan out a way to decrease productivity in exchange for less expensive office space – all while convincing workers that the workers were getting one over on management by being allowed to spend more time talking and avoiding hearing other people talking rather than working.

orderly rows

Instead Foucault identifies a general trend toward scientific regularity and the privileging of visual metaphors he identifies as the “empire of the gaze” and, eventually, “panopticism”.  Let’s try to make this plausible and show how it is relevant to the rise of the open office.

In his book Discipline and Punish, Foucault introduces the notion that modern civilization, built on firm scientific principles, has had regulation and observation built into it on a cultural level.  As an example, he cites the development of geometrical plans for the laying out of military camps starting in the 17th century.  Military manuals from that time spell out explicitly how camps were to be laid out, how far tents needed to be from one another, how high they must be, etc.  The goal of these standardized layouts was to make the entire camp visible and an easy object of surveillance from a given point of view.  More importantly, soldiers were made to know, by the layout of the camps that they themselves built, that their conduct was being observed by their superiors and that they needed to fall in line, so to speak.

“For a long time this model of the camp, or at least its underlying principle, was found in urban development, in the construction of working-class housing estates, hospitals, asylums, prisons, schools: the spatial ‘nesting’ of hierarchized surveillance … The camp was to the rather shameful art of surveillance what the dark room was to the great science of optics.

“A whole problematic then develops: that of an architecture that is no longer built simply to be seen (as with the ostentation of palaces), or to observe  the external space (cf. the geometry of fortresses), but to permit an internal, articulated and detailed control – to render visible those who are inside it; in more general terms, an architecture that would operate to transform individuals: to act on those it shelters, to provide a hold on their conduct, to carry the effects of power right to them, to make it possible to know them, to alter them.”

The fault in each of these geometries is the point of view required to perform surveillance.  It is a weakness in the system that constantly draws attention to itself as the observer.  When a soldier in the camp knows who is observing him – that is, whose opinion matters most – he can choose to be obsequious to his officer, to buddy up to his officer, to flatter him, to bribe him, and in other ways undermine the surveillance culture that is being developed.  In this sort of scenario, the soldier merely has to “act” as if he is behaving and only when he thinks someone is watching; whereas the true goal of a surveillance culture is to mold people to behave well all the time and to do this sincerely rather merely as an act.

panopticon

Foucault finds the architectural fulfillment of this managerial vision in something known as the Panopticon.  The Panopticon is a concept for a prison designed by Jeremy Bentham, the father of utilitarianism.  The idea behind it was to have a prison designed in a ring so that every prisoner was constantly being observed by other prisoners.  Additionally, there was a tower in the center of the ring that provided the only privacy available in the prison layout.  The tower housed guards, but inmates could never be sure how many were watching them at any time.  What is important in the design is that prisoners always feel as if they are being watched.  Under constant surveillance of this sort, it was hoped, would cause prisoners to behave morally and hence undergo rehabilitation through self-discipline as well as punishment.  The Panopticon would put them on their best behavior.

How does this apply to the open office?  Just as there are design patterns in architecture – patterns that repeat themselves to the point that technicians can use them as guides for architectural design – there are also patterns in civilization.  These patterns mark epochs in culture. Thomas Kuhn, when discussing scientific revolutions, called them “paradigms” – from which we get the overused term “paradigm shift” that, technically, describes the transitions between scientific epochs.

For Foucault, the cultural epoch we are currently living through is ultimately one guided by the notion of surveillance.  Surveillance patterns inform our managerial practices as well as our modes of self-governance as a nation, our architecture as well as how we do interior decorating, our city planning as well as how we raise our children.  Surveillance entertainment, more commonly known as “reality television”, is a media staple.  And of course, surveillance design patterns inform our office spaces.

In discussing living in a surveillance society, in this particular time and place, it feels overly heavy handed to even link to articles about Edward Snowden, WikiLeaks, NSA spying or project PRISM.   These are the design patterns of a world we have simply learned to accept as a matter of course.  It is worth reflecting, however, that Foucault worked through his insights on surveillance and panopticism in the 60’s and 70’s; Discipline and Punish, in which he laid out these observations, was published in 1975.

The picture at the top of this post is of the office I work in.  It is an open office plan.  There happen to be offices with doors for managers.  Their office walls, however, as well as their doors are made of glass.  This allows management to more easily observe us, just as it allows us to more easily watch management.  It is the fulfillment of panopticism because it has no area for guards whatsoever – everyone inhabits the empire of the gaze.

The greatest office design innovation here at work are the two tiny rooms designated for nursing mothers.  They are the most used spaces – not because we have that many nursing mothers but rather because they are the only places in the office where people can hide.  This requires correction.

Quick Reference: Kinect 1 vs Kinect 2

 

This information is preliminary as Kinect for Windows SDK 2.0 has not been released in final form and some of this may change.  Some things, such as no tilt motor and supported USB standards, are probably impossible to change.

Feature Kinect for Windows 1 Kinect for Windows 2
Color Camera 640 x 480 @30 fps 1920 x 1080 @30 fps
Depth Camera 320 x 240 512 x 424
Max Depth Distance ~4.5 M 8 M
Min Depth Distance 40 cm in near mode 50 cm
Depth Horizontal Field of View 57 degrees 70 degrees
Depth Vertical Field of View 43 degrees 60 degrees
Tilt Motor yes no
Skeleton Joints Defined 20 joints 25 joints
Full Skeletons Tracked 2 6
USB Standard 2.0 3.0
Supported OS Win 7, Win 8 Win 8
Price $249 $199