In August I purchased and reviewed the Microsoft Touch Mouse. I still use my Microsoft Arc Mouse more than the touch, initially due to what I felt was dodgy scrolling performance on the Touch Mouse, as I mentioned in my review. Still, I've kept it in my backpack and I use the Touch Mouse perhaps a few times a month and have kept the software up to date in case there's some software changes made to improve performance.
八月份，我买了，审查了一下。Microsoft Touch Mouse 。 我还在用Microsoft Arc Mouse起初，我不认为触摸是因为Touch Mouse正如我在评论中提到的，上滚动功能不稳定。 尽管如此，我还是把它放在背包里，一个月可能用几次Touch Mouse，并将软件保持为最新版本，以防止一些软件更改以提高性能。
I can happily say that they've changed something and the scrolling performance is WAY better. I can finally get 1 to 2 pixel precision with it while scrolling in my browsers. The other nice feature is the "three finger swipe up" which gives you effectively a Windows version of the Mac Expose window switcher view.
我可以高兴地说，他们做到了一些滚动性能更好。 在浏览器中滚动时，最终可以达到1到2像素的精度。 另一个很好的功能是三向上滑动，可以有效地为您提供Windows版本的Mac Expose窗口切换器视图。
Today I noticed while catching up on Long Zheng's excellent blog that the Touch Mouse Sensor SDK is available for download. Per their site:
今天，当我在的时候Long Zheng在发送精彩博客信息时，请注意下载Touch Mouse Sensor SDK。 根据他们的网站：
"The Microsoft Touch Mouse supports multitouch gestures via an integrated sensor. The Touch Mouse Sensor API SDK is a small library intended to enable students and researchers to experiment directly with Touch Mouse sensor output.
“ Microsoft触摸鼠标通过集成传感器支持多点触摸手势。触摸鼠标传感器API SDK它是一个小库，旨在使学生和研究人员能够直接使用触摸鼠标传感器输出进行实验。
Using this SDK, you can create your own applications consuming the 13×15 sensor image. The SDK includes C# and C samples demonstrating how to read and manipulate sensor data"
使用此SDK，您可以使用13×15传感器图像创建自己的应用程序。 该SDK包含C＃和C 演示了如何读取和操作传感器数据。
OK, so what can we do with this thing? It comes with a number of samples to get the bitmap from the sensor and process it. It includes examples in both C# and C . Because I don't have C on this machine I got an error opening that solution, but you can just remove that project and still build the samples.
好吧，我们该怎么办？ 它有许多样本，可以从传感器中获取位图并进行处理。 它包括C＃和C 中的示例。 因为我的电脑上没有C ，因此，打开解决方案时出现错误，但您可以删除项目并仍然建立示例。
You don't need to do your work in a graphical application, although it's nice to visualize this data of course. First sample is a console app, that tells you were the center of mass of your big fat finger is.
虽然可视化数据当然很好，但你无需在图形应用程序中工作。 第一个例子是一个控制台应用程序，它告诉你大手指的重心在哪里。
The smarts are in the Microsoft.Research.TouchMouseSensor namespace. You implement a callback function that the mouse effectively calls whenever something interesting happens. It looks like this:
位于这些智能控件Microsoft.Research.TouchMouseSensor命名空间中。 只要有趣的事情发生，鼠标就会有效地调用回调函数。 看上去像这样：
/// <summary>/// Function receiving callback from mouse./// </summary>/// <param name="pTouchMouseStatus">Values indicating status of mouse.</param>/// <param name="pabImage">Bytes forming image, 13 rows of 15 columns.</param>/// <param name="dwImageSize">Size of image, assumed to always be 195 (13x15).</param>static void TouchMouseCallbackFunction(ref TOUCHMOUSESTATUS pTouchMouseStatus, byte[] pabImage, int dwImageSize){
...} As you can see, the image size is 13x15, always. You get the raw bytes that represent the image, 195 bytes long.
如你所见，图像大小总是13x15。 原始字节代表图像，长195个字节。
The first thing I was surprised to see was just HOW MUCH of the surface area of the mouse is covered and how high the resolution is. I was thinking, "13x15? That's so small, how could it tell me anything useful with such a limited structure? That's so small, how could it tell me anything useful with such a limited structure?" Well, that's how clueless I was.
我惊讶地发现，第一件事就是鼠标的表面积和分辨率有多高。 当时我在想：当时我在想：当时我在想：我在想：当时我在想：当时我在想： 13x15？太小了，它怎么能告诉我在这样有限的结构下有用的东西呢？ 那就是我的无知。
Of course, each of these bytes is giving a number between 0 and 255 so a lot of information can be extrapolated between two pixels with different values and you can get a pretty detailed picture of what's going on. How much? Well, before I move on to a graphical example,
当然，这些字节中的每个字节都给出了0到255之间的数字，所以很多信息可以在两个不同值的像素之间推断出来，并详细了解正在发生的事情。 多少？ 嗯，在继续介绍图形示例之前，
First, I'll output just te hex values with this code, then show what it looks like when I move my figures around the surface of the mouse.
首先，我将使用此代码仅输出十六进制值，然后显示将图形围绕鼠标表面移动时的外观。
Console.SetWindowSize(50,16);Console.SetCursorPosition(0, 0);StringBuilder sb = new StringBuilder(300);for (Int32 y = 0; y < pTouchMouseStatus.m_dwImageHeight; y++){
// Iterate over columns. for (Int32 x = 0; x < pTouchMouseStatus.m_dwImageWidth; x++) {
// Get the pixel value at current position. int pixel = pabImage[pTouchMouseStatus.m_dwImageWidth * y + x]; if (pixel > 0) sb.AppendFormat("#{0:X2}", pixel); else sb.Append(" "); } sb.Append("\n"); }Console.Write(sb.ToString());
Here's the result, animated.
这是动画的结果。
Cool. But what about with color? I could use the default Console stuff and set the colors, or I could get direct access to the Console, use the Win32 APIs and what not, but I could also use Tim Sneath's class that's on NuGet thanks to Anthony Mastrean! First, I'll "" to bring it in.
凉。 但是颜色呢？ 我可以使用默认的Console东西并设置颜色，或者我可以直接访问Console，使用Win32 API，但不能，但是我也可以使用Tim Sneath在NuGet上的类，这要归功于Anthony Mastrean ！ 首先，我将“ ”将其引入。
How about a mouse touch with color? I thought about building a whole "find closest color" map and trying to map 255 different colors, but then I just did this.
带有颜色的鼠标触摸怎么样？ 我考虑过要构建一个完整的“查找最接近的颜色”贴图，并尝试绘制255种不同的颜色，但是后来我做到了。
if (pixel > 230) Console.BackgroundColor = ConsoleColor.Red;else if (pixel > 128) Console.BackgroundColor = ConsoleColor.Yellow;else if (pixel > 90) Console.BackgroundColor = ConsoleColor.Green;else if (pixel > 45) Console.BackgroundColor = ConsoleColor.Blue;else if(pixel > 15) Console.BackgroundColor = ConsoleColor.DarkBlue;else Console.BackgroundColor = ConsoleColor.Black;ConsoleEx.WriteAt(x*2, y, " ");
And the result is this:
结果是这样的：
You can do the same thing in WPF, of course, with better bitmap support, but seriously, with a Console-based heatmap, who needs graphics? ;)
当然，在WPF中，您可以通过更好的位图支持来执行相同的操作，但实际上，使用基于控制台的热图，谁需要图形？ ;)
OK, fine, here's the sample code that takes the results of the TouchMouseSensorEventArgs and creates a grayscale image.
好的，这是示例代码，该示例代码获取TouchMouseSensorEventArgs的结果并创建灰度图像。
void TouchMouseSensorHandler(object sender, TouchMouseSensorEventArgs e){
// We're in a thread belonging to the mouse, not the user interface // thread. Need to dispatch to the user interface thread. Dispatcher.Invoke((Action<TouchMouseSensorEventArgs>)SetSource, e);}void SetSource(TouchMouseSensorEventArgs e){
// Convert bitmap from memory to graphic form. BitmapSource source = BitmapSource.Create(e.Status.m_dwImageWidth, e.Status.m_dwImageHeight, 105, 96, PixelFormats.Gray8, null, e.Image, e.Status.m_dwImageWidth); // Show bitmap in user interface. SensorImage.Source = source;}
And the result:
结果：
One way to look at this is as if the surface of the mouse is a tiny Xbox Kinect. What kinds of gestures could I recognize and hook up to do stuff? Control WIndows, do custom stuff inside my application, browser, or whatever. Any ideas?
一种查看方式是，鼠标的表面好像是一个很小的Xbox Kinect。 我可以识别出哪些手势并进行操作？ 控制窗口，在我的应用程序，浏览器或其他任何东西中执行自定义操作。 有任何想法吗？
The downloads are here:
下载在这里：
Enjoy!
请享用！
翻译自: https://www.hanselman.com/blog/abusing-the-microsoft-researchs-touch-mouse-sensor-api-sdk-with-a-consolebased-heatmap