forked from microsoft/Windows-universal-samples
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Windows 10 Anniversary Update - August 2016 Update 5
- Loading branch information
Showing
32 changed files
with
2,838 additions
and
48 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,88 @@ | ||
<!--- | ||
category: AudioVideoAndCamera | ||
samplefwlink: http://go.microsoft.com/fwlink/p/?LinkId=825745 | ||
---> | ||
|
||
# Camera stream correlation sample | ||
|
||
This sample shows how to use spatially correlated color and depth cameras and the depth frames | ||
to map image pixels from one camera to another using a [DepthCorrelatedCoordinateMapper] | ||
(https://msdn.microsoft.com/library/windows/apps/windows.media.devices.core.depthcorrelatedcoordinatemapper.aspx), | ||
as well as decoding a vendor-specific media frame layout with a [BufferMediaFrame] | ||
(https://msdn.microsoft.com/library/windows/apps/Windows.Media.Capture.Frames.BufferMediaFrame.aspx). | ||
|
||
This sample demonstrates how to: | ||
|
||
- Find cameras which support color, depth and pose tracking respectively. | ||
- Create FrameReaders and read frames from multiple sources concurrently. | ||
- Map depth camera's pixels onto correlated color camera. | ||
- Process color and depth frames pixel by pixel to produce a background removal effect. | ||
- Detect if a vendor-specific camera source exist using a vendor-specific sub type. In this sample, we look for a pose tracking stream. | ||
- How to use vendor-specific buffer layout to decode a 1D BufferMediaFrame. | ||
- Overlay skeletal tracking points to color camera coodinate system. | ||
|
||
### Correlation of multiple capture sources | ||
|
||
Use the DepthCorrelatedCoordinateMapper class to map depth space pixels to color | ||
space pixels. | ||
|
||
Use the camera intrinsics of the color camera to project skeletal | ||
tracking points on top of the color image. | ||
|
||
### 1D camera frame with BufferMediaFrame | ||
|
||
With new BufferMediaFrame in media capture APIs, cameras can also support 1D media frame format. | ||
Using the "Perception" major media type and a vendor's custom sub media type, a camera | ||
in this sample can expose a PoseTrackingFrame and the app can overlay skeletal tracking points. | ||
|
||
###Vendor specific media frame format | ||
|
||
This sample also demonstrate how camera vendors can use a WinRT library to wrap vendor-specific | ||
camera frame layout into WinRT class so that apps can easily consume the vendor specific data | ||
with same coding patterns as Windows APIs. | ||
|
||
**Note** The Windows universal samples for Windows 10 require Visual Studio 2015 Update 2 | ||
and Windows SDK version 14393 or above to build. | ||
|
||
To obtain information about Windows 10 development, go to the [Windows Dev Center](https://dev.windows.com). | ||
|
||
## See also | ||
|
||
### Samples | ||
|
||
[CameraFrames](/Samples/CameraFrames) | ||
|
||
### Reference | ||
|
||
[Windows.Media.Capture.Frames namespace](https://msdn.microsoft.com/library/windows/apps/windows.media.capture.frames.aspx) | ||
|
||
[Windows.Media.Devices.Core.DepthCorrelatedCoordinateMapper](https://msdn.microsoft.com/library/windows/apps/windows.media.devices.core.depthcorrelatedcoordinatemapper.aspx) | ||
|
||
[Windows.Media.Devices.Core.CameraIntrinsics](https://msdn.microsoft.com/library/windows/apps/windows.media.devices.core.cameraintrinsics.aspx) | ||
|
||
## System requirements | ||
|
||
**Client:** Windows 10 build 14393 | ||
|
||
**Camera:** Correlated color and depth camera (For example a Kinect V2 sensor) | ||
|
||
## Build the sample | ||
|
||
1. If you download the samples ZIP, be sure to unzip the entire archive, not just the folder with | ||
the sample you want to build. | ||
2. Start Microsoft Visual Studio 2015 and select **File** \> **Open** \> **Project/Solution**. | ||
3. Starting in the folder where you unzipped the samples, go to the Samples subfolder, then the | ||
subfolder for this specific sample, then the subfolder for your preferred language (C++, C#, or | ||
JavaScript). Double-click the Visual Studio 2015 Solution (.sln) file. | ||
4. Press Ctrl+Shift+B, or select **Build** \> **Build Solution**. | ||
|
||
## Run the sample | ||
|
||
The next steps depend on whether you just want to deploy the sample or you want to both deploy and | ||
run it. | ||
|
||
### Deploying and running the sample | ||
|
||
- To debug the sample and then run it, follow the steps listed above to connect your | ||
developer-unlocked Microsoft HoloLens, then press F5 or select **Debug** \> **Start Debugging**. | ||
To run the sample without debugging, press Ctrl+F5 or select **Debug** \> **Start Without Debugging**. |
54 changes: 54 additions & 0 deletions
54
Samples/CameraStreamCorrelation/cpp/CameraStreamCorrelation.sln
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,54 @@ | ||
|
||
Microsoft Visual Studio Solution File, Format Version 12.00 | ||
# Visual Studio 14 | ||
VisualStudioVersion = 14.0.25420.1 | ||
MinimumVisualStudioVersion = 10.0.40219.1 | ||
Project("{8BC9CEB8-8B4A-11D0-8D11-00A0C91BC942}") = "CameraStreamCorrelation", "CameraStreamCorrelation.vcxproj", "{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}" | ||
EndProject | ||
Project("{8BC9CEB8-8B4A-11D0-8D11-00A0C91BC942}") = "PoseTrackingPreview", "PoseTrackingPreview\PoseTrackingPreview.vcxproj", "{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}" | ||
EndProject | ||
Global | ||
GlobalSection(SolutionConfigurationPlatforms) = preSolution | ||
Debug|ARM = Debug|ARM | ||
Debug|x64 = Debug|x64 | ||
Debug|x86 = Debug|x86 | ||
Release|ARM = Release|ARM | ||
Release|x64 = Release|x64 | ||
Release|x86 = Release|x86 | ||
EndGlobalSection | ||
GlobalSection(ProjectConfigurationPlatforms) = postSolution | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|ARM.ActiveCfg = Debug|ARM | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|ARM.Build.0 = Debug|ARM | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|ARM.Deploy.0 = Debug|ARM | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|x64.ActiveCfg = Debug|x64 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|x64.Build.0 = Debug|x64 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|x64.Deploy.0 = Debug|x64 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|x86.ActiveCfg = Debug|Win32 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|x86.Build.0 = Debug|Win32 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Debug|x86.Deploy.0 = Debug|Win32 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|ARM.ActiveCfg = Release|ARM | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|ARM.Build.0 = Release|ARM | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|ARM.Deploy.0 = Release|ARM | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|x64.ActiveCfg = Release|x64 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|x64.Build.0 = Release|x64 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|x64.Deploy.0 = Release|x64 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|x86.ActiveCfg = Release|Win32 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|x86.Build.0 = Release|Win32 | ||
{F710B9FD-4E6B-42D7-A99A-6D48888D48B0}.Release|x86.Deploy.0 = Release|Win32 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Debug|ARM.ActiveCfg = Debug|ARM | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Debug|ARM.Build.0 = Debug|ARM | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Debug|x64.ActiveCfg = Debug|x64 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Debug|x64.Build.0 = Debug|x64 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Debug|x86.ActiveCfg = Debug|Win32 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Debug|x86.Build.0 = Debug|Win32 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Release|ARM.ActiveCfg = Release|ARM | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Release|ARM.Build.0 = Release|ARM | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Release|x64.ActiveCfg = Release|x64 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Release|x64.Build.0 = Release|x64 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Release|x86.ActiveCfg = Release|Win32 | ||
{67B5157A-25B1-4EC3-98CF-50E1B9177DB4}.Release|x86.Build.0 = Release|Win32 | ||
EndGlobalSection | ||
GlobalSection(SolutionProperties) = preSolution | ||
HideSolutionNode = FALSE | ||
EndGlobalSection | ||
EndGlobal |
Oops, something went wrong.