Package org.openni

Class CoordinateConverter

java.lang.Object
org.openni.CoordinateConverter

public class CoordinateConverter extends Object
The CoordinateConverter class converts points between the different coordinate systems. Depth and World coordinate systems OpenNI applications commonly use two different coordinate systems to represent depth. These two systems are referred to as Depth and World representation. Depth coordinates are the native data representation. In this system, the frame is a map (two dimensional array), and each pixel is assigned a depth value. This depth value represents the distance between the camera plane and whatever object is in the given pixel. The X and Y coordinates are simply the location in the map, where the origin is the top-left corner of the field of view. World coordinates superimpose a more familiar 3D Cartesian coordinate system on the world, with the camera lens at the origin. In this system, every point is specified by 3 points -- x, y and z. The x axis of this system is along a line that passes through the infrared projector and CMOS imager of the camera. The y axis is parallel to the front face of the camera, and perpendicular to the x axis (it will also be perpendicular to the ground if the camera is upright and level). The z axis runs into the scene, perpendicular to both the x and y axis. From the perspective of the camera, an object moving from left to right is moving along the increasing x axis. An object moving up is moving along the increasing y axis, and an object moving away from the camera is moving along the increasing z axis. Mathematically, the Depth coordinate system is the projection of the scene on the CMOS. If the sensor's angular field of view and resolution are known, then an angular size can be calculated for each pixel. This is how the conversion algorithms work. The dependence of this calculation on FoV and resolution is the reason that a VideoStream object must be provided to these functions. The VideoStream object is used to determine parameters for the specific points to be converted. Since Depth coordinates are a projective, the apparent size of objects in depth coordinates (measured in pixels) will increase as an object moves closer to the sensor. The size of objects in the World coordinate system is independent of distance from the sensor. Note that converting from Depth to World coordinates is relatively expensive computationally. It is generally not practical to convert the entire raw depth map to World coordinates. A better approach is to have your computer vision algorithm work in Depth coordinates for as long as possible, and only converting a few specific points to World coordinates right before output. Note that when converting from Depth to World or vice versa, the Z value remains the same.
  • Constructor Details

    • CoordinateConverter

      public CoordinateConverter()
  • Method Details

    • convertWorldToDepthInt

      public static Point3D<Integer> convertWorldToDepthInt(VideoStream depthStream, float worldX, float worldY, float worldZ)
      Converts a single point from the World coordinate system to the Depth coordinate system.
      Parameters:
      depthStream - Reference to an openni::VideoStream that will be used to determine the format of the Depth coordinates
      worldX - The X coordinate of the point to be converted, measured in millimeters in World coordinates
      worldY - The Y coordinate of the point to be converted, measured in millimeters in World coordinates
      worldZ - The Z coordinate of the point to be converted, measured in millimeters in World coordinates
      Returns:
      Point3D Coordinate of the output value, and depth measured in the PixelFormat of depthStream
    • convertWorldToDepthFloat

      public static Point3D<Float> convertWorldToDepthFloat(VideoStream depthStream, float worldX, float worldY, float worldZ)
      Converts a single point from the World coordinate system to a floating point representation of the Depth coordinate system
      Parameters:
      depthStream - Reference to an openni::VideoStream that will be used to determine the format of the Depth coordinates
      worldX - The X coordinate of the point to be converted, measured in millimeters in World coordinates
      worldY - The Y coordinate of the point to be converted, measured in millimeters in World coordinates
      worldZ - The Z coordinate of the point to be converted, measured in millimeters in World coordinates
      Returns:
      Point3DPoint to a place to store: the X coordinate of the output value, measured in pixels with 0.0 at far left of the image

      the Y coordinate of the output value, measured in pixels with 0.0 at the top of the image

      the Z(depth) coordinate of the output value, measured in millimeters with 0.0 at the camera lens

    • convertDepthToWorld

      public static Point3D<Float> convertDepthToWorld(VideoStream depthStream, int depthX, int depthY, short depthZ)
      Converts a single point from the Depth coordinate system to the World coordinate system.
      Parameters:
      depthStream - Reference to an VideoStream that will be used to determine the format of the Depth coordinates
      depthX - The X coordinate of the point to be converted, measured in pixels with 0 at the far left of the image
      depthY - The Y coordinate of the point to be converted, measured in pixels with 0 at the top of the image
      depthZ - the Z(depth) coordinate of the point to be converted, measured in the PixelFormat of depthStream
      Returns:
      Point3D to a place to store the X,Y,Z coordinate of the output value, measured in millimeters in World coordinates
    • convertDepthToWorld

      public static Point3D<Float> convertDepthToWorld(VideoStream depthStream, float depthX, float depthY, float depthZ)
      Converts a single point from a floating point representation of the Depth coordinate system to the World coordinate system.
      Parameters:
      depthStream - Reference to an openni::VideoStream that will be used to determine the format of the Depth coordinates
      depthX - The X coordinate of the point to be converted, measured in pixels with 0.0 at the far left of the image
      depthY - The Y coordinate of the point to be converted, measured in pixels with 0.0 at the top of the image
      depthZ - Z(depth) coordinate of the point to be converted, measured in the PixelFormatof depthStream
      Returns:
      Point3D to a place to store the X coordinate of the output value, measured in millimeters in World coordinates
    • convertDepthToColor

      public static Point2D<Integer> convertDepthToColor(VideoStream depthStream, VideoStream colorStream, int depthX, int depthY, short depthZ)
      For a given depth point, provides the coordinates of the corresponding color value. Useful for superimposing the depth and color images. This operation is the same as turning on registration, but is performed on a single pixel rather than the whole image.
      Parameters:
      depthStream - Reference to a openni::VideoStream that produced the depth value
      colorStream - Reference to a openni::VideoStream that we want to find the appropriate color pixel in
      depthX - value of the depth point, given in Depth coordinates and measured in pixels
      depthY - value of the depth point, given in Depth coordinates and measured in pixels
      depthZ - value of the depth point, given in the PixelFormat of depthStream
      Returns:
      The Point2D with X,Y coordinate of the color pixel that overlaps the given depth pixel, measured in pixels