Robot Sensing: Measurements, Noise, and State Estimates

3 minute read

Published:

TL;DR: Sensors provide measurements, not a complete physical state. State estimation combines measurements with a motion model and uncertainty assumptions. Calibration, coordinate frames, and timestamps determine whether the quantities being combined are actually comparable.

Different sensors answer different questions

Intuition first. An arm’s encoders report joint positions, but they do not directly say whether a cup has slipped. A camera may reveal the cup’s position while missing an occluded contact. Combining sensors is useful when their information complements one another.

SensorTypical measurementA limitation to remember
Joint encoderJoint position or rotationDoes not directly locate external objects
CameraImage intensity and colourOcclusion and projection hide information
LiDARRange along measured raysRange data still needs a frame and association
IMUAngular rate and specific forceBias and integration can cause drift
Force/torque sensorLoad at the sensorInterpretation depends on mounting and contact

An accelerometer measures specific force; recovering world-frame acceleration requires accounting for orientation and gravity. Merely integrating its raw readings twice is not a general position estimator.

Prediction and correction

A motion model predicts a state estimate forward. A new measurement supplies evidence for a correction. In a scalar linear example with measurement \(z=x+v\) and zero-mean noise, let \(\hat x^-\) be the prior estimate, \(P^-\) its error variance, and \(R\) the measurement-noise variance. The Kalman update is

\[ \begin{aligned} K&=\frac{P^-}{P^-+R},\\ \hat x^+&=\hat x^-+K(z-\hat x^-),\\ P^+&=(1-K)P^-. \end{aligned} \]

These expressions assume the prior error and measurement noise are uncorrelated, with the stated linear measurement model. Gaussian assumptions make the update an exact posterior mean and variance. Kalman-filter course notes.

Combine a prediction with a measurementThe residual compares the measurement with its prediction. Uncertainty controls how much of that residual changes the estimate. Prior estimateMeasurement residualCorrected estimate
The residual compares the measurement with its prediction. Uncertainty controls how much of that residual changes the estimate.

Worked example: uncertainty determines the weight

Suppose the predicted position is \(\hat x^-=1.0\) metre with variance \(P^-=0.04\;\mathrm{m}^2\). A sensor reports \(z=1.3\) metres with noise variance \(R=0.09\;\mathrm{m}^2\). Then

\[ \begin{aligned} K&=0.04/(0.04+0.09)\approx0.3077,\\ \hat x^+&=1.0+0.3077(0.3)\approx1.0923\;\mathrm m,\\ P^+&\approx0.0277\;\mathrm{m}^2. \end{aligned} \]

The correction favours the prior because its stated variance is smaller. The posterior standard deviation is approximately \(\sqrt{0.0277}=0.1664\) metres; variance and standard deviation have different units.

If the measurement variance were 0.01 instead, the gain would be 0.8 and the estimate 1.24 metres. More confidence in the measurement leads to a larger correction.

The assumptions can fail before the arithmetic does

Suppose two estimates both reuse the same camera detection. Treating them as independent evidence can count the same information twice and produce excessive confidence. Likewise, an unknown constant sensor bias is not explained by a zero-mean noise model merely because a variance was supplied.

Timing matters too. At 0.5 metres per second, a 0.1-second delay corresponds to 0.05 metres of motion. Combining the old position with a current joint reading without alignment describes a scene that may never have existed.

Calibration supplies the mapping between sensor units and geometry. A correct estimator using a wrong camera-to-base transform can confidently report the wrong location. The robot_localization sensor-data guide gives concrete examples of frame, sign, and covariance conventions.

Key Insight: Sensor fusion improves an estimate when its models and uncertainty assumptions describe the evidence. More measurements do not automatically mean more independent or better information.

Next, feedback control uses the estimate to correct motion. Rapid motor adaptation learns information about hidden dynamics from recent interaction history.

References

  1. Welch, G., & Bishop, G. An Introduction to the Kalman Filter: SIGGRAPH course notes.
  2. robot_localization maintainers. Preparing sensor data.