Robotics Basics: From Measurements to Motion

3 minute read

Published:

TL;DR: A robot closes a loop between measurements and physical action. Geometry describes where it can move; sensing estimates what is happening; planning chooses a desired motion; control applies commands and reacts to feedback. Learning can improve individual parts of this loop or provide a policy spanning several of them.

Start with one ordinary task

Intuition first. Ask an arm to pick up a cup. “Pick it up” is a task description. The hardware needs commands such as joint-position targets, velocities, or torques. Between those two levels lie questions about where the cup is, how to reach it, and whether the fingers have actually made contact.

A successful system must connect the meanings of those commands to measurements from the real robot. A neural network does not remove that requirement.

Measurements and commands form a feedback loopPhysical motion produces new measurements. The next command can correct the difference between predicted and observed behaviour. Sense and estimatePlan and controlAct and observe
Physical motion produces new measurements. The next command can correct the difference between predicted and observed behaviour.

The minimum vocabulary

TermMeaningExample
ConfigurationCoordinates describing the robot’s arrangementJoint angles \(q\)
StateInformation needed to model its evolutionPositions and velocities
ObservationSensor information available to the systemImages and encoder readings
PosePosition and orientation relative to a frameGripper pose in the base frame
TrajectoryDesired motion with timingA gripper path traversed in two seconds
Control inputCommand acting on the systemJoint torque or velocity target

A path specifies geometric motion without necessarily specifying when each point is reached. A trajectory adds timing. A control law uses the current information to produce commands. The Modern Robotics course develops these distinctions.

A minimal mathematical model

A discrete-time description is

\[ \begin{aligned} x_{t+1}&=f(x_t,u_t,w_t),\\ y_t&=h(x_t,v_t). \end{aligned} \]

Here \(x_t\) is physical state, \(u_t\) the input, \(y_t\) the measurement, and \(w_t,v_t\) represent disturbances and measurement noise. A controller acts on measurements or an estimated state, not necessarily on the exact \(x_t\) used by a simulator.

Worked example: an action needs units and a duration

Suppose a one-dimensional robot is at 0.40 metres and receives a velocity command of 0.10 metres per second for 0.20 seconds. Under an ideal constant-velocity model,

\[ p_{t+1}=p_t+u_t\Delta t =0.40+0.10(0.20)=0.42\;\mathrm m. \]

The number 0.10 would mean something entirely different if the interface expected a position target in metres. A policy can output numerically plausible values and still be incompatible with the controller receiving them.

The ideal model also ignores acceleration and disturbances. A fresh measurement tells the system whether the expected displacement actually occurred.

Where learning enters

A learned perception model can estimate cup pose from an image. A learned dynamics model can predict consequences of candidate commands. A policy can imitate demonstrated actions or improve through reward feedback. These choices place learning at different interfaces; none is automatically required for every component.

For example, a learned policy might provide joint targets at a lower frequency while a conventional feedback controller tracks them more frequently. Evaluate both the high-level decisions and the tracking behaviour.

Read the foundations before the paper chapters

  1. Kinematics and frames: relate joints to gripper motion.
  2. Sensors and state estimation: turn imperfect measurements into useful information.
  3. Dynamics and feedback: understand how commands produce and correct motion.
  4. Robot-learning basics: compare demonstrations, rewards, and learned models.

These prepare learned MPC, residual RL, rapid motor adaptation, and ACT.

Key Insight: Robot learning works through physical interfaces. Frames, units, timing, feedback, and action meanings are part of the model specification.

References

  1. Lynch, K. M., & Park, F. C. Modern Robotics: course and book resources.
  2. Tedrake, R. Underactuated Robotics: Introduction.