CNC Marble Machining

CNC Calibration and Accuracy — A Laser Interferometer Guide

✍️ USEL Engineering📅 01 May 20266 min read

A CNC machine can offer ±0.05 mm accuracy when it is first delivered — but over the years that figure falls away through mechanical wear and thermal deformation. Without regular calibration, accuracy can drift out to ±0.3 mm within two or three years. This guide explains what calibration is, why it matters and how it is done.

CNC Accuracy — The Concepts

  • POSITIONING ACCURACY — how closely the machine physically reaches the commanded coordinate
  • REPEATABILITY — how consistently it returns to the same place when the same coordinate is called 10 or more times
  • BACKLASH (lost motion) — the mechanical slack as an axis reverses direction
  • GEOMETRIC ERROR — the deviation in squareness measured between axes
  • THERMAL DEFORMATION — dimensional change caused by temperature change
  • PITCH ERROR — the lead error of the ball screw (a linear error)

What Is a Laser Interferometer?

A laser interferometer is an instrument that uses the wavelength of light to measure distance to nanometre accuracy. The beam of a Helium-Neon laser (633 nm) is stable at the atomic level. The makers are Renishaw XL-80, Keysight 5530 and API XD Laser. It is the gold standard of CNC calibration.

  • Accuracy: ±0.5 ppm (0.5 micron over a metre)
  • Measuring range: 0-80 m
  • Temperature and humidity compensation (via sensors)
  • Measures linear position, angular error, squareness and straightness
  • Connects to a computer — automatic data capture plus reporting

The Calibration Process — 6 Steps

  1. Preparation — after the machine has been warmed up for 2 hours (thermal equilibrium)
  2. Mounting the laser and reflector — positioned on the axis
  3. Linear position measurement — the axis moves to 10-20 points and the laser reads the true position at each one
  4. Backlash measurement — the lost motion observed at the point of reversal
  5. Geometric error measurement — angular calibration, squareness, straightness
  6. The results report — an error map plus compensation parameters (loaded into the CNC control)

Compensation in the CNC Control

The error map produced by the laser measurement is loaded into the CNC control (TEX, Fagor, Siemens and so on). From then on the machine corrects itself automatically as it executes commands:

  • PITCH COMPENSATION — corrects the lead error of the ball screw
  • BACKLASH COMPENSATION — takes up the slack on a reversal
  • THERMAL COMPENSATION — dynamic correction from a temperature sensor
  • GEOMETRIC COMPENSATION — corrects the squareness of the axes
  • The result: ±0.3 mm of deviation → ±0.05 mm repeatability
What Calibration Achieves
Thanks to annual laser calibration, even a machine that is 5-10 years old can be brought back to factory accuracy. It is the most economical way of protecting the investment.

Which Axis, Which Error?

AxisAccuracy TargetCommon Source of Error
X (long horizontal)±0.03 mm/mBridge slideways, ball screw pitch
Y (short horizontal)±0.03 mm/mTightness of the fixings, rack wear
Z (vertical)±0.02 mm/mGravitational deflection, the ball screw
A (tilt axis)±0.01°Gearbox backlash, pivot pin wear
C (head rotation)±0.005°Servo motor encoder error
Squareness (X-Y)±0.02 mm/mTable flatness, assembly

How Often to Calibrate

SituationRecommended Frequency
Commissioning a new machineBy the manufacturer — the initial calibration
Standard useAnnually
Heavy use (3 shifts)Every 6 months
After a collisionIMMEDIATELY — before any further work is set up
Spindle or axis replacementAfter the work is completed
A precision job has been taken onA check calibration before the job starts

Signs That Accuracy Is Falling

  • Irregular deviation in the dimensions of workpieces (more than ±0.2 mm)
  • A circular cut coming out "egg-shaped" (oval)
  • Noticeable deviation at corners (a visible error on a 90° angle)
  • The same part cut again comes out differently
  • Surface quality has fallen off for no explicable reason
  • Abnormal load fluctuation on the spindle motor

Workshop Standards — Temperature and Humidity

  • Ideal workshop temperature: 20-25°C, stable to ±2°C
  • A cold workshop (winter): the viscosity of the oil and hydraulics in the machine changes and errors grow
  • A hot workshop (summer): metal expands and axis positions drift
  • Thermal compensation → modern CNCs do this automatically (via sensors)
  • Humidity: 40-60% is ideal; too dry → static electricity, too damp → corrosion
  • An air-conditioned workshop is recommended for precision work and consistent quality all year round

Backlash — The Silent Error

Backlash is the slack an axis shows at the moment it reverses direction. It grows with mechanical wear in ball screws, gearboxes and rack and pinion drives.

  • On a new machine: 0.01-0.02 mm (acceptable)
  • After 1-2 years: 0.03-0.05 mm (corrected by annual calibration)
  • After 5 years or more: 0.08-0.15 mm (replacing the ball screw comes onto the agenda)
  • Badly worn: more than 0.15 mm (compensation is no longer enough, parts must be replaced)
  • CW and CCW motion in CAM (to the right and to the left) — backlash shows up most clearly at that point
  • Regular lubrication slows the growth of backlash

Verification After Calibration

After calibration a test piece is cut and measured:

  • Circle test — a tolerance of ±0.05 mm
  • Straight line test — ±0.03 mm of deviation over 1 m
  • Squareness test — ±0.02 mm/m at the corner
  • 5-axis position test — ±0.05 mm at a point of movement in space
  • Repeatability test — the same part 10 times, consistent to ±0.01 mm
  • Issuing the certificate — the workshop owner holds a traceability report
Frequently Asked Questions

COMMON
QUESTIONS

No — buy the calibration as a service. Accredited test bodies (registered with TÜRKAK in Türkiye) visit annually. Laser equipment is expensive and needs a specialist; doing it in-house is not economical.