Nautical Miles and Distance Calculation

061-01-04Pablo Asensio Martínez2026-04-014 min

In air navigation, distance is not just a linear measurement; it is a combination of spherical geometry, the movement of air masses, and time calculations. Below, we break down all the essential concepts needed to understand how distances are measured around the world.

1. The Shape of the Earth and the Basic Unit

Although for many calculations we assume the Earth is a perfect sphere, in reality it is an Oblate Spheroid (flattened at the poles). This means that the radius of curvature changes slightly:

  • A Nautical Mile (NM) is historically defined as the length of 1 minute of arc of a meridian.
  • Because of the flattening, a real nautical mile is slightly longer at the Poles (approx. 1862 m) and slightly shorter at the Equator (approx. 1844 m).
  • However, for standardization, ICAO defines the Nautical Mile as exactly 1,852 meters.

2. Navigating North to South (Latitude)

Parallels of latitude are lines that run East–West, but they are used to measure how far North or South we are. The distance between them is constant.

  • Golden Rule: 1 minute of latitude = 1 NM. Therefore, 1 degree of latitude = 60 NM.

  • Calculation: To find the distance between two points on the same meridian:

    • If they are in the same hemisphere, subtract the latitudes.
    • If they are in different hemispheres, add the latitudes.
    • Multiply the difference in degrees by 60 to obtain the distance in miles.

3. Navigating East to West (Departure)

This is where meridian convergence comes into play. Lines of longitude converge at the poles. Therefore, the physical distance of 1 degree of longitude varies depending on where you are. The actual distance traveled along a parallel is called Departure.

  • Formula: Departure (NM) = Change of Longitude (in minutes) × Cosine of Latitude.
  • The higher the latitude (closer to the pole), the shorter the distance for the same change in degrees.
  • On Lambert charts, although the distance in NM decreases with latitude, the “angular” distance (degrees of arc) remains constant.

Lambert Conformal Conic Projection

4. Nautical Air Miles (NAM) vs. Nautical Ground Miles (NGM)

An aircraft moves within an air mass.

  • NAM (Nautical Air Miles): Distance traveled with reference to the air. It depends on TAS (True Airspeed).
  • NGM (Nautical Ground Miles): Distance traveled over the ground. It depends on GS (Ground Speed).

The Effect of Wind:

  • Headwind: GS is lower than TAS. The aircraft flies more air distance (NAM) than ground distance (NGM).
  • Tailwind: GS is higher than TAS. The aircraft covers more ground (NGM) with less “air effort” (NAM).
  • The Greatest Difference: Occurs when flying at high altitude with strong headwinds, since the difference between TAS and GS is more pronounced.

Conversion Formula: $ \text{NAM} = \text{NGM} \times \frac{\text{TAS}}{\text{GS}} $

5. Encounters and Closing Speed

When two aircraft fly toward each other along the same route, when will they meet?

  • Their speeds are added (Closing Speed).
  • Time to encounter = Total Distance / (Speed A + Speed B).
  • This is useful for calculating meeting points on oceanic or polar routes.

6. Vertical Calculations (Climb and Descent)

To plan efficient climbs or descents:

  • Horizontal Distance: Calculated using the average ground speed during the maneuver multiplied by the maneuver time.

  • Rate of Descent (ROD): To maintain a 3-degree glide path, multiply your Ground Speed (GS) by 5.

    • Example: With 140 kts GS, you need approximately 700 ft/min of descent.

7. Polar and Great Circle Routes

The shortest distance between two points on a sphere is a Great Circle (orthodromic route).

  • Special Case (180° of separation): If two points lie on the same parallel but are separated by 180° of longitude (opposite sides of the Earth), the shortest route is not along the parallel, but over the Pole.
  • Polar Calculation: The distance from point A to the Pole (90° − Latitude) is calculated and added to the distance from the Pole to point B.

8. Using Radar for Distance

Although today we use GPS, the Weather Radar (AWR) has a “Map Mode.”

  • By tilting the antenna downward, the radar can detect terrain contrasts such as coastlines, mountains, or cities.
  • This allows the pilot to confirm position or estimate distances to geographic references if other systems fail.

9. Quick Conversions

  • m/s to km/h: Multiply by 3.6 (or use the flight computer).
  • km to NM: Divide kilometers by 1.852 (or multiply by approx. 0.54).
  • Arc to Time: The Earth rotates 15° of longitude per hour.

Mastering these concepts allows the pilot not only to follow a magenta line on a screen, but to understand the physics of motion over the planet, optimizing fuel and time.