Navigation & Position formula solvers
All 73 categories, 1,930 solvers
Along-Track Distance (the Companion of Cross-Track Error)
Navigation & PositionAerospace & FlightHow far along its track an aircraft or a ship has got, once it is off the track: the distance from the start of the leg, measured along the great circle, to the point abeam of where it is now. Ed Williams' Aviation Formulary gives it with the cross-track error: from the distance dist_AD from the start A to the present position D and the cross-track distance XTD, the along-track distance is ATD = acos(cos(dist_AD) / cos(XTD)), with the distances as angles at the centre of the Earth (distance divided by the radius). It is the number that says how much of the leg is behind you, and the cross-track error is how far off it you are: the two are the legs of a right spherical triangle whose hypotenuse is the distance from the start. The Formulary's worked example has an aircraft on its way from Los Angeles to New York at N34:30 W116:30, 99.87 nautical miles from the start and 7.45 nautical miles to the right of the track: it has made good 99.59 nautical miles along the track. The page uses the mean Earth radius of 6 371 008.8 m, so its numbers in nautical miles differ from the Formulary's by 0.07 percent (the Formulary counts one nautical mile for each minute of arc).
Beaufort Force and Wind Speed
Air Quality & DispersionCoastal & Ocean WavesNavigation & PositionWind speed at 10 metres in metres per second from the Beaufort force number, by the empirical fit v = 0.836 B^(3/2), and the force number back from a measured speed. The scale runs from force 0 (calm) to force 12 (hurricane force, 32.7 m/s and over), and it was built from what the sea and the sails looked like before anyone had an anemometer.
Carbon Dioxide from Burning a Fuel (Factor per Mass of Fuel)
Water & WastewaterChemical EngineeringNavigation & PositionThe mass of carbon dioxide a fuel makes when it is burned, from the mass burned and a factor for the fuel: every kilogram of carbon in the fuel becomes 44/12 kilograms of carbon dioxide (the molar masses of CO2 and of carbon), so the factor is the carbon content times 3.667. The International Maritime Organization's Fourth Greenhouse Gas Study (2020), in its Table 21 taken from the 2018 EEDI Guidelines, gives the factors for ships' fuels in grams of CO2 per gram of fuel: 3.114 for heavy fuel oil (carbon content 0.8493) and for low-sulphur heavy fuel oil, 3.206 for marine diesel and gas oil (0.8744), 2.750 for LNG (0.7500) and 1.375 for methanol (0.3750). A tonne of heavy fuel oil therefore makes 3.114 tonnes of carbon dioxide. The factor is a number of kilograms of CO2 per kilogram of fuel, so it works in any mass unit, and for a fuel sold by the litre or the gallon the mass is the volume times the density. This is the whole of the combustion step: unburned carbon, methane escaping from the engine (the 'slip' of an LNG engine) and the CO2 of making and delivering the fuel are not in it. The ship-fuel-cubic-law page gives the fuel burned per day from the speed; this page turns it into CO2.
Compass to True Heading (Variation and Deviation)
Navigation & PositionThe TVMDC chain in one line: a compass heading corrected by deviation for the ship's own iron and by variation for the earth's field, giving the true heading a chart is drawn in. East corrections are positive and are added going this way.
Cross Track Error
Navigation & PositionThe perpendicular distance from the intended track to where you actually are, on a sphere: the number a plotter shows on its deviation bar. Positive is right of track, negative is left.
Crosswind Component on a Runway
Aerospace & FlightNavigation & PositionAir Quality & DispersionThe part of the wind that blows straight across a runway: the wind speed times the sine of the angle between the wind direction and the runway heading. It is the number a pilot checks against the aircraft's maximum demonstrated crosswind, which the FAA's Pilot's Handbook of Aeronautical Knowledge (FAA-H-8083-25C, chapter 11) says is tested at 90 degrees to a wind of up to 0.2 times the stalling speed with power off, gear and flaps down. The handbook's Sample Problem 10 has runway 17 (a heading of 170 degrees) and a wind from 140 degrees at 25 knots: the angle is 170 minus 140, 30 degrees, and its crosswind chart gives a crosswind component of 13 knots. The sine of 30 degrees times 25 is 12.5, which the chart, read to the whole knot, shows as 13. Take the angle between the wind direction and the runway heading, both as the direction the wind blows from and the runway points to, and use the smaller of the two ways round, 0 to 180 degrees: the crosswind is the same from the left or the right, and this page gives its size only. At 0 degrees it is nothing, at 90 degrees it is the whole wind. An airport report gives the wind direction and speed but not the runway heading, so the heading has to come from the airport's runway list. The gust, not the steady wind, is what is usually checked against a limit.
Dead Reckoning Position
Navigation & PositionThe classic DR advance: speed times time gives the distance run, and the cosine of the course splits it into the change of latitude. The oldest position-finding method there is, and still the one that catches an instrument failure.
Destination Latitude from Course and Distance
Navigation & PositionWhere a great circle course of a given length puts you: the latitude reached from a starting latitude, an initial true bearing and a distance run. The answer carries the change of longitude with it.
Destination Longitude from Course and Distance
Navigation & PositionAerospace & FlightThe longitude you reach after running a distance d along the great circle that leaves a starting point at latitude phi_1 and longitude lambda_1 on a true bearing theta: the other half of the destination point, of which the library's destination-latitude page gives the latitude. Ed Williams' Aviation Formulary gives it, with longitudes counted positive to the west, as dlon = atan2(sin tc sin d cos lat1, cos d - sin lat1 sin lat) and lon = mod(lon1 - dlon + pi, 2 pi) - pi. This page counts longitude positive to the east, as the rest of the library does, so the change is added instead: lambda_2 = lambda_1 + dlon, wrapped into the range from -180 to 180 degrees. The destination latitude phi_2 that appears in the formula is found inside the page from the same start, bearing and distance. The Formulary's worked example, a waypoint 100 nautical miles out of Los Angeles (33 degrees 57 minutes north, 118 degrees 24 minutes west) on the 66 degree radial (1.150035 radians), lands at 34 degrees 37 minutes north and 116 degrees 33 minutes west. The bearing is the initial one: along a great circle the course changes as you go, except along the equator and the meridians. The page uses the mean Earth radius of 6 371 008.8 m.
Distance from Pace Count
Navigation & PositionDistance covered from a pace count times your calibrated pace length. The compass gives the direction; this is how a navigator measures the how-far.
Distance to the Visible Horizon
Navigation & PositionHow far away the sea horizon is from a given height of eye: the tangent line from the observer to the sphere. The geometric figure, before atmospheric refraction pushes it out by about a tenth.
Equation of Time (Fourier Series Approximation)
Astronomy & GravitationNavigation & PositionSolar & Wind PowerHow far the Sun runs ahead of, or behind, a steady clock on a given day: the difference between the time a sundial reads (apparent solar time) and the time a clock keeps (mean solar time). It is positive when the Sun is ahead, as in early November when it reaches about +16 minutes, and negative when it is behind, about -14 minutes in mid February. It comes from two things that add up: Earth's orbit is an ellipse, so the Sun's apparent speed through the year changes, and the Sun travels along the ecliptic, which is tilted against the celestial equator. This page uses the Fourier series in the fractional year that NOAA's Global Monitoring Laboratory prints in its General Solar Position Calculations note: the fractional year gamma in radians is 2 pi / Y times (n - 1 + (h - 12) / 24), with Y the days in the year (365, or 366 in a leap year), n the day of the year and h the hour of the day, and the equation of time E in minutes is 229.18 times a sum of five terms in cos gamma, sin gamma, cos 2 gamma and sin 2 gamma. The 229.18 is 1440 / (2 pi), the minutes in a day per radian, rounded as NOAA prints it. This is an approximation, not an almanac. Measured here against an independent solar position calculation across 2003 and 2004 it stays within about 0.7 minute (about 40 seconds), and at the instant of the worked example in NREL's Solar Position Algorithm report it gives 14.88 minutes against that report's 14.6415, which is 14 seconds high. That is good enough to correct a sundial or to place solar noon to the minute, and not good enough for celestial navigation. The hour only moves the answer by at most about 30 seconds a day, so any clock will do for it. Solar noon on a mean-time clock at the middle meridian of a time zone falls at 12:00 less E; at other longitudes the longitude page adds 4 minutes for each degree.
Estimated Time En Route
Navigation & PositionDistance divided by ground speed. Trivial arithmetic, and the single most common place a navigation plan goes wrong, because the speed put into it is so often the airspeed or the log speed rather than the speed actually made good.
Great Circle Distance (Haversine)
Navigation & PositionThe shortest distance between two points on a sphere, from their latitudes and longitudes. Sinnott's haversine form, which keeps its precision on short legs where the older law-of-cosines version loses it.
Ground Distance on a Slope
Navigation & PositionThe distance your legs travel on a slope, from map distance and rise. Pythagoras, and forgiving: a 20 % grade adds only 2 % to the distance.
Headwind or Tailwind Component on a Runway
Aerospace & FlightNavigation & PositionAir Quality & DispersionThe part of the wind that blows along a runway: the wind speed times the cosine of the angle between the wind direction and the runway heading. A positive answer is a headwind, which shortens the takeoff and landing run; a negative answer is a tailwind, which lengthens it, and it happens when the angle is more than 90 degrees. The FAA's Pilot's Handbook of Aeronautical Knowledge (FAA-H-8083-25C, chapter 11) works the same sample as the crosswind: runway 17 (a heading of 170 degrees) and a wind from 140 degrees at 25 knots, an angle of 30 degrees, for which its component chart gives a headwind component of 22 knots. The cosine of 30 degrees times 25 is 21.65, which the chart, read to the whole knot, shows as 22. Take the angle between the wind direction and the runway heading as 0 to 180 degrees, both as the direction the wind blows from and the runway points to. The handbook's performance notes take their takeoff and landing corrections from this component, for example to decrease distances by 10 percent for each 9 knots of headwind. An airport report gives the wind but not the runway heading, which has to come from the airport's runway list.
Height by Clinometer
Navigation & PositionHeight of a tree or cliff from a paced distance and a clinometer angle, plus your eye height: the sight line starts at your eye, not your boots.
Initial Great Circle Bearing
Navigation & PositionThe course at the moment of departure along the great circle to a destination, measured clockwise from true north. It is the starting bearing only: on any track but a meridian or the equator it changes the whole way.
Longitude to Solar Time Difference
Navigation & PositionSolar time difference from a longitude difference: 4 minutes per degree, because the Earth turns 360° in 24 hours. Sun time, not zone time.
Map Scale to Real Distance
Navigation & PositionReal distance from a map measurement times the scale denominator. On a 1:50,000 sheet every centimetre stands for 50,000 cm of world, half a kilometre.
Naismith's Rule (Hiking Time)
Navigation & PositionNaismith's 1892 walking-time estimate: an hour for every 5 km on the map plus an hour for every 600 m of climb. A planning floor, not a promise.
Radar and Radio Horizon with Standard Refraction
Navigation & PositionAir Quality & DispersionAerospace & FlightHow far an antenna at a given height sees the surface, or an aircraft sees a receiver, by radio or radar, with the bending of the beam in the air allowed for. The air is thinner higher up, so a radio beam that starts out level curves gently down toward the ground. Recommendation ITU-R P.834 handles that by keeping the beam straight and enlarging the Earth to an effective radius k times the real one, with k = 4/3 for the standard atmosphere (for heights below 1 000 m): the horizon is then the tangent from the antenna to that bigger sphere. For an antenna of height h in metres this is about 4.12 times the square root of h kilometres, against 3.57 for the bare geometry of the library's horizon-distance-from-height page, so the radio horizon is about 15 percent farther than the geometric one. A 1 500 m mast or aircraft altitude sees to about 160 km. The distance between two antennas that can just see each other is the sum of the two horizon distances, one for each height. The factor k is an average: in strong temperature inversions it can be much larger, with ducting, and in very dry, cold or unstable air smaller. Enter k = 1 for the geometric horizon with no bending.
Rhumb Line Distance
Navigation & PositionThe length of the track that crosses every meridian at the same angle: the route you actually steer when you set one course and hold it. Longer than the great circle, and the stretching factor q comes from the Mercator latitude.
Set and Drift of the Current
Navigation & PositionThe current the water was making, worked backwards from the gap between where dead reckoning said you were and where the fix put you. Drift is its speed; set is the true direction it flows toward.
Ship Fuel Burn by the Cubic Speed Law
Coastal & Ocean WavesNavigation & PositionWater & WastewaterHow much fuel a ship burns per day at a given speed, from what it burns per day at another speed: the burn scales with the cube of the speed. The Fourth IMO Greenhouse Gas Study (2020) estimates a ship's main engine power with an Admiralty-type formula in which the power varies with the ratio of the instantaneous speed to the reference speed raised to a power n that 'is assumed to be 3', and with the ratio of draughts to the 0.66 power; with a fixed specific fuel consumption the fuel burned per day follows the power, which gives F = F_d (V / V_d)^3. A ship that slows from 14 knots to 12, which is 14 percent, burns 31.5 tonnes a day instead of 50, a saving of 37 percent a day, and since the passage takes 17 percent longer the saving per nautical mile is about 27 percent. The carbon dioxide follows from the fuel: the same study's Table 21 gives 3.114 grams of CO2 per gram of heavy fuel oil (and of low-sulphur heavy fuel), 3.206 for marine diesel, 2.750 for LNG and 1.375 for methanol, so the 31.5 tonnes a day of heavy fuel oil is 98.1 tonnes of CO2 a day, or 4.1 tonnes an hour; the fuel-combustion-co2 page does that step for any fuel. Real engines burn a little more fuel per unit of work at low load, and a ship loses speed in weather, so the cube law is the first estimate and a measured speed-and-consumption curve from the ship is better.
Ship Propulsive Power by the Admiralty Coefficient
Coastal & Ocean WavesNavigation & PositionFluid MechanicsA quick estimate of the power a ship needs to make a given speed, from the power of a similar ship that is known. The Admiralty coefficient is C = displacement^(2/3) x speed^3 / power, with the displacement in tonnes, the speed in knots and the shaft power in kilowatts; the Wärtsilä Encyclopedia of Marine and Energy Technology defines it that way as a coefficient for the preliminary estimation of the power a new design needs to reach its speed, and gives its values as 400 to 600, with the higher values for the more economical vessels. Take C from a ship of the same type and a similar hull, and the power at another size or speed follows. The cube of the speed comes from resistance that rises with the square of the speed, times the speed it acts through; the two-thirds power of the displacement is the wetted area of a hull of fixed shape. For a 20 000 tonne ship at 15 knots with C = 450 the power is 5 526 kW. It is a screening number: it assumes the same hull form, the same loading and trim, the same state of the hull, and a speed in the range where the resistance still follows the square of the speed. Check which kind of power and which units a coefficient was worked in before using it, since coefficients in horsepower are smaller than those in kilowatts.
Solar Azimuth Angle (Compass Bearing of the Sun)
Solar & Wind PowerAstronomy & GravitationNavigation & PositionWhich way along the horizon the Sun lies, as a compass bearing measured clockwise from north (90 degrees is east, 180 degrees south, 270 degrees west), from the latitude phi, the Sun's declination delta and the hour angle H. The hour angle is 0 degrees at solar noon, negative in the morning and positive in the afternoon, 15 degrees for each hour. The page uses the two-argument arctangent, as NREL's Solar Position Algorithm does in its equations 45 and 46: the astronomers' azimuth Gamma = atan2(sin H, cos H sin phi - tan delta cos phi) is measured westward from south, and adding half a turn gives the bearing from north. Because atan2 keeps the sign of both of its arguments, it lands in the right quadrant in the morning and in the afternoon, and for a Sun that stands north of an observer at noon in the tropics, which the arccosine form that NOAA's note prints for the azimuth cannot do without a rule about the sign of the hour angle. Given the topocentric declination and hour angle that the NREL report prints for its Golden, Colorado example (17 October 2003, 12:30:30 local time), the page returns 194.34026 degrees against the report's 194.34024, within 0.00003 degrees. It is the geometric bearing: atmospheric refraction lifts the Sun's apparent height near the horizon but moves its bearing by a negligible amount. Its accuracy is that of the declination and hour angle you give it: take the declination from the declination page and the hour angle from solar time, which is the clock time corrected for the longitude and the equation of time. A bearing is also given when the Sun is below the horizon (it then says which way the Sun lies beneath you), and it is undefined only when the Sun is at the zenith or the nadir, where every direction is the same.
Tide Height Between High and Low Water (Cosine Curve)
Coastal & Ocean WavesNavigation & PositionThe height of a semi-diurnal tide at any moment between one high or low water and the next, by treating the rise and fall as half of a cosine wave. It is the smooth version of the rule of twelfths, and it is how a harbour's tide table (a high and a low, with their times) becomes a height at the minute you want to cross a bar, or the time at which a stated depth is reached.
Wind Correction Angle
Navigation & PositionHow far off the desired track to point the nose so the wind carries you along it instead of off it. Only the crosswind component matters: the along-track part of the wind changes the speed, never the heading.
Wind Triangle Ground Speed
Navigation & PositionWhat the aircraft is actually making over the ground once the wind has had its say: true airspeed, wind speed, and the angle between the wind and the intended track. The E6B's whole reason for existing.