Trade Math: Whole Numbers, Fractions, Decimals, and Unit Conversion

Why Math Accuracy Matters on the Shop Floor

In CNC machining, a calculation error does not just produce a wrong answer on paper—it produces scrap metal, a broken tool, a damaged spindle, or a part that fails in service. A marine propeller shaft machined 0.010 inch oversized will not fit its bearing. A depth-of-cut calculated incorrectly can stall the spindle or cause a tool to shatter. Precision arithmetic is therefore a safety skill as much as a technical one. Before you touch a machine, get the math right.

Safety note: Never rely on mental math alone when setting up a cut. Write your numbers down, estimate first, then verify with a calculator. If your estimate and your calculator disagree by more than a small rounding difference, find the error before you press Cycle Start.

Whole Numbers in Machining

Whole-number arithmetic—addition, subtraction, multiplication, and division—appears constantly: counting passes, calculating total depth of material to remove, determining how many parts fit on a piece of stock.

Example: A bar of stock is 48 inches long. Each part requires 3 inches of material plus 0.125 inch for each saw kerf. How many parts can you cut? Set up the arithmetic clearly, step by step, and you avoid costly mistakes.

Always estimate before calculating. Round 3.125 up to 3.2 and divide 48 by 3.2 to get roughly 15 parts. Then do the exact math. If your exact answer is far from 15, you have made an error somewhere.

Fractions in Machining

US customary drawings express dimensions as common fractions: 1/4, 3/8, 7/16, 1-7/32. You must be able to add, subtract, multiply, and divide fractions without a calculator.

Adding fractions: Find a common denominator. To add 3/8 and 5/16, convert 3/8 to 6/16, then add: 6/16 + 5/16 = 11/16.

Subtracting fractions: Same rule. To find the wall thickness when an outer diameter is 2-3/4 inches and an inner diameter is 1-7/8 inches, subtract: 2-3/4 − 1-7/8. Convert to eighths: 2-6/8 − 1-7/8. Borrow 1 from the whole number: 1-14/8 − 1-7/8 = 7/8 inch total difference; wall thickness is half that, or 7/16 inch.

Reducing fractions: Always express answers in lowest terms. 6/8 reduces to 3/4. On a drawing, an un-reduced fraction signals a calculation that was not finished.

Decimals in Machining

CNC controllers work in decimals. You will read fractional dimensions on blueprints and enter decimal equivalents at the control. Memorize the most common conversions or derive them quickly by dividing numerator by denominator.

| Fraction | Decimal Inch |

|---|---|

| 1/64 | 0.015625 |

| 1/32 | 0.03125 |

| 1/16 | 0.0625 |

| 1/8 | 0.125 |

| 3/16 | 0.1875 |

| 1/4 | 0.250 |

| 3/8 | 0.375 |

| 1/2 | 0.500 |

| 7/8 | 0.875 |

When converting, divide and carry at least four decimal places for machining work. Rounding 0.3125 to 0.31 introduces an error of 0.0025 inch—enough to cause a press-fit to fail.

Unit Conversion: Inches and Millimeters

The marine industry and most export manufacturing use metric dimensions. You must convert fluently in both directions.

• Inches to millimeters: multiply by 25.4
• Millimeters to inches: divide by 25.4

These are exact, defined values—not approximations.

Estimation habit: 1 inch ≈ 25 mm is close enough to catch gross errors. If you calculate that 2 inches equals 508 mm, your estimate (2 × 25 = 50 mm) tells you something is wrong immediately.

Significant figures: Match the precision of the original dimension. A dimension given as 1.750 inches (four significant figures) should be reported as 44.45 mm, not 44.4 or 44.450.

Feed and Speed Ratios

Surface footage, spindle RPM, and feed rate all involve ratio arithmetic. The basic spindle speed formula is:

RPM = (CS × 12) ÷ (π × D)

where CS is cutting speed in surface feet per minute and D is cutter diameter in inches. For estimation, substitute 3.14 for π. Reasonable cutting speeds for common materials are found in your textbook or the machinery handbook—do not memorize values that change with tooling and coolant; learn to look them up and plug them in correctly.

Mental Estimation as a Safety Check

Before every calculation, estimate the answer. If you are converting 2-7/16 inches to millimeters, recognize that 2-7/16 is close to 2.5 inches, and 2.5 × 25.4 = 63.5 mm. Your exact answer should be close to 63.5 mm. If it is not, find the error.

Estimation catches transposed digits, misplaced decimals, and wrong operations—the three most common pencil-and-paper errors in shop math.

Pencil-and-Paper Discipline

Always show your work in a clear layout: write the formula, substitute values, calculate step by step, and box your answer with units. This habit makes errors easy to find and is required during NIMS credential practical exams where your reasoning is evaluated alongside your answer.