TY - THES AU - Lastman, Gary Joseph PY - 1963 TI - Rounding errors in digital computer arithmetic subroutines. KW - Thesis/Dissertation LA - eng M3 - Text AB - In this thesis we investigate arithmetic subroutines and round-off procedures. An error analysis of single operations in normalized floating point arithmetic leads us to the construction of an improved form of addition-subtraction subroutine. In addition the properties of several types of round-off procedures are examined (adding ½; adding random digits; dropping digits). The experimental work (using the above mentioned subroutines) with the system x• = y, y• = -x shows that the systematic accumulation of round-off error observed by Huskey is due to the type of rounding-off procedure used. Furthermore, Hartree's explanation of this effect is found to be inadequate because carrying extra digits throughout the calculations does not eliminate the systematic round-off. N2 - In this thesis we investigate arithmetic subroutines and round-off procedures. An error analysis of single operations in normalized floating point arithmetic leads us to the construction of an improved form of addition-subtraction subroutine. In addition the properties of several types of round-off procedures are examined (adding ½; adding random digits; dropping digits). The experimental work (using the above mentioned subroutines) with the system x• = y, y• = -x shows that the systematic accumulation of round-off error observed by Huskey is due to the type of rounding-off procedure used. Furthermore, Hartree's explanation of this effect is found to be inadequate because carrying extra digits throughout the calculations does not eliminate the systematic round-off. UR - https://open.library.ubc.ca/collections/831/items/1.0080564 ER - End of Reference