UBC Theses and Dissertations

UBC Theses Logo

UBC Theses and Dissertations

Cost-performance trade-offs in haptic hardware design Brouwer, Iman 2004

Your browser doesn't seem to have a PDF viewer, please download the PDF to view this item.

Item Metadata


831-ubc_2004-0384.pdf [ 15.32MB ]
JSON: 831-1.0080699.json
JSON-LD: 831-1.0080699-ld.json
RDF/XML (Pretty): 831-1.0080699-rdf.xml
RDF/JSON: 831-1.0080699-rdf.json
Turtle: 831-1.0080699-turtle.txt
N-Triples: 831-1.0080699-rdf-ntriples.txt
Original Record: 831-1.0080699-source.json
Full Text

Full Text

COST-PERFORMANCE TRADE-OFFS IN HAPTIC HARDWARE DESIGN by I MAN BROUWER lr, Delft University of Technology, 2000  A THESIS SUBMITTED IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF APPLIED SCIENCE in THE FACULTY OF GRADUATE STUDIES DEPARTMENT OF MECHANICAL ENGINEERING  We accept this thesis as conforming to the required standard  THE UNIVERSITY OF BRITISH COLUMBIA August 2004  © Iman Brouwer, 2004  UBCl T H E U N I V E R S I T Y O F BRITISH C O L U M B I A  FACULTY OF G R A D U A T E STUDIES  Library Authorization  In presenting this thesis in partial fulfillment of the requirements for an advanced degree at the University of British Columbia, I agree that the Library shall make it freely available for reference and study. I further agree that permission for extensive copying of this thesis for scholarly purposes may be granted by the head of my department or by his or her representatives. It is understood that copying or publication of this thesis for financial gain shall not be allowed without my written permission.  Name of Author (please print)  Title of Thesis:  Degree:  D e P a r t m e n t  Cost - rWrW^^c «. Tr^ctx-QfPs  ft). °  f  Date (dd/mm/yyyy)  Year:  A.  V»*A~»X-\r~Q  f Y ^ t c 3gw4**A^ E * * ^  1_Ool{  Cl^.  The University of British Columbia Vancouver, B C Canada  *  grad.ubc.ca/forms/?formlD=THS  page 1 of 1  r  last updated: 20-Jul-04  Abstract The objective o f this research was to determine whether low performance haptic hardware leads to the same surgical task performance compared to more expensive hardware in a virtual reality surgical simulator for laparoscopy. V R surgical simulators are currently being introduced in leading teaching hospitals around the world. While they provide great potential for improvement over current laparoscopic skills training methods, a major barrier to large-scale acceptance is their high cost. Therefore this study is performed to determine whether a reduction in quality and therefore cost can be obtained without affecting surgical task performance.  T o perform user test at different levels of haptic quality, we developed software that can introduce friction, cogging, force saturation, inertia, and backlash into the haptic loop, simulating the characteristics of less expensive hardware on a high-end haptic interface. This software avoids the need for an expensive hardware redesign, while it allows varying the different parameters on a continuous scale, independent from each other, and within a realistic range.  In a pilot study expert surgeons performed a clip application (2 participants) and a dissection task (3 participants) on commercial haptic hardware and V R laparoscopic software. Each surgeon performed the task(s) 3 times under 5 different settings while forces and kinematic data were recorded. T w o settings were picked from the ones mentioned above; the other three consisted of the unaltered high fidelity setting, zero force feedback, and a combination of force saturation, cogging, friction, and inertia. W e compared tissue-interaction forces, velocities, tool-tip path lengths, and completion times between the high fidelity setting and each o f the other 7 settings. A t a significance level o f 0.05 a Friedman test showed that only the no force feedback condition was significantly different from the high fidelity condition in applied 95 percentile forces. In the clip application task both 50 percentile, and 95 percentile forces were significantly different in the no force feedback condition compared to high fidelity.  None o f the other settings showed  significant differences in any o f the performance measures.  These preliminary results suggest that low performance components can be used in haptic hardware for laparoscopy without affecting task performance, potentially creating a significant cost reduction.  ii  Table of contents Abstract  ii  Table of contents  iii  List of Figures  v  List of Tables  viii  Acknowledgements  ix  Chapter 1  1  Introduction  1.1 Minimally Invasive Surgery and Computer Simulation  1  1.1.1  Minimally Invasive Surgery  1.1.2  Haptic Perception and Multimodal-Task Performance  1 2  1.1.1  Virtual Environments  4  1.1.2  Haptic Rendering  5  1.1.3  Haptic Interfaces  7  1.1.4  Surgical Simulation: Advanced Virtual Environments with Haptics  1.2 Roles of Simulation in Surgical Applications 1.2.1  8 10  Training  10  1.2.2  Performance Evaluation  13  1.2.3  Practice on Patient Specific Anatomy  14  1.3 Cost Contributing Factors in Haptic Hardware Design  14  1.3.1  Components  14  1.3.2  Hardware Designs  18  1.3.3  Market Size and Relative Cost of Contributing Factors  19  1.4 The influence of Haptic Quality on Task Performance  20  1.5 The B i g Picture  21  1.6 Thesis Objectives  21  Chapter 2  Simulating Inexpensive Haptic Hardware  2.1 Motivation and Approach  23 23  2.1.1  Goal of Simulations  24  2.1.2  Approach to Designing Simulations  24  2.1.3  Hardware and Virtual Environment  26  2.1.4  Challenges  27  2.2 Methods: the Hardware Models  27  2.2.1  Inertia  28  2.2.2  Backlash  31  2.2.3  Friction  33  2.2.4  Torque Ripple and Cogging  37  2.2.5  Torque Saturation  41  2.2.6  Model Integration  42  2.2.7  Software Implementation  46  2.3 Analysis and Discussion of Simulation Methods  47  2.3.1  Friction  48  2.3.2  Backlash and Inertia  49  2.3.3  Computational Load:  50  The Models Combined  51  2.3.4 Chapter 3  User studies  53  iii  3.1 Abstract  53  3.2 Introduction  53  3.2.1  Related work  53  3.2.2  Goals  54  3.3 Methods 3.3.1  54 The Virtual Environment  54  3.3.2  Choice of Tasks  55  3.3.3  Choice of Hardware Degradation Settings  57  3.3.4  Strength of Haptic Degradations  58  3.3.5  Performance Measures  59  3.3.6  Experimental Design  60  3.3.7  Statistical Methods.....  62  3.4 Results  65  3.4.1  Data  65  3.4.2  Statistical Analysis  85  3.5 Discussion  92  3.5.1  Inter Setting Differences  92  3.5.2  Other Observations  93  3.5.3  Participants  95  3.5.4  The V E Hardware and Software  96  3.5.5  Strength of Haptic Degradations  99  3.5.6 Chapter 4  Statistical Power  100  Conclusions and recommendations  101  4.1 M a i n Findings & Thesis Contributions  101  4.1.1  Experimental Setup  101  4.1.2  User Study  102  4.2 Recommendations for Future Work  105  4.2.1  Experimental Platform  105  4.2.2  User Studies  107  4.3 Hardware Quality in Future Haptic Interfaces Appendix I: Data analysis with the Kolmogorov-Smirnov Test and Bootstrapping Introduction  107 109 109  The Kolmogorov-Smirnov Test  109  Introduction to Bootstrapping  110  Methods  Ill  Results  111  Discussion  115  Bibliography  117  iv  List of Figures F I G U R E 1-1: M I N I M A L L Y I N V A S I V E S U R G E R Y : P L A C E M E N T O F T H E I N S T R U M E N T S A N D T R O C A R S RELATIVE TO THE A B D O M I N A L W A L L (LEFT), A N D A N OVERVIEW OF A M I N I M A L L Y INVASIVE S U R G E R Y S E T U P I N T H E OR ( R I G H T )  2  F I G U R E 1-3: T W O M I L E S T O N E S I N V I R T U A L R E A L I T Y : T H E M U L T I S E N S O R Y B U T N O N - I N T E R A C T I V E S E N S O R A M A ( L E F T ) A N D T H E FIRST G R A P H I C A L C O M P U T E R I N T E R F A C E S K E T C H P A D (RIGHT), O P E R A T E D B Y ITS I N V E N T O R I V A N S U T H E R L A N D  ,  4  F I G U R E 1-5: A C O M M E R C I A L S I M U L A T O R F O R M I N I M A L L Y I N V A S I V E S U R G E R Y ( L E F T ) : T W O INSTRUMENTS A N D T H E C A M E R A A R E INSERTED INTO T H E S I M U L A T O R . T H E MONITOR SHOWS THE VISUAL REPRESENTATION OF THE V I R T U A L ORGANS INTERACTING WITH THE INSTRUMENTS WHILE T H E INSTRUMENTS REFLECT T H E FORCES THAT C A N B E FELT B Y INTERACTING WITH THESE ORGANS.  (SOURCE: W W W . X I T A C T . C O M ) . T H E RIGHT PICTURE  SHOWS A N I M A G E OF T H E V I R T U A L E N V I R O N M E N T OF A N O T H E R C O M M E R C I A L S I M U L A T O R (SOURCE: WWW.SIMBIONIX.COM) F I G U R E 1-7: How  5  D O W E INTERACT WITH A HAPTIC V I R T U A L ENVIRONMENT?  (SOURCE:  [SRINIVASAN, 1997])  6  F I G U R E 1-9: E X A M P L E S O F H A P T I C I N T E R F A C E S ( F R O M L E F T T O R I G H T ) : T H E  GROPE  I  is T H E  FIRST  HAPTIC INTERFACE, D E V E L O P E D A T T H E U N I V E R S I T Y OF N O R T H C A R O L I N A IN 1971. T H E P H A N T O M IS T H E F I R S T C O M M E R C I A L H A P T I C I N T E R F A C E ( R E L E A S E D 1 9 9 5 ) . C O M M E R C I A L JOYSTICK WITH FORCE F E E D B A C K A N D T H E L A P A R O S C O P I C S U R G I C A L W O R K S T A T I O N F R O M IMMERSION CORP  8  F I G U R E 1-11: A S T U D E N T W O R K I N G O N A ' B E N C H - T O P T R A I N E R ' (LEFT): S T A N D A R D LAPAROSCOPIC TOOLS C A N B E USED TO INTERACT WITH INANIMATE OBJECTS. T H E RIGHT PICTURE SHOWS A C L O S E - U P OF T H E S C R E E N  12  F I G U R E 1-13: F I V E E X A M P L E S O F D I R E C T D R I V E H A P T I C I N T E R F A C E S ( F R O M L E F T T O R I G H T ) : T H E B M W IDRIVE, THE LOW-COST 1 - D O F HAPTIC TWIDDLER, T I M BEAMISH'S D'GROOVE DIGITAL T U R N T A B L E , A P A N T O G R A P H CONFIGURATION B Y V I N C E N T H A Y W A R D , A N D T H E L O G I T E C H W I N G M A N A FORCE F E E D B A C K M O U S E WITH P A N T O G R A P H DESIGN (RIGHT)  15  F I G U R E 1 - 1 5 : C A B L E D R I V E A N D G E A R E D S Y S T E M S . T H E P A N T O G R A P H ( L E F T ) IS A H I G H - F I D E L I T Y SYSTEM WITH C A B L E DRIVE. O N T H E RIGHT A R E PLASTIC COMPONENTS F O U N D IN T H E G E A R E D TRANSMISSION OF A FORCE F E E D B A C K JOYSTICK.  T H E DESIGN H A S SIGNIFICANT B A C K L A S H  A N D FRICTION. T H E L A R G E A M O U N T O F G R E A S E P R E S E N T C O U L D N O T C O M P E N S A T E T H E LATTER F I G U R E 1-17: Two  16 TRANSMISSIONS USING C A B L E S : A C A B L E - D R I V E S Y S T E M IN T H E L S W  LAPAROSCOPIC INTERFACE (LEFT). A R R O W S INDICATE T H E LOCATION OF S O M E OF T H E CABLES. T H E TENSION-BASED S Y S T E M O N T H E RIGHT COMBINES MINIMAL B A C K L A S H WITH L O W INERTIA  17  F I G U R E 2 - 1 : F L O W D I A G R A M OF FORCES A N D POSITIONS IN A V I R T U A L R E A L I T Y S Y S T E M WITH HAPTICS, A N D T H E FACTORS THAT LIMIT HAPTIC FIDELITY FIGURE 2-2: V I R T U A L C O U P L I N G WITH T W O L O W - PASS FILTERS T O S I M U L A T E INERTIA.  28 SUBSCRIPT  ' V M ' I N D I C A T E S T H A T T H E V A R I A B L E IS R E L A T E D T O T H E V I R T U A L M A S S , S U B S R I P T ' H I ' I N D I C A T E S IT IS R E L A T E D T O T H E H A P T I C I N T E R F A C E FIGURE 2-3: A B A C K L A S H M O D E L C O M M O N L Y USED IN T H E FIELD OF CONTROL THEORY. X I I N D I C A T E S T H E P O S I T I O N O F M A S S 1 (Ml).  X 2 INDICATES T H E POSITION OF M A S S 2 ( M 2 ) . A  V  30  S P R I N G A N D D A M P E R C O M B I N A T I O N O N E A C H SIDE O F T H E G A P S I M U L A T E I M P A C T O F T H E T W O MASSES  31  FIGURE 2-4: B A C K L A S H M O D E L  32  FIGURE 2-5: MICROSCOPIC CONTACT B E T W E E N T W O SURFACES. T H E A C T U A L SURFACE OF C O N T A C T IS S M A L L C O M P A R E D T O T H E T O T A L S U R F A C E  33  F I G U R E 2-6: C O G G I N G : A S T A B L E (LEFT) A N D U N S T A B L E (RIGHT) D E T E N T POSITION O F A PERMANENT MAGNET MOTOR  38  FIGURE 2-7: E X A M P L E S OF SIMULATED A N D EXPERIMENTALLY OBTAINED DATA FROM VARIOUS I E E E P U B L I C A T I O N S (SOURCE (LEFT T O RIGHT, TOP TO B O T T O M ) : [ B E N A R O U S , 1 9 9 9 ] , [DEODHAR, 1996], [ISHIKAWA, 1993], [STUDER, 1997]) FIGURE 2-8: E X P E R I M E N T A L L Y OBTAINED B A C K E M F  39  IN A MOTOR WITH TRAPEZOIDAL B A C K E M F  (SOURCE: [SOZER, 1998])  40  F I G U R E 2-9: T O R Q U E RIPPLE A S A FUNCTION OF MOTOR A N G L E (SOURCE: [ L A J O I E - M A Z E N C , 1989])  40  FIGURE 2-10: T H E RELATION B E T W E E N FORCES DISPLAYED A T THE HAPTIC INTERFACE A N D FORCES C O M M A N D S S E N D B Y T H E V I R T U A L E N V I R O N M E N T W H E N F O R C E S A T U R A T I O N IS T U R N E D O N . F E IS T H E F O R C E O U T P U T B Y T H E V I R T U A L E N V I R O N M E N T . F i IS T H E F O R C E D I S P L A Y E D O N H  V  THE HAPTIC INTERFACE. F  M A X  C A N B E V A R I E D TO SATURATE THE FORCE A T T H E DESIRED  LEVEL  41  FIGURE 2-11: T H E BASIC PHYSICAL REPRESENTATION OF O U RM O D E L INTEGRATION WITH B A C K L A S H PRESENT. T H E F O L L O W I N G SUBSCRIPTS A R E U S E D : HI=HAPTIC I N T E R F A C E , VM=VIRTUAL MASS, C=COGGING, VE=VIRTUAL ENVIRONMENT, VES=SATURATED V E FORCE. 42 F I G U R E 2 - 1 2 : T H E P H Y S I C A L R E P R E S E N T A T I O N O F T H E M O D E L I N T E G R A T I O N IF N O B A C K L A S H IS PRESENT  43  F I G U R E 2 - 1 3 : T H E C O O R D I N A T E S Y S T E M S IN T H E L S W : T H E ORIGIN OF T H E W O R L D F R A M E C O O R D I N A T E S Y S T E M IS D E F I N E D I N B E T W E E N T H E T W O T R O C A R S ( L E F T ) . T H E V I R T U A L T O O L SHAFT C A N B E A D J U S T E D IN L E N G T H A N D R O T A T E D (RIGHT)  44  FIGURE 2-14: FRICTION M O D E L , R E C O R D E D D A T A . INSTRUMENT A N G L E (TOP FIGURE), I N S T R U M E N T A N G U L A R V E L O C I T Y (MIDDLE FIGURE), A N D FRICTION T O R Q U E ( B O T T O M FIGURE)  49  F I G U R E 2 - 1 5 : B A C K L A S H : P R O B E POSITION R E L A T I V E TO T H E B A C K L A S H - G A P IN T H E V I R T U A L M A S S . T H E P A T H S H O W N IS B A S E D O N D A T A O B T A I N E D B Y M A N U A L L Y P U S H I N G T H E INSTRUMENTS OF T H E L S W . B O T H I N S T R U M E N T POSITION A N D V I R T U A L I N S T R U M E N T POSITION W E R E R E C O R D E D . T H E V I R T U A L I N S T R U M E N T POSITION W A S E X P A N D E D TO B O T H SIDES T O S H O W T H E B A C K L A S H G A P F I G U R E 3-1  50  PICTURES O F T H E DISSECTION T A S K (LEFT) A N D CLIP APPLICATION T A S K (RIGHT). I N  T H E DISSECTION T A S K L I G H T C O L O U R E D TISSUE C O V E R S D A R K E R SENSITIVE TISSUE O N W H I C H A G R E E N L I N E IS P A I N T E D . T H E O B J E C T I V E IS T O F U L L Y E X P O S E T H E ( G R E E N ) L I N E B Y DISSECTING A W A Y T H E C O V E R I N G TISSUE. I N T H E CLIP APPLICATION T A S K A G R A S P E R IN T H E L E F T H A N D IS U S E D T O S T A B I L I Z E A D U C T W H I L E T H E T O O L rN T H E R I G H T H A N D IS U S E D T O A P P L Y A CLIP O N T H E SPOT M A R K E D B Y A B L A C K L I N E F I G U R E 3-2  57  C U M U L A T I V E DISTRIBUTION FUNCTIONS OF FORCES E X E R T E D B YT H E RIGHT H A N D  T O O L B Y S U R G E O N 1. T H R E E R E P E T I T I O N S W E R E E X E C U T E D U N D E R 5 C O N D I T I O N S . T O A V O I D CLUTTERING T H E PLOT O N L Y D A T A F R O M T H E THREE MOST IMPORTANT CONDITIONS A R E SHOWN HERE  67  vi  F I G U R E 3-3  C U M U L A T I V E DISTRIBUTION FUNCTIONS OF FORCES E X E R T E D B Y T H E RIGHT H A N D  T O O L B Y S U R G E O N 1 IN T H E CLIP A P P L I C A T I O N T A S K . N I N E REPETITIONS W E R E E X E C U T E D U N D E R 5 CONDITIONS. T O A V O I D C L U T T E R I N G T H E PLOT O N L Y D A T A F R O M T H E T H R E E MOST IMPORTANT CONDITIONS A R E SHOWN HERE F I G U R E 3-4:  67  C U M U L A T I V E DISTRIBUTION FUNCTIONS OF TOOL-TIP FORCES  68  F I G U R E 3-5  C U M U L A T I V E DISTRIBUTION FUNCTIONS OF A B S O L U T E VELOCITIES  70  F I G U R E 3-6  M E D I A N T O O L TIP F O R C E S . E A C H D A T A P O I N T R E P R E S E N T S A R E P E T I T I O N  72  F I G U R E 3-7  9 5 P E R C E N T I L E T O O L TIP F O R C E S . E A C H P O I N T R E P R E S E N T S A R E P E T I T I O N  74  F I G U R E 3-8  C O M P L E T I O N TIMES. E A C H POINT REPRESENTS A REPETITION  76  F I G U R E 3-9  M E D I A N A B S O L U T E VELOCITIES. E A C H D A T A POINT REPRESENTS A SINGLE  REPETITION  78  FIGURE 3-10  P A T H L E N G T H S . E A C H D A T A POINT REPRESENTS A REPETITION.  F I G U R E 3-11  C O M P A R I S O N O F T H E M E D I A N I N TIP F O R C E E X E R T E D B Y T H E L E F T H A N D V E R S U S T H E  80  RIGHT H A N D . SINCE T H E BARS REPRESENTS D A T A F R O M A L L PARTICIPANTS A N D A L L Q U A L I T Y SETTINGS, T H E DISSECTION B A R S R E P R E S E N T 4 5 D A T A POINTS, A N D T H E CLIP A P P L I C A T I O N B A R S R E P R E S E N T 9 0 D A T A POINTS E A C H FIGURE 3-12  82  C O M P A R I S O N O F 9 5 P E R C E N T I L E TIP F O R C E E X E R T E D B Y T H E L E F T H A N D V E R S U S  T H E RIGHT H A N D . T H E DISSECTION B A R S R E P R E S E N T 45 D A T A POINTS, T H E CLIP A P P L I C A T I O N B A R S R E P R E S E N T 9 0 D A T A POINTS E A C H FIGURE 3-13  83  C O M P L E T I O N TIMES C O M P A R E D B E T W E E N SURGEONS. E A C H B O X P L O T CONSISTS OF  1 5 D A T A POPNTS F O R D I S S E C T I O N A N D 4 5 D A T A P O I N T S F O R T H E C L I P S E T T A S K FIGURE 3-14 FIGURE 3-15:  84  T H E H O O K OF THE C A U T E R Y TOOL  85  M E A N F O R C E S V E R S U S E X P E R I M E N T N U M B E R : S U R G E O N 1, L E F T H A N D  89  FIGURE 3-16  9 5 P E R C E N T I L E F O R C E S V E R S U S E X P E R I M E N T N U M B E R : S U R G E O N 1, L E F T H A N D . . 9 0  FIGURE 3-17  P A T H L E N G T H V E R S U S E X P E R I M E N T N U M B E R : S U R G E O N 2, L E F T H A N D  F I G U R E 0-1  90  T H E C U M U L A T I V E DISTRIBUTION F U N C T I O N F O R T W O FINITE D A T A SETS A R E  R E P R E S E N T E D A S A S T A I R C A S E . T H E K O L M O G O R O V - S M I R N O V S T A T I S T I C , D , IS D E F I N E D A S T H E M A X I M U M V E R T I C A L DIFFERENCE B E T W E E N T W O C U M U L A T I V E DISTRIBUTION  FUNCTIONS. 109  F I G U R E 0-2  RESULTS F R O M THE K O L M O G O R O V - S M I R N O V ANALYSIS O N FORCE DATA. 95  PERCENT CONFIDENCE BOUNDS FOR THE D — V A L U E A R E GIVEN FOR PNTRA-HL FIDELITY ( B L A C K ) , A N D B E T W E E N H I G H F I D E L I T Y A N D E A C H SETTING (RED). IF T H E I N T E R V A L S I N D I C A T E D B Y T H E R E D A N D B L A C K L I N E D O N O T O V E R L A P , T H E R E IS A H I G H L I K E L I H O O D O F A DIFFERENCE B E T W E E N T H E SETTING A N D T H E H I G H FIDELITY SETTING. S I , S 2 , A N D S 3 INDICATE WHICH SURGEON (NUMBER) T H E D A T A ORIGINATES F R O M FIGURE 0-3:  113  RESULTS F R O M THE K O L M O G O R O V - S M I R N O V ANALYSIS ON VELOCITY DATA. 95  P E R C E N T C O N F I D E N C E B O U N D S F O R T H E D — V A L U E A R E G I V E N F O R TNTRA-HIFI ( B L A C K ) , A N D B E T W E E N HIFI A N D E A C H S E T T PNG ( R E D ) . I F T H E I N T E R V A L S I N D I C A T E D B Y T H E R E D A N D B L A C K L I N E D O N O T O V E R L A P , T H E R E IS A H I G H L I K E L I H O O D O F A D I F F E R E N C E B E T W E E N T H E SETTING A N D T H E H I G H FIDELITY SETTING. S 1 , S 2 , A N D S 3 INDICATE WHICH S U R G E O N (NUMBER) T H E D A T A ORIGINATES F R O M  114  Vll  List of Tables T A B L E 2.1. L A P A R O S C O P I C W O R K S T A T I O N SPECIFICATIONS  26  T A B L E 2.2  M A I N PARAMETERS OF THE MODELS O N SIMULTANUOUSLY  47  T A B L E 2.3  C O M P U T I N G TIMES OF T H E VARIOUS DEGRADATIONS. T H E B A C K L A S H M O D E L C A N N O T  BE R U N WITHOUT T H E INERTIA M O D E L ; A N D THEREFORE T H E LISTED T O T A L L E A V E S SINGLE I N E R T I A O U T O F ITS S U M M A T I O N  51  T A B L E 3 . 1 : P A R A M E T E R S OF M O D E L S U S E D IN THIS S T U D Y  58  T A B L E 3.2 T H E SETTINGS T O B E E X E C U T E D B Y EIGHT PARTICIPANTS. T H I S T A B L E APPLIES T O B O T H TASKS T A B L E 3.3 T A B L E 3.4:  61 A S S I G N M E N T OF SETTINGS TO T H E PARTICIPANTS  65  P V A L U E S F O R I N T R A - S U R G E O N F R I E D M A N TESTS. A SIGNIFICANT P - V A L U E  I N D I C A T E S T H A T IT IS L I K E L Y T H A T T H E P E R F O R M A N C E M E A S U R E S H A V E D I F F E R E N T M E D I A N S . 85 T A B L E 3.5  P V A L U E S OF PAIR WISE COMPARISONS B E T W E E N T H E H I G H F I D E L I T Y SETTING A N D  E A C H O F T H E O T H E R 7 S E T T I N G S . T H E D A T A IS F R O M T H E D I S S E C T I O N T A S K . T H E N U M B E R I N B R A C K E T S B E H I N D E A C H S E T T I N G I N D I C A T E S T H E N U M B E R O F S U R G E O N S T H E D A T A IS F R O M . A B O L D F A C E P - V A L U E INDICATES A SIGNIFICANT DIFFERENCE (SEE T E X T ) T A B L E 3.6  87  P V A L U E S OF PAIR WISE COMPARISONS B E T W E E N T H E H I G H FIDELITY SETTING A N D  E A C H O F T H E O T H E R 7 S E T T I N G S . T H E D A T A IS F R O M T H E C L I P A P P L I C A T I O N T A S K . T H E N U M B E R IN B R A C K E T S BEHIND E A C H SETTING INDICATES T H E N U M B E R OF SURGEONS T H E D A T A IS F R O M . A B O L D F A C E P - V A L U E I N D I C A T E S A S I G N I F I C A N T D I F F E R E N C E ( S E E T E X T ) . . . 8 7 T A B L E 3.7-  W E A K CORRELATIONS BETWEEN PERFORMANCE MEASURES A N D EXPERIMENT  NUMBER T A B L E 4.1  91  STABLE PARAMETERS OF THE HARDWARE MODELS  viii  101  Acknowledgements I would like to thank all of those who contributed to m y stay here at U . B . C . I would like to thank my supervisor Antony Hodgson for his knowledge, insight and enthusiasm. I am very grateful to my co-supervisor Karon MacLean for her extensive contributions and commitment. A n extra thanks for helping me pushing me through the tough parts. I would like to thank Dr. Qayumi and the Centre of Excellence for Surgical Education and Innovation for providing me with the necessary resources and the critical link to the medical community. Finally, I am very grateful to the surgeons who participated in this project. Their commitment was, especially in one case, far beyond what I could have asked for. Unfortunately I can not name them here.  Thanks to my fellow N C L e r s and SPINners for being such grate lab mates. Catherine and Joanne: lab-life would have been a lot more boring without you. Carolyn: thanks for sharing all your knowledge and all the great feedback. Thanks Colin and Andrew for the discussions on stats and experimental design, Lewis for helping me become a better programmer, Mario for bringing great snacks with even greater names back from Mexico. Finally, I would like to thank Roderigo for his unrivalled efforts in bringing some extra colour to our (mech) department.  Thanks to the C E S E I team: Vanessa, Marlene, Ferooz, and Humberto for providing me with a great time and all the help when I needed it. A special thanks goes out to Ferooz for always helping us out when we had IT problems.  Last, but definitely not least, I would like to thank my family for all their support.  ix  Chapter 1 Introduction Currently surgical residents acquire their laparoscopic skills mainly in the O R . In search o f a more suitable training environment, leading teaching hospitals are currently acquiring computer based surgical simulators. These simulators provide an interactive visual simulation of the surgery, while the more advanced systems also let the users feel the forces that they exert on the tissue with the instruments. Research has shown that the ability to feel these forces makes a difference in how surgeons execute the task [Moody, systems with force-feedback are expensive,  2002; Wagner, 2002]. Unfortunately,  creating a barrier for hospitals to acquire these  devices. In this project we would like to investigate the relation between force-feedback quality and user performance, to formulate new design requirements that may lead to a more costeffective design of hardware for laparoscopic surgical simulation.  This chapter will introduce the important concepts involved in this study: in Section 1 we introduce minimally invasive surgery, computer-based simulation with force-feedback,  and  human haptic and multi-modal perception. In Section 2 we discuss the main roles o f simulation in surgical applications: training, performance evaluation, and practice on patient  specific  anatomy. The main cost contributing factors in haptic hardware design will be introduced in Section 3; the components of the hardware, what designs are currently used, and the influence o f market size and other factors. Finally, in Section 4 previous work on the relation between haptic quality and task performance will be reviewed and Section 5 will state the objectives of this thesis research.  1.1 Minimally Invasive Surgery and Computer Simulation 1.1.1 Minimally Invasive Surgery In open surgery, a surgeon manipulates the tissue at the target site directly by hand. T o provide access for the hands a fairly large incision has to be made. Minimally invasive surgery (MIS) techniques are employed in an effort to decrease the amount of tissue damage for access purposes. Special long and thin instruments are used that are inserted into the body through small incisions (Figure 1-1). The surgeon operates these instruments from outside the patient.  1  Figure 1-1: Minimally invasive surgery: Placement of the instruments and trocars relative to the abdominal wall (left), and an overview of a minimally invasive surgery setup in the O R (right).  Laparoscopic surgery is MIS applied to the abdominal area. During laparoscopic procedures, the abdominal wall is inflated to provide a tent-like workspace. After inflation, access ports, called canula, are inserted into the abdominal wall to provide airtight entry ports for the instruments. T o provide visual access to the inner structures, a camera is inserted through one of these canula as well. This camera is usually not directly controlled by the surgeon but held by an assistant. The surgeon looks on a monitor to view the camera image (Figure 1-1).  The book by [Berci, 1998]  gives a good overview of clinical aspects of MIS.  Minimally invasive procedures have important benefits compared to their open counterparts. Due to the decrease in tissue damage necessary to access the site of operation, these procedures are usually associated with shorter recovery times and less scar tissue. A s a result, minimally invasive surgery has seen an explosive growth in the last decade. B y 1995 60-80% o f all abdominal surgical procedures in the United States were conducted laparoscopically [Taylor, 1995].  This percentage is expected to increase with advances in technology, allowing more  complex procedures to be performed minimally invasive as well.  1.1.2 Haptic Perception and Multimodal-Task Performance The word 'haptic' is defined as relating to the sense o f touch. It is derived from the Greek verb haptesthai: to touch. Haptic perception is derived through two main mechanisms: •  Tactile perception through the receptors just beneath the skin. Tactile perception is used to feel textures on surfaces, small vibrations, and for initial contact detection.  •  Kinaesthetic perception is acquired through receptors in the muscles and tendons. From these receptors information about forces on the muscles and body position is obtained. The just noticeable difference (JND) in force perception is about 7% [Tan, 1994]. Our kinaesthetic perception is better at estimating relative forces than absolute forces. The J N D in joint angle position were reported by Tan for the wrist ( 2 . 0 ° ) , elbow ( 2 . 0 ° ) , and shoulder ( 0 . 8 ° ) [Tan, 1994]. If more than one joint is involved in perception of position, the error due to resolution will accumulate.  In laparoscopic surgery, the surgeon relies mainly on two senses: vision and touch. A very important question for this research is how surgeons integrate information from vision and touch. How much do they rely on vision and how much on touch? A n important aspect of surgical skill is the ability to exert the right amount of force on tissue and to judge the stiffness. Work by Srinivasan and colleagues showed that visual information can strongly influence kinaesthetic perception of stiffness. In experiments to judge the stiffness of a spring that participants could feel but not see, participants relied more on indirect, visual information of the spring deformation then on the kinaesthetic haptic feedback [Srinivasan, 1996]. Ernst et al. performed experiments in which subjects were asked which one of two bars was higher. The bars could be perceived both visually and by touch. The setup allowed the experimenters to vary the amount of visual information and haptic information. Based on their results the authors proposed that humans integrate vision and haptics in a statistically optimal fashion, similar to a maximum likelihood estimator [Ernst, 2002]. Their hypothesis implies that the brain will assign more weight to information coming from the sense that provides the most reliable information at that time.  In minimally invasive surgery, the amount of force feedback is reduced compared to open surgery due to indirect touch and the low mechanical efficiency of the laparoscopic tools [Breedveld, 1999]. Stylopolous et al. suggest in [Stylopoulos, 2004] that surgeons have learned to adapt to the reduced force feedback conditions during laparoscopy in the O R by using something they call 'visual haptics': surgeons judge the amount of forces exerted on the tissue on visual cues as tissue color, contour, and adjacent tissue integrity and this is combined with a general gentleness. This would explain how expert surgeons are currently able to train residents how much force to exert on tissue while not being able to directly feel those forces.  3  1 . 1 . 1 Virtual Environments This paragraph aims to give a short introduction to virtual environments. The reasons that virtual environments have been proposed for surgery will be discussed later in this chapter. There is no agreement on how to define a virtual environment ( V E ) exactly. A general definition is given by Webster's 2003 New Millennium Dictionary of English as " A computer-generated, threedimensional representation o f a setting in which the user o f the technology perceives themselves to be and within which interaction takes place".  A milestone  in the creation o f these  environments is the Sensorama [Heilig, 1962] (Figure 1-3). It was developed during the 1950's by Morton Heilig, who would later invent the first head mounted display [Heilig, I960]. The Sensorama consisted o f a pre-recorded film in colour and stereo that was augmented with binaural sound, wind, scent as well as vibration experiences. Around the same time, a milestone in computer graphics was set by the work of Ivan Sutherland when he developed the Sketchpad (Figure 1-3): a computer that allowed an engineer to make a drawing that would be displayed on a C R T monitor and edit it while immediately seeing the results [Sutherland, 1963]. This was the first step in computer simulation, which can be described as the techniques o f representing the real world in a computer program. While the Sensorama aimed at creating the most realistic multi-sensory experience, it was not interactive like the Sketchpad. But the Sketchpad did not have the immersive properties of a virtual environment yet.  Figure 1-3: Two milestones in virtual reality: The multi sensory but non-interactive Sensorama (left) and the first graphical computer interface Sketchpad (right), operated by its inventor Ivan Sutherland.  4  With the enormous increase in computational power and the tremendous improvements in computer graphics in the last 40 years, it is now possible to simulate physics-based interactive 3D graphical environments (Figure 1-5). These environments have applications as far ranging as the treatment of anxiety disorders [Krijn, 2004], architectural education by recreation of historic buildings [Chan, 2003], engineering design [Sensable Technologies, 2004], and virtual training environments for virtually all kinds o f surgery (e.g. laparoscopic [Tendick, 2000], [Basdogan, 2004], open abdominal [Bielser, 2003], and brain surgery [Larsen, 2001]).  Figure 1-5: A commercial simulator for minimally invasive surgery (left): two instruments and the camera are inserted into the simulator. The monitor shows the visual representation of the virtual organs interacting with the instruments while the instruments reflect the forces that can be felt by interacting with these organs, (source: www.xitact.com). The right picture shows an image of the virtual environment of another commercial simulator (source: www.simbionix.com).  1.1.2 Haptic Rendering Haptic rendering is the process by which haptic cues are delivered to the person interacting with the application, to convey information about virtual haptic objects [Salisbury, 2004]. These can be cues reflecting the weight o f objects, friction, texture, inertial forces etc. Haptic rendering is a relatively new field and there remain many unsolved problems. The main challenges are: •  Multi-contact interaction: In many applications today, there is only a single point or two points of contact interacting with the environment. T o imitate real environments, multipoint, multi-hand, multi-person environments need to be developed. A great advantage of laparoscopic surgery is that there is no direct contact between the hands of the user and the V E : the indirect manipulation of the V E through the laparoscopic instruments greatly simplifies haptic rendering and is the main reason that there are so many more virtual environments available for laparoscopic surgery compared to open surgery.  5  •  Level of detail: increase of level of detail increases the computational load of the V E to calculate forces, but also requires a high quality haptic interface to display subtle haptic cues.  •  Stable rendering of simulations.  Stable rendering o f simulations is a first requirement for any simulation but not an easy one to achieve. The cause of stability issues can be illustrated with Figure 1-7.  / Computer Haptics * A T> fe» V  |S»kto Sulfate  Sensors  Actuators  Figure 1-7: How do we interact with a haptic virtual environment? (source: [Srinivasan, 1997])  O n the left side of Figure 1-7 is the human who is interacting with a virtual object. O n the right side of the figure is the computer system with the haptic interface. Both systems are made up o f a sensing part and an actuating part, with a delay in between. Position sensing in the haptic system is discrete in time. For a system to be stable, it needs to be passive: it should not be possible to extract energy from the system. Because position is only sampled at discrete times, the position is constant in between updates. The delay associated with this zero-order hold in position destabilizes the system by introducing energy. This can be illustrated by the common haptic example of exploring a virtual wall with a haptic interface. Let's assume that the wall is modelled with a spring. A s a result of the time delay, the position of the probe in the V E will always trail behind its real position. This means that as one penetrates a virtual wall, the felt forces will trail behind the 'ideal' forces that would have to be overcome without the time delay, and the user has to perform less work than in the case of a real wall. O n the way out of the wall,  6  the position and forces will trail again and this time the forces will be higher than in the case of a real wall. A s a result, the work returned by the system will be higher than in a real system without the zero-order hold. Overall, the haptic system returned more energy than the user put into it. This is a very important issue in the modeling of inertia later in Chapter 2. A more detailed explanation of this phenomenon is given in [Gillespie, 1996]. T o address this issue, update rates of 500 H z are considered a minimal requirement for haptic simulation, though even higher update rates are required for environment that are very stiff or dynamic.  1.1.3 Haptic Interfaces In 1971, the first force feedback system, G R O P E I, was realized at the University of North Carolina (Figure 1-9). A robot was modified to allow a user to move it around freely in 2D. It would  display  forces  present  in  a simulated  environment  to  the  user  [Batter,  1971].  Unfortunately, this project was stopped for about 10 years because of lack of computational power available at the time. Force feedback became a major research area in the nineties and the first commercial haptic interface, the Phantom [Massie, 1994], was released on the market in 1995. More than 1600 o f these devices had been sold by 2003 and it is currently the most popular haptic interface for professional use. Meanwhile force-feedback devices for consumers have outnumbered professional force feedback devices boosted by a considerable drop in price that made these devices available for less than US$100. More then 4 million force feedback gaming peripherals had been sold by October 2003 according to Dean Chang, Chief Technology Officer  and V i c e President of Technology Adoption and Partner Services  [Immersion Corporation, 2003].  7  at Immersion  GROPE I  Phantom  Joystick  LSW  Figure 1-9: Examples of haptic interfaces (from left to right): The G R O P E I is the first haptic interface, developed at the University of North Carolina in 1971. The Phantom is the first commercial haptic interface (released 1995). Commercial Joystick with force feedback and the Laparoscopic Surgical Workstation from Immersion Corp. Multiple research groups at universities have developed haptic interfaces  for laparoscopic  surgery. A n overview of designs by these groups and commercially available designs will be given later in this chapter.  Very basic tactile haptic interfaces have made their way into consumer electronics as vibrating cell  phones,  pagers  etc.  Essentially the  same vibro-tactile technology  commercially on instrumented gloves. More complex technology  is  also  available  aims at providing tactile  actuation at a spatially higher resolution, usually in the form of pin arrays (e.g. [Moy, 2000; Siegel, 2002] ). Though these displays are still a topic of active research, some displays are commercially available as for example Braille displays. Haptic interfaces that are designed to activate the tactile component of touch are to the best knowledge o f the author not commercially available for surgical training at the time of writing.  1.1.4 Surgical Simulation: Advanced Virtual Environments with Haptics Surgeons sometimes ask "Why do we only now start to have V E ' s for surgical training while pilots have had flight simulators for decades?". A simple answer is that surgical environments are extremely difficult to simulate. Face validity has been shown for 3 simulators in a recent review o f 7 commercially available simulators for laparoscopic surgery [Schijven, 2003]. Still, there are many challenges ahead to improve realism.  8  Surgical V E ' s are computationally intensive for both graphics and haptics. They require a computer model that contains a geometrical, mechanical and graphical representation of the organs involved in the operation and their interaction with the instruments. Both the mechanical properties and graphical properties will be discussed in the next two paragraphs.  Mechanical properties of living tissue are much more complicated than common engineering materials.  Living tissue is anisotropic, inhomogeneous,  nonlinear, and viscous. Obtaining  accurate mechanical models of living tissue is still an active research area [De, 1999; Mayrose, 2000; Brouwer, 2001]. A surgical simulation must repeatedly analyze the tissue structure with calculations similar to those commonly performed on man-made structures in mechanical or civil engineering. However, in surgical simulation the goal of accurately simulating mechanical properties competes with the necessity to provide interactive update rates. T o provide a smooth haptic experience o f the simulation, update rates o f at least 500Hz are necessary. The 2 ms time allowed in surgical simulation to calculate forces based on the new state o f the tissues is in sharp contrast to  the more traditional application of structural analysis  in engineering  where  computation times of hours to multiple days are acceptable. Therefore the current simulation models are optimized more for high update rates and low latency than for accuracy. M a n y variations on mass-spring-damper, finite element, and boundary element methods have been used to speed up computation times or increase realism of the mechanical model [Berkley, 1999; James, 1999b; James, 2002; K i m , 2002a; Zhang, 2002; Gosline, 2003b; Gosline, 2004][Berkley, 1999; James, 1999a; James, 2002; K i m , 2002a; Zhang, 2002; Gosline, 2003a; Gosline, 2003b; Gosline, 2004]. A l l of these methods greatly simplify the mechanical model of the tissue and often do not allow the tissue to be cut. Mahvash and Hayward developed  a promising  methodology that does not rely on real-time calculation of forces but instead retrieves precalculated forces during task execution. Forces can be obtained either by off-line simulation or by measurement in the real environment [Mahvash, 2004].  The graphical properties of a surgical environment are very complex as well. There are many challenging phenomena: blanching of tissue under tension, properties o f a cut surface, realistic rendering of the flow of fluids and the reflection caused by the humid environment, complex  9  textures, smoke from cautery [Jensen, 2001], and visual properties of tissue after it has been cauterized.  While a lot of progress has been made in the past decade, there are still many barriers to overcome before surgeons can experience a simulation of surgery that is realistic in both touch and vision.  1.2 Roles of Simulation in Surgical Applications Computer simulations of surgery could until recently only be found in research labs. Due to the advances in technology  and the great market potential, there were 8 companies'  offering  computer-based surgical simulations for laparoscopy in 2004. This section will start with a discussion of the currently most prevalent application of computer-simulated  laparoscopy:  training. After that performance evaluation for certifying surgeons and testing and comparison of instruments and procedures will be discussed. This section will end with a discussion of a potential application that can be expected in the future: training and practice of a procedure on patient-specific data.  1.2.1 Training W h y use a simulator to learn minimally invasive surgery? In open surgery, technical skills are acquired according to the apprentice model: the student first watches an expert performing an operation and will gradually participate more and more in the procedure until the student can do the whole procedure by him or herself. While the apprentice model is still the most important component in minimally invasive surgery training, the general consensus is that training in the O R should be reduced in favour of training outside the O R . The main reasons are: •  Due to design of the instruments and the limitations of the camera-monitor system, M I S motor skills are more difficult to acquire than their open counterparts. Impeding factors include the limitation of moving the tool tip in only 4 degrees of freedom, mirroring of motion and forces at the tool tip with respect to the instrument handle, and the reduction of 3D information in vision [Breedveld, 1999, 2000].  1  Immersion, Simbionix, Reachin, Surgical-Science, Xitact, Select-IT V E S T , Mentice, Haptica  10  •  Reducing risks to patients: Surgeons are more likely to make errors at the beginning of their career [Grantcharov, 2001].  •  Reducing cost of training: O R time cost is expensive and average operating time is reported to increase by almost 50 percent when a resident is present [Traverso, 1997]. The cost of training a resident in the O R is estimated at a total of US$48,000 over 4 years. [Bridges, 1999].  •  Guaranteeing exposure to certain kinds of less frequently encountered cases that usually do not show up during a resident's training. It can for example be of vital importance to recognize unusual anatomical configurations in time.  •  Currently a resident will read 'the manual' for an advanced procedure before going into the O R to learn it. It may be beneficial to actually practice the new procedure in simulation before stepping starting to perform on patients [Soper, 2004].  The need to train outside the O R was underlined by the Society o f American Gastrointestinal Endoscopic Surgeons  (SAGES)  Education Committee's  creation o f the Fundamentals o f  Laparoscopic Surgery (FLS) at the annual meeting in 1998 [Villegas, 2003]. It was proposed that controlled inanimate training environments outside the O R should replace initial training on patients. In [Stylopoulos, 2004] a survey was administered to a panel o f thirty expert surgeons attending the 8th annual meeting of S A G E S . Ninety-five percent of the participants said that skills training should be incorporated into the residency programs and medical curricula.  Currently, there are two forms of non-patient training available other than computer simulation: 'bench-top trainers' and animal labs. Bench-top trainers, or phantom boxes, consist of a box that has openings  through which standard minimally invasive instruments can be inserted to  manipulate inanimate objects that are placed inside of the box. A standard laparoscopic video setup can be used for visualization (Figure 1-11). While these simulators provide an environment to train basic motor skills and in some cases provide a representation of anatomical structures in the form of latex tissues, they lack the complex physiology of the human body. Physical 3D models o f organs are often expensive and can often not be reused.  11  Figure 1-11: A student working on a 'bench-top trainer' (left): standard laparoscopic tools can be used to interact with inanimate objects. The right picture shows a close-up of the screen.  Training on porcine models provides a realistic physiological environment. While in 1993 its use was still recommended by some [Wolfe, 1993], ethical concerns have since been raised and led to a ban on using animals for surgical training in the United Kingdom [Lirici, 1997]. The costs associated with an animal training facility also make it a less attractive option today.  Trainers that are based on computer simulation technology have the potential to overcome many of the disadvantages  that training with boxes and porcine models have. Computer-based  simulators do not need a special facility; they can be used with minimal supervision, and at any time of the day. A s the technology progresses and more data become available, the anatomy and physiology will be more realistic, it will also be possible to train on a specific anatomic anomaly or specific disease type. Because the movement of the instruments are tracked and the tissue interaction forces can be logged, automatic performance feedback can be provided and the student can be provided with automated personalized suggestions for improvement. Since all tissue is virtual, modules can be repeated as many times as necessary: students can focus on that aspect with which they have most trouble. For further reading on training for minimal invasive surgery, the article by Villegas et al. [Villegas, 2003] provides a good recent overview o f its many aspects.  12  1.2.2 Performance Evaluation Structured  global rating forms  are the  current gold  standard in evaluation  o f surgical  performance. These assessments are performed on a videotape o f the procedure in question. Expert surgeons evaluate the anonymous video, making judgements on issues such as dexterity, respect for tissue, spatial orientation, flow o f the operation, assistant use, and knowledge o f the procedure (e.g. [Reznick, 1997; Adrales, 2003]). While Adrales et al. reported that the surgeonexaminers shared a common perception of competence [Adrales, 2003], other researchers have found that expert surgeons often have different opinions on the relative importance o f certain technical skills [Baldwin, 1999]. There are other disadvantage to global rating forms: they place a high demand on limited and expensive resources (expert surgeons), and they are not an objective assessment in the sense that individual human perception and opinion is still part o f the analysis.  Another, relatively new, approach is quantitative performance analysis based on measurement o f relevant aspects o f surgery such as tool trajectories and forces. Algorithms are applied to the obtained data to extract performance measures. Though quantitative performance analysis may not be as comprehensive as expert surgeon's judgement, it has two main advantages: •  It is objective: The same algorithms can be applied to all data: no subjective judgements have to be made at any point.  •  It does not require the time of highly skilled experienced surgeons. If the data is acquired during simulation, no human intervention is needed at all since a completely automated process can apply the algorithms to extract the performance indicators.  A wide variety o f measures can potentially be extracted: A t this moment evaluation algorithms are based on efficiency and evaluation of kinematics and global forces. The most commonly administered performance measure is completion time (e.g. [Chung, 1998; Derossis, 1998; Fried, 1999]). Some studies use penalty scores for errors made (e.g. [Derossis, 1998; Eubanks, 1999]), kinematic measures [Kinnaird, 2004], and force and torques [Rosen, 2001; Kinnaird, 2004] Future knowledge in areas like tissue injury mechanics can add to a more comprehensive evaluation of surgical skill on simulators [Schijven, 2003].  13  1.2.3 Practice on Patient Specific Anatomy Not everybody has the same anatomy. While most people only show small variations in anatomy, there are certain outliers that can be the cause o f increased risk during surgery i f they are not recognized in time. In the future O R , it could be possible for a surgeon to actually practice a procedure on patient-specific data before performing the real procedure. Before the procedure the site of interest of the patient is scanned. From the images a 3D model is build to generate the V E to perform the procedure in. In a next step, the V R procedure could be recorded, and then optimized, with a robot finally performing the operation on the patient, with the surgeon only intervening when necessary [Satava, 2003].  1.3 Cost Contributing Factors in Haptic Hardware Design A s mentioned in the introduction, force feedback is a significant contributor to the overall costs of a surgical simulation system. For example, Immersion sells a two-instrument interface without force feedback for U S $ 7,800, and a similar product with force feedback for U S $ 28,000. What makes a haptic interface so expensive? For that we have to look at the major cost contributing factors: •  Components  •  Labour / production facilities  •  R&D  •  Marketing  •  Maintenance  1.3.1 Components This section gives with an overview of the components of haptic hardware: motors, transmission, encoders, and electronics.  Motors  The motors are an essential part of the interface: they are the direct source of forces or torques that are exerted on the user. If all six degrees of freedom for each instrument are actuated in a laparoscopic interface with the standard 2 instruments, 12 motors are needed. Almost without exception, modern haptic interfaces make use of permanent magnet motors, either brushed or brushless. Cost of motors can vary greatly. While cheap motors as found in force feedback 14  joysticks can cost only a couple of dollars, high end motors used in many high-end haptic interfaces can exceed US$200 a piece. Motor companies contacted for this research were all leluctant to share pricing information and were only willing to specify prices for a few motors. The most important cost-contributing factors are torque output, cogging, friction, and inertia. These phenomena will be described in more detail in Chapter 2.  Transm ission  The most commonly used transmission systems can be divided into three categories: direct drive, cable-based and geared. In direct drive, the rotational shaft of the motor is connected to the usercontact point of the interface either through a rigid connection ( iDrive , d'Groove [Beamish, 3  2004], Twiddler [Shaver] ), or through a linkage system (e.g. a pantograph design). Figure 1-13 shows five examples of direct-drive haptic interfaces.  Figure 1-13: Five examples of direct drive haptic interfaces (from left to right): the B M W iDrive, the low-cost 1-DOF Haptic Twiddler, T i m Beamish's d'Groove digital turntable, a pantograph configuration by Vincent Hayward, and the Logitech Wingman a force feedback mouse with pantograph design (right)  In some designs gears are used to increase torque. This can add a significant amount of friction, backlash, and inertia and is used mainly in low cost devices like force feedback joysticks [Bin, 2002]. Some designs in force feedback joysticks use belts over directly interlocking gears to reduce backlash [Rosenberg, 2002b].  The pantograph design has been used in a consumer force feedback mouse (Logitech) that sold for below US$100 (Figure 1-13, right). Two important differences from the pantograph design by Hayward (Figure 1-13, second from right), is the absence of expensive machined components  http://www.bmwusa.com/Joy/Drive/Technology/iDrive.htm  15  combined with cheaper motors in the Logitech design.  The result is a haptic interface of  noticeable lower quality, but also a significantly cheaper device.  Figure 1-15: Cable drive and geared systems. The Pantograph (left) is a high-fidelity system with cable drive. On the right are plastic components found in the geared transmission of a force feedback joystick. The design has significant backlash and friction. The large amount of grease present could not compensate the latter.  Cable-drive systems can be found in many high-end multiple degree of freedom devices [e.g. the Phantom by Sensable Technologies and the Laparoscopic Surgical Workstation by Immersion Corp.]. Two advantages of cable-drives over direct-drive systems is that cable drive designs allow more freedom in the placement of the motors relative to the end-effector, and it allows more flexibility in choosing the transmission ratio. Compared to geared systems, cable-driven systems have virtually no backlash. Disadvantages of cable-drive systems are the high costs of manufacturing, assembly and servicing issues.  Finally, there are tension-based devices that use cables and pulleys instead of linkages (Figure 1-17) [Ishii, 1993; Kawamura, 1993; Kim, 2002b]. These systems combine low inertia with the absence of backlash but can be difficult to control because of the complex dynamics of the cables. A commercial version of this design is marketed by Mimic Technologies.  16  Figure 1-17: Two transmissions using cables: A cable-drive system in the LSW laparoscopic interface (left). Arrows indicate the location of some of the cables. The tension-based system on the right combines minimal backlash with low inertia.  Encoders  Most haptic interfaces use digital encoders to measure position. Their cost is highly correlated with the resolution. While haptic problems with low encoder resolution were discussed earlier in this chapter, low resolution can also lead to visible quantization of the tool movements. Costs o f encoders  vary from  US$28  apiece,  as found in one particular commercial design  of a  laparoscopic haptic interface, to roughly US$400 a piece for 6000 C P R encoders found in a high end pantograph design.  Electronics  The electronic components other than the encoders are the interface to the computer and the amplifier.  Interfacing electronics send the digital encoder signals to the computer and convert the digital control signals from the computer to analog signals for the amplifiers. Because of the high update rate, and many degrees of freedom, a very high bandwidth communication channel is needed. The Immersion L S W uses 3 custom-made PCI boards to control the hardware. In force feedback  joystick  design  the  communication  bottleneck  problem  has  been  solved  by  downloading local models of the V E to a processor on the joystick to perform high update rates locally so that only low update rates between the interface and the computer are needed [Patent  17  US2002033841]. The cost advantage of this is that a standard communication port on the computer, like the serial port or U S B - 1 , can be used. This has not been used in surgical simulation so far though M i m i c Technologies is now shipping haptic interfaces with up to 6 D O F that connect to the computer through standard U S B 2 ports. becoming faster, the communication bottleneck  With new computer ports  is diminishing. Surgical simulations  could  benefit from extra local processing power in the haptic interface to offload the main computer CPUs. While processing power of standard personal computers is constantly increasing, it may take a long time before the need for more processing power by surgical simulations is satisfied. Successful attempts to increase processing power in a cost-effective way has seen the use of powerful graphics card to perform haptic computation processing [James, 2002].  Amplifiers are more expensive with increase of power, dynamic range, and reduction in noise.  Since all the components described before are needed for each actuated degree of freedom, the total cost o f components will go up roughly linear with the D O F . A common perception is that at the same time reliability will go down which can add to long-term costs.  1.3.2 Hardware Designs Tendick and collegues at U . C . Berkeley developed a haptic interface that makes use of two Sensable Corp. Phantom haptic devices to provide force feedback at the tooltip in combination with custom made devices that provide torque-feedback  on rotation of the shaft  of the  instruments [Tendick, 2000]. Another design based on modified Phantom's was developed by Ben-Ur at the M I T Artificial Intelligence Laboratory [Ben U r , 1999]. A laparoscopic simulation station developed at the Forschungszentrum Karlsruhe that is now marketed by Select IT as the V E S T System One makes use of modified Immersion Laparoscopic Engines . The Laparoscopic 4  Engines are the precursor o f the Laparoscopic Workstation but had a much less sophisticated design. Its design has similarities with designs used for force-feedback joysticks [Moore, 2000] but with the addition of actuation of rotation of the instrument shaft. Baumann developed an interface based on a spherical remote-center-of-motion mechanical structure [Baumann, 2001] at  4  The 'Karlsruhe Endoscopic Surgery Trainer' http://www-kismet.iai.fzk.de/TRATNER/rnic_trainerl.htrnl  18  the Swiss Federal Institute of Technology, Lausanne, Switzerland. Designs with hybrid spherical mechanisms were proposed by Payandeh et al. at S . F . U . , Canada [Payandeh, 2003].  Currently the following companies produce haptic interfaces or haptic simulations systems for laparoscopic surgery: Immersion, Simbionix, Xitact, and Mentice.  The top model by Immersion Corp. is the Laparoscopic Surgical Workstation. Ten motors are located in the main housing (Figure 1-9).  Cables run from each motor through the arm between  the housing and the instrument to drive the main 4 D O F of the instrument. Only the motors to actuate the grippers are not placed in the main housing but in the handle instead [Patent EP1417547].  Xitact's patent on a haptic device is about providing force feedback to the shaft o f the instrument for both the insertion and rotation. A method is described in which a drive block around the instrument's shaft engages with grooves made in the shaft [Patent WO03023736].  Simbionix partnered with M i m i c Technologies in Seattle to apply M i m i c Technologies' haptic interface technology to Simbionix's simulators. A patent search for "Simbionix" did not bring up any patents related to haptic interface designs of their own in the worldwide database. Mentice, the company that markets the M I S T system, does not have patents related to haptic interface technology either.  1.3.3 Market Size and Relative Cost of Contributing Factors Obtaining a generic formula for the breakdown of costs for haptic interfaces is practically impossible. A very important factor in the cost price of individual products is the production size. With high volumes, the cost of R & D and marketing can be spread over more products, buying power will bring component costs down, and cheaper manufacturing techniques can be applied as well as different designs more suitable for mass production. Given the fact that there are only a limited number of laparoscopic surgeons in the world, with only a limited number of institutions that are able to afford high-tech training environments for their surgeons,  19  the  maximum number of haptic interfaces that can be sold for laparoscopy training may well be in the thousands.  For a 3 D O F haptic interface developed  at a university, part costs contributed 30% to  manufacturing costs, labour the other 70%. For a similar design, but extended to 5 D O F , the components accounted for 60% of the price. The cost of an amplifier was not included, nor the cost of development. Many commercially available haptic interfaces were originally developed at universities, for example the Phantom. It should be noted that haptic devices with high degrees o f freedom are more prone to break down and therefore more expansive to maintain.  The relative cost advantage from big batch sizes may be reduced in the future by the advancement of completely automated flexible manufacturing plants that can make small batches at low cost. This technology, which was pioneered by Paul Wright at U . C . Berkeley [Wright, 1998] relies on customers using software supplied by the plant that automatically checks the customer's design for compatibility with the C A M plant. The approved design is submitted to the plant over the internet and produced with minimal intervention of humans. While the original technology  was  developed  for fast prototyping machines,  this  service  is now  available  commercially for milling, turning, C N C laser cutting, and C N C waterjet cutting of metals as well as injection molding, extrusion molding and thermofolding of plastics in low batch sizes (www.emachineshop.com),  and  fabrication  and  assembling  haptic  interface  of  printed  circuit  boards  (www.pad2pad.com).  The  main  cost-contributing  factors  in  a  are  R & D , components  and  manufacturing. If manufacturing costs for prototyping and manufacturing custom-parts in low batch sizes (50-5000) will substantially come down in the future, the importance of the costs of components will become relatively more important.  1.4 The influence of Haptic Quality on Task Performance Studies have  shown that for multiple tasks,  the addition of force-feedback  significantly  influenced task performance[Adams, 2001b; Moody, 2002; Wagner, 2002] [Adams, 2001a; Moody, 2002; Wagner, 2002]. How accurate does the force-feedback have to be to be effective?  20  The limited number of studies that have examined task performance as a function of haptic quality suggest that task performance is often not affected by differences in haptic quality, even i f an obvious degradation is perceived [MacLean, 1996; O'Malley, 2002; Richard, 2002].  This  suggests that the force rendering in current surgical simulators may be of higher quality than necessary for their intended purposes.  1.5 The Big Picture This research is part of a bigger project to assess the validity of training environments for laparoscopic surgery. Kinnaird assessed performance validity of the V R training environment used in this study and a bench top trainer by quantitatively assessing whether measurable quantities of performance are the same in the simulators as those in the O R [Kinnaird, 2004]. She found that the surgeons treated the V R environment differently than the O R . The impact o f this on the results presented here is discussed in paragraph 3.5.4 and "Upgrading the G o l d Standard Hardware and Software". In a parallel study, L i m is investigating the influence of training in the V R environment on O R performance. This study addresses the issue of validity of the simulator by asking the following important question: "Does training on the simulator result in improved O R performance?". Publication of results of that study is expected in fall 2004. Together with the research presented here, these three projects aim at obtaining a simulation for training of laparoscopic technical skills that is both a valid alternative to training in the O R and cost-effective.  1.6 Thesis Objectives Given the high costs o f high-end haptic hardware, the possible advantages  force-feedback  simulators can bring for teaching hospitals, the barrier the high costs pose for teaching institutions to acquire these devices, and the plausibility that lowering the quality of the hardware may not bring a significant change in user performance, we would like to answer the following question:  " Can we degrade haptic quality in a state-of-the-art simulator without incurring a noticeable difference in user performance?"  21  Secondly, i f we find that certain factors in haptic quality can be degraded without affecting task performance, can we rank them on impact? E . g . i f both friction and backlash lead to a significant chance in task performance, which of the two affects task performance most? B y answering these questions we hope to define new guidelines that will lead to more cost-effective designs of haptic hardware for surgical simulation. T o do this, we developed a simulation with variable haptic quality (Chapter  2) and studied the impact of varying the hardware quality on task  execution with user studies described in Chapter 3. Chapter 4 will contain the major findings, conclusions, and future work.  22  Chapter 2  Simulating Inexpensive Haptic Hardware  This chapter describes a platform devised to explore the dependence of task execution in a virtual environment on the quality, and therefore cost, of the system's haptic hardware: a complex haptic interface in which hardware quality can be varied in simulation. Software intercepts the position and force signals between the haptic hardware and the virtual environment software, and alters them to create the effect o f increased friction, cogging, backlash, inertia and/or lower force output. A l l parameters o f the introduced effects can be set independently or in combination and on a continuous scale. A primary contribution o f this project is the creation of haptically realistic hardware models that are stable in combination on complex haptic hardware.  Section 1 will give an overview o f our implementation o f the different hardware quality effects and state our objectives. Section 2 will discuss the models that we use for each effect, introduce relevant previous work, and provide details on integration of the different models.  Finally  Section 3 provides experimentally obtained data from our models and results from tests on computational efficiency.  A conclusion and future work section can be found in Chapter 3. The  majority o f the work in this chapter has been presented at I C R A 2004 [Brouwer, 2004].  2.1 Motivation and Approach There is a general consensus that a significant part o f surgical training for minimally invasive surgery will move towards computer based simulation. While the software for these simulators has significant room for improvement, the current commercially available hardware is able to render soft tissue simulations very well. A main drawback o f the hardware is a cost too high for many hospitals to afford. Therefore, there is an incentive to make this hardware significantly less expensive. One approach is to invent lower-cost components that don't sacrifice quality; e.g. through optimizing electro-mechanical design (e.g. [Vlachos, 2004]), and signal processing to compensate for unwanted characteristics as friction [Kwon, 2000] or torque ripple [Lawrence, 2004]. Another approach, taken here, is to understand the dependence o f task execution on the device's performance in order to establish design guidelines for the minimum haptic interface quality required for a given application. That is, we would like to see if, and under what conditions, low performance components will yield equivalent task performance as their high  23  performance counterparts, thus permitting systematic substitution of less expensive components where appropriate.  2.1.1 Goal of Simulations To  study the dependence  of task execution  on haptic hardware quality, we  require an  experimental test bed that: •  Allows us to vary the quality factors associated with major cost-contributing components of haptic hardware.  •  Supports this variation in quality levels across a realistic range of possible designs.  •  Allows quality factors to be tested singly and in combination.  Such a setup will allow us to rank hardware quality characteristics based on their impact on task performance: e.g.  given the  financial  constraints, should the designer put more effort in  minimizing friction or cogging?  2.1.2 Approach to Designing Simulations Our test bed is based on a surgical virtual environment with force feedback in which we can vary perceived haptic hardware quality through simulation, by means of a custom software plug-in that intercepts the control loop between the virtual environment and a state-of-the-art haptic interface. Through modification of the position signal sent from the hardware to the virtual environment and the force signal sent the other way, this high-fidelity interface can be made to display characteristics associated with inexpensive hardware, such as friction, superimposed on the V E . A s a result, the user will perceive forces from two simulations: the forces generated by the surgical simulation software, as well as the forces generated by the hardware-degradation simulation. Forces generated by the surgical simulation software are altered by the hardwaredegradation simulation before they reach the user. The forces generated by the hardwaredegradation simulation are dependent on instrument kinematics as well as the forces generated by the surgical simulation software.  24  Computer 1 Device  Position  Position . Custom DLL  Driver  Force  Surgery Simulation  i  Force  Software  Figure 18: Interception of the signal flow between the surgical simulation software and haptic control algorithms allows the perceived haptic quality to change according to algorithms that model desired behaviour. W e chose the approach of simulated degradations over a hardware implementation because the latter would entail building haptic interfaces with a wide range of components and designs. While the use of real hardware instead of simulated hardware would give the highest possible fidelity, it would not allow us to change parameters easily or individually, while construction of the hardware would be both time consuming and expensive. T o illustrate this, i f the effect of higher cogging in the current hardware were to be studied, the motors would have to be replaced with motors with higher cogging. Since the variety of non-custom motors is limited, the new motors would almost certainly have different inertia as well as different dimensions from the one that are replaced. The former would lead to confounding of parameters in the user test while the latter could potentially lead to a very expensive redesign of the haptic interface.  Though the fidelity of a software implementation is limited by the accuracy of the models and the quality of the haptic interface used to display the models, the models of hardware degradation only have to be sufficiently realistic to result in comparable task performance. W e maximized the quality of the hardware simulation by using one of the best laparoscopic haptic interfaces available at the time of experimentation.  Overall, the advantages  outweighed the possible disadvantage.  25  of software  simulation  2.1.3 Hardware and Virtual Environment We use Immersion Corp.'s Laparoscopic Surgical Workstation ( L S W ) (Figure 1-9; hardware 5  specifications in Table 2.1). This device is currently the only commercially available high-end haptic interface for laparoscopy. This device has two 5 - D O F laparoscopic instruments, each of which can move in and out of a 2 - D O F pivoting point and rotate around a longitudinal axis. A virtual tool tip opens, closes and rotates relative to the main shaft. The first two of these three degrees of freedom are actuated. The main 4 D O F are actuated by low inertia, cogging-free permanent magnet motors while position is read by digital encoders (resolution ranging from 1024 C P R to 2048 CPR). Results of a preliminary study on some mechanical characteristics of the device is performed by Waldron and Tollon [Waldron, 2003]. Our software is designed as a stand-alone library compiled into a dynamic link library ( D L L ) . A DLL  is a file containing executable  code and data that are dynamically linked with the  application that uses them during program execution rather than being compiled with the main application. It can be shared by multiple applications. Our D L L intercepts the force and position signals between the hardware driver and V E software.  It can therefore relatively easy be  modified to work with different kinds of V E software or hardware.  T A B L E 2.1.  LAPAROSCOPIC WORKSTATION  Range  Insertion  170 mm  SPECIFICATIONS  Cont.  Peak.  Sensor  Output  Output  Res.  11.0 N  19.0 N  .008 mm  The  Pitch  100°  0.47 Nm  0.85 Nm  0.01°  Yaw  100°  0.47 Nm  0.85 Nm  0.01°  Handle Twist  180°  0.04 Nm  0.07 Nm  0.03°  Virt. Tip Twist  Cont.  N/A  N/A  0.7°  Handle Grip  20°  0.15 Nm  0.32 Nm  0.04°  virtual environment ( V E ) is a simulation of minimally invasive surgical procedures,  intended to offer training in laparoscopic techniques. It incorporates abstract tasks such as pickand-place tasks as well as more complex modules requiring the subject to dissect, staple and cut  5  www.immersion.com/medical  26  structures.  Force feedback  is provided in Cartesian coordinates  to the tool-tip  on  two  instruments. The software is commercially available as the Reachin Laparoscopic Trainer by Reachin Corp . More details about the available V E modules are given in Chapter 3. 6  2.1.4  Challenges  The main challenges in implementing our hardware degradation simulations are caused by the complex dynamics of the haptic hardware in combination with a low and varying update rate. Models that are stable in a computer simulation may not be when displayed haptically, because the virtual models interact with the real hardware dynamics, including the hardware's friction, inertia and coupled kinematics. For example, in our hardware, rotating the unactuated tool handle altered the dynamics enough to cause instability in the pitch and yaw direction in some cases. A n accurate description o f hardware dynamics, when available, can in principle be incorporated into a computer simulation [Hacksel, 1994; Grewal, 2001]; however, this is usually unavailable for commercial hardware, and it is difficult to obtain this information experimentally. Even i f the model was available, this hardware is so complex it would still be hard to utilize since the algorithms require very accurate models. Likewise, our need to simultaneously  simulate a variety of hardware degradations  vastly  complicates the stability prognosis. These virtual models interact with one another, in addition to the real hardware. This has both influenced details of the model implementations and imposed limits on their parameterization. Finally, Reachin's simulation software uses a sample rate that varies between 200-2000 H z when working in conjunction with our haptic degradation simulation computer with 2 G B R A M .  on a 2.0 G H z dual Xeon  W e have no control over the sample rate, except for making the  hardware degradation simulation as fast as possible (see paragraph 2.3.3 Computational Load). W e can not impose a fixed sample rate but we can measure update times. Therefore our models must work with all sample rates in this range.  2.2 Methods: the Hardware Models W e have chosen to model several primary effects found in less expensive haptic interface hardware: cogging, inertia, backlash, friction and force saturation. Together with encoder  6  www.reachin.se  27  resolution and refresh rate, these are the most prominent quality descriptors for haptic hardware. Figure 2-1 shows which hardware components are associated with each quality aspect.  Measured Position  Position  a CD TO E ZD  Encoder resolution  d  -e o > > Force Request  Motor &Power Electronics - inertia - torque ripple - friction - max torque  P o s i t i o n Transmission - backlash - friction - inertia  Actual Position CD CO  Actual Force  Force  Figure 2-1: Flow diagram of forces and positions in a virtual reality system with haptics, and the factors that limit haptic fidelity.  W e did not degrade refresh rate in our experiments because it depends on computing power rather than the haptic hardware, and the cost of computing power is rapidly declining. N o r did we degrade encoder resolution because the encoders used were not expensive and a reduction in encoder resolution would result in insignificant cost-benefits (in fact, our simulations of haptichardware degradation would have benefited from better encoders). In the following paragraphs, each effect is initially presented as a 1-DOF translational model. W e do not describe the rotational variants, also implemented, which are obtainable through a straightforward transformation. Each section begins with a short discussion of previous work relating to simulation of that physical phenomenon. The model parameters we used are listed in Table 2.2.  2.2.1 Inertia Background Inertia is the force or torque that resists changes in velocity of an object. A n object with high inertia will require more force to speed up or slow down than an object with low inertia. The most straightforward way to simulate inertia is to multiply actual acceleration by the virtual inertia. However, an acceleration estimate obtained by double-differentiating the position signal is too noisy to produce a stable simulation. A common solution is to simulate the virtual inertia's 28  dynamics through integration of a 2nd order system, and virtually couple it to the probe position through a damper-spring combination (e.g. [Colgate, 1995]). T o calculate damping, only a velocity estimate is required. The stiffness of the spring and damper coefficient determine the tightness of the coupling, which ideally is critically damped.  Implementation  Our system's temporal and position resolutions are such that the velocity signal tends to oscillate between a small number of values. Therefore we applied a first- order, low- pass Butterworth filter to the raw velocity before feeding it to the inertia model. W e implemented this filter in the standard difference equation:  a(\yv^n)  = b(l)*v Jn) ra  + .... + b(nb +  + b(2yv Xn-\) m  -a(2)*v (n  In this equation Vf is the filtered velocity, v  raw  a(na + Y)*v (n  -1)  f  irv(n-nb) f  -na)  the raw velocity, a and b vectors with the filter  coefficients and na and nb the length o f vectors a and b.  A Butterworth filter was chosen  because infinite-duration impulse response (IIR) filters require in general a much lower filter order then finite-duration impulse response (FIR) filters for a given performance level and accordingly introduce less delays, which is very important in this application. Also,  the  Butterworth filter has a maximally flat magnitude response in the passband, giving the smoothest response achievable. A l l standard implementations of these filters require constant sample rates over all the last na and nb updates, and therefore we could only use a 1 order filter as illustrated st  in formula (2.2). Filter coefficients are pre-calculated in M a t l a b ™ . The sample rate windows for which the same coefficients are used are 10Hz wide at low update rates (150Hz) and up to 200Hz wide at higher update rates. The lookup algorithm is designed such that the low-updaterate coefficients are retrieved first, so the least amount of time is spent when time is shortest in supply. The cut-off frequency was chosen at 70Hz to balance filtering high-frequency spikes due to time and positional discretization while passing user-induced rapid movements.  a(l) *v (n) = b(\) * v f  r  a  » + b(2) * v „ (n -1) - a(2) * v (n -1) w  29  f  (2.2)  Because of the low starting quality of the velocity signal, an inertia signal based on its differentiation is still too noisy to be used. Therefore the inertia signal is low-pass-filtered again by averaging it over the last three updates or a 20ms time window, whichever is shorter. The resulting model is illustrated in Figure 2-2. Parameters are listed in Table 2.2.  diff  - - •  low  low pass  pass  'inertia  K  B  integrator  integrator  1_ M  Figure 2-2: Virtual coupling with two low- pass filters to simulate inertia. Subscript 'vm' indicates that the variable is related to the virtual mass, subsript 'hi' indicates it is related to the haptic interface.  W e hoped to be able to increase the stiffness of the virtual coupling through a stability analysis of the model [Colgate, 1994; Colgate, 1995], thereby making the K and B variables dependent on sample rate. High update rates will typically occur during free space motion, when there is no direct contact between the instruments and the tissue. Since we also expect the  largest  accelerations in user movements to occur at this time, it would make sense to stiffen the virtual coupling in this regime. However, the mathematical model we derived by applying Colgate's theory [Colgate, 1994] did not provide more insight on the relationship between the stability limits of B and K as a function of the sample rate. This is a direct result of the complexity of our z-l transfer function compared to the transfer function used by Colgate et al.  (H(z) = K + B — ) . Tz  Therefore we have continued to use the same virtual coupling coefficients regardless of sample rate. In a paper published after completion of our setup, Mahvash et al. proposed a method that extends Colgate's results to the general class of nonlinear virtual environments and non-linear devices [Mahvash, 2004].  30  2.2.2 Backlash  Background  Backlash refers to the play between mechanical components that results in discontinuous motion transfer. Often backlash is present in gears due to play between the teeth o f the gears. In haptic interface design, backlash can be present in the transmission between the motor and the part o f the interface that is in direct contact with the user. Because the encoder is often mounted directly on the motor (Figure 2-1), backlash can also affect position measurement. The amount of backlash is dependent mainly on the design of the transmission. A s discussed in Chapter 1, direct drive and cable driven systems have very low backlash or none at all, while geared systems can have considerable amounts of backlash. In a system with backlash, motion transfer between two masses occurs within a finite gap, causing a discontinuity and impact upon changes in direction and velocity. A significant amount of simulation research has been done in the control theory community to accurately control systems with backlash. In a commonly used model, impact between the two masses in a transmission with backlash is approximated as occurring through a linear damped spring [Gerdes, 1995; Jukic, 2001] as depicted in Figure 2-3. >.  Backlash "width"  F1  g  H  Figure 2-3: A backlash model commonly used in the field of control theory. XI indicates the position of mass 1 (Ml). X2 indicates the position of mass 2 (M2). A spring and damper combination on each side of the gap simulate impact of the two masses. The spring forces F are a function of the indentation 8, and the damper forces G a function of the speed of indentation 5. The following equations describe the system when the masses are in contact:  31  F -(F  +  G)=M x  l  (2.3)  F +(F  +  G)=M x  (2.4)  l  2  l  2  2  When the masses are not in contact, these equations simplify to:  F,  =M x 1  (2.5)  1  F =Mx 2  2  (2.6)  2  Implem entation W e have adopted this model b y attaching the virtual coupling to the gap-wall, engaging it when the user interface contacts either edge o f the gap. In Figure 2-4, the virtual mass (M ) represents vm  the simulated extra mass o f the motor and transmission. The position o f the virtual mass is x . vm  The user's input position is indicated by x/,,-. W e assume that there is negligible backlash in our real hardware's cable drive transmission and therefore consider the encoder signal an accurate estimate of x/,,-. Probe  Probe  Friction  H4  M„  IVL  /////?////////////7///  EE /P//////////7///  CI  (a): In the gap  (b): Outside the gap  Figure 2-4: Backlash model  T o enhance stability, we apply a small amount o f friction on the mass M  mv  while the masses are  not interacting to prevent them from oscillating: in any real system some friction would always be present. This friction model is described in Section 2.2.3. When the probe is i n contact with the mass, the virtual coupling engages the gap wall (b), and a variable p  vc  point of the virtual coupling. p  vc  holds the attachment  is undefined when the probe is not in contact with the mass.  32  if M x  >  if x  X V  M  <x  hi  vm  + 0.5 • cigap : -0.5• d  gap  P  :  v  c  + 0.5 • Jgap  =x  vm  p„ = x„  -0.5-d  m  (2.7)  gap  The force felt by the user is then described as:  if (x  vm  - 0.5 • d  gap  <x  ht  <x  vm  + 0.5 • d ): gap  F =0 otherwise: F = F  (2.8) ext  + K(x  vm  -x ) M  + B (x 2  vm  -x ) hi  2.2.3 Friction Background Friction refers to the force that resists the relative motion of two bodies in contact, or the tendency to such a motion. Since friction plays an important role in control of mechanical systems, a substantial amount of work exists on the modelling of friction. Relatively little work has been done on the haptic display of friction and how this modelled friction compares to real friction in the way it affects task performance. O n a microscopic scale all surfaces contain asperities, even i f they look smooth (Figure 2-5). When two of these surfaces are in contact and one surface tries to move relative to the other, these asperities will lock or rub against each other, causing the friction force.  Figure 2-5: Microscopic contact between two surfaces. The actual surface of contact is small compared to the total surface.  The relative motion of two surfaces in dry friction can be categorized as follows: 33  •  Presliding: During static friction, the asperities can deform in both normal and tangential directions. Experimental observations of ball bearings in small motions have shown an approximate linear relation between applied force and displacement during presliding. Experiments by multiple authors, summarized in [Armstrong-Helouvry, 1994] have shown that the breakaway displacement in engineering materials is in the order of 2-5 microns in steel junctions.  •  Breakaway and sliding: Friction is proportional to the shear strength of the asperity junctions. The area of these junctions is in direct proportion to the total load. In surface contact without any contamination, the shear strength of the contact area can be as great as the shear strength of the materials themselves. In practice, surfaces  are never really clean, and usually  lubricants are added to lower the shear strength. Lubricants contain additives that bond to the metal surface and cause the shear strength in the contact area to lower.  Many friction models are described in the literature; Armstrong-Helouvry et al. provides a good overview [Armstronghelouvry, 1994]. The most important models will be reviewed in the next section.  Haessig et al. proposed a friction model that simulates the rubbing o f asperities of two surfaces [Haessig, 1991]. The model introduces deformable bristles, sticking out from the surface, as an equivalent of the asperities. The bristles can attach to bristles on the other surface, deform under motion and snap when the force becomes too high. The friction force is dependent on the resultant deformational forces of all bristles (each bristle is basically a spring). The bristle model was designed for accuracy, without regard to use of computer time, to accurately simulate multipoint microscopic stick-slip contacts in real surfaces, and it is too computationally expensive for real time processing. Therefore Chen et al. developed a version for haptic rendering based on a single bristle that produces the dependency between normal and friction force [Chen, 1997]. The authors report mixed results, and we could not implement it because our interaction normal force is unavailable. In Dahl(1976), the author proposes a friction model based on a single differential equation. In this frequently cited model, the time rate of change of solid friction is expressed as:  34  dF(x)  dF(x) dx  dt  dx  (2.9)  dt  in which F(x) is a friction force that is only a function of displacement x. In 2000, Hayward & Armstrong showed that this model drifts i f there are small oscillations in position while a small bias force is present [Hayward, 2000]. This is important in haptic rendering, since position is read from digital encoders that tend to oscillate due to their discrete nature and the natural tremor of the hand.  Hayward & Armstrong [Hayward, 2000] produced a 4-state version dependent only on position. However, the state transition process assumes a constant sampling rate, making it unusable for our system. Karnopp introduced a friction model that incorporates stick-slip without pre-sliding: i.e. when the friction force is below  F j, stal C  the relative velocity between surfaces is set to zero, something  that can not be done in haptic simulation i f the velocity of one of the objects is directly controlled by the user [Karnopp, 1985]. In this model the friction force Ff is a function of velocity v, except for the speeds where the absolute velocity is smaller then a value v  . In this velocity range,  min  friction force is the resultant of all forces working on the object. If this force exceeds a set limit F iick, s  the object will start to move and the friction force will be dependent on velocity again.  Richard proposed a modified version of Karnopp's model that included viscous friction and asymmetric friction values for positive and negative velocities [Richard, 1999].  Nahvi & Hollerbach introduced a haptic friction model that has two states: stick and slip. In the stick-state, a virtual spring extends from the current position of the mass to the rest position of the mass to simulate presliding. This spring ruptures when the spring force exceeds  F ,i . sla  C  The  transition from slip-stick is made continuous by choosing the attachment position of the spring such that the static friction force is equal to the slip friction force [Nahvi, 1998].  35  Implementation  Multiple authors [Chen, 1997; Gosline, 2001] reported oscillation problems with friction forces based on velocity measurements in systems where velocity is not directly measured but obtained from discrete position measurements.  With the haptic hardware used in this study, the update  rates achievable, and the low velocity movements in this task, only 0 to 3 encoder tics pass in one update. Even after filtering this would result in inaccurate and possibly oscillating friction values.  Multiple authors identified friction to be non-symmetric (with regards to velocity) in friction identification experiments  [[Armstrong-Helouvry, 1991;  Johnson, 1992]. T o minimize the  number of variables in these experiments, we assume the friction to be symmetric.  For our main haptic friction effect, we use the model developed by Nahvi et al but we assume the unknown normal force to be o f unit size. In the slip phase the friction force Ff is then defined as: F  in which p  d  /=-^jq  '/H>  V m  in  (2-10)  is the dynamic friction coefficient, v is the tangential velocity o f the two moving  surfaces in the haptic interface for which extra friction is modeled, and v  min  is the minimum  threshold velocity to remain in the slip state. When the relative velocity of the two surfaces drops below this minimum, the spring attaches so as to form a continuous transition from slip to stick state:  F =-p ~ f  = -K (x-x )  d  f  c  (2.11)  in which x is the attachment point o f the spring to the second surface: the stick centre. The stick c  centre can therefore be found by: x =x~%-f e  K  f  |v|  (2.12)  It reaches a maximum static friction (stuck state) at a pre-sliding displacement of 100 um in translation and (0.0075 rad in rotation). Parameters are shown in Table 2.2.  36  In our backlash model, friction was necessary to dissipate kinematic energy from the virtual mass to prevent it from sliding back and forth between the walls. Since the velocity o f the virtual mass in the gap is not controlled by the instrument position, we were able to directly apply Karnopp's friction model here. The advantage of Karnopp's model over the model proposed by Navhi et al. for objects not directly controlled by the user is its increased stability in the stick state: velocity can be set to exactly zero. In the stick state, this model can be described as:  if  \F \<Fn» f  *>=E «» F  v  When the sum o f all external forces exceed the maximum F  =  0  (- ) 2  13  , the contact will go into the slip  max  state in which the state variables are defined similar to the model proposed by Navhi et al.:  V  2.2.4 Torque Ripple and Cogging D C brushed permanent magnet motors are the most commonly used actuators for kinaesthetic haptic force feedback interfaces. Ideally, their output torque would be independent of the position of the rotor. However, in most motors torque fluctuations occur as the motor rotates due to cogging and torque ripple.  Cogging Caused by the preferential alignment o f rotor and stator, cogging can be felt as a series o f opposing and aiding torques as the motor is turned when unpowered (Figure 2-6).  37  Figure 2-6: Cogging: A stable (left) and unstable (right) detent position of a permanent magnet motor.  Figure 2-6 (left) shows the rotor magnet aligned with the poles. This is called a stable detent position: any disturbance of the rotor position will result in a torque that causes it to realign with the poles again. The right side of Figure 2-6 shows the same magnet in another detent position: here also no resulting torque on the rotor is present but in this case any disturbance o f the rotor position will result in a torque away from the shown position. A position like this is called an unstable detent. In formula form, the cogging torque T  coggjng  can be described as:  (2.15)  with P the number of poles, <f> the air gap magnetic flux, $R the reluctance, and 6 the rotor g  position [Studer, 1997]. A motor design with more poles will usually result in a higher torque for the same current level. A s the number o f poles increases, the space for each pole will become smaller, while the total amount of between-pole space increases. This eventually leads to decreased performance, limiting the number of poles [Hanselman, 1994]. A s a result, the cogging torque o f a permanent magnet motor is a complex function of commutation, motor geometry, and material properties. Example cogging torques as a function of rotor angle are shown in Figure 2-7. Many motor design techniques have been applied to reduce cogging [Hanselman, 1994; Studer, 1997] successfully, such as skewing of the magnets or using ironless cores. A drawback of low and zero cogging designs is their high price.  38  e (Degrees) r  rotor position (slot pitch)  Figure 2-7: Examples of simulated and experimentally obtained data from various I E E E publications (source (left to right, top to bottom): [Benarous, 1999], [Deodhar, 1996], [Ishikawa, 1993], [Studer, 1997]).  Ripple torque  The main cause of ripple torque is fluctuations in back electromotive force ( E M F ) from their ideal value. Most permanent magnet D C motors are designed to have a trapezoidal back E M F [Kapuscinski, 1997]. In practice, deviations from perfect trapezoidal shape occur. Figure 2-8 illustrates the resulting rounded edges and nonuniform slopes.  39  am® (s) Figure 2-8: Experimentally obtained back E M F in a motor with trapezoidal back E M F (source: [Sozer, 1998]).  The effect of this on the torque output is seen in Figure 2-9 which show experimental results from work by Lajoie-Mazenc et al. [Lajoie-Mazenc, 1989] on ripple torque in a motor with trapezoidal back E M F . The left diagram shows the output torque as a function of rotor position for a motor with 3 phases. The right figure shows the results for an identical motor except for that it has 9 phases. According to the authors, cogging is negligible in both motors.  Figure 2-9: Torque ripple as a function of motor angle (source: [Lajoie-Mazenc, 1989])  Torque output is higher for the design with 9 phases. The angular frequency of torque ripple is higher in the design with 9 phases, but the torque ripple amplitude is the same in the two designs.  40  Three-phase motors are most commonly used since two- and three-phase motors minimize the number of power electronic devices required to control the winding currents.  Implementation W e produced a torque-angle shape match to experimentally obtained cogging data [Ishikawa, 1993; Deodhar, 1996; Studer, 1997; Benarous, 1999] which resulted in a sinusoidal relationship between torque and motor angle. Since both cogging and torque ripple produce a positiondependent torque fluctuation, we chose to capture both effects in a single model to reduce experimental variables. While in torque ripple the exact function shapes can vary as a function of torque, we  felt this was  less critical since torques are generally low in our simulation.  Furthermore, much of the fine instrument positioning occurs while there is minimal tissue interaction. T o minimize the number of experimental parameters, we only modeled cogging.  2.2.5 Torque Saturation Electromotors are usually described by both continuous and peak maximum torque outputs; the peak torque can only be exerted for a limited time because of heat generated. Thus, while a motor has two design torque limits, the lower limit will be expressed in hardware as overheating and eventual damage to the motor rather than a haptically perceptible performance reduction. Therefore we applied only a single cut-off limit for motor torque: i.e., when in effect, the motor force is clipped to the imposed saturation level.  Figure 2-10: The relation between forces displayed at the haptic interface and forces commands send by the virtual environment when force saturation is turned on. F E is the force output by the virtual environment. F i is the force displayed on the haptic interface. F can be varied to saturate the force at the desired level. V  H  m a x  41  2.2.6 Model Integration We integrated our models in two stages. First, we combined the various degradations into a single DOF model so as to maximize simulation fidelity and stability. Next, we extended this 1DOF model to the 3-DOF movement of the instrument tool-tip.  1-DOF integration  To the extent possible, we based our integration on the actual physical location of the respective degradations in a typical haptic hardware system (see Figure 2-1). In some respects, detailed and justified below, this was not practicable. We first simplified our model of the real system (Figure 2-1) by lumping the mass of the motor and transmission. Backlash is then defined as the difference between the user's probe and the lumped mass. Friction is defined as the movement-opposing force between this mass and the 'ground'. Forces from the virtual environment are transferred through this backlash mechanism. As a result, the user feels forces from the virtual environment and from the degradation models only while the probe is in contact with the mass Figure 2-11. The mass of the motor and the parts of the transmission were all lumped together to avoid the difficult, if not impossible, process of realistically simulating the dynamics of impact of multiple small masses at very small distances from each other.  Probe x  c  hi  £ c > c LU  Cogging  gap.  ves+c  "CD  Friction  I  Saturation  M.  Figure 2-11: The basic physical representation of our model integration with backlash present. The following subscripts are used: hi=haptic interface, vm=virtual mass, c=cogging, ve=virtual environment, ves=saturated V E force.  42  Probe c  <D  E c 2 >  LXjii^vmjL ! 1  Cogging  fves+c  LU "ro  M.  Friction Saturation  Figure 2-12: The physical representation of the model integration if no backlash is present  To maximize perceptual fidelity of the different models, the V E , cogging, and friction forces are applied directly to the instrument instead of to the virtual mass when possible: the virtual coupling is an device necessary to simulate inertia, but it also low-pass filters the other degradation models as well as the forces coming from the virtual environment. Therefore, the only case in which these forces are applied on the virtual mass is when the backlash is turned on. In this situation it is necessary to apply V E forces and the appropriate hardware degradation forces directly to the mass since these forces determine the position of the virtual mass in the backlash-gap: i f a sinusoidal V E force should work on the tooltip, then backlash in the transmission can cause the motors to move back and forth while the user interface is being held in a rigid position. In this case the V E , cogging and friction models get positional input from the virtual mass, after this position signal has been corrected to stay within the range of the gap - i.e. when backlash is turned on these models receive a positional input signal that can not be more than half a gap width away from the instrument position.  Extension ofl DOF to 3 DOFs  The previously described 1 DOF models are applied to 3 different axes on each of the two instruments: insertion (translation), yaw (rotation) and pitch (rotation). Environmental forces in world frame coordinates need to be transformed to these three axes and back as well as a tooltip position to insertion, yaw and pitch transformation.  43  Figure 2-13: The coordinate systems in the L S W : the origin of the world frame coordinate system is defined in between the two trocars (left). The virtual tool shaft can be adjusted in length and rotated (right).  The environmental force F is transformed to tool tip coordinates after which these lateral forces e  are used to calculate insertion force F „ yaw torque T  , and pitch torque T h.  yaw  F -F i  pitc  sin(yaw) * cos(pitch) + F cos(yaw) * sin(pitch) - F_ cos(_yaw) * sin(Pitch) (2.16)  xe  e  e  The effective moment arm has to be calculated to compute the torque around the pitch axis o f rotation:  L .,. = Insertion * cos( yaw) i  T P  =  tch  ,ch  1 Pi  * ( y, F  e  (2.17)  cos(pitch) + F  :e  sm(pitch))  iln which L uch is the effective torque arm o f the environmental forces working around the pitchp  axis. T n h is the torque around the pitch-axis. A n identical calculation is used for the yaw p  c  direction:  L  = Insertion * cos(pitch)  ya*  = ya»  T  L  * ( t,e F  (2.18)  COS( VOW) + F_  e  44  SVOiyOW))  The transformation from insertion forces, yaw and pitch torques to forces in world coordinates is as follows:  F -F tx  sin(yaw) cos(pitch) + - ^ J  j  F =F ty  T. cos(yaw) sin(pitch) + " p  i  L  cos(yaw)  cos(pitch)  ch  (2.19)  ^ pilch  F _ = -F. cos(yaw) cos(pitch) +  T  mw  T  aw  sin(yaw) +  t  ^'yaw  sm(pitch)  ^yaw  Backlash causes a discontinuity between user input and visual feedback: due to play in the mechanism, the instrument handles can be moved small amounts before the virtual encoder will register it. T o simulate this possibly important visual feedback characteristic, the position of the virtual mass is sent back to the graphical environment when backlash is turned on. T o visually simulate infinitely stiff gap-walls, the difference between the real and virtual tooltip position is limited to half the gap width. In the V E , the instrument position is defined by two vectors: the position of the tooltip and the orientation of the instrument to calculate where the insertion points of the instruments are. Backlash-adjusted pitch, yaw, and insertion are used to update a positional offset vector and an orientation offset matrix. These are used in the next update to reflect the new perceived position of the instrument and instrument insertion point. T o calculate the positional offset in Cartesian coordinates, we use E q . (2.20):  cos(-yaw) Offset =\ c  0 -sin(-vaw)  sin(pitch) sin(-yaw)  cos(pitch) sin(-yaw)  cos(pitch)  -sm(pitch)  sm(pitch) cos(-yaw)  cos(pitch)cos(-yaw)  Offset  yaw  Offset * pitch  * Insertion Insertion  (2.  °ff insertion Set  A n d finally the offset in instrument orientation can be calculated by first calculating the offset in orientation of the tool tip frame R ffsei,t and multiplying this with the transformation matrix from 0  tool tip coordinates to world frame coordinates  R. w  45  cos{Offset J ya  pjlch  0  R offset,: =R  cos(Offset )sm(-Offset J pilch  pilch  sm(Offset ) cos(-Offset J pitch  ya  -sin(Offset )  pitch  ya  <j//i«,c  ya  cos(Offset )  - sm(-Offset J R  sm(Offset )cos(-Offset J  ya  cos(Offset ) cos(-Offset J pitch  ya  J  (2.21)  * R  offset,! - \ i f  2.2.7 Software Implementation The hardware degradation software has a modular design. For each instrument, an instance of our HapticEffect class is created. The HapticEffect class creates instances o f the different degradation classes for each degree of freedom. Because of this design, the code can relatively easily be re-used for haptic interfaces with a different number o f degrees o f freedom. The main limitation to reuse o f the code for other devices is the use o f Immersion Corp.-specific variables, mainly in the HapticEffect class.  Degradation Classes Backlash-Inertia  Classes for data storage L i n k e d List  Main class Cogging  Haptic Effect Node  Friction  Saturation  In the V E software, an instance of the Haptic Effect class is defined for each instrument. Text files contain settings for the different degradations. The V E contains a function that updates the haptic interface forces and retrieves new positions. In this V E function our haptic-effect update function is called that updates forces and positions in our hardware degradation model and returns the 'degraded' position and force values to the V E . A version o f the code that was compiled into the executable of another virtual environment generates a window with sliders to allow the user to adjust the parameters at any moment during runtime. Because o f memory sharing issues between the HapticEffect D L L and the main application it is not possible to use this window with the Reachin surgical V E .  46  For various reasons, the code was compiled with a Microsoft Visual C++ compiler into a D L L . This D L L is called by the Reachin device driver D L L . A problem was caused by the fact that the Reachin V E was created using a Borland compiler. Even though D L L files are an important component of the M S Windows platform, their format is not standardized; the major compilers do not produce the same D L L format. A s a result, software compiled with a Borland compiler can not read D L L s compiled with a Microsoft compiler. Even different versions of the Microsoft compiler generated compatibility issues. There are solutions to work around this problem but many cannot deal with class definitions in C++. A n exception is described in an article on bcbdev.com which entails creating a separate D L L that creates virtual C O M wrapper to translate 7  between the two D L L s that are compiled with different compilers. W e used this method here.  2.3 Analysis and Discussion of Simulation Methods The models above were implemented on a dual Xeon 2.0GHz with 2 G B o f R A M running Windows 2000, Service Pack 4. Table 2.2 lists key model parameters used in the integrated version of the models; the values were chosen through a combination of realistic levels we expect to see in inexpensive  hardware components,  and constraints imposed by simulation  stability. Below, we discuss some of the more interesting features we observed in the simulations individually and in combination. T A B L E 2.2  MAIN PARAMETERS OF T H E MODELS O N SIMULTANUOUSLY  Inertia  7  Translation  Rotation  Mass  = 0.2 kg  = 2gm  K  =600 N/m  = 4 Nm/rad  B  0.3 critical  0.2 critical  damping  damping  2  Backlash  Gap Width  = 1 mm  = 2"  Cogging  Amplitude  0.6 N  0.04 Nm  Friction  Presliding  = 100 pm  =5 millirad  Stick Velocity  = 5 mm/s  = 0.1 rad/s  http://www.bcbdev.com/articles/vcdll2.htm  47  Implementation of the cogging and saturation setting were very straightforward. The following sections will discuss details of the Friction, Backlash, and Inertia implementation.  2.3.1 Friction Figure 2-14 shows a measured probe trajectory segment with only the friction degradation turned on. When the instrument handle is moved back and forth, we can see evidence in this data that the state of the friction model for this D O F is oscillating between stick and slip (the vertical dotted lines indicating state transitions have been added manually). The instrument is initially in the slip state while being moved in a positive direction. When the velocity drops below 0.05 rad/s, the model goes to the stick state: a spring is applied such that a continuous friction torque transition will occur between the two states, and the position trajectory immediately flattens. In between t=l.ls and t=1.9s, the model is the stick-state and the friction torque is entirely dependent on the position (pre-sliding stage in real friction). When the friction-torque exceeds a limit T uck, a discontinuous transition to the slip state occurs. Because of the low s  velocities  involved at this point, combined with the discretized velocity measurement, small oscillations between the two states are possible (though not perceptible during haptic simulation).  48  0  1.1  1.9  2.8  3.6  6  5.1  7.2  Time (s)  Figure 2-14: Friction model, recorded data. Instrument angle (top figure), instrument angular velocity (middle figure), and friction torque (bottom figure).  2.3.2 Backlash and Inertia Figure 2-14 shows a measured trajectory segment of the user-controlled probe and the virtual mass with backlash turned on. A t t=29.5s, the probe is pushing against one wall of the gap, dragging the virtual mass closely behind it. When the probe stops, the virtual mass continues until the other wall of the gap hits the probe. When the probe starts moving in the other direction, this repeats itself. The backlash gap-width in this example is 1 m m , and the simulated mass increment is 0.2 kg. While our backlash model is structurally similar to that used in non-haptic simulation [Gerdes, 1995; Jukic, 2001], our simulated wall stiffness is significantly lower than could be expected in real metal on metal contact: K=600 N / m for the linear case. A s a rough comparison, a 1 cm contact area of a 1 c m steel block has a K ( E A / L ) value of 200x10 N / m . This is reflected in the 3  7  backlash model's feel: while there is a clearly perceptible play in the gap, the impact is not as  49  crisp as one would feel in a real system. One remedy (untried through lack of time) might be to apply a force impulse on impact with the mass, as described for crisp simulation of virtual walls [16, 22]. However, the small gap creates a serious risk of wall-to-wall oscillation. Instead, to limit the impact on perceived gap-width, the backlash models' output to the graphical environment is adjusted to have infinitely stiff walls. Probe Position Gap  138 136 134 132 130 128 126 124  29.5  30 Time(s)  30.5  Figure 2-15: Backlash: probe position relative to the backlash-gap in the virtual mass. The path shown is based on data obtained by manually pushing the instruments of the LSW. Both instrument position and virtual instrument position were recorded. The virtual instrument position was expanded to both sides to show the backlash gap.  2.3.3  Computational Load:  The C P U effort required to simulate the various model aspects for the three degrees of freedom we degraded are listed in Table 2.3. Values were obtained by recording the time required to run each degradation independently and without the V E for 10,000 cycles, then substracting the time it takes for the loop to run without the models, and finally computing mean update time. Sharing of computational results by multiple models has the effect that the update time of all effects together is actually 2 p.s smaller then the actual sum of the update times of the separate models.  50  Table 2.3 Computing times of the various degradations. The backlash model cannot be run without the inertia model; and therefore the listed total leaves single inertia out of its summation. Effect  Update Time (us) 19  0. All effects off 1. Inertia 2. Backlash + Inertia 3. Friction  +26 + 136 +0.5  4. Cogging 5. Saturation Total (sum of 1,2-5)  +2.3 +0.1 156  For the two instruments simulated, the total update time required when all models are running is 312 JUS on one C P U (this includes the computational overhead present when all effects are turned off). The V E update frequency dropped in our experiments regularly to 200-500H.Z with both C P U ' s working at 100%. A t critical times such as these, the percentage o f C P U time spent on running the simulated degradations is roughly 3%-8%.  2.3.4 The Models Combined When all the models are turned on at the same time, cogging, friction and backlash can all be clearly distinguished. Inertia as an individual degradation is not as strongly present as the other degradations when all are displayed: while it is apparent in the backlash model and the force on impact with the gap-walls can be felt, during constant acceleration in one direction it is hard to distinguish it while the other degradations are present.  Unfortunately, in the dissection task of the V E the haptic interface becomes occasionally unstable while in contact with the tissue. This happens only when the inertia/backlash model and friction model are turned on at the same time and both instruments are interacting with the tissue models. A t this point the update rate drops well below 500Hz (150-300Hz). While the exact tissue models used in the simulation are unknown, it is likely that the delays in the haptic loop introduce extra energy as described in Chapter 1 for virtual walls: holding on to tissue is similar to having a tool tip located exactly in between two walls: force fields will increase in either direction instead of just one.  51  In summary, we have described software that can simulate characteristics o f inexpensive hardware on a high-end haptic feedback system. W e observed good overall realism o f the models at low computational load relative to the V E . Our conclusions based on these observations will be presented in Conclusions and recommendations.  52  Chapter 3  User studies  3.1 Abstract This chapter comprises the experimental design and results o f a pilot study to examine the extent to which task execution in a V R surgical environment is affected by quality o f the force feedback hardware. Expert surgeons performed a V R dissection and clip application task on a simulator displaying with its maximum fidelity, as well as with simulated hardware degradations such as friction, cogging, force saturation, backlash, and/or inertia present. Preliminary results show that the forces exerted by the surgeons were not significantly affected by any o f the hardware degradations except for the setting in which no force feedback was present. Median velocities of tool-tip movement, completion time, and path length were unaffected by the different hardware settings, across all surgeons.  3.2 Introduction The motivation behind this study is the high cost of force feedback hardware: many believe it will have great potential in surgical education. If less expensive hardware can be used without affecting surgical performance, more institutions will be able to afford these simulators. A more extensive discussion of the motivation is available in Chapter 1.  3.2.1 Related work Previous studies have compared surgical tasks performance under force feedback to no-force feedback conditions. Wagner et al. found in a simulated dissection task that the mean force applied to the artificial tissue increased by 50%, and peak forces increased with at least a factor of 2 in the absence of force feedback. The speed o f dissection and the precision were not affected [Wagner, 2002]. M o o d y found that under force feedback conditions, completion time decreased and the precision of suturing in a virtual environment increased compared with no force feedback [Moody, 2002]. She did not report on tissue interaction forces. While both studies found that haptic feedback make a difference in task execution, the difference was found in different performance measures. In both studies participants were students o f unspecified background. Heijnsdijk and colleagues studied the influence o f force feedback and visual feedback on closing force of a laparoscopic grasper [Heijnsdijk, 2004]. In this study, 9 expert laparoscopic surgeons  53  and 12 participants with no laparoscopic experience were asked to pull on porcine tissue with 5 N  without letting the tissue slip. The experiments were repeated with and without visual  feedback and by varying the mechanical efficiency o f the grasper from 30% to 90%. The average exerted grasping force was well above what had been established as the minimal grasping force to prevent slip. Visual feedback as well as changes in force feedback did not make a significant difference in exerted forces.  A s discussed in Chapter 1, MacLean [Maclean, 1996]  and Kilchenman [Kilchenman, 2001]  found in independent studies that task performance is largely unaffected by haptic quality in haptic identification tasks. The task in MacLean's research involved identifying resemblance between emulated and real mechanical sliders. In Kilchenman's research participants judged surface hardness and the size of ridges on a surface. New in this study is a larger group o f haptic quality factors that are varied and different tasks.  3.2.2 Goals T o objective of this user study is to answer the following questions related to task performance by expert surgeons in a V R surgical environment: 1.  D o specific and/or combined hardware degradations result in significant changes in user task execution, when compared to high fidelity haptic rendering?  2.  If certain hardware degradations do make a difference, which degradations result in the largest deviations from task performance under high fidelity conditions? E . g . i f both cogging  and friction significantly  affect  performance,  which  of the  two  affects  performance most?  3.3 Methods 3.3.1 The Virtual Environment Our virtual environment consists of both hardware and software. The software used in these experiments is a commercial product specifically designed for laparoscopic training. It consists of eight different basic training lessons, ranging from camera navigation to bimanual dissection, plus  more  advanced  lessons  that  train specific  parts  of  a cholecystectomy  procedure.  Unfortunately, technical details on tissue models and parameters are not publicly available. A s  54  evidence of the high regard with which this product is held, its core haptic technology will soon be incorporated in what is arguably the best-known and most thoroughly studied simulator for laparoscopic surgery, the M I S T - V R . The software provides 3 D O F of force feedback on the tip, 8  plus force feedback in the handle when a clip is applied.  Our haptic interface is the Laparoscopic Surgical Workstation ( L S W ) from Immersion Corp. Immersion is the largest force-feedback hardware company in the world, and the L S W is their top-of-the-line interface for laparoscopic surgery. It provides 2 instruments with 6 D O F each, five out of the six D O F are actuated.  Because both the software and hardware used are arguably the best available at the time of this study, we regard their unaltered behavior as the gold standard for high quality surgical simulation.  3.3.2 Choice of Tasks The tasks chosen for the experiment are the dissection task and clip application task depicted in Figure 3-1.  Dissection  Task  Dissection accounts for 25-35% of the time spent in most surgical tasks [Scott-Conner, 1999]. It requires bimanual dexterity: to properly dissect tissue, the non-dominant hand first puts the tissue under tension so that the dominant hand can be used to do the actual dissection. Due to the tension, the tissue will tear more easily.  In the simulator's implementation, a dark structure is shown that is covered with a light colored tissue. O n one side, a red dot is shown. The goal of the task is to dissect away the covering tissue to expose a green line that starts at the red dot (Figure 3-1, left). The actual trajectory of the green line can vary somewhat, but it always starts at the red dot on the left side of the tissue and a second line will branch off halfway along the line.  Currently marketed by Mentice Corp. as the MIST system.  55  Clip Application Task  Clip application involves similar bimanual coordination: the non-dominant hand will grasp the structure on which the clip will be placed, after which the dominant hand is used to place the clip. Precise motor skills are necessary to place the clip in the correct way. Clip application is an important part o f the most commonly performed laparoscopic procedure, cholecystectomy (gallbladder removal) as well as of more advanced procedures.  In the software  implementation, a tube-shaped  structure is shown connecting two larger  structures. Somewhere on the tube, a black marker indicates the place to apply the clip (Figure 3-1, right). The clip is then placed bimanually.  Comments on Tasks  In light of the limited available time from the participants, the number o f tasks was limited to two. Other tasks available in the software were rejected because they either took too long to complete, did not require enough technical skills, or simply did not provide any force feedback.  The two tasks chosen do have shortcomings. The software sometimes fails to detect a clip when it looks like it is properly applied. In that case a new clip has to be applied which naturally leads to an increase in completion time. Shortcomings in the software's collision detection and graphics algorithms sometimes cause the simulator to fail to display the proper order o f overlaying anatomical structures and instruments, leading to an increase in difficulty o f the task since the operator has to correct for objects that are not properly displayed. Another shortcoming of the dissection task was discovered during the actual experiments with expert surgeons. In the V E it is possible to dissect in a manner that is not possible in the O R , but allows for fast completion o f the task without any penalties. The Discussion section of this chapter will go into more detail on this.  56  0/3  Figure 3-1 Pictures of the dissection task (left) and clip application task (right). In the dissection task light coloured tissue covers darker sensitive tissue on which a green line is painted. The objective is to fully expose the (green) line by dissecting away the covering tissue. In the clip application task a grasper in the left hand is used to stabilize a duct while the tool in the right hand is used to apply a clip on the spot marked by a black line.  3.3.3 Choice of Hardware Degradation Settings The following considerations played an important role in the design of the experiment: •  Potential participants (i.e. expert laparoscopic surgeons) were limited in number and their time and cooperation was hard to get.  •  W e anticipated potential significant differences between the participants in terms of task execution (not in terms of quality, but in terms of actual kinematics and force profiles; similar to top athletes that play at the same level but have distinct strokes).  Therefore to reduce experimental time, only a limited number of quality settings was chosen, and each effect was only tested at a single level with the exception o f N o Force Feedback (implemented by setting the force saturation level to 0 N). These settings, which were discussed in detail in Chapter 2, are: •  High Fidelity  •  Friction  •  N o Force Feedback  •  Cogging  •  Inertia  •  Force Saturation  •  Inertia + Backlash  •  A l l Degradations  57  Due to the time constraints we only include one setting with multiple degradations on at the same time. This is the A l l Degradations setting, which consists o f the superposition o f the Inertia, Backlash, Cogging, and Force Saturation settings.  3.3.4 Strength of Haptic Degradations To choose the strength o f degradations, the following criteria were considered: •  The levels should be representative o f those that might actually be found in a cost-cutting hardware design.  •  The degradations need to be strong enough to be perceptible.  •  The effects should not be so strong that one would expect ergonomic objections to using the machine.  •  While any noticeable haptic degradation may make the tasks less pleasurable to perform, and this cannot be avoided, the effects should not be so strong that it would compromise subject cooperation in any way.  •  The individual strengths o f the degradations should be unaltered when they are combined in the A l l Degradations setting.  The final decision on the choice o f parameters was made after a preliminary round o f experimentations and assessments. The chosen amplitudes and other parameters are listed in Table 3.1. In a pilot study with graduate students, higher amplitudes had been used; amplitudes were scaled down for the final study to simulate more realistic values that might be implemented in actual commercial hardware. Table 3.1: Parameters of models used in this study. Parameter  Translation  Rotation  Cogging  Amplitude  0.45 N  30mNm  Friction  Amplitude  0.45 N  30mNm  Presliding  0.1 m m  0.01 rad  Backlash  Gap Width  2 mm  0.04 rad  Inertia  Mass  0.1 K g  lgm  Saturation  Amplitude  1 N  N/A  58  2  3.3.5 Performance Measures The following performance measures were used in this study: •  Completion time  •  Median absolute tool-tip force  •  Peak (95 percentile) absolute tool-tip force  •  Median absolute tool-tip velocity  •  Path length  Both absolute velocity and force distributions are non symmetrical. The performance measures use the median instead o f the mean since the median is less sensitive to outliers.  Completion Time  The completion time was chosen because it is a direct intuitive measure o f performance. Multiple studies have shown that completion time decreases with experience [Rosser, 1997; Chung, 1998; Den Boer, 2001; Coleman, 2002] and is therefore a good candidate to measure differences in performance. In the Reachin V E , both tools need to be retracted completely to start a task. Completion time was measured from the time that the tools reach 20 m m insertion into the simulated tissue, until the last time the tissue is touched.  Median and Peak Absolute Tool-Tip Force  Tissue interaction forces are an important measure o f surgical performance. T o minimize the risk o f tissue damage, it is necessary to exert forces that are not higher than what is required to execute the task. A n important part of technical skills training in surgery is to learn to exert the right amount o f force. While median force gives a good indication o f overall forces applied, the peak force was also chosen as a separate measure since it directly relates to potential tissue damage. T o improve robustness o f the measure to outliers, we used 95 percentile forces instead of the 100 percentile force. Tissue interaction force is obtained for each tool in as a vector with x, y, and z coordinates. The absolute tool tip force is calculated as follows:  (3.1)  59  This vector also contains all the zero force values for the time that the tools are not into contact with any tissue. Since this would result in force percentiles reflecting the amount o f time that the tool-tip is not in contact with the tissue, force values close to zero (F b <\ mN) were filtered out. a  S  Median Absolute Tool-Tip Velocity and Path Length  Velocity and path length are commonly used to describe tool-tip kinematics. The absolute value of velocity was taken according to Formula (3.2) to obtain a single measure that is also robust against the small variations in location o f the target in each task.  (3.2)  Measures calculated by the Reachin software were not used, since we were unable to learn what algorithms are used to calculate them and they do not provide results for segments of data.  3.3.6 Experimental Design Participants In order to assure expert performance, only expert laparoscopic surgeons that were performing laparoscopic procedures on a regular basis were allowed to participate in the experiments. Residents and surgical fellows were excluded from the experiments.  Experiment Size  Based on a pilot study with 3 graduate students from the Mechanical Engineering Department, we predicted that surgeon participants would be able to complete 3 repetitions of all settings in the dissection and 9 repetitions o f the clip application task in roughly 90 minutes. The assumption was that the experienced surgeons would be able to execute the tasks at least as fast as the inexperienced graduate students. Unfortunately, this was not the case: the 1 participant st  took 3 hours to complete these tasks. Therefore, the experimental design was scaled back to have all participants do only those settings that were judged most important (High Fidelity, N o Force Feedback, and A l l Degradations), plus two o f the other five conditions (see Table 3.2)  60  Table 3.2 The settings to be executed by eight participants. This table applies to both tasks.  Participant  NoFFB  Hifi  All Dg  Cogg  Frict  Inertia  Sat  *  Surgeon 1  *  Surgeon 2 iiiilitesllliii  *  Surgeon 3 PS1IIH8I8B6  *  *  *  ItSilifjipljS  Surgeon 4  Bckl  *  *  *  *  *  Surgeon 5 fl|l§|lS||j|§  Surgeon 6  *  Surgeon 7  *  *  Surgeon 8  *  ^Blil^llllll  * *  *  While we started to execute this design, repeated failure of the haptic hardware and the extreme difficulty in recruiting participants led to the decision to limit this thesis research to the first 3 participants only. Participant 1 and 2 performed both tasks, while participant 3 only performed the dissection task because the haptic interface stopped working at the end o f the dissection session. Since no data was collected from the other 5 subjects, this limits the power o f the statistical tests that are used, and makes the study more of a pilot study. One  Instructions  of the main constraints in this study was the limited time available from participants.  Therefore we wanted to minimize the need for practice. Since laparoscopic techniques are not standardized but vary between surgeons, each participant was asked to use the technique that he/she use in the O R . Since the statistical tests used in this study have a within-subject design, differences between surgeons present in all settings do not affect the statistical outcome.  Also, i f different techniques actually affect how haptic quality affects performance, it is beneficial to have this variability in the experimental population since this would reflect variation in the larger population.  61  The participants were allowed training time to repeat the tasks until they felt their performance was not improving anymore. Duration o f training time used was recorded. For consistency during the experiment, they were instructed not to change their technique once the training period had ended.  3 . 3 . 7 Statistical Methods We first want to test the hypothesis that none o f the degradations make a difference. If this hypothesis was going to be rejected for any performance measure, we then wanted to do pair wise comparisons between the High Fidelity setting and the other settings to determine which haptic degradation is significantly different from the High Fidelity setting.  Since we expected variability between subjects, a within-subject design was chosen to avoid losing power due to inter-subject variability. Power was especially important since we had to reduce our experiment both in number o f participants, and in the number o f settings each participant executed. The most common parametric test for within-subject designs is the repeated measures A N O V A test. However, it had very low power for the data in our study for two reasons. First, the power o f a repeated measures A N O V A  does not increase with multiple  repetitions. Second, our data was not symmetrical and Mauchly's test revealed that it strongly violated the sphericity assumption (Sphericity refers to the equality of variances o f the paired differences  between  conditions).  compensation techniques  When  data does not  meet  the  ANOVA  assumptions,  can be applied but these generally lead to lower power. The  multivariate A N O V A test does not require sphericity o f the data and can be a more powerful substitute o f the repeated measures A N O V A . Unfortunately, it loses this advantage in the case o f a small number of participants compared to factors [Maxwell, 2003], as is the case in this study.  Friedman  Test  The Friedman test [Friedman, 1937] used in this study is an alternative to the repeated measures A N O V A when the assumptions of normality or equality o f variance are not met [Zar, 1996]. A significant result o f the Friedman test indicates that in a set o f k dependent samples (k represents the eight hardware settings in our case), at least two o f the samples represent populations with different median values [Sheskin, 2000]. The relative power o f the Friedman test compared to  62  the A N O V A (in case A N O V A assumptions are met) is  3k  which is 0.80 in our case.  7T(k + \)  Therefore the Friedman test should only be used when the assumptions of the A N O V A are not met. A n example of how the Friedman test works is given below with fictional data.  N o Force Feedback  High Fidelity  -•  A l l Degradations  Force  Rank  Force  Rank  Force  Rank  Dissect, SI, R H  0.5  3  2  1  1  2  Dissect, SI, L H  0.3  3 . •.  1.5  2 ••„  1.6  1  Dissect, S2, R H  0.8  2  1.2  1  0.7  3  Dissect, S3, L H  0.7  3.  1.0  • - :i'" 'v  0.9  2  ;  ."  v  10  i7';  Sum  13  The examples shows forces obtained for surgeons completing the dissection and clip application task. Forces are compared within each row and ranked. The largest force value is ranked 1. The total sum of column ranks is calculated. The underlying idea o f the test is that i f the columns (hardware settings) have no effect, the column-wise sums o f ranks should be roughly equal. T o put a number on the term 'roughly', the following equation is then used to compute the chisquared approximation o f the Friedman test statistic [Sheskin, 2000]:  X  2 r  =  12  f *  nk(k + l)\  ^  II*/)  -3n(k + l)  (3.3)  If the calculated chi-squared value is greater than the chi-squared value at the specified level o f significance, performance measures in at least two o f the hardware settings have different median values. When multiple repetitions per cell are made, ranking is performed on all repetitions together [Zar, 1996].  If the result is significant, pair wise comparisons can be performed to calculate which medians are significantly different. There was a complication in our experiment due to the fact that we had to scale the experiment down from each surgeon doing all 8 settings to each surgeon doing 5 settings. This made it  63  impossible to apply the Friedman test across all surgeons and all settings at once. Therefore an alternative approach was taken in which first the Friedman test was applied to data of each surgeon individually. If for at least one surgeon the null hypothesis o f equal medians between settings was rejected, 7 pair-wise comparisons were performed between the High Fidelity setting and each o f the other settings. Alpha values were adjusted to reflect the increased chance of a type-I error when multiple comparisons are made; i f the chance o f incorrectly observing a difference is 5% per observation, the chance o f incorrectly observing a difference over 7 observations would be 30% (1-0.95 ). Therefore only P-values lower then ( 1 - ^ 0 . 9 5 )=0.0073 7  are judged significant.  Other Tests Considered  Before we turned to the Friedman test, a significant effort was made to develop a statistical methodology based on the Kolmogorov-Smirnov test [Smirnov, 1939]  and bootstrapping  [Effron, 1979]. This methodology was attractive for the following reasons: •  N o assumption is made about the distribution o f data.  •  It uses a dimensionless difference measure that allows comparing across difference performance measures (differences in force can be compared to differences in velocities).  •  This difference measure can be used for relative ranking of hardware degradations  Unfortunately, the power of the test proved lower than the Friedman test: we were not able to detect any significant differences. This is most likely due to a violation o f the assumption of the bootstrapping method that the samples form a good representation o f the real population; in our case we had 2 or 3 participants as a representation o f the population o f expert laparoscopic surgeons. For researchers who follow in this path, Appendix I:  Data analysis with the  Kolmogorov-Smirnov Test and Bootstrapping, provides a description o f the methodology and a more detailed discussion o f why it did not work for our data.  The standard test to compare means o f different groups to a control (in our case the High Fidelity setting), is Dunnett's test for comparison with a control [Dunnett, 1964] . One o f the assumptions of this test is that the population variances are equal which is not the case in our data. Therefore we used the Friedman test for the pair wise comparisons as well.  64  3.4 Results The results section is organized as follows. Following a report o f observations made during the experiments, we present: cumulative distribution plots of tool-tip forces and velocities, and data plots of median and 95 percentile forces, completion time, median velocities, and path lengths that show values o f the repetitions. Finally, learning effects are presented.  3.4.1  Data Experiment We originally intended to recruit 8 participants. W e initially intended to recruit experienced surgical residents. While surgical residents are busy the whole year through, our experiments coincided with exams. A s a result none o f the invited residents responded to our invitation. A subsequent effort to recruit expert laparoscopic surgeons resulted in 3 participants. Each o f them had more than 5 years of experience with laparoscopic procedures. A l l three are male. A s explained in the methods section, each surgeon was assigned to 5 out o f 8 settings. The settings were presented in random order. Table 3.3 shows the assignment o f settings to the participants. Table 3.3 Hifi  Participant  Surgeon 1  NoFFB Jr  Surgeon 2 ISlls'ilB  *  .  Assignment of settings to the participants. All Dg  Bckl  Cogg  tJSji||||*:|iMBi  ;|§IIH*lll|||  *  BlllifeBiillH  Frict  Inertia  Sat  *  *  HiiHisniilMllii  Surgeon 3  . *  *  ,*  Surgeon 1 first performed the clip application task first, then the dissection task. Surgeon 2 also performed both tasks, but the dissection task first. Surgeon 3 only performed the dissection task.  Task Duration  A factor-of-two difference in completion times between mechanical engineering students in the pilot study and Surgeon 1 in the final study caused the total experimental duration o f the first participant to approach 3 hours. Due to a failure in data collection, fifteen minutes o f the experiment had to be repeated on another day. Assuming that the remaining surgeons would  65  need a comparable amount of time, we then reduced the experiment to the above schedule. Surgeon 2 completed the experiment in 1.5 hours. Surgeon 3 took 60 minutes to complete the dissection task, after which the grippers o f the haptic interface became unresponsive, which made it impossible to perform the clip application task.  Cumulative Distribution  Plots  Insight into the complete distributions of forces and velocities  can be obtained from the  cumulative distribution functions (CDFs) o f the data (Figure 3-4 and Figure 3-5). These plots show the probability that a value takes a value equal to or less than the value presented on the xaxis. The value on the x-axis that corresponds to a y-axis value o f 0.5 is the median value.  Figure 3-2 and Figure 3-3 show the variability in forces between repetitions o f the High Fidelity, N o Force Feedback and A l l Degradations settings compared to the inter-setting differences. The data shown are the C D F s from the right hand instrument o f Surgeon 1 executing the dissection task and clip application task. Both plots show a general trend we noticed: the variation between repetitions of each setting is large compared to the differences between settings. In general the only exception is the N o Force Feedback setting which can be quite different from the High Fidelity and the other settings. Note that Surgeon 1 executed the task under 5 conditions. Data from the other two settings are not shown to avoid cluttering o f the plot. The other 2 settings show trends similar to the High Fidelity and A l l Degradation setting.  66  CDFs of Surgeon 1 repetitions of dissection in 3 settings  • High Fidelity No Force Feedback' • A l l Degradations  Force (N)  Figure 3-2 Cumulative distribution functions of forces exerted by the right hand tool by Surgeon 1. Three repetitions were executed under 5 conditions. To avoid cluttering the plot only data from the three most important conditions are shown here. C D F s of Surgeon 1 repetitions of clip application in 3 settings  • High Fidelity No Force Feedback • A l l Degradations  0  0.5  1 Force (N)  1.5  2  Figure 3-3 Cumulative distribution functions of forces exerted by the right hand tool by Surgeon 1 in the clip application task. Nine repetitions were executed under 5 conditions. To avoid cluttering the plot only data from the three most important conditions are shown here.  67  To limit the number o f plots, data from multiple repetitions by a single surgeon are grouped together into a single curve, and curves for the different settings are included in a single plot. Since repetitions vary in duration and thus in number o f samples taken, all repetitions were resampled to have the same number of samples as the repetition with the lowest number o f samples, which in all cases exceeded 1500. Finally, x-axes on all plots have the same range for easier comparison.  1  to 0.5  Clip Set r  I  Surgeon 1  Surgeon 2  Surgeon 3 NoDegradation NoForceFeedback AIIDegradations BacklashHigh CoggingHigh FrictionHigh InertiaHigh SaturationM  0.5  RH = Clip Set |  0  5  LH!5 Dissect |> rx  0.5  RH 5  i  0.5  co 0.5  Dissect -g  2  Force (N)  4  0  2  Force (N)  4  0  2  4  Force (N)  Figure 3-4: Cumulative distribution functions of tool-tip forces.  In the dissection task, the right hand o f all surgeons is remarkably consistent between the different settings with the exception o f the N o Force Feedback setting (although the variability between repetitions does not show up in these graphs, they do indicate average behavior between settings). The three surgeons all have different force profiles. The left hand shows more variability in force profiles, and individual force profiles are not as distinct in the left hand. Surgeon 3 seems least affected by the different settings, both for the right hand and left hand.  68  In the clip application task, forces generally do not exceed 1 N . The exception to this is the forces  exerted  by  Surgeon  1  in  the  69  No  Force  Feedback  setting.  Surgeon 1  LH Clip Set  Surgeon 3  Surgeon 2  NoDegradation NoForceFeedback AIIDegradations BacklashHigh CoggingHigh FrictionHigh InertiaHigh SaturationM  JQ co 0.5 O  RH Clip Set  LH 5 Dissect •§  RH Dissect -g 0  0.1  Velocity (m/s)  0.2  0  0.1  Velocity (m/s)  0.2  0  0.1  0.2  Velocity (m/s)  Figure 3-5 Cumulative distribution functions of absolute velocities.  Velocity CDFs look very similar along the different settings, except for the left hand clip setting data for Surgeon 1 and 2, and the No Force Feedback setting in right hand dissection Surgeon 1, and the All Degradations setting in the left hand dissection task of Surgeon 1. There are clearly visible differences between surgeons, tasks, and hands: for example Surgeon 2 has a different velocity CDF than Surgeon 3 in left hand dissection, but both surgeons are consistent in maintaining their velocity profile over the different settings.  Raw Data Plots  The following plots show the median tool tip forces, 95 percentile forces, completion times, median velocities, and path lengths. Each data point represents an individual repetition of a task. The data are ordered per surgeon. For the clip application data, for each surgeon a bar shows the  70  range and the 25 percentile, 50, and 75 percentile values over the different repetitions o f the measure of interest. Because in the dissection task only 3 repetitions were obtained, only the range  is  shown.  Comments  about  71  trends  follow  each  plot.  50 percentile force Inertia Friction Cogging  * . +•  All Degr.  X  No Force Fb.  Surgeon 1 Surgeon 2 Surgeon 3  3 :  High Fidelity  CD CO CL  O  Inertia Friction Cogging  X  or  All Degr.  03 CO  No Force Fb.  CL  High Fidelity  O  Saturation Inertia Friction Cogging  -*  ••—  -  Backlash  C  - >  .g V-<  All Degr. No Force Fb.  o  CD CO CO  -H-.  High Fidelity Saturation Inertia Friction Cogging  X  0£  Backlash  c o o  All Degr.  CD  No Force Fb.  CO CO  High Fidelity 0  0.5  2.5  1.5  3.5  Force (N)  Figure 3-6  M e d i a n tool tip forces. Each data point represents a repetition.  72  50 percentile forces (Figure 3-6): •  Dissection: Right hand forces and range o f forces within the same setting are small compared to left hand forces.  •  Right hand Surgeon 3: Range of forces within the same setting are very small. Left hand variations are more in line with the other two participants.  •  Clip application: significant range o f forces over repetitions compared to differences between surgeons and between settings.  73  95 percentile force Inertia Friction BT" " iCogging  * ~ Surgeon 1 + — Surgeon 2 x — Surgeon 3  All Degr. No Force Fb.  .. CD  -+.9O  High Fidelity  Inertia jQcFriction Cogging  X ^—•  All Degr.  CD  CO  No Force Fb.  CL  o  High Fidelity  Saturation Inertia Friction Cogging  .|ld/-J. ;  Backlash  c o o  All Degr.  CD  No Force Fb.  CO  „....  to  -  High Fidelity  Saturation X Inertia Friction Cogging Mi. — '  liili  Backlash All Degr. No Force Fb.  «<•' "  X  cr:  '  c g o  X  -  CD  CO CO  High Fidelity  15  10  20  Force (N)  Figure 3-7  95 percentile tool tip forces. Each point represents a repetition.  74  25  95 percentile forces (Figure 3-7): •  Right hand dissection: differences between surgeons and between settings are larger than differences between repetitions at the same setting (exception Surgeon 1, N o Force Feedback setting).  •  Surgeon 1 and Surgeon 2: the largest variability between repetitions is present in the N o Force Feedback setting.  •  Dissection: higher forces and larger variability between repetitions in left hand compared to right hand.  •  Dissection: Surgeon 2 often exerts the highest forces.  75  Completion Times Inertia  * — Surgeon 1 + — Surgeon 2 x — Surgeon 3  Friction Cogging  o  CZDH  CO  o  =^ All Degr.  CD  CL <  Force Fb.  O High Fidelity  i  1 h  H~TT"-r-r— •••w-jjJF  1  j t  Saturation Inertia Friction Cogging c: O Backlash  -.—*  o  CD CO  (0  b  All Degr.  No Force Fb.  High Fidelity  50  100  150  200  250  300  Time (s)  Figure 3 - 8  Completion times. Each point represents a repetition.  76  350  Completion times (Figure 3-8): •  There is a wide variability between completion times o f the repetitions.  •  Surgeons do not seem to maintain relative speed compared to other surgeons when going from one task to the other: O n visual inspection, Surgeon 3 seems fastest in the dissection task and Surgeon 2 slowest, while in the clip application task Surgeon 2 looks fastest.  77  Absolute Velocity Inertia Friction Cogging  * Surgeon 1 + — Surgeon 2 x — Surgeon 3 —  All Degr.  —fj>-  No Force Fb. High Fidelity  CO CO Q.  O  Inertia Friction Cogging  •EE  X  vUt..„  or  All Degr.  co g.  No Force Fb. •yfc,,^  High Fidelity  O  E E C Z Z 3 - #  Saturation Inertia Friction Cogging  -* *  Backlash  c o  All Degr.  "•4—»  O CD CO CO  No Force Fb. High Fidelity  Q  «—*—™  Saturation Inertia Friction Cogging  X  Backlash  or c  All Degr.  g  o  No Force Fb. x  High Fidelity 0.002  0.004  CD CO CO  ...^  J  0.006  0.008 Velocity (m/s)  0.01  0.012  0.014  0.016  Figure 3 - 9 Median absolute velocities. Each data point represents a single repetition.  78  Median absolute velocity (Figure 3-9) •  Median velocities are lower for left hand, though magnitude o f this difference is dependent on the surgeon  •  In the clip application task, the two surgeons' median velocity range overlap considerably, whereas in the dissection task each surgeon has a more distinct profile: the difference between the left hand and right hand of surgeon 3 is small compared to the other two surgeons.  •  In the dissection task, as in the clip task, Surgeon 2's right hand moves consistently faster than Surgeon 3, but the inverse relation is true in the left hand.  79  Path Length Inertia -8D— Friction Cogging  * — Surgeon 1 + — Surgeon 2 x — Surgeon 3  AH Degr. » No Force Fb. High Fidelity  o  Inertia Friction ©-H Cogging i~WW-  X DU  All Degr. 0  "CD  CO  No Force Fb.  CL  High Fidelity m.  O  Saturation Inertia Friction Cogging  *  #  Backlash All Degr.  CD  CO  7I  c o o  K  -+-+- ,  CD  No Force Fb.  CO CO  High Fidelity Saturation Inertia Friction Cogging  X a:  Backlash  c o o  , —^  All Degr.  ¥  CD CO CO  No Force Fb. High Fidelity  b  •* Path Length (m)  Figure 3-10  Path lengths. Each data point represents a repetition.  80  Path length (Figure 3-10) •  Clip application: Surgeon 2 shows overall shorter path lengths than surgeon 3.  •  Dissection right hand: Surgeon 2 shows longer path lengths than the other surgeons.  •  There seem to be no other clear difference in path length due to hardware setting, hand, or surgeon.  •  The clip application task shows shorter path length compared to the dissection task.  Comparison Plots  In the previous plots, some interesting trends were noticed. W e will examine these trends in further detail in the remainder o f this section. The first plots (Figure 3 - l l F i g u r e 3-12) show the differences in exerted forces between the left hand and the right (dominant) hand. Figure 3-13 shows the differences in completion times between the surgeons in both tasks. A l l plots show the 25th percentile, median and 75th percentile points in a rectangle, with whiskers extending to either the most extreme data points or to the most extreme point within this range i f this would result in a whisker length greater than 3 times the inter-quartile range (75 percentile point - 25 th  th  percentile point). Data points outside of this area are treated as outliers, and their location is indicated by the '+' sign.  81  50 percentile force •  •  3.5 {  3" 2.5  8  2  1.5  0.5  RH Dissect  RH ClipSet  LH Dissect  LH ClipSet  Figure 3-11 Comparison of the median in tip force exerted by the left hand versus the right hand. Since the bars represents data from all participants and all quality settings, the dissection bars represent 45 data points, and the clip application bars represent 90 data points each. A Friedman test showed that the medians of the 50 percentile forces in the left hand are significantly higher than in the right hand for dissection (P=6E-9) and clip application (P=lE-5). It should be noted that participants and quality settings were grouped together and that these differences have added to the range of data.  82  95 percentile force  25 -  20 -  ^  15 -  CD O  o LL  10"  5  RH Dissect  LH Dissect  ^  RH ClipSet  LH ClipSet  Figure 3-12 Comparison of 95 percentile tip force exerted by the left hand versus the right hand. The dissection bars represent 45 data points, the clip application bars represent 90 data points each. In Figure 3-12, 95 percentile forces from surgeons at different hardware settings were added together. While the median value of the left hand is high compared to the right hand in dissection (P=4E-6, Friedman test), there was no significant difference in median of the data for the clip application task.  83  Completion Times  S1 Dissect  Figure 3-13  S 2 Dissect  S 3 Dissect  S1 ClipSet  S 2 ClipSet  Completion times compared between surgeons. Each boxplot consists of 15 data points for dissection and 45 data points for the clip set task.  A second point o f interest is the differences between surgeons. A Friedman test applied to the data from all 3 surgeons in the dissection task resulted in a significant difference in mean completion times between at least 2 surgeons ( P=9E-5 ). Pair wise comparisons using the Friedman test showed that Surgeon 3 was statistically faster then Surgeon 2 ( P = l E - 4 ), but there was not statistical difference in median completion time between Surgeon 1 and 3 in dissection, while completion times of Surgeon 1 were statistically different from Surgeon 2 (P=0.005). The relative speed of Surgeon 1 to Surgeon 2 was opposite in the clip application task (there was a statistical difference in medians with P=lE-9).  Miscellaneous Observations on Task Execution  Surgeon 1 noted that even though he did not directly recognize the structure in the dissection task as an anatomical structure occurring in the human body, he would treat is as delicate tissue, because it most resembled a fluid filled sac. 84  Surgeon 3 used a slightly different approach than the other surgeons in dissection: he used the hook (Figure 3-14) upside down. He would do this to prevent the sharp point o f the hook sticking into the delicate tissue below the fat. In the OR, he would either do this, or stick the hook into the fat, and pull it away from the under lying tissue before burning. Since this is not possible in the simulation, he used the 90 degree hook o f the tool to burn tissue with. ] jjJMwcfcfl | P i a / w r o s c i * f > f c Tratnar  2.4 Dissection Cystic Duct Simulator John M . Doe  Figure 3-14  3.4.2  Statistical Analysis The  The hook of the cautery tool.  Friedman Test  Friedman test was first used to test the null-hypothesis that the hardware degradations did  not have a significant effect on the performance measures for each o f the individual participants. To test for this, a separate test was applied to data from each participant. A significance level of a =0.05 was chosen.  Table 3.4: P values for intra-surgeon Friedman tests. A significant P-value indicates that it is likely that the performance measures have different medians. 5 Op force  95p force  Time  50p velocity  Path length  Diss Surgeonl  0.10  0.006  0.7  0.86  0.11  Diss Surgeon 2  0.06  0.003  0.001  0.007  0.003  Diss Surgeon 3  0.57  0.01  0.06  0.6  0.17  Clip Surgeon 1  0.001  6E-5  0.16  0.008  0.07  Clip Surgeon 2  0.12  0.002  0.0002  0.35  0.003  85  For all participants, the null hypothesis was rejected based on the 95 percentile force measure. In the dissection task, completion time, median velocity, and path length of Surgeon 2 were affected by the hardware settings as well. In the clip application task, both Surgeon 1 and Surgeon 2 showed significant differences in performance measures other than 95 percentile force, but different performance measures affected each surgeon.  Subsequently, pair-wise comparisons are made to test which settings are significantly different from the High Fidelity setting. For any of the 7 pair-wise tests, the Friedman test was applied to all data available. The number in brackets behind the setting description indicates how many participants performed the task at the given setting.  Table 3.5 lists the f-values for each  comparison. T o limit the probability of making a Type-I error to 0.05, only P-values smaller than 0.0073 are judged to be significant in each of the individual comparisons (see Methods section). The median force performance measure was not used on data from the dissection task since it did not show any overall differences for the individual surgeons in the previous test. Completion time could not be used for some of the settings since not enough data was available (while other performance measures have separate rows of data for left hand and right hand, this is not the case for completion time, thereby reducing the amount of data). In the clip application task some of the measures are not covered because no subject data was available due to Surgeon 3 only performing the dissection task.  86  Table 3.5 P values of pair wise comparisons between the High Fidelity setting and each of the other 7 settings. The data is from the dissection task. The number in brackets behind each setting indicates the number of surgeons the data is from. A bold face P-value indicates a significant difference (see text). P-value  High Fidelity compared to:  50p  Force  95p  Force  Comp.  Median  Path  Time  Velocity  Length  No Force Feedback (3)  N/A  8E-6  0.25  0.07  0.15  All Degradations  N/A  0.21  0.52  0.48  0.72  (3)  Backlash  (1)  N/A  1  N/A  0.76  0.12  Cogging  (2)  N/A  0.28  0.76  0.51  1  Friction  (1)  N/A  0.06  N/A  0.53  0.12  N/A  0.22  N/A  0.53  0.03  N/A  0.22  N/A  0.76  0.35  Inertia (1) Saturation  (1)  Table 3.6 P values of pair wise comparisons between the High Fidelity setting and each of the other 7 settings. The data is from the clip application task. The number in brackets behind each setting indicates the number of surgeons the data is from. A bold face P-value indicates a significant difference (see text). P-value  High Fidelity compared to:  50 perc. force  No Force  Feedback(2)  All Degradations  (2)  95 per. force  Comp.  Median  Path  time  Velocity  Length  0.0071  7E-6  0.19  0.02  0.02  0.48  0.35  0.71  0.72  0.60  Backlash  (0)  N/A  N/A  N/A  N/A  N/A  Cogging  (2)  0.40  0.79  0.32  0.90  0.11  Friction  (1)  0.21  0.53  N/A  0.23  0.26  0.66  0.19  N/A  0.90  0.03  N/A  N/A  N/A  N/A  N/A  Inertia (1) Saturation  (0)  In the dissection task, the only significant difference that could be detected was in 95 percentile forces between High Fidelity and N o Force Feedback. In the clip application task, a difference between these two settings is significant both in median forces as well as 95 percentile force  87  levels. Other performance measures  did not detect a significant  difference  in pair wise  comparisons.  Time-Dependent Effects  T o make sure that the results are not biased due to significant time-dependent effects such as learning, fatigue, loss of interest, etc., the data was checked for a correlation between trial number and performance measure. The first trial the subject executes is designated Trial 1. Every following data segment that is treated separately during the analysis is given a successively higher trial number. During the clip application task, the subjects apply 3 clips on one 'duct'. Since each of these clips are treated separately in the analysis, they are given separate (and sequential) numbers. Using starting time of the trial, as opposed to trial number, gave similar results.  Correlation coefficients were computed for every surgeon, task, and hand (except for completion time). It is generally understood that when  \K\ < 0.3 the correlation is little or none,  for  0.3 < \R\ < 0.7 correlation is weak, while for \R > 0.7| the correlation is strong. Only values with |i?| > 0.45 are reported here. T o interpret the correlation coefficient, its squared value R , called 2  the coefficient of determination, expresses the proportion of variance in the dependent variable explained by the independent variable. Therefore a correlation coefficient of 0.7 between force and experiment number means that a little less than half of the variance in the force data can be explained with the experiment number. Since we are more used to thinking in standard deviations than variance we can also put is as follows: i f R=0.7, then i f we compute the standard deviation of force from the line that describes the correlation (see for example Figure 3-16), and we divide this standard deviation by the original (non-compensated) standard deviation of the force, the ratio will be 0.71. This means that the standard deviation of force is reduced by 29 percent after compensation for experiment number at the given value of R [Norman, 1994] (For R=0.5 and 0.9 the ratio is 0.87 and 0.43 respectively). Finally, the reported P-value indicates the probability of getting a correlation as large as the observed value by random chance, when the true correlation is zero.  88  The three strong correlations found are: •  50 percentile force: Dissect, Surgeon 1, left hand: R=0,74 P=0.002.  •  95 percentile force: Dissect, Surgeon 1, left hand: R=0,70 P=0.003  •  Path length: Dissect, Surgeon 2, left hand: R=-0.71, P=0.003  Figure 3-15-Figure 3-17 show the variables in these datasets plotted versus experiment number. A line indicates the trend. Markers indicate degradation setting.  Correlation Surgeonl Dissect LH 1.1  X  . o x * 0  1  o  0.9  X  0  10  5  15  Experiment Number  Figure 3-15: Mean forces versus experiment number: Surgeon 1, Left hand.  89  High Fidelity No Force Fb All Degrad. Cogging Inertia  Correlation Surgeonl Dissect LH High Fidelity No Force Fb X All Degrad. * Cogging 0  0  5  Inertia  10 Experiment Number  Figure 3-16  95 Percentile forces versus experiment number: Surgeon 1, Left hand. Correlation Surgeon2 Dissect LH  3.5  §5 2.5  *  -  o  -  o  _i  ro Q.  . High Fidelity o No Force Fb x All Degrad. * Cogging Friction  -*-  •  1.5  5  10  15  Experiment Number  Figure 3-17  Path length versus experiment number: Surgeon 2, Left hand.  90  Weak correlations were found for the following cases:  Table 3.7: Weak correlations between performance measures and experiment number. R  P  Surgeon 1  -0.51  0.05  Dissect  Surgeon 2  -0.53  0.04  Completion Time  Dissect  Surgeon 3  -0.63  0.01  Median Velocity  Dissect  Surgeon 3  0.61  0.02  Path Length  Dissect  Surgeon 2  -0.58  0.02  Path Length  Dissect  Surgeon 3  -0.53  0.04  Perf. Measure  Task  Participant  Completion Time  Dissect  Completion Time  91  3.5 Discussion This section will discuss the implications o f our results and specifics on task execution by the individual participants. This will be followed by comments on how the surgical environment, haptic hardware, and the strength o f haptic degradations may have influenced our results.  3.5.1  Inter Setting Differences  Our first hypothesis was that the hardware settings caused no significant difference in the performance measures (Ho).  Force Measures  Based on the Friedman test, H was rejected for all surgeons for both tasks for the 95 percentile 0  force measure. This means that at least one o f the hardware settings made a significant difference in exerted (peak) forces. Pair wise comparisons between the High Fidelity and the other 7 settings showed that only the N o Force Feedback conditions caused  significantly different 95  percentile forces across all surgeons and both tasks, while the N o Force Feedback settings caused significantly different 50 percentile forces in clip application as well. A n important result is that the force saturation at 1 N that is present in the A l l Degradations setting as well as the Force Saturation setting did not cause a significant difference in task performance.  The null hypothesis was rejected for Surgeon 1 in the clip application task using the 50 percentile force measure as well. Pair wise comparisons showed that the only hardware setting that resulted in significantly different median forces across all surgeons is the N o Force Feedback setting.  The increase in exerted forces under no force feedback we found is in line with results found by Wagner in a simulated dissection task [Wagner, 2002], and by M o o d y in a V R suturing task [Moody, 2002].  Time, Median Velocity and Path Length Measures  In the dissection task, the null hypothesis had to be rejected based on the time, median velocity and path length measures  for Surgeon 2 but not for the other two surgeons.  Pair-wise  comparisons over the data from all surgeons did not lead to a significant difference in these measures for any o f the hardware settings compared to the High Fidelity setting. From Figure  92  3-8-Figure 3-10, it can be seen that Surgeon 2 stands out from the other two surgeons in this task by having high repeatability between repetitions in combination with larger differences between settings.  In the clip application task, data from Surgeon 1 showed significant differences between the different settings in median velocity. B y inspection o f Figure 3-9, the median velocities at the left hand High Fidelity setting stand apart (lower) from the other settings. Pair-wise comparisons over both surgeons between the High Fidelity setting and the 7 other settings did not reveal any significant difference.  There was a significant difference between settings in the data from Surgeon 2 in completion time and path length in the clip-setting task. Pair wise comparisons over both surgeons did not reveal significant differences between the High Fidelity setting and any o f the other 7 settings. This is likely due to the fact that Surgeon 2 has a high repeatability with relatively large differences between settings compared to the other surgeon.  3.5.2  Other Observations  Learning and Hurrying  There are three possible explanations for the correlations found between repetition number and force or time: 1.  Learning (completion time decreases, quality remains constant or goes up).  2.  Hurrying (completion time decreases, quality as well).  3.  None of the above, in the cases that show a correlation between trial number and performance measure, the particular order o f the degradations influenced the outcome.  The only strong correlation between exerted forces and experiment number was found for Surgeon 1 in dissection. In this particular session, the last experiments were done under the N o Force Feedback setting 3 times in a row followed by two repetitions under the A l l Degradation setting. While setting order was chosen at random, in this particular case the random choice was not well distributed. This could have influenced the outcome.  93  The 3 weak correlations between time and experiment number were negative. Since no reliable evidence o f changes in forces over time were found, the most likely explanation is learning.  Correlations with time were found only in the dissection task. A possible explanation for why this did not appear in the clip application task is that it took all participants roughly 60 minutes to complete all repetitions o f the dissection task, compared to only 30 minutes for the clip application task. Surgeon 1 first performed the clip application task, Surgeon 2 performed the dissection task first.  The strong negative correlation found between path length and experiment number may be due to learning since it is accompanied by a weak negative correlation in completion time: assuming no other differences between the task repetitions, a decrease in path length combined with an increase in completion time would suggest that more efficient movements are made but at a lower speed ( A n increase in path length with a decrease in completion time would suggest faster movements but more unnecessary movements as well)  Inter-Hand Differences  When data from different surgeons were grouped together to do hand-wise comparisons per task, the median values o f all 50 percentile forces suggest that lower median forces are exerted by the left hand compared to the right hand in both tasks. This may reflect the functional differences between the left and right hand. In both tasks the left hand is used for holding the tissue in place and putting it under tension. The right hand is used to do more subtle manipulation and positioning. Also, the left hand applies a forces o f longer duration compared to the right hand, affecting the median force applied.  In the median velocities, a clear distinction between the right hand and left hand reflects this difference in function as well. W e will go into somewhat more detail on this below.  94  Inter-Surgeon Differences  The cumulative distribution plots of tool-tip forces in Figure 3-4 showed Surgeon 3 being remarkably less affected by the N o Force Feedback and A l l Degradation settings than the other two participants in the dissection task. Surgeon 3 also logged the shortest median completion time. Surgeon 3's video gaming experience may explain this. Both laparoscopic literature [Grantcharov, 2003], and repeated unanticipated observations in our research group suggest that 9  gaming experience may influence task performance in virtual environments.  Figure 3-9 showed a smaller difference in velocity between right hand and left hand for Surgeon 3 compared to the other surgeons. This may show adaptation of that participant's technique to the virtual environment. In the simulator the user can dissect by grasping the tissue with the nondominant hand, and dissect away all tissue in one stroke. While this is a highly unlikely, i f not impossible, way to perform dissection in the O R , it is efficient on the simulator. If the nondominant hand only grasps the tissue in one place, using the one-stroke technique in the dominant hand, its median velocity will be low. Therefore the technique used has a direct influence on the median velocities, and may be the cause o f the differences between surgeons.  Varian ce between repetitions  There was a notable variance in all the performance measures between the different repetitions o f the same task under the same setting. While there will always be some variation when a task is executed repeatedly; stance, posture, fatigue, and even day of the week may have an impact on task performance and repeatability.  3.5.3 Participants This section will discuss how our results may be biased by the size and composition o f our subject pool.  9  Sensory Perception and Interaction Research Group, Computer Science Department, University of British  Columbia. U R L : http://www.cs.ubc.ca/labs/spin/ Related studies forthcoming  95  A n implication of Grantchov's paper [Grantcharov, 2003] on hand dominance, gender, and video gaming experience on performance in laparoscopic surgery is that these factors should be taken into account when recruiting subjects. In our study, all subjects were male and right-handed which is representative  of the current majority of surgeons.  In Grantchov's study,  male  participants completed the tasks significantly faster while participants with right hand dominance performed fewer unnecessary movements. A larger group of participants would be needed to account for the variability between surgeons. In our experiment the surgeon with substantial computer gaming experience (Surgeon 3) seemed least affected by the different settings and showed high repeatability in general. Other factors that could influence individual performance are age,  innate motor skills, the innate ability to internally represent models  o f spatial  information, and the way people are trained. Because laparoscopy has only recently become widespread, standardization of curriculums is still underway. Surgeons with many years o f experience, like the participants in our study, all had very different training experiences. Since we were able to test only up to 3 participants, our results may be skewed due to individual characteristics of the participants.  A n unexpected result we found was the difference in completion time between the mechanical engineering students in a pilot test and the expert surgeons in the final study. W e expected the expert to be able to do the tasks at least as fast as complete novices, while instead they took longer. From observation, it seems plausible that this was due to difference in techniques used. The surgeons performed the dissection task by making many small dissections bit by bit, in a generally more careful fashion. In contrast, the engineering students tended to 'sweep' the cautery tool over the tissue, dissecting large portions of the structure in one stroke: a way o f dissection that is not possible on real tissue, but very efficient in the V E .  3 . 5 . 4 The V E Hardware and Software This section will discuss how the choice of software and hardware may have influenced our results, and how future versions of V R simulators may give different results.  96  Level of Force Feedback  Surgeon 1 noted that he relied mainly on vision in the clip application task, due to the low stiffness of the tube that the clips are applied on. In his experience, manipulating the cystic duct in a real patient with standard instruments provides significantly more force feedback then in the task presented by the software. This was also reflected in comments by other surgeons. In fact when asked about the force feedback, none o f the surgeons seemed to notice that force feedback was turned off completely at some o f the repetitions. T w o participants in the pilot study were so convinced that they did have force feedback in the N o Force Feedback setting, that they insisted after completion o f the experiment to do the task again in this setting. They were stunned to notice that there was not any force feedback present.  A plausible explanation for this is that the forces generated in the V E are too low. Both Kinnaird [Kinnaird, 2004] and Rosen [Richards, 2000] collected forces in the O R during laparoscopic cholecystectomy with standard surgical tools that are modified to measure forces. Force levels measured by both researchers in the O R are significantly higher than force levels in the Reachin V E . While we were not aware of this at the time we were conducting the experiments (Kinnaird obtained her results after the start of our experiments), our hardware degradation software could potentially be used to amplify the forces computed by the Reachin V E to higher levels.  A s discussed in more detail in chapter 1, Stylopolous et al. suggest in [Stylopoulos, 2004] that laparoscopic surgeons derive how much force they are exerting on tissue also based on visual cues as tissue color, contour, and adjacent tissue integrity. While the more subtle visual force cues that a real environment gives like blanching o f tissue under tension are not yet incorporated in V R surgical environments, changes in shape due to applied forces are obvious and could be the dominant factor in judging force feedback.  A third hypothesis to explain that subjects did not notice the absence o f force feedback is that by repeating the same task over and over again the participants after a while strongly rely on motor memory to execute the tasks. Possibly haptic feedback was used to determine the properties o f the environment during the exploring and learning phase, but after enough practice the participants were able to execute the task' without paying too much attention to haptic cues. Such  97  a scenario is more likely to occur in the V E , where subsequent repetitions are very similar, than in the O R .  A s a final remark on the force levels in the V E , the fact that our analysis shows that surgeons exerted significantly different forces  on the tissue under the N o Force Feedback  setting  compared to the High Fidelity setting, shows that in both tasks the settings did make a difference even though the participants may not have consciously noticed when force feedback was absent. It is important to notice that force saturation at 1 N did not result in a statistically significant difference.  Other Aspects of the Tasks  The dissection and clip application tasks in the experiment were not as natural to the surgeons as we expected. T o minimize learning, the participants were instructed to perform the task as they would do during real surgery. However, the participants requested further instruction, for reasons such as the following: •  The structures that were subject to dissection or clip application were not similar enough to any corresponding structure in human anatomy to evoke an obvious approach of how to complete the task.  •  In the dissection task, participants mentioned that they would have used blunt dissection instead o f cautery because o f the fragility o f the underlying tissue. Blunt dissection by means of spreading the tissue by opening the forceps is not implemented on the simulator.  •  When applying cautery in the V E , the covering tissue can be removed by a single sweep over the tissue, almost like applying paint on a surface with a brush. In the O R , it is not possible to burn away the tissue at such a fast rate. Instead many small movements need to be made while the cautery tool has to be used by pulling tissue away from the underlying structure instead of pushing it. This may have led to the difference between completion times of the surgeons and the graduate students: the graduate students may have dissected in the way that is most effective in the V E , while the surgeons were asked to dissect in a similar way to the O R , which required more time.  98  3.5.5 Strength of Haptic Degradations The haptic degradations were chosen to be within the limits of what could be expected in a costeffective hardware design. There were no complaints of any of the participants that the degradation settings were too strong. There may have even been room to make the effects more strong: Surgeon 1 said at one point that he found it hard to distinguish between the different settings.  W o u l d the experiment have benefited from stronger degradations? This would be dependent on the results. It is plausible that any of the hardware degradations can affect task performance, i f one simply increases the strength of the degradations enough. What we would like to know, is at which strength it starts to make an impact, something we would have tested for explicitly i f we were not bound by the limited time available by our participants. Therefore i f we would have executed the experiments with stronger degradations and had obtained the same results, we would know even more since our current settings would be a subset of these stronger settings (assuming that there is such a point in amplitude of hardware degradation above which surgical task performance is affected). O n the other hand, i f results of that experiment would show that the degradations did make a significantly difference, we would not have been able to identify levels of friction etc. that can be allowed in a design without affecting task performance.  Finally, i f the force levels in the surgical environment were higher (which is probably more representative of real conditions), how would this have affected our results? It should be realized that the forces generated by the surgical environment are only present when a tool is in contact with tissue. The friction, cogging, backlash, and inertia forces from our hardware degradation software are present anywhere in the workspace when turned on. Since the hardware degradation forces can be seen as a nuisance factor, higher surgical environment forces would lead to a higher signal to noise ratio. Exactly how this would translate to task performance taking into account the difference between tissue contact and free movement, can only be determined by experiments.  99  3.5.6 Statistical Power One last question that needs to be addressed is whether the Friedman test had enough power to draw any conclusions on the quality settings for which we did not find any significant difference. According to ([Zar, 1996], [Noether, 1959]): the power of the Friedman test is roughly  3k time the power of the A N O V A (k is the number of fixed-effect factors). In our case,  x(k + Y) k=5, and thus our results have 80% o f the power that we would have obtained from an A N O V A on the same data, were it appropriate. The power o f the A N O V A test goes up with increasing distances in means between groups and decreasing variances o f the groups. The variance o f the 50 percentile and 95 percentile forces exerted in the N o Force Feedback setting is large compared to the other settings, but nevertheless the Friedman test  detected a significant  difference between the N o Force Feedback and the High Fidelity setting. Since in general power goes up with increasing differences in means and decreasing variance in the data, the smaller variance in data sets other than High Fidelity should lead to more power to detect an equal difference in means. This suggests that the Friedman test did have acceptable power to find differences i f in fact there were any. However, sufficient statistical power to detect differences for 1 to 3 participants does not mean that the results o f this study are fully representative of the greater surgeon population.  Finally, bugs in the clip application tasks that were discussed in the results section led to a decrease in reliability o f completion time as a performance measure. The extra noise introduced by these shortcomings has decreased the effectiveness o f the tests to find inter-setting differences for this performance measure.  100  Chapter 4  Conclusions and recommendations  4.1 Main Findings & Thesis Contributions 4.1.1 Experimental Setup W e have modeled and implemented inertia, backlash, cogging, friction, and force saturation and shown that it is possible to implement degradation factors of haptic hardware under the following circumstances: •  Multiple models working simultaneously,  •  in multiple degrees o f freedom,  •  some with non-linearities,  •  on hardware with complex and unknown dynamic properties,  •  at varying and low sample rates  While the friction, cogging, and force saturation are stable at practically any amplitude, stability issues limit the mass the inertia/backlash model can represent. When all factors are turned on at the same time, maximal parameters as shown in Table 4.1 can be simulated.  Table 4.1 Stable parameters of the hardware models  Inertia  Translation  Rotation  Mass  = 0.2 kg  = 2gm  K  = 600 N/m  = 4 Nm/rad  B  0.3 critical  0.2 critical  damping  damping  2  Backlash  Gap Width  = I mm  = 2°  Cogging  Amplitude  0.6 N  0.04 Nm  Friction  Pre-sliding  = 100 pm  =5 millirad  Stick Velocity  = 5 mm/s  = 0.1 rad/s  101  While the models can be further improved upon to either extend the range of model parameters (e.g. mass), or the fidelity of the effects, the current model parameters fit the range we need to test for and we feel that the fidelity is high enough for our purpose. Occasional V E sampling rates as low  as 2 0 0 H z made the creation of accurate  models  increasingly challenging. Especially our inertia/backlash model will benefit from either more computer power or V E environments that takes up less resources.  Contribution: Real-time Simulation of Inexpensive Component Substitution in  Haptic Interface This is the first time a platform has been developed to simulate in real-time the result of introducing friction, cogging, force saturation, backlash and inertia in a haptic interface.  This  allows developers to test the effect of substituting expensive haptic hardware with inexpensive components by simply adding the custom software to the haptic loop, instead of having to go through an expensive iterative hardware-redesign process to obtain acceptable parameters. Because our software can be called from the device driver, a hardware developer can test the hardware settings with a variety of software applications without having to modify any of the applications themselves.  4.1.2 User Study W e tested task execution of expert surgeons in a dissection task and a clip application task under different haptic conditions. While our design was for 8 surgeons, a reasonably representative sample of the population, extreme difficulties in recruitment and hardware reliability constrained our observations to three individuals, with consequent impact on the type of analysis we could perform and its power. Three surgeons performed the dissection task and 2 surgeons performed the clip application task.  Did the Degradations in Haptic Quality Lead to Differences in Task Performance  Our first goal was to test i f degradations in quality of haptic feedback would lead to significant differences in task performance. W e tested for 8 different settings:  102  •  High Fidelity  •  Inertia  •  N o Force Feedback  •  Inertia with Backlash  •  Force Saturation  •  Cogging  •  Friction  •  Saturation+Cogging+Inertia+Backlash  The following performance measures were used: •  Median force  •  Median velocity  •  95 percentile force  •  Path length  •  Completion time  A Friedman tests on data from individual surgeons showed that for each surgeon the 95 percentile force performance measure was significantly affected by the hardware settings. Other performance measures showed significant differences for individual cases only. Seven pairwise comparisons between the High Fidelity settings and each of the other settings showed that over all participating surgeons, only N o Force Feedback caused a significant chance in exerted forces (both median and at the 95 percentile level). In previous research, differences in exerted forces were found between force-feedback and no-force-feedback in a virtual dissection task and a tele-operated dissection task on artificial tissue. In this study no significant differences in completion time were found due to degraded hardware. It was found though that the completion time as a measure o f performance in the clip application task had low reliability due to malfunctioning o f the V E software. Also, none o f the hardware degradations caused a significant difference in path length or median velocity compared to the High Fidelity setting.  Which Degradations Matter Most?  The second goal was to order conditions for which a significant effect was found according to impact. Since significant differences were found for only one single setting, no such ranking can be made with the current data. Experiments with stronger degradations are necessary to show such ranking.  103  Other observations  Some other practical observations were made that are important for future work. There was considerable variance in exerted forces between repetitions o f the same task at the same setting. Variance between repetitions in a study using the same software and hardware was lower in [Kinnaird, 2004]. Kinnaird's study employed a different task with a longer duration; her experiment however was o f much shorter duration, because she did not need to test for different hardware settings. She also recorded only 2 repetitions. These factors could all have contributed to the smaller variance in data.  Contrary to our expectations, graduate students were faster in executing the experiment than expert surgeons. In the V E , a dissection technique can be applied that is very fast but not realistic. While the expert surgeons were instructed to apply a dissection technique similar to the O R , graduate students who did not have O R experience dissected in the manner that was most efficient.  The Kolmogorov-Smirnov statistic in combination with bootstrapping was not able to detect any significant differences (introduction to the test and results are in Appendix I). This was partly due to large confidence intervals o f the D-values, while non-overlapping 95% confidence intervals lead to a very conservative test: the chance o f making a Type I error is very small, but it has low power. This method is expected to have higher power when the subjects form a better representation o f the surgeon population.  In the dissection task all surgeons showed a weak negative correlation between completion times and trial number. For Surgeon 2 the path length o f the left hand tool-trajectory showed a strong negative correlation with time. Both phenomena are most likely due to either learning or using a faster but unrealistic dissection technique that is possible in this particular virtual environment.  Force C D F s showed that surgeons performed differently, justifying our within-subjects design. Each surgeon maintained a consistent velocity profile within the same task, suggesting both consistency o f performance by individuals, and an overall lack o f influence of hardware  104  degradations on performance. The only exceptions to these are the left hand clip dissection velocities, and tool-tip velocity o f Surgeon 1 under N o Force Feedback in dissection.  Contribution: Degraded Haptic Quality Did Not Significantly Impact Performance  W e found that as long as force feedback is turned on, the introduced hardware degradations did not make a significant impact on surgical task performance in a V R simulator.  While our  number o f participants was limited, this suggests that haptic hardware for laparoscopic surgery does not heed very expensive components and therefore could be made cheaper than is currently the case.  4.2 Recommendations for Future Work 4.2.1 Experimental Platform  Improvement and Extension of Models  Several aspects o f the reported models are potentially improvable. Stiffening the virtual coupling will increase the fidelity of the inertia / backlash model; to do this stably requires application o f more sophisticated filtering methods and a better understanding of the actual hardware dynamics. Also, a better velocity estimate for the friction model will make the transition from slip to stick state more reliable and possible at a lower velocity.  In this study it was necessary to limit the number of hardware degradations we tested, and consequently we implemented only those we felt were most important given our experimental goals. Models can be expanded and improved upon i f there is no such burden. A n extra model can be made to account for torque ripple. Cogging and torque ripple models can be adjusted to match specific motor designs, while the friction model can be adjusted to match specific friction characteristics of certain materials and contact situations.  Upgrading the 'Gold Standard' Software and Hardware  Shortly before the end of this project, Kinnaird published preliminary results o f a validation study o f the used V R environment. She measured tool-tip kinematics and exerted forces during a gall-bladder dissection task in the O R and in the V R environment by 2 expert surgeons doing 2  105  repetitions each. Her results suggested that the surgeons treated the V R differently from the O R . The most notable difference she found was the lower forces exerted in the V R environment. Therefore future versions of the V R environment may have stronger haptic cues. O n the other hand, this thesis has presented arguments why surgeons may rely less on haptic cues in future simulation software that has improved graphics that show subtle force cues visually. When interpreting the results of this study, it should be taken into account that the software was the state of the art in laparoscopic simulation at the time of the experiment.  Occasional V E sampling rates as low  as 200Hz made the creation of accurate  models  increasingly challenging. A faster computer that could provide update rates of at least 500 H z , but preferably 1000 H z , would allow stiffer models and therefore a more crisp backlash/inertia effect.  We hope that this situation will improve with increased computational power, but such  gains could be negated by corresponding increases in V E model complexity. Our results suggest that the value of maintaining a minimal update rate of 500-1000 H z might outweigh the benefits of increasing model complexity.  A s mentioned in the introduction, soft tissue environments are relatively easy to render haptically and are therefore less demanding of haptic hardware than stiffer environments. However, our case hardware degradation software would have benefited from better hardware. The friction model  and backlash inertia model  would  have  benefited  from  more  accurate  position  measurement at high update rates. Both the low encoder resolution and noticeable backlash and flexibility in the instrument shaft when the instrument is extracted led to inaccurate position measurement in the current hardware. Also, as result of working with commercial hardware and software, we did not have access to details about software and hardware that would have helped us in increasing the stability of our own haptic simulation and we could not implement changes in for example device driver functionality that would have reduced computational overhead. Finally, development of the models and running the experiments was impaired by the significant down time of the hardware (shipping, repairs, and trouble shooting).  106  4.2.2 User Studies  Subject Pool  A user study with more participants could improve the significance of the results. Considering the difficulty o f getting experienced surgeons to participate in the study, a small group o f surgeons  could be complemented  with non-medical participants with significant  gaming  experience. The latter would be easier to recruit, have advanced skills in 3D V R environments, and i f given proper instruction, may be able to duplicate the expert surgeons behaviour in basic skills  tasks.  Judging from our experience  with  engineering  students  and the  software  implementation o f the surgical V E , proper instructions will be important to obtain similar task execution.  Experim ent Design  In future studies that require repetitions o f settings, it would be recommended to assign the settings in blocks o f all k settings to the user, randomizing the order o f the settings within the blocks. This would avoid having more-than 2 subsequent tasks at the same setting, and would assure an even distribution o f settings over the length o f the experiment.  Next Step: Does Haptic Quality Impact Learning?  The current study investigates the immediate impact of haptic quality on an expert surgeon's task execution. A second important question is how haptic quality affects learning. If medical students would train in a V E with low quality haptic feedback, how would this affect their final performance? Results o f this study suggest that subjects relied less on force feedback when repeating a task many times. This study would address the issue o f force feedback reliance at different stages o f training.  4.3 Hardware Quality in Future Haptic Interfaces The market for haptic interfaces has been divided into two segments: cheap consumer haptic interfaces with low degrees o f freedom, and expensive high fidelity complex interfaces for research and professional  applications. This  study has investigated  i f for one particular  professional application, laparoscopic training, such a high-fidelity interface can be replaced by a less expensive one b y using cheaper components. In a recent production launch a similar move has been made by a producer o f low-volume high-end haptic interfaces that are used for 3 D  107  design: interfaces that cost until recently $15,000 or more have been brought to market with lower torque output and relatively high friction for $1,950  10  (backdrive friction < 0.26N, cont.  force >0.88N). Preliminary reports suggest that this device has discernibly lower performance (forces, workspace etc) than its higher-end counterparts, and yet we anticipate that much can be done with it. While more research is necessary, our own results suggest that it is possible to lower hardware costs of haptic interfaces for laparoscopy without affecting performance as long as a minimum amount of force feedback is still provided.  10  Sensable Technologies PHANTOM® Omni™ haptic device (volume pricing below US$1000)  http://www.sensable.com/newsevents/pressreleases/pr-Devkit072104.asp  108  Appendix I:  Data analysis with the Kolmogorov-Smirnov  Test and Bootstrapping. Introduction The Kolmogorov-Smirnov Test The Kolmogorov-Smirnov test (KS test) evaluates the hypothesis that two independent datasets are drawn from the same distribution. This test was developed by Smirnov [Smirnov, 1939] in 1939 and builds on a test previously developed by Kolmogorov for evaluating  goodness-of-fit  for a single sample [Kolmogorov, 1933]. Some of the interesting characteristics of the test are: •  The samples can be obtained from data from any kind of underlying distribution  •  A difference measure obtained has no dimension.  The underlying idea of the K S test is that i f the two datasets are drawn from the same population, one would expect their cumulative distribution functions to be similar. Therefore, i f there is any significant difference at any point between the cumulative distribution functions of the two datasets, one can conclude that there is a high likelihood that the datasets were drawn from different populations. In addition, we can use the D-value (Figure 0-1) as a difference measure.  Figure 0-1 The cumulative distribution function for two finite data sets are represented as a staircase. The Kolmogorov-Smirnov statistic, D, is defined as the maximum vertical difference between two cumulative distribution functions.  The maximum vertical distance between the two distributions is indicated with the letter D (sometimes this value is referred to as M [Sheskin, 2000]). The null-hypothesis that the two  109  samples  came from the same underlying distribution is rejected in a two-tailed test at  significance level 5% when the D exceeds the value calculated in the following formula:  (1.4)  n,,n > 25 2  in which « / and m are the number o f independent samples in dataset 1 and dataset 2 respectively. Slightly modified versions of this formula are used for one-sided tests, and for testing at significance levels other then 5%, or with smaller numbers o f samples.  Introduction to Bootstrapping Resampling methods are used to calculate confidence bounds for statistical results when analytical methods are not available or are too complex. Effron introduced the bootstrap method in 1979 [Effron, 1979]. Bootstrapping is a method to estimate variability and bias in a statistic o f a sample taken from a large population. While traditional parametric inference relies on assumptions about distribution of the population, the bootstrapping method assumes only that the samples' distribution is a good estimate of the actual population distribution; no assumptions o f the shape of the distribution are made.  The Bootstrapping method works as follows. If y is a parameter o f the population P, and y is the statistic that estimates this parameter based on a sample S drawn from P with S = {5 5 ,...,5 }, 15  2  n  then in an ideal world, Monte Carlo sampling can be used to repeatedly draw a sample S and calculate the statistic y for each S to create a distribution of y to infer confidence bounds on the estimate. In the real world, only a limited number of samples can be taken. The bootstrapping method therefore applies Monte Carlo sampling to the original sample S to estimate confidence bounds on the statistic y to make inferences about y. S is resampled with replacement m times. Each S*has n elements: therefore it is likely to contain some elements from S more than once, while sometimes not having any at all. The variability mS* will lead to variation in y as well. Therefore i f the process is repeated many times, a population o f y  110  is built from which a  confidence interval can be derived. T o derive a confidence interval, m has to be a fairly large number, usually m > 1000.  The standard bootstrapping method assumes that the samples are independent. However in our study, force and kinematic data are temporally correlated: the position of the tooltip for example will be strongly correlated to its position in the immediately adjacent samples, especially at the higher update rates. Autoregressive analysis on multiple samples o f data showed a high variance in the number of correlated samples. Therefore the moving block bootstrap is used which does not require any knowledge about the autoregressive model order [Lahiri, 2003].  Methods We used the K S statistic in combination with bootstrapping to test the null hypothesis that there is no significant difference in D-values between repetitions o f a task at the High-Fidelity setting and  the other setting o f interest. W e replicate our experiment  1000  times by randomly  resampling at all levels. W e first randomly pick a surgeon. From the data of this surgeon we then randomly pick a repetition o f the High Fidelity setting (HF1), a second repetition o f the High Fidelity setting (HF2), and a repetition o f the setting o f interest (SI1). After resampling H F 1 , HF2, and SI1, the K S statistic is then applied between the HF1 and H F 2 data sets to calculate a Di t n  ra  and between HF1 and SI1 to calculate Dj er. When repeated 1000 times, the range of D j nt  n t r a  values shows the variability within the High Fidelity setting, while the D j r values show the nte  range o f D values between the High Fidelity and setting o f interest. W e reject the null hypothesis if 95 percent of the range o f D j t n  ra  and D j  n t e  r are not overlapping.  Results The plots on the following pages shows the K S statistic results for instrument-tissue interaction forces (Figure 0-2), and tool-tip velocity (Figure 0-3). Within each row, the black line represents the 95% range o f the D-statistic within the High Fidelity repetitions ( D  i n t r a  ) , and the red line  represents the 95% range o f the D-statistic between the High Fidelity setting and the degradation listed on the y-axis at this row (Djnter)- One might expect the confidence intervals on D j  n t r a  to be  the same within the clusters since they are comparisons within the High Fidelity setting. This is not the case because the D^ti-a and D i  n t e r  values are calculated by performing within-subject  111  comparisons: since not all surgeons participated in each setting, the  Dj t n  r a  values are extracted  from different (combinations of) surgeons. For example in the dissection task, the D  i n t r a  values in  the N o Force Feedback and A l l Degradations settings reflect data from all 3 surgeons; in the Saturation setting the D i „  tra  values represent data only from Surgeon 3. For settings in which the  same surgeons participated, small variations in D  i n t r a  occur due to the bootstrapping process.  In both velocity and force K S plots, all red and black confidence interval pairs are overlapping, which means that no significant difference was found.  Force results show a clear distinction between the two tasks. In the dissection task the confidence intervals are small compared to the clip setting task. This is especially true for the right hand and confidence intervals on D  i n t r a  .  The confidence intervals on the velocity data are small compared to the confidence intervals on the force data.  112  -1  Inertia Friction •  }S1  —I}S2 1 }S1,S2  Cogging  I }S1,S2  All Degr.  H } S1.S2  No Force Fb.  -t  Inertia  ,}S1  Friction -  ,}S2  Cogging •  j_ }S1,S2 )  All Degr.  } S1.S2  No Force Fb.  _j}S1,S2  H } S3  Saturation  }S1  Inertia H }S2  Friction  1 } S1.S2  Cogging -  H}S3  Backlash -  1 }S1,S2,S3  All Degr.  H }S1,S2,S3  No Force Fb.  ,}S3  Saturation  ,}S1  Inertia ™i}S2  Friction  H}S1,S2  Cogging -I} S3  Backlash  } S1,S2,S3  j  All Degr.  H } S1.S2.S3  No Force Fb. 0.1  0.2  0.3  0.4  0.5 D  0.6  0.7  0.8  0.9  Figure 0-2 Results from the Kolmogorov-Smirnov analysis on force data. 95 percent confidence bounds for the D—value are given for intra-Hi Fidelity (black), and between High Fidelity and each setting (red). If the intervals indicated by the red and black line do not overlap, there is a high likelihood of a difference between the setting and the High Fidelity setting. SI, S2, and S3 indicate which surgeon (number) the data originates from.  113  ^  Inertia  -I }  |H  Friction  H} S2  CD  CO  H } S1.S2  Cogging  H } S1.S2  D_  =  S1  All Degr.  H}  S1.S2  No Force Fb.  I  H}  Inertia  S1  H } S2  Q£  Friction  ^  Cogging  U S1.S2 H } S1.S2  Q_ All Degr.  S1.S2  Wo Force Fb.  Saturation  I  c .O —I  TJ  Inertia  JL|}S3  H  }S1  Friction  _j  Cogging  j  H } S1.S2 S2  j^}S3  CD Backlash  } S1.S2.S3  CO  ^  All Degr.  1 } S1.S2.S3  No Force Fb. H} S 3  Saturation  H } S1  Inertia Q5  Friction  §  Cogging  H}S2 j H}S3  Tj Backlash CD  $ fib  . } S1.S2  } S1.S2.S3  All Degr.  HI} S1.S2.S3  Force Fb. 0.1  0.2  0.3  0.4  0.5 D  0.6  0.7  0.8  0.9  Figure 0-3: Results from the Kolmogorov-Smirnov analysis on velocity data. 95 percent confidence bounds for the D—value are given for intra-hifi (black), and between hifi and each setting (red). If the intervals indicated by the red and black line do not overlap, there is a high likelihood of a difference between the setting and the High Fidelity setting. S1,S2, and S3 indicate which surgeon (number) the data originates from.  114  Discussion W e found no significant differences between the High Fidelity setting and any o f the other settings by applying the KS-test. Confidence bounds on the D-statistic were much larger than in a study performed by Kinnaird [Kinnaird, 2004] who found smaller differences between repetitions o f a simulated dissection task. In contrast to this study, Kinnaird's study has: •  Different task: a more complicated gall-bladder dissection task  •  Longer duration o f the task  •  Only 2 repetitions vs. 3 repetitions in this study  •  Only high fidelity setting  •  Different participants: same surgical experience level, different individuals.  These differences will be discussed in this section to shed some light on how they may have affected the outcome.  One observation that can be made from Figure 0-2 (which shows the confidence intervals on the D-value o f the Kolmogorov-Smirnov statistic applied to force data) is that the confidence intervals in the clip application task are almost always larger than the confidence intervals in the dissection task. Average completion times for these tasks are roughly 1 minute for clip application, but 2 minutes for dissection. The dissection task in Kinnaird's requires dissecting a whole area instead o f one line and took on average 5 minutes to complete. This suggests that there may be an increase of reliability o f the D-value o f force measurements with increasing task duration. The number o f repetitions decreased with the increase o f completion time; the clip application task has 9 repetitions, dissection 3, and Kinnaird's 5 minute dissection task was repeated twice. With an increase of repetitions it is more likely to obtain a rarely occurring value. B y taking the 95 percentile o f D-values, these outliers may not be filtered out since every point was in a way multiplied in it's nearest neighbors by bootstrapping resampled data.  The total experiment completion time was below 20 minutes in Kinnaird's study, while 1.5 to 3 hours in this study. Our longer experimental time may have also contributed to the larger variation between repetitions. The fact that the same surgeons work for at least 90 minutes in a  115  row in the O R during the real procedure makes fatigue a less likely explanation though it is hard to tell i f monotony o f the tasks and possible resulting boredom did contribute to the results.  Finally, the uneven number o f populations that we draw from and the unequal variances in populations contribute to the wide range of 95% D-value range. W e used two or three surgeons to represent the larger surgeon population, and 3 to 9 repetitions to represent the variability due to doing the experiment over with the same surgeon. W e resampled the roughly 10,000 data points in a single repetition to represent doing the experiment again with the same surgeon under exactly the same circumstances that occurred when the dataset was originally recorded. A s can be expected, variations due to resampling o f the dataset are very small compared to differences between surgeons or repetitions. The range o f the D-values was determined mostly by the differences between a small number o f surgeons and a small number of repetitions. While the 95 percentile range is used to filter out outliers, outliers are multiplied by resampling.  116  Bibliography Adams, R. J . , Klowden, D . and Hannaford, B . (2001a), "Virtual Training for a Manual Assembly Task", Haptics-e, The Electronic Journal of Haptics Research (www.haptics-e.org), 2 (2), pp. Adams, R. J . , Klowden, J. and Hannaford, B . (2001b). Virtual training for a manual assembly task. 2, Nr. 2. Adrales, G . L . , Chu, U . B . , Witzke, D . B . , Donnelly, M . B . , Hoskins, D . , Mastrangelo, M . J . , Jr., Gandsas, A . and Park, A . E . (2003), "Evaluating minimally invasive surgery training using lowcost mechanical simulations", Surgical Endoscopy, 17 (4), pp. 580-5. Armstrong-Helouvry, B . (1991), "Control o f Machines with Friction", pp. Armstrong-Helouvry, B . , Dupont, P. and Canudas De Wit, C . (1994), "A survey o f models, analysis tools and compensation methods for the control of machines with friction." Automatica, 30 (7), pp. 1083-1138. Armstronghelouvry, B . , Dupont, P. and Dewit, C . C . (1994), "A Survey of Models, Analysis Tools and Compensation Methods for the Control o f Machines with Friction", Automatica, 30 (7), pp. 1083-1138. Baldwin, P. J . , Paisley, A . M . and Brown, S. P. (1999), "Consultant surgeons' opinion of the skills required of basic surgical trainees", B r J Surg, 86 (8), pp. 1078-82. Basdogan, C , De, S., K i m , J . , Muniyandi, M . , K i m , H . and Srinivasan, M . A . (2004), "Haptics in minimally invasive surgical simulation and training", I E E E Computer Graphics and Applications, 24 (2), pp. 56-64. Batter, J. J. B . , F. P. Jr. (1971). " G R O P E - I : A computer display to the sense of feel." International  Federation of Information Processing,  Ljubljana, Yugosolavia,.  Baumann, R. and Clavel, R. (2001). "Haptic interface for virtual reality based minimally invasive surgery simulation". IEEE International. Conference on Robotics, and  Automation  Beamish, T . , Maclean, K . and Fels, S. (2004). "Manipulating Music: Multimodal Interaction for DJs". ACMSIGCHI,  Vienna, Austria.  Ben U r , E . , "Development of a Force-Feedback Laparoscopic Surgery Simulator", Master's Thesis, Massachusetts Institute of Technology, 1999 Benarous, M . and Eastham, J. F . (1999). "The effect of the distribution of the magnetisation in brushless D C machines on cogging torques". Ninth International  Machines and Drives, 1999  117  Conference on  Electrical  Berci, G . , Margolin, D . A . and Marks, J. M . (1998). "Minimally Invasive Surgery: Principles and Outcome", Harwood Academic Publishers. Berkley, J., Weghorst, S., Gladstone, H . , Raugi, G . , Berg, D . and Ganter, M . (1999), "Fast finite element modeling for surgical simulation", Stud Health Technol Inform, 62, pp. 55-61. Betrisey, S. and Vollenweider, M . , "Device for simulating a rod-shaped surgical instrument having a force feedback effect", Patent WO03023736, Xitact S A , Bielser, D . , " A framework for open surgery simulation", PhD thesis, Swiss Ferderal Institute of Technology Zurich, Switzerland, 2003 Bin, A . and Stiles, W . P., "Haptic feedback joystick", Patent US6429849, Microsoft Corp., U S A , Breedveld, P., Stassen, H . G . , Meijer, D . W . and Jakimowicz, J. J. (1999), "Manipulation in laparoscopic surgery: overview of impeding effects and supporting aids", J. Laparoendosc. A d v . Surg. Tech. A , 9 (6), pp. 469-480. Breedveld, P., Stassen, H . G . , Meijer, D . W . and Jakimowicz, J. J. (2000), "Observation in laparoscopic surgery: overview of impeding effects and supporting aids", J. Laparoendosc. A d v . Surg. Tech. A , 10 (5), pp. 231-241. Bridges, M . and Diamond, D . L . (1999), "The financial impact of teaching surgical residents in the operating room", A m J Surg, 177 (1), pp. 28-32. Brouwer, I., Maclean, K . E . and Hodgson, A . J. (2004). "Simulating cheap hardware: a platform for evaluating cost-performance trade-offs in haptic hardware design". Robotics and  Automation,  2004. Proceedings. ICRA '04. 2004 IEEE International Conference on Brouwer, I., Ustin, J., Bentley, L . , Sherman, A . , Dhruv, N . and Tendick, F . (2001). "Measuring in vivo animal soft tissue properties for haptic modeling in surgical simulation". Stud.Health  Technol.Inform. (Medicine Meets Virtual Reality 2001) Chan, C . S., Tong, Z . , Dang, A . and Qian, J. (2003). "Virtual Reality Modeling of Traditional Chinese Architecture". Virtual Systems and  MultiMedia  Chen, J . , Dimattia, C , Taylor, R. M . I., Falvo, M . , Thiansathaporn, P. and Superfine, R. (1997). "Sticking to the point: A friction and adhesion model for simulated surfaces". Proceedings  of the  Sixth Annual Symposium on Haptic Interfaces for Virtual Environment and Teleoperator System, Dallas, T X , U S A . Chung, J. Y . and Sackier, J. M . (1998), "A method o f objectively evaluating improvements in laparoscopic skills", Surgical Endoscopy, 12 (9), pp. 1111-6. Coleman, R. L . and Muller, C . Y . (2002), "Effects of a laboratory-based skills curriculum on laparoscopic proficiency: a randomized trial", A m J Obstet Gynecol, 186 (4), pp. 836-42.  118  Colgate, J . E . and Schenkel, G . (1994). "Passivity of a Class of Sampled-Data Systems: Appliation to Haptic Interfaces". American Control Conference,  1994  Colgate, J. E . , Stanley, M . C . and Brown, J. M . (1995). "Issues in the haptic display of tool use".  Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. 'Human Robot Interaction and Cooperative Robots', Pittsburgh, P A , U S A . De, S. and Srinivasan, M . A . (1999), "Thin walled models for haptic and graphical rendering of soft tissues in surgical simulations", Stud Health Technol Inform, 62, pp. 94-9. Den Boer, K . T . , De Wit, L . T . , Davids, P. H . , Dankelman, J . and Gouma, D . J. (2001), "Analysis of the quality and efficiency in learning laparoscopic skills", Surg Endosc, 15 (5), pp. 497-503. Deodhar, R. P., Staton, D . A . , Jahns, T . M . and Miller, T . J. E . (1996), "Prediction of cogging torque using the f l u x - M M F diagram technique", I E E E Transactions on Industry Applications, 32 (3), pp. 569-576. Derossis, A . M . , Fried, G . M . , Abrahamowicz, M . , Sigman, H . H . , Barkun, J. S. and Meakins, J . L . (1998), "Development of a model for training and evaluation of laparoscopic skills", 175 (6), pp. 482-487. Dunnett, C . W . (1964), "New Tables for Multiple Comparisons with a Control", Biometrics, 20, pp. 482-491. Effron, B . (1979), "Bootsrap methods: Another look at the jackknife." The Annals of Statistics, 7, pp. 1-26. Ernst, M . O . and Banks, M . S. (2002), "Humans integrate visual and haptic information in a statistically optimal fashion", Nature, 415 (6870), pp. 429-433. Eubanks, T . R., Clements, R. H . , Pohl, D . , Williams, N . , Schaad, D . C , Horgan, S. and Pellegrini, C . (1999), "An objective scoring system for laparoscopic cholecystectomy", J. A m . Coll. Surg., 189 (6), pp. 566-574. Fried, G . M . , Derossis, A . M . , Bothwell, J. and Sigman, H . H . (1999), "Comparison of laparoscopic performance in vivo with performance measured in a laparoscopic simulator", 13 (11), pp. 1077-1081. Friedman, M . (1937), "The use of ranks to avoid the assumption of normality implicit in the analysis of variance." Journal of the American Statistical Association, 32, pp. 675-701. Gerdes, J. C . and Kumar, V . (1995). "An impact model of mechanical backlash for control system analysis". Proceedings of the American Control  119  Conference  Gillespie, B . and Cutkosky, M . (1996). "Stable user-specific haptic rendering of the virtual wall".  Proceedings of the ASME Dynamic Systems and Control  Division  Gosline, A . , "bla", E E C S University o f British Columbia, 2003a Gosline, A . H . (2001). Evaluation of Friction Models with a Haptic Interface. SPSC515 Course Report, University of British Columbia. Gosline, A . H . , "Simulation of Linear Elastic Media with Fluid Inclusions", M . A . S c . thesis, Department of Electrical and Computer Engineering U N I V E R S I T Y O F B R I T I S H C O L U M B I A , 2003b Gosline, A . H . , Salcudean, S. E . and Y a n , J. (2004). "Haptic simulation of linear elastic media with fluid pockets". Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004.  HAPTICS  '04. Proceedings. 12th International Symposium on  Grantcharov, T . P., Bardram, L . , Funch-Jensen, P. and Rosenberg, J. (2003), "Impact of hand dominance, gender, and experience with computer games on performance in virtual reality laparoscopy", Surg Endosc, pp. Online First. Grantcharov, T . P., Rosenberg, J., Pahle, E . and Funch-Jensen, P. (2001), "Virtual reality computer simulation", Surgical Endoscopy, 15 (3), pp. 242-244. Grewal, M . , S. and Andrews, A . P. (2001). "Kalman Filtering Theory and Practice Using M A T L A B " , John Wiley & Sons, Inc. Hacksel, P. and Salcudean, S. E . (1994). "Estimation of Environment Forces and Rigid-Body Velocities Using Observers". Proceedings  of the IEEE International  Conference on Robotics and  Automation, San Diego, U S A . Haessig, D . A . and Friedland, B . (1991), "On the Modeling and Simulation of Friction", Journal of Dynamic Systems Measurement and Control-Transactions of the Asme, 113 (3), pp. 354-362. Hanselman, D . C . (1994). "Brushless permanent-magnet motor design", M c G r a w - H i l l , New York. Hayward, V . and Armstrong, B . (2000). A new computational model of friction applied to haptic rendering. Experimental Robotics. P. Corke and J. Trevelyan. V I : 403-412. Heijnsdijk, E . A . , Pasdeloup, A . , V a n Der Pijl, A . J . , Dankelman, J. and Gouma, D . J. (2004), "The influence of force feedback and visual feedback in grasping tissue laparoscopically", Surg Endosc, 18 (6), pp. 980-5. Heilig, M . L . , "Stereoscopic-television apparatus for individual use", Patent U . S . , Heilig, M . L . , "Sensorama simulator", Patent US3050870; G09B5/06; G02B27/22S,  120  Immersion Corporation (2003). Press Release: Immersion Launches Gaming Software That Immediately Enables Force Feedback for the Vast Majority of P C Games; TouchWare Gaming Turns Sound Waves into Touch Sensations. San Jose, C A . Ishii, M . and Sato, M . (1993). "A 3D interface device with force feedback: a virtual work space for pick-and-place tasks". IEEE Virtual Reality Annual International Symposium,  1993  Ishikawa, T . and Slemon, G . R. (1993), "A method of reducing ripple torque in permanent magnet motors without skewing", I E E E Transactions on Magnetics, 29 (2), pp. 2028-2031. James, D . L . P., D . K . (1999a). "ArtDefo, Accurate Real Time Deformable Objects". Proceedings  of Computer Graphics ACM SIGGRAPH  99 Conference  James, D . L . P., D . K . (2002). "DyRT: Dynamic Response Textures for Real Time Deformation Simulation with Graphics Hardware". Proceedings Animation,  of ACM  SIGGRAPH  2002, Computer  San Antonio, Texas.  James, D . L . P., D . K . (1999b). "ArtDefo, Accurate Real Time Deformable Objects". Computer Graphics: ACM SIGGRAPH  99 Conference  Proceedings  Jensen, R. F . J. S. H . W . (2001). "Visual Simulation of Smoke". Proceedings  of  SIGGRAPH  Johnson, C . T . and Lorenz, R. D . (1992), "Experimental identification of friction and its compensation in precise, position controlled mechanisms", I E E E Transations on Industry Applications, 28 (6), pp. Jukic, T . and Peric, N . (2001). "Model based backlash compensation". American  Control  Conference, Arlington, V A , U S A . Kapuscinski, C . L . , "Motor Selection and Damper Design for a Six Degree o f Freedom Haptic Display", M . A . S c . thesis, Department of Mechanical Engineering Northwestern University, 1997 The 'Karlsruhe Endoscopic Surgery Trainer' http://wwwkismet.iai.fzk.de/TRAINER/mic_trainerl.html. Karnopp, D . (1985), "Computer simulation of stick-slip friction in mechanical dynamic systems", A S M E Journal of Dynamic Systems and Control, 107, pp. 100-103. Kawamura, S. and Ito, K . (1993). "A new type of master robot for teleoperation using a radial wire drive system". Proceedings  of the 1993 IEEE/RSJ  International  Conference on Intelligent  Robots and Systems '93, IROS '93 Kilchenman, M . and Goldfarb, M . (2001). "Force saturation, system bandwidth, information transfer, and surface quality in haptic interfaces". IEEE International and  Automation  121  Conference on Robotics  K i m , J., De, S. and Srinivasan, M . A . (2002a). "Computationally Efficient Techniques for Real Time Surgical Simulation with Force Feedback". 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Los Alamitos, C A . K i m , S., Hasegawa, S., Koike, Y . and Sato, M . (2002b). "Tension based 7 - D O F force feedback device: S P I D A R - G " . Virtual Reality, 2002. Proceedings.  IEEE  Kinnaird, C , "A Multifaceted Quantitative Validity Assessment of Laparoscopic Surgical Simulators", M . A . S c . thesis, Mechanical Engineering University of British Columbia, 2004 Kolmogorov, A . N . (1933), "suula determinazione emperica di una legge di distribuzione", Giorn dell'Inst. Ital. degli. A l t , 4, pp. 89-91. Krijn, M . , Emmelkamp, P. M . , Olafsson, R. P. and Biemond, R. (2004), "Virtual reality exposure therapy of anxiety disorders: A review", C l i n Psychol Rev, 24 (3), pp. 259-81. Kwon, D . - S . and Woo, K . Y . (2000). "Control of the haptic interface with friction compensation and its performance evaluation". Intelligent Robots and Systems, 2000. (IROS 2000). Proceedings.  2000IEEE/RSJInternational  Conference on  L . Villegas, B . E . S., M . P. Callery, D . B . Jones (2003), "L. Villegasl, B . E . Schneiderl, M . P. Calleryl and D . B . Jones", Surgical Endoscopy, Online First, pp. Lahiri, S. N . (2003). "Resampling Methods for Dependent Data", Springer-Verlag. Lajoie-Mazenc, M . , Nogarede, B . and Fagundes, J. C . (1989). "Analysis of torque ripple in electronically commutated permanent magnet machines and minimization methods". International  Conference on Electrical  Fourth  Machines and Drives  Larsen, O. V . H . , J.;0stergaard,L.R.;Hansen,K.V.;Nielsen,H (2001). "The Virtual Brain Project: development of a neurosurgical simulator." Medicine  Meets Virtual Reality, Newport Beach,  California, U S A . Lawrence, D . A . , Pao, L . Y . , White, A . C . and X u , W . (2004). "Low cost actuator and sensor for high-fidelity Haptic interfaces". Proceedings  12th International Symposium on Haptic Interfaces  for Virtual Environment and Teleoperator Systems Lirici, M . M . (1997), "Editorial - New techniques, new technologies and educational implications." Minimally Invasive Theapies & Allied Technologies, 6, pp. 102-104. Maclean, K . E . , "Emulation of Haptic Feedback for Manual Interfaces", Ph.D. thesis, Mechanical Engineering M I T , 1996 Mahvash, M . and Hayward, V . (2004), "High-fidelity haptic synthesis of contact with deformable bodies", Computer Graphics and Applications, I E E E , 24 (2), pp. 48-55.  122  Massie, T . H . and Salisbury, J. K . (1994). "The P H A N T o M haptic interface: a device for probing virtual objects", the Third Ann. Symp. on Haptic Interfaces for Virtual Environment Teleoperator Systems,  and  ASME/IMECE  Maxwell, S. E . D . , H . D . (2003). "Designing Experiments and Analyzing Data. A model comparison perspective." Mayrose, J., Chugh, K . and Kesavadas, T . (2000), "Material property determination of subsurface objects in a viscoelastic environment", Biomed Sci Instrum, 36, pp. 313-7. Moody, L . , Baber, C . and Arvanitis, T . N . (2002). "Objective surgical performance evaluation based on haptic feedback". Medicine Meets Virtual Reality Conference, Newport Beach, C A , USA. Moore, D . F . , Schena, B . M . and Shahoian, E . J . , "An input device with force feedback", Patent GB2350170, Immersion Corp., M o y , G . , Wagner, C . and Fearing, R. S. (2000). "A compliant tactile display for teletaction". Proceedings of the IEEE International  Conference on Robotics and  Automation  Nahvi, A . , Hollerbach, J. M . , Freier, R. and Nelson, D . D . (1998). "Display of friction in virtual environments based on human finger pad characteristics". American Society of Mechanical Engineers, Dynamic Systems and Control Division, Anaheim, C A , U S A . Noether, P. V . E . G . E . (1959), "The asymptotic efficiency of the X 2 -test for a balanced A  incomplete block design." Biometrika, 46, pp. 475-477. Norman, G . R. and Streiner, D . L . (1994). "Biostatistics, the bare essentials", M o s b y Year Book Inc. O'malley, M . and Goldfarb, M . (2002). "Comparison of Human Haptic Performance in Real and Simulated Environments." Proceedings of the I E E E 10th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Payandeh, S. and L i , T . (2003), "Toward new designs of haptic devices for minimally invasive surgery", International Congress Series, 1256, pp. 775-781. Reznick, R., Regehr, G . , Macrae, H . , Martin, J. and Mcculloch, W . (1997), "Testing technical skill via an innovative "bench station" examination", Am.J.Surg., 173 (3), pp. 226-230. Richard, C , Cutkosky, M . and Maclean, K . (1999). "Friction Identification for Haptic Display". the 8th Ann. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, ASME/IMECE,  Nashville, T N .  123  Richard, C . and Cutkosky, M . R. (2002). "Friction modeling and display in haptic applications involving user performance". Proceedings  of the IEEE International  Conference on Robotics  and Automation Richards, C , Rosen, J., Hannaford, B . , Pellegrini, C . and Sinanan, M . (2000), "Skills evaluation in minimally invasive surgery using force/torque signatures", Surgical Endoscopy, 14 (9), pp. 791-798. Rosen, J., Hannaford, B . , Richards, C . G . and Sinanan, M . N . (2001), "Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills", I E E E Trans.Biomed.Eng, 48 (5), pp. 579-591. Rosenberg, L . B . , "Force feedback device with microprocessor receiving low level commands", Patent US2002033841, Immersion Corp., U S A , Rosenberg, L . B . , Moore, D . F . , Bruneau, R. D . , Schena, B . M . and Martin, K . M . , "Mechanical and force transmission for force feedback devices", Patent US6400352, Immersion Corp., U S A , Rosser, J. C , Rosser, L . E . and Savalgi, R. S. (1997), "Skill acquisition and assessment for laparoscopic surgery", Arch Surg, 132 (2), pp. 200-4. Salisbury, K . , Conti, F . and Barbagli, F . (2004), "Haptic rendering: introductory concepts", I E E E Computer Graphics and Applications, 24 (2), pp. 24-32. Satava, R. (2003). "Keynote talk". Medicine  Meets Virtual Reality 2003, Newport Beach, C A ,  USA. Schijven, M . J., J (2003), "Virtual Reality Surgical Laparoscopic Simulators", Surgical Endoscopy, Online First, pp. Scott-Conner, C . E . H . (1999). "The S A G E S Manual: Fundamentals of Laparoscopy and GI Endoscopy." Springer, New York. Sensable Technologies (2004).  http://www.sensable.com/products/3ddesign/index.asp.  Shaver, M . J. http://www.cs.ubc.ca/~mshaver/ToolProject/ToolProject.html. Sheskin, D . J. (2000). "Handbook of parametric and nonparameteric statistical procedures." Chapman & Hall / C R C . Siegel, M . (2002). "Tactile display development: the driving-force for tactile sensor  development". IEEE International Applications  Workshop on Haptic Virtual Environments and Their  Smirnov, N . V . (1939), "Estimate of deviation between empirical distribution functions in two independent samples. (Russian)", B u l l Moscow Univ, 2, pp.  124  Soper, N . J. (2004). Surgical Education, Talk at the Centre of Excellence for Surgical Education and Innovation. Vancouver, B C , Canada. Sozer, Y . and Torrey, D . A . (1998). "Adaptive torque ripple control of permanent magnet brushless D C motors". Proceedings  of the Thirteenth Annual Applied Power  Electronics  Conference and Exposition Srinivasan, M . A . and Basdogan, C . (1997), "Haptics in virtual environments: Taxonomy, research status, and challenges", Computers & Graphics, 21 (4), pp. 393-404. Srinivasan, M . A . , Beauregard, G . L . and Brock, D . (1996). The impact of Visual Information on the Haptic Perception of Stiffness in Virtual Environments. Proc. of the 5th A n n . Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Atlanta, G A , I M E C E . Studer, C , Keyhani, A . , Sebastian, T . and Murthy, S. K . (1997). "Study of cogging torque in permanent magnet machines". IEEE Industry Applications  Conference, 1997. Thirty-Second  IAS  Annual Meeting, IAS '97., Stylopoulos, N . , Cotin, S., Maithel, S. K . , Ottensmeye, M . , Jackson, P. G . , Bardsley, R. S., Neumann, P. F . , Rattner, D . W . and Dawson, S. L . (2004), "Computer-enhanced laparoscopic training system ( C E L T S ) : bridging the gap", Surg Endosc, 18 (5), pp. 782-9. Sutherland, I. (1963). "Sketchpad: A man-machine graphical communication system". IFIPS Proceedings  of the Spring Joint Computer Conference, Detroit, Michigan.  Tan, H . Z . , Srinivasan, M . A . , Eberman, B . and Cheng, B . (1994). "Human Factors for the Design of Force-Reflecting Haptic Interfaces", the 3rd Ann. Symp. on Haptic Interfaces for  Virtual Environment and Teleoperator Systems, ASME/IMECE,  Chicago, IL.  Taylor, R. H . , Funda, J . , Eldridge, B . , Gomory, S., Gruben, K . , Larose, D . , Talamini, M . , Kavoussi, L . and Anderson, J. (1995), "A telerobotic assistant for laparoscopic surgery", Engineering in Medicine and Biology Magazine, I E E E , 14 (3), pp. 279-288. Tendick, F . , Downes, M . , Goktekin, T . , Cavusoglu, M . C , Feygin, D . , W u , X . L . , Eyal, R., Hegarty, M . and Way, L . W . (2000), "A virtual environment testbed for training laparoscopic surgical skills", Presence-Teleoperators and Virtual Environments, 9 (3), pp. 236-255. Traverso, L . W . , K o o , K . P., Hargrave, K . , Unger, S. W . , Roush, T . S., Swanstrom, L . L . , Woods, M . S., Donohue, J. H . , Deziel, D . J . , Simon, I. B . , Froines, E . , Hunter, J. and Soper, N . J. (1997), "Standardizing laparoscopic procedure time and determining the effect of patient age/gender and presence or absence of surgical residents during operation. A prospective multicenter trial", Surg Endosc, 11 (3), pp. 226-9. Vassallo, S. P., Bailey, D . W . and Gregorio, P., "Interface Apparatus with Cable-Driven Force Feedback and Four Grounded Actuators", Patent EP1417547, I M M E R S I O N C O R P ,  125  Villegas, L . , Schneider, B . E . , Callery, M . P. and Jones, D . B . (2003), "Laparoscopic skills training", Surgical Endoscopy, 17 (12), pp. 1879 - 1888. Vlachos, K . , Papadopoulos, E . and Mitropoulos, D . N . (2004). "Mass/ inertia and joint friction minimization for a low-force five-dof haptic device". Proceedings  of the IEEE  International  Conference on Robotics and Automation Wagner, C . R., Stylopoulos, N . and Howe, R. D . (2002). "The role of force feedback in surgery: analysis of blunt dissection". 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2002. Waldron, K . J. and Tollon, K . (2003). Mechanical Characterization of the Immersion Corp. Haptic, Bimanual, Surgical Simulator Interface. Springer Tracts in Advanced Robotics. 5: 106112. Wolfe, B . M . , Szabo, Z . , Moran, M . E . , Chan, P. and Hunter, J. G . (1993), "Training for minimally invasive surgery. Need for surgical skills", Surg Endosc, 7 (2), pp. 93-5. Wright, P. K . and Dornfeld, D . A . (1998), "CyberCut: A Networked Manufacturing Services", Transactions of N A M R C / S M E , 16, pp. Zar, J. H . (1996). "Biostatistical analysis", Prentice Hall, Upper Saddle River, New Jersey. Zhang, J., Payandeh, S. and D i l l , J. (2002). "Haptic subdivision: an approach to defining levelof-detail in haptic rendering". Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2002  126  


Citation Scheme:


Citations by CSL (citeproc-js)

Usage Statistics



Customize your widget with the following options, then copy and paste the code below into the HTML of your page to embed this item in your website.
                            <div id="ubcOpenCollectionsWidgetDisplay">
                            <script id="ubcOpenCollectionsWidget"
                            async >
IIIF logo Our image viewer uses the IIIF 2.0 standard. To load this item in other compatible viewers, use this url:


Related Items