<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="Perspectives" dtd-version="1.0" xml:lang="en">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">IJME</journal-id>
      <journal-id journal-id-type="nlm-ta">Int J Med Educ</journal-id>
      <journal-title-group>
        <journal-title>International Journal of Medical Education</journal-title>
        <abbrev-journal-title abbrev-type="pubmed">Int J Med Educ</abbrev-journal-title>
      </journal-title-group>
      <issn pub-type="epub">2042-6372</issn>
      <publisher>
        <publisher-name>IJME</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">12-264266</article-id>
      <article-id pub-id-type="doi">10.5116/ijme.61ba.07c6</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Perspectives</subject>
          <subj-group>
            <subject>Curriculum-based assessment</subject>
          </subj-group>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Critical aspects in developing curriculum-based assessment for emerging surgical procedures</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes">
          <name>
            <surname>Blackham</surname>
            <given-names>Ruth</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Hamdorf</surname>
            <given-names>Jeffrey</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <aff id="aff1"><label>1</label>Medical School, The University of Western Australia</aff>
      </contrib-group>
      <author-notes>
        <corresp id="cor1">Correspondence: Ruth Blackham, Medical School, The University of Western Australia. Email: <email xlink:href="r-jme@scalpelandsword.com">r-jme@scalpelandsword.com</email></corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>23</day>
        <month>12</month>
        <year>2021</year>
      </pub-date>
      <pub-date pub-type="collection">
        <year>2021</year>
      </pub-date>
      <volume>12</volume>
      <fpage>264</fpage>
      <lpage>266</lpage>
      <history>
        <date date-type="accepted">
          <day>15</day>
          <month>12</month>
          <year>2021</year>
        </date>
        <date date-type="received">
          <day>12</day>
          <month>06</month>
          <year>2021</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>Copyright: &#xA9; 2021 Ruth Blackham et al.</copyright-statement>
        <copyright-year>2021</copyright-year>
        <license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0">
          <license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License which permits unrestricted use of work provided the original work is properly cited. <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/3.0/">http://creativecommons.org/licenses/by/3.0/</ext-link></license-p>
        </license>
      </permissions>
      <kwd-group kwd-group-type="author">
        <kwd>Medical education</kwd>
        <kwd>curriculum</kwd>
        <kwd>surgery</kwd>
        <kwd>assessment</kwd>
        <kwd>simulation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec sec-type="intro"><title>Introduction</title>
<p>The past century has seen an enormous rise in new surgical procedures. The general surgery landscape has changed markedly, from predominantly open procedures to laparoscopic and now robotic surgery.&#xA0; Surgical training has been far slower to adjust to change, as evidenced by the haphazard method of introduction of laparoscopic surgery.&#xA0; The introduction of laparoscopy was marked by procedures being performed by surgeons without a structured fellowship training program, in addition to questionable legitimacy of procedures due to the lack of supportive data.<xref ref-type="bibr" rid="r1"><sup>1</sup></xref></p>
<p>New surgical methods and new technologies, such as robotic surgery, have been accompanied by a greater emphasis upon educational efforts prior to surgical "practice".&#xA0; Capabilities such as dual consoles to maximise the teaching potential of the platform in addition to exposure during training lends some recognition to this modern requirement.<xref ref-type="bibr" rid="r2"><sup>2</sup></xref> Whilst adjuncts such as certified proctorship and simulation exposures have arisen, there remains a need for academic rigour via validity testing to ensure robust and defensible curricula are developed.<xref ref-type="bibr" rid="r3"><sup>3</sup></xref> This is especially important when the curriculum articulates into an assessment tool with a rating scale and associated rubric.</p>
<p>To date, the most common methods of assessing a surgeon for accreditation by an institution have relied upon surrogate competency measures. The two most common are Years of experience<xref ref-type="bibr" rid="r4"><sup>4</sup></xref><sup>,</sup><xref ref-type="bibr" rid="r5"><sup>5</sup></xref> and Case volume-based measures. 6-8 Both may be problematic, especially when assessing surgeons who wish to undertake new procedures as time in practice do not necessarily equate to transferability of skillset; likewise, volume-based criteria require some degree of overlap of skill from one surgical procedure to another.&#xA0; The use of simulator-based teaching and assessment shows great promise in its ability to be used for de-identified, reproducible and but the method by which curricular documents and subsequent assessment matrices are developed is not clearly defined.&#xA0; In this paper, we describe a number of critical considerations in creating credentialing guidelines for surgeons in novel or emerging procedures.</p>
<sec><title>Novel procedures and emerging technologies</title>
<p>Refinement of existing surgical procedures is ubiquitous by surgeons and device technology developers alike. However, the past half-century has seen an unprecedented rise in new operations. In general surgery, the development of laparoscopy has led to a legion of new ways to perform existing procedures and a paradigm shift in skillset, almost unrecognisable to that of a traditionally-trained "open" surgeon.&#xA0; In hindsight, the methodology of learning laparoscopic surgery was at best haphazard; at worst, dangerous with a concomitant rise in morbidity and mortality.</p>
<p>Similarly, the introduction of robotic surgery has shown benefits of shortened hospital stays and complication rates, tempered by increased intraoperative times, cost and increased training burden of the new technique.<xref ref-type="bibr" rid="r9"><sup>9</sup></xref></p>
<p>The belated introduction of structured courses such as Fundamentals of Laparoscopic Surgery course<xref ref-type="bibr" rid="r10"><sup>10</sup></xref> followed the more routine use of laparoscopy in gynaecology and general surgery, such that it is now the normative approach worldwide. More recently, the introduction of robotic surgery had been accompanied by a greater awareness of the difficulties in introducing surgeons to new technology requiring novel skills and an increased reliance upon simulation in addition to proctorship for training and credentialing.<xref ref-type="bibr" rid="r11"><sup>11</sup></xref></p>
</sec><sec><title>Curriculum processes &#x2013; modified Delphi methodology</title>
<p>Proceduralists benefit from standardised, validated curriculums for teaching competence focused upon specific skills.<xref ref-type="bibr" rid="r12"><sup>12</sup></xref> There are a number of methods wherein a structured curriculum for teaching a new skill or procedure can be developed.&#xA0; The most ubiquitous is the "expert opinion" method, with variations upon the rigour with which it is created. The older "hot-tubbing" approach involved a group of experts discussing and creating a curriculum within a set time frame.&#xA0; The more formal, validated approach requires a defined expert-level opinion formed via an iterative forecasting method via multiple rounds seeking consensus, also known as the Delphi method.&#xA0; For example, utilisation of the Delphi process to develop a proficiency-based progression course in training for robotic surgery.<xref ref-type="bibr" rid="r13"><sup>13</sup></xref> Benefits of the Delphi approach include the validation of a formal consensus opinion as well as the statistical significance of reaching consensus via Cronbach's alpha. However, in addition to defining the curriculum, a further demonstration of the use of a skills curriculum over existing teaching paradigms is required.<xref ref-type="bibr" rid="r14"><sup>14</sup></xref> A second limitation is the lack of a readily accessible group of experts when the technology is only newly developed or a novel surgical procedure wherein the number of experts may not be enough to utilise Delphi methodology<xref ref-type="bibr" rid="r15"><sup>15</sup></xref>; thus, the option of informal expert consensus is likely to continue in future with caveats in place.</p>
</sec><sec><title>Content validity</title>
<p>The creation of a formal, structured curriculum for a novel surgical procedure must be adjusted to suit the local environment.&#xA0; The curriculum must be structured to suit local nuances of device availability, preference of technique, and patient demographic. Validating the content of a curriculum towards a particular region is often conducted via Delphi methodology similar to above, with the expert group derived entirely from the defined area.<xref ref-type="bibr" rid="r16"><sup>16</sup></xref><sup>,</sup><xref ref-type="bibr" rid="r17"><sup>17</sup></xref> In doing so, the teaching method and assessment are more relevant for the country or region with greater applicability when extended into the credentialing environment.&#xA0; However, with greater specificity, there is a loss of generalisability; the potential for bias dependent upon ethnicity and place of qualification must be recognised by the assessor.<xref ref-type="bibr" rid="r18"><sup>18</sup></xref> Such deficiencies in procedure would need to be noted by the credentialing body.</p>
</sec><sec><title>Construct validity</title>
<p>One of the most powerful aspects of a validated curriculum is the ability to discern a novice from an expert surgeon. The definitions of these are highly debatable and is most notably determined by surrogate competency markers such as case-volume load or time-based (years in practice).&#xA0; There is a move towards standardised, reproducible content assessment, which often requires the use of a simulator.&#xA0; Via direct observation or retrospective video review of a surgical operation upon a simulator, a trained assessor can rate them upon predefined metrics, utilising construct validity to determine whether the assessment score relates to the allocated group of experts or surgeons.&#xA0; The preferred approach of a simulator removes the requirement for statistical adjustment for patient comorbidities such as body habitus, previous surgery or adhesions.&#xA0; However, its transferability to "real-life surgery" is an extra consideration that often needs to be validated prior to use as a high-stakes assessment methodology. Defining criteria for credentialing to determine "expert status" utilising consensus methodology has been applied in robotic<xref ref-type="bibr" rid="r19"><sup>19</sup></xref> and laparoscopic surgery.&#xA0; Development of learning curve phases from "competent" to "proficient", then "mastery" of procedures<xref ref-type="bibr" rid="r20"><sup>20</sup></xref> allows for a more nuanced comparison of the level of expertise.</p>
</sec></sec>
    <sec sec-type="conclusions"><title>Conclusions</title>
<p>The determination of a curriculum-based assessment for novel surgical procedures is an exemplary modality of reproducible, quality assessment.&#xA0; The rise of high-stakes assessment requires greater rigour in the development of the underlying curriculum with which surgeons are being trained to ensure competency upon the simulator as well as ensuring patient safety. Our paper describes the key educational and clinical concerns regarding the development of construct and content validity as well as components of transferability for assessment.&#xA0; Future assessment of surgeons in novel surgical procedures will likely require credentialing bodies to be cognizant of similar considerations of defensible curricular and assessment development.</p>
<sec><title>Conflict of Interest</title>
<p>The authors declare that they have no conflict of interest.</p>
</sec></sec>
  </body>
  <back>
    <ref-list><title>References</title>
<ref id="r1"><label>1</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rock</surname><given-names>JA</given-names></name><name><surname>Warshaw</surname><given-names>JR</given-names></name></person-group><article-title>The history and future of operative laparoscopy.</article-title><source>American Journal of Obstetrics and Gynecology</source><year>1994</year><volume>170</volume><fpage>7</fpage><lpage>11</lpage><pub-id pub-id-type="doi">10.1016/s0002-9378(13)70270-9</pub-id></element-citation></ref><ref id="r2"><label>2</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname><given-names>B</given-names></name><name><surname>Lam</surname><given-names>J</given-names></name><name><surname>Hollandsworth</surname><given-names>HM</given-names></name><name><surname>Lee</surname><given-names>AM</given-names></name><name><surname>Lopez</surname><given-names>NE</given-names></name><name><surname>Abbadessa</surname><given-names>B</given-names></name><name><surname>Eisenstein</surname><given-names>S</given-names></name><name><surname>Cosman</surname><given-names>BC</given-names></name><name><surname>Ramamoorthy</surname><given-names>SL</given-names></name><name><surname>Parry</surname><given-names>LA</given-names></name></person-group><article-title>General surgery training in the era of robotic surgery: a qualitative analysis of perceptions from resident and attending surgeons.</article-title><source>Surg Endosc</source><year>2020</year><volume>34</volume><fpage>1712</fpage><lpage>1721</lpage><pub-id pub-id-type="doi">10.1007/s00464-019-06954-0</pub-id><pub-id pub-id-type="pmid">31286248</pub-id></element-citation></ref><ref id="r3"><label>3</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eppich</surname><given-names>W</given-names></name><name><surname>Howard</surname><given-names>V</given-names></name><name><surname>Vozenilek</surname><given-names>J</given-names></name><name><surname>Curran</surname><given-names>I</given-names></name></person-group><article-title>Simulation-based team training in healthcare.</article-title><source>Simul Healthc</source><year>2011</year><fpage>14</fpage><lpage>19</lpage><pub-id pub-id-type="doi">10.1097/SIH.0b013e318229f550</pub-id><pub-id pub-id-type="pmid">21817858</pub-id></element-citation></ref><ref id="r4"><label>4</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Novais</surname><given-names>EN</given-names></name><name><surname>Carry</surname><given-names>PM</given-names></name><name><surname>Kestel</surname><given-names>LA</given-names></name><name><surname>Ketterman</surname><given-names>B</given-names></name><name><surname>Brusalis</surname><given-names>CM</given-names></name><name><surname>Sankar</surname><given-names>WN</given-names></name></person-group><article-title>Does Surgeon Experience Impact the Risk of Complications After Bernese Periacetabular Osteotomy?</article-title><source>Clin Orthop Relat Res</source><year>2017</year><volume>475</volume><fpage>1110</fpage><lpage>1117</lpage><pub-id pub-id-type="doi">10.1007/s11999-016-5010-1</pub-id><pub-id pub-id-type="pmid">27495809</pub-id></element-citation></ref><ref id="r5"><label>5</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Abdullah</surname><given-names>F</given-names></name><name><surname>Salazar</surname><given-names>JH</given-names></name><name><surname>Gause</surname><given-names>CD</given-names></name><name><surname>Gadepalli</surname><given-names>S</given-names></name><name><surname>Biester</surname><given-names>TW</given-names></name><name><surname>Azarow</surname><given-names>KS</given-names></name><name><surname>Brandt</surname><given-names>ML</given-names></name><name><surname>Chung</surname><given-names>DH</given-names></name><name><surname>Lund</surname><given-names>DP</given-names></name><name><surname>Rescorla</surname><given-names>FJ</given-names></name><name><surname>Waldhausen</surname><given-names>JH</given-names></name><name><surname>Tracy</surname><given-names>TF</given-names></name><name><surname>Fallat</surname><given-names>ME</given-names></name><name><surname>Klein</surname><given-names>MD</given-names></name><name><surname>Lewis</surname><given-names>FR</given-names></name><name><surname>Hirschl</surname><given-names>RB</given-names></name></person-group><article-title>Understanding the Operative Experience of the Practicing Pediatric Surgeon: Implications for Training and Maintaining Competency.</article-title><source>JAMA Surg</source><year>2016</year><volume>151</volume><fpage>735</fpage><lpage>741</lpage><pub-id pub-id-type="doi">10.1001/jamasurg.2016.0261</pub-id><pub-id pub-id-type="pmid">27027471</pub-id></element-citation></ref><ref id="r6"><label>6</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aspinall</surname><given-names>S</given-names></name><name><surname>Oweis</surname><given-names>D</given-names></name><name><surname>Chadwick</surname><given-names>D</given-names></name></person-group><article-title>Effect of surgeons' annual operative volume on the risk of permanent Hypoparathyroidism, recurrent laryngeal nerve palsy and Haematoma&amp;#x00A0;following thyroidectomy: analysis of United Kingdom registry of endocrine and thyroid surgery (UKRETS).</article-title><source>Langenbecks Arch Surg</source><year>2019</year><volume>404</volume><fpage>421</fpage><lpage>430</lpage><pub-id pub-id-type="doi">10.1007/s00423-019-01798-7</pub-id><pub-id pub-id-type="pmid">31254103</pub-id></element-citation></ref><ref id="r7"><label>7</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pace</surname><given-names>D</given-names></name><name><surname>Borgaonkar</surname><given-names>M</given-names></name><name><surname>Evans</surname><given-names>B</given-names></name><name><surname>Marcoux</surname><given-names>C</given-names></name><name><surname>Lougheed</surname><given-names>M</given-names></name><name><surname>Falk</surname><given-names>V</given-names></name><name><surname>Hickey</surname><given-names>N</given-names></name><name><surname>O'Leary</surname><given-names>M</given-names></name><name><surname>McGrath</surname><given-names>J</given-names></name><name><surname>Boone</surname><given-names>D</given-names></name></person-group><article-title>Annual colonoscopy volume and maintenance of competency for surgeons.</article-title><source>Surg Endosc</source><year>2017</year><volume>31</volume><fpage>2630</fpage><lpage>2635</lpage><pub-id pub-id-type="doi">10.1007/s00464-016-5275-1</pub-id><pub-id pub-id-type="pmid">27752813</pub-id></element-citation></ref><ref id="r8"><label>8</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Doll</surname><given-names>KM</given-names></name><name><surname>Milad</surname><given-names>MP</given-names></name><name><surname>Gossett</surname><given-names>DR</given-names></name></person-group><article-title>Surgeon volume and outcomes in benign hysterectomy.</article-title><source>J Minim Invasive Gynecol</source><year>2013</year><volume>20</volume><fpage>554</fpage><lpage>561</lpage><pub-id pub-id-type="doi">10.1016/j.jmig.2013.03.005</pub-id><pub-id pub-id-type="pmid">23622760</pub-id></element-citation></ref><ref id="r9"><label>9</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hussain</surname><given-names>A</given-names></name><name><surname>Malik</surname><given-names>A</given-names></name><name><surname>Halim</surname><given-names>MU</given-names></name><name><surname>Ali</surname><given-names>AM</given-names></name></person-group><article-title>The use of robotics in surgery: a review.</article-title><source>Int J Clin Pract</source><year>2014</year><volume>68</volume><fpage>1376</fpage><lpage>1382</lpage><pub-id pub-id-type="doi">10.1111/ijcp.12492</pub-id><pub-id pub-id-type="pmid">25283250</pub-id></element-citation></ref><ref id="r10"><label>10</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ritter</surname><given-names>EM</given-names></name><name><surname>Scott</surname><given-names>DJ</given-names></name></person-group><article-title>Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery.</article-title><source>Surg Innov</source><year>2007</year><volume>14</volume><fpage>107</fpage><lpage>112</lpage><pub-id pub-id-type="doi">10.1177/1553350607302329</pub-id><pub-id pub-id-type="pmid">17558016</pub-id></element-citation></ref><ref id="r11"><label>11</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zorn</surname><given-names>KC</given-names></name><name><surname>Gautam</surname><given-names>G</given-names></name><name><surname>Shalhav</surname><given-names>AL</given-names></name><name><surname>Clayman</surname><given-names>RV</given-names></name><name><surname>Ahlering</surname><given-names>TE</given-names></name><name><surname>Albala</surname><given-names>DM</given-names></name><name><surname>Lee</surname><given-names>DI</given-names></name><name><surname>Sundaram</surname><given-names>CP</given-names></name><name><surname>Matin</surname><given-names>SF</given-names></name><name><surname>Castle</surname><given-names>EP</given-names></name><name><surname>Winfield</surname><given-names>HN</given-names></name><name><surname>Gettman</surname><given-names>MT</given-names></name><name><surname>Lee</surname><given-names>BR</given-names></name><name><surname>Thomas</surname><given-names>R</given-names></name><name><surname>Patel</surname><given-names>VR</given-names></name><name><surname>Leveillee</surname><given-names>RJ</given-names></name><name><surname>Wong</surname><given-names>C</given-names></name><name><surname>Badlani</surname><given-names>GH</given-names></name><name><surname>Rha</surname><given-names>KH</given-names></name><name><surname>Eggener</surname><given-names>SE</given-names></name><name><surname>Wiklund</surname><given-names>P</given-names></name><name><surname>Mottrie</surname><given-names>A</given-names></name><name><surname>Atug</surname><given-names>F</given-names></name><name><surname>Kural</surname><given-names>AR</given-names></name><name><surname>Joseph</surname><given-names>JV</given-names></name></person-group><article-title>Training, credentialing, proctoring and medicolegal risks of robotic urological surgery: recommendations of the society of urologic robotic surgeons.</article-title><source>J Urol</source><year>2009</year><volume>182</volume><fpage>1126</fpage><lpage>1132</lpage><pub-id pub-id-type="doi">10.1016/j.juro.2009.05.042</pub-id><pub-id pub-id-type="pmid">19625032</pub-id></element-citation></ref><ref id="r12"><label>12</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grantcharov</surname><given-names>TP</given-names></name><name><surname>Reznick</surname><given-names>RK</given-names></name></person-group><article-title>Teaching procedural skills.</article-title><source>BMJ</source><year>2008</year><volume>336</volume><fpage>1129</fpage><lpage>1131</lpage><pub-id pub-id-type="doi">10.1136/bmj.39517.686956.47</pub-id><pub-id pub-id-type="pmid">18483056</pub-id></element-citation></ref><ref id="r13"><label>13</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Collins</surname><given-names>JW</given-names></name><name><surname>Levy</surname><given-names>J</given-names></name><name><surname>Stefanidis</surname><given-names>D</given-names></name><name><surname>Gallagher</surname><given-names>A</given-names></name><name><surname>Coleman</surname><given-names>M</given-names></name><name><surname>Cecil</surname><given-names>T</given-names></name><name><surname>Ericsson</surname><given-names>A</given-names></name><name><surname>Mottrie</surname><given-names>A</given-names></name><name><surname>Wiklund</surname><given-names>P</given-names></name><name><surname>Ahmed</surname><given-names>K</given-names></name><name><surname>Pratschke</surname><given-names>J</given-names></name><name><surname>Casali</surname><given-names>G</given-names></name><name><surname>Ghazi</surname><given-names>A</given-names></name><name><surname>Gomez</surname><given-names>M</given-names></name><name><surname>Hung</surname><given-names>A</given-names></name><name><surname>Arnold</surname><given-names>A</given-names></name><name><surname>Dunning</surname><given-names>J</given-names></name><name><surname>Martino</surname><given-names>M</given-names></name><name><surname>Vaz</surname><given-names>C</given-names></name><name><surname>Friedman</surname><given-names>E</given-names></name><name><surname>Baste</surname><given-names>JM</given-names></name><name><surname>Bergamaschi</surname><given-names>R</given-names></name><name><surname>Feins</surname><given-names>R</given-names></name><name><surname>Earle</surname><given-names>D</given-names></name><name><surname>Pusic</surname><given-names>M</given-names></name><name><surname>Montgomery</surname><given-names>O</given-names></name><name><surname>Pugh</surname><given-names>C</given-names></name><name><surname>Satava</surname><given-names>RM</given-names></name></person-group><article-title>Utilising the Delphi Process to Develop a Proficiency-based Progression Train-the-trainer Course for Robotic Surgery Training.</article-title><source>Eur Urol</source><year>2019</year><volume>75</volume><fpage>775</fpage><lpage>785</lpage><pub-id pub-id-type="doi">10.1016/j.eururo.2018.12.044</pub-id><pub-id pub-id-type="pmid">30665812</pub-id></element-citation></ref><ref id="r14"><label>14</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Satava</surname><given-names>RM</given-names></name><name><surname>Stefanidis</surname><given-names>D</given-names></name><name><surname>Levy</surname><given-names>JS</given-names></name><name><surname>Smith</surname><given-names>R</given-names></name><name><surname>Martin</surname><given-names>JR</given-names></name><name><surname>Monfared</surname><given-names>S</given-names></name><name><surname>Timsina</surname><given-names>LR</given-names></name><name><surname>Darzi</surname><given-names>AW</given-names></name><name><surname>Moglia</surname><given-names>A</given-names></name><name><surname>Brand</surname><given-names>TC</given-names></name><name><surname>Dorin</surname><given-names>RP</given-names></name><name><surname>Dumon</surname><given-names>KR</given-names></name><name><surname>Francone</surname><given-names>TD</given-names></name><name><surname>Georgiou</surname><given-names>E</given-names></name><name><surname>Goh</surname><given-names>AC</given-names></name><name><surname>Marcet</surname><given-names>JE</given-names></name><name><surname>Martino</surname><given-names>MA</given-names></name><name><surname>Sudan</surname><given-names>R</given-names></name><name><surname>Vale</surname><given-names>J</given-names></name><name><surname>Gallagher</surname><given-names>AG</given-names></name></person-group><article-title>Proving the Effectiveness of the Fundamentals of Robotic Surgery (FRS) Skills Curriculum: A Single-blinded, Multispecialty, Multi-institutional Randomized Control Trial.</article-title><source>Ann Surg</source><year>2020</year><volume>272</volume><fpage>384</fpage><lpage>392</lpage><pub-id pub-id-type="doi">10.1097/SLA.0000000000003220</pub-id><pub-id pub-id-type="pmid">32675553</pub-id></element-citation></ref><ref id="r15"><label>15</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gordon</surname><given-names>AG</given-names></name><name><surname>Magos</surname><given-names>AL</given-names></name></person-group><article-title>The development of laparoscopic surgery.</article-title><source>Baillieres Clin Obstet Gynaecol</source><year>1989</year><volume>3</volume><fpage>429</fpage><lpage>449</lpage><pub-id pub-id-type="doi">10.1016/s0950-3552(89)80003-3</pub-id><pub-id pub-id-type="pmid">2533004</pub-id></element-citation></ref><ref id="r16"><label>16</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>von Buchwald</surname><given-names>JH</given-names></name><name><surname>Frend&#xF8;</surname><given-names>M</given-names></name><name><surname>Guldager</surname><given-names>MJ</given-names></name><name><surname>Melchiors</surname><given-names>J</given-names></name><name><surname>Andersen</surname><given-names>SAW</given-names></name></person-group><article-title>Content validity evidence for a simulation-based test of handheld otoscopy skills.</article-title><source>Eur Arch Otorhinolaryngol</source><year>2021</year><volume>278</volume><fpage>2313</fpage><lpage>2320</lpage><pub-id pub-id-type="doi">10.1007/s00405-020-06336-6</pub-id><pub-id pub-id-type="pmid">32909062</pub-id></element-citation></ref><ref id="r17"><label>17</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Angelo</surname><given-names>RL</given-names></name><name><surname>Ryu</surname><given-names>RK</given-names></name><name><surname>Pedowitz</surname><given-names>RA</given-names></name><name><surname>Gallagher</surname><given-names>AG</given-names></name></person-group><article-title>Metric Development for an Arthroscopic Bankart Procedure: Assessment of Face and Content Validity.</article-title><source>Arthroscopy</source><year>2015</year><volume>31</volume><fpage>1430</fpage><lpage>1440</lpage><pub-id pub-id-type="doi">10.1016/j.arthro.2015.04.093</pub-id><pub-id pub-id-type="pmid">26239785</pub-id></element-citation></ref><ref id="r18"><label>18</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tiffin</surname><given-names>PA</given-names></name><name><surname>Paton</surname><given-names>LW</given-names></name></person-group><article-title>Differential attainment in the MRCPsych according to ethnicity and place of qualification between 2013 and 2018: a UK cohort study.</article-title><source>Postgrad Med J</source><year>2021</year><volume>97</volume><fpage>764</fpage><lpage>776</lpage><pub-id pub-id-type="doi">10.1136/postgradmedj-2020-137913</pub-id><pub-id pub-id-type="pmid">32883769</pub-id></element-citation></ref><ref id="r19"><label>19</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stefanidis</surname><given-names>D</given-names></name><name><surname>Huffman</surname><given-names>EM</given-names></name><name><surname>Collins</surname><given-names>JW</given-names></name><name><surname>Martino</surname><given-names>MA</given-names></name><name><surname>Satava</surname><given-names>RM</given-names></name><name><surname>Levy</surname><given-names>JS</given-names></name></person-group><article-title>Expert Consensus Recommendations for Robotic Surgery Credentialing.</article-title><source>Ann Surg</source><year>2020</year><pub-id pub-id-type="doi">10.1097/SLA.0000000000004531</pub-id><pub-id pub-id-type="pmid">33214434</pub-id></element-citation></ref><ref id="r20"><label>20</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wehrtmann</surname><given-names>FS</given-names></name><name><surname>de la Garza</surname><given-names>JR</given-names></name><name><surname>Kowalewski</surname><given-names>KF</given-names></name><name><surname>Schmidt</surname><given-names>MW</given-names></name><name><surname>M&#xFC;ller</surname><given-names>K</given-names></name><name><surname>Tapking</surname><given-names>C</given-names></name><name><surname>Probst</surname><given-names>P</given-names></name><name><surname>Diener</surname><given-names>MK</given-names></name><name><surname>Fischer</surname><given-names>L</given-names></name><name><surname>M&#xFC;ller-Stich</surname><given-names>BP</given-names></name><name><surname>Nickel</surname><given-names>F</given-names></name></person-group><article-title>Learning Curves of Laparoscopic Roux-en-Y Gastric Bypass and Sleeve Gastrectomy in Bariatric Surgery: a Systematic Review and Introduction of a Standardization.</article-title><source>Obes Surg</source><year>2020</year><volume>30</volume><fpage>640</fpage><lpage>656</lpage><pub-id pub-id-type="doi">10.1007/s11695-019-04230-7</pub-id><pub-id pub-id-type="pmid">31664653</pub-id></element-citation></ref></ref-list>
  </back>
</article>
