ORIGINAL RESEARCH 1409 DOWNLOADS

Exploring medical residents’ perceived need for negotiation skills training

Lisa N. Isbouts1, Arno M.M. Muijtjens2, Walther N.K.A. van Mook3 and Jamiu O. Busari4

1Department of Pediatrics, Radboud University Medical Centre, Nijmegen, the Netherlands

2Department of Educational Development and Research, Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, the Netherlands

3Academy for Postgraduate Medical Education and Department of Intensive Care Medicine, Maastricht University Medical Center, Maastricht, the Netherlands

4Department of Pediatrics, Zuyderland Medical Centre, Heerlen, the Netherlands

Submitted: 02/09/2018; Accepted: 19/02/2019; Published: 28/02/2019

Int J Med Educ. 2019; 10:45-53; doi: 10.5116/ijme.5c6c.3430

© 2019 Lisa N. Isbouts et al. This is an Open Access article distributed under the terms of the Creative Commons Attribution License which permits unrestricted use of work provided the original work is properly cited. http://creativecommons.org/licenses/by/3.0

Objectives: This study explores the optimal focus for negotiation skills development training by investigating how often medical residents negotiate in practice, and how they perceive the effectiveness of their negotiation capabilities.

Methods: An exploratory study was performed using a questionnaire regarding the medical residents’ working environment, negotiation frequency, knowledge and skills using a 5-point Likert scale, multiple choice questions and open questions. Exploratory factor analysis with principal component analysis, varimax rotation, reliability analysis, and content analysis were used to reduce the number of variables. Descriptive and interferential statistics and multiple regression analysis were used to analyze the data.

Results: We analyzed the responses of 60 medical residents. The findings showed that the perceived development of their negotiation knowledge (M=3.06, SD=0.83) was less than their negotiation skills (M=3.69, SD=0.47). Their attitude during negotiations, especially females, differed substantially in the interactions with nurses than with their supervisors. Medical residents with more working experience, better negotiation skills or who worked in hierarchical environments negotiated more frequently with their supervisors. Medical residents with better collaboration skills and negotiation knowledge demonstrated better negotiation skills.

Conclusions: This study underlines medical residents’ need for negotiation training. In addition to the basic negotiation knowledge and skills, training programs in negotiation should focus on the medical residents’ awareness of their attitudes during negotiations, combining the assertiveness shown in interactions with supervisors with the empathy and emotional engagement present in interactions with nurses.  Furthermore, attention should be paid to the influence of the environmental hierarchy on negotiation skill development. 

In contemporary clinical practice, medical residents and specialists are constantly exposed to changes in health care systems. The complexity associated with these changes places great demands on their management and leadership capabilities.1-7 Unfortunately, most competency-based training programs give little attention to the development of management and leadership skills.1,2,4,8,9 Previous needs assessments in the Netherlands regarding management and leadership development have shown at least half (50%) of the medical residents expressed a need for negotiation training.1,2 These findings have been confirmed by international studies in Canada, Denmark, and Australia.3 Teaching medical residents management and leadership skills such as negotiation gives them the ability to cope with ongoing changes in their work.8,10,11 Despite the need for training in this area, ideal negotiation training programs for medical residents do not yet exist. Moreover, the current literature neither describes how often medical residents negotiate in practice, nor how they perceive the effectiveness of their negotiation capabilities. We believe that information about these issues is needed to design appropriate negotiation training programs. Therefore, it is crucial for program developers to understand the dynamics involved in the process of negotiation amongst medical residents, for example by exploring medical residents’ frequency of negotiation in practice, their perception of their negotiation knowledge and negotiation skills, and their attitude when negotiating with nurses and supervisors. Negotiation knowledge (NK), refers to the extent to which a medical resident is knowledgeable of the various techniques, approaches, and styles of negotiation. Negotiation skills (NS) refer to a resident’s capacity to efficiently carry out a negotiation.

The frequency of medical residents’ negotiations, as well as their NK and NS are expected to vary in relation to the function of the negotiation partner (nurse or supervisor), characteristics of the medical residents themselves, and the medical residents’ working environment. For example, factors that are likely to affect negotiation frequency (NF) are NK and NS.

Medical residents with good NK and NS are likely to negotiate more often than those who lack these capabilities. Collaboration skills (CS), or the ability to build positive working relationships, can also positively influence the cooperation between negotiation partners and their willingness to negotiate.12 Older medical residents or medical residents with more working experience (WE) would probably have advantages during negotiations because of their seniority and knowledge about the processes in a hospital. Furthermore, in a working environment with a strong hierarchical character, medical residents are likely to engage less frequently in negotiations.13 In such environments, male medical residents are likely to initiate negotiations more frequently and assertively than their female counterparts.14

NK also can be positively influenced by NS. Medical residents with proficient CS might easily be able to use NK in different types of situations. Older or more experienced medical residents, for example, are likely to have learned more practice-based NK through practical negotiation experience, which can benefit them during negotiations. Compared to their male counterparts, female medical residents are likely to have different negotiation styles and are more likely to underestimate their knowledge.14 Working in an environment with a strong hierarchical character, therefore, could negatively influence NK by providing fewer opportunities to negotiate as well as suppressing the willingness to engage in negotiations.

There are also factors that can optimize NS. For example, adequate NK can positively influence skills such as self-expression and confidence and also stimulate the initiation of the interaction (assertiveness). Good collaborative skills can positively affect NS, as those medical residents with good CS are likely to be better at identifying common goals and brokering agreements than those without it.

Negotiators’ attitudes within a discourse are crucial in determining the outcome of any negotiation. A negotiator could choose to be, among other attitudes, open, empathic, tactful, assertive, emotionally engaged, pragmatic, firm, appeasable, timid, or dominant. Attitude can be influenced by the negotiator’s gender and/or position in a hierarchy. Negotiators of higher status can also have more power in a negotiation.14

Since our objective was to design an appropriate training program for negotiation skills development, an exploratory study investigating how often medical residents negotiate in practice, and how they perceive the effectiveness of their negotiation capabilities was designed to address the following research questions:

·       First, how is the frequency of negotiation (NF) with nurses and supervisors related to the medical resident’s NK, NS, CS, WE, age, and gender, and the hierarchical character of the working environment?

·       Second, how is a medical resident’s NK related to NS, CS, WE, age, gender, and hierarchy?

·       Third, how is a medical resident’s NS related to NK, CS, WE, age, gender, and hierarchy?

·       Fourth, how do medical residents perceive their attitude during negotiations (NA)?

Study participants

This study was conducted between September 2015 and January 2016 in the Zuyderland Medical Centre (MC), a 589-bed, large peripheral teaching MC in the Netherlands affiliated with the Maastricht University MC. All medical residents (n=186) enrolled in the institution were eligible for inclusion except those who had a prior negotiation training experience. All medical residents were invited by email to participate in the web-based questionnaire using the online web tool Survey Monkey. The email explained the purpose of the study and we sought and obtained informed consent from the participants through the questionnaire. Participation in the survey was only possible if consent was given.  We emphasized that data gathered during participation would be analyzed anonymously and anyone could opt out of the study at any time for any reason without any consequences. We sought and obtained approval for the study from the Ethical Review Board of the Zuyderland MC.

Instrument

A 54-item, a web-based questionnaire was designed. The content was validated and improved by two educational experts, superfluous questions eliminated and clarifying remarks added. Two independent medical residents reviewed the questionnaire deleting redundant questions and critically appraising the contents of each question for relevance and comprehension. Following this exercise, the final questionnaire that we used for the survey consisted of 21 items: two open-ended questions, six multiple-choice questions (MCQs) and 13 statements using a five-point Likert scale (see Appendix 1).

The questionnaire items were mapped into three sections. The first section explored the demographic characteristics of the medical resident: age, gender, years of experience as a medical resident, previously received negotiation training (MCQs), department of the medical resident (open question), frequency of negotiations and hierarchy (Likert scale).

The second section assessed the medical resident’s NS (Likert scale) and attitude during negotiations (MCQs). Question regarding NA included the influence of the hierarchical status of negotiation partners (supervisors or nurses) and gender of the medical resident on the medical resident’s attitude to negotiations. To further explore medical residents’ attitude, the respondents were asked to indicate the subset of characteristics that best described their behaviors when negotiating, namely open, tactful, assertive, pragmatic, firm, appeasable, timid, dominant, emphatic, and emotionally engaged.  The third section of the questionnaire focused on the respondents’ self-perceived knowledge of negotiation (Likert scale). The section ended with the contact details of the medical resident (email address, an open question).

Table 1. Participants demographics (N=57)

Scale construction

As a large number of variables were included in our questionnaire, an exploratory factor analysis (EFA) to identify any underlying relationships between the different questions was performed, a technique which helps to identify subsets of related items often referred to as scales of the questionnaire. Our goal was to identify, if present, any latent constructs underlying these scales or clusters of measured variables. As we did not have a separate a priori hypothesis of the patterns of the variables we measured, performing an EFA would help determine which variables we eventually could use in our analysis.  Clusters of items related to the same content were sought for using principal component analysis, varimax rotation, reliability analysis, and content analysis. Separate EFAs were executed for the sets of items regarding skills (Table 1, 4.1-4.9), and NF (Table 1, 2.1-2.6). To test the reliability and remove items that did not contribute to the result, a reliability analysis was performed for each scale. A Cronbach’s alpha of >0.60 was considered to indicate a sufficient level of reliability.

Table 2. Factor loadings and resulting scales of the Explorative Factor Analysis for the negotiation skills items

Data analysis

Descriptive and interferential statistics

Descriptive and interferential statistics were applied to describe the age, gender, working experience of the participants as well as the level of hierarchy in the departments.

Exploratory factor analysis

EFA regarding NS: A 3-factor solution was initially found based on the criterion eigenvalue >1.0. Items 4.7-4.9 were removed because of communalities <0.5. The EFA was repeated, and a satisfactory 2-factor solution was found based on eigenvalue >1.0, the scree-plot, and the content of the items. Table 2 shows the factor loadings of the items on the two scales, which are marked as “collaboration skills” and “negotiation skills”. Table 3 shows the Cronbach’s Alpha and the value for the corresponding variable defined as the mean of the scores of the scale’s items.

EFA regarding NF: The initial EFA resulted in a 2-factor solution. Item 2.1 was removed because of low communality, and the final EFA resulted in a 2-factor solution based on eigenvalue >1.0, the scree-plot, and the content of the items in relation to the hierarchical position of the negotiation partner. Table 4 shows the factor loadings of the items on the two scales, which are marked as “negotiation frequency with supervisors” and “negotiation frequency with nurses”. Table 3 shows the Cronbach’s Alpha and the value for the corresponding variable defined as the mean of the scores of the scale’s items.

Table 3. Descriptive statistics for collaboration and negotiation skills

Multiple regression analysis

To answer the first research question i.e. ‘How is the frequency of negotiation (NF) with nurses and supervisors related to the medical resident’s NK, NS, CS, WE, age, and gender, and the hierarchical character of the working environment?’, two multiple regression analysis (MR analysis) were performed, one for negotiation frequency with supervisors and one for negotiations with nurses. Independent variables were NK, CS, NS, age, gender, and hierarchy.

To answer the second i.e. ‘How is a medical resident’s NK related to NS, CS, WE, age, gender, and hierarchy?’ and third research questions, i.e., ‘How is a medical resident’s NS related to NK, CS, WE, age, gender, and hierarchy?’ two MR analysis were performed with the set of independent variables indicated above.

Table 4. Factor loadings and resulting scales of the Explorative Factor Analysis for the negotiation frequency items

The MR analysis was performed using a backward procedure, stepwise excluding independent variables that did not contribute sufficiently to the explained variance of the dependent variable. A p-value of <0.05 was considered to indicate a significant effect. The standardized regression coefficient (beta) resulting from the MR analysis was used as an indicator of effect size classified according to Cohen’s values (0.1, 0.3 and 0.5, respectively corresponding to a small, moderate and large effect).15 The self-perceived attitude of medical residents during negotiations (variable NA, research question 4) was analyzed by calculating the percentage of medical residents who indicated a characteristic to be representative of their attitude. These percentages were calculated separately for negotiations with nurses, and supervisors, and male and female medical residents. The Statistical Package for Social Sciences (SPSS) for Windows was used for scale construction and data analysis.

Table 5. Results of the multiple regression analysis

Demographics

Out of 186 medical residents about one third responded (60 medical residents). Three medical residents (5%) were excluded because of prior training in negotiation. Most respondents were between 24-33 years old and female (65%, (37/57)).16 The majority of the medical residents had around 2.5 years of WE (Table 1). In most of the training programs in the hospital (80%, 12/15), male supervisors among clinical supervisors (teaching staff) predominated (79%) while in three programs (gynecology, pediatrics, and emergency medicine) a female predominance of the teaching staff was observed (75%). In terms of departmental hierarchy, the presence of a strong hierarchical working environment was rated with a mean of 2.58 (SD=1.07) on a 5-point Likert scale, indicating that the working environment was, on average, mildly hierarchical.

Negotiation frequency

For the statements pertaining to negotiation frequency with supervisors and nurses (Table 1), the mean scores were 2.13 (SD=0.90) and 3.42 (SD=1.04) respectively, indicating that medical residents negotiate more often with nurses than with supervisors.

Multiple regression analysis for negotiation frequency with supervisors showed that medical residents with more WE, in a more hierarchical working environment, or with better NS, negotiated with supervisors more frequently (b=0.21, 0.27, and 0.62 respectively), with standard regression coefficients (beta) ranging from 0.31 to 0.33 indicating moderate effect sizes (Table 5).

None of the independent variables in the multiple regression analysis for negotiation frequency with nurses showed a significant effect. Therefore, the results of this analysis were not included in Table 5.

Negotiation knowledge and skills

Medical residents perceived their NK as moderate (Table 1, M=3.06, SD=0.83). They have a more positive perception regarding their CS (M=3.96, SD=0.56) and NS (M=3.69, SD=0.47). Multiple regression analysis of negotiation knowledge showed that medical residents with better NS were found to score significantly higher on the scale of NK (b=1.10) (Table 5). Multiple regression analysis of negotiation skills resulted in medical residents with better NK or better CS, scoring significantly higher on the scale of NS (Table 5, respectively b=0.34 and 0.23). A more hierarchical working environment had an almost-significant negative impact on NS with a small effect size (beta) of -0.21 (b= -0.09) and a p-value of 0.05.

Negotiation attitude

Male and female medical residents reported very different attitudes during negotiations with nurses compared to negotiation with supervisors.

Nurses versus supervisors

Medical residents identified their attitudes toward nurses mostly as open, empathic, and tactful. Moreover, a relatively large proportion (39% (22/57)) identified themselves as emotionally engaged in these negotiations. Towards supervisors, medical residents identified themselves as assertive, open, and tactful. However, only a quarter (26%, 15/57) of the medical residents identified themselves as empathic when negotiating with supervisors, compared to more than half (67%, 38/57) when negotiating with nurses. Furthermore, only a few (18%, 10/57) medical residents identified themselves as emotionally engaged in negotiations with supervisors, less than half compared to negotiations with nurses. When negotiating with supervisors, medical residents indicated that they were more assertive and appeasable, but also more timid.

Gender

Regarding NA, large differences were observed between male and female medical residents. Female medical residents considered themselves more open, empathetic, assertive, emotionally engaged, and firm toward nurses than male medical residents did. However, both male and female medical residents reported themselves to be more timid, less emotionally engaged, and less empathic towards their supervisors. Female medical residents showed a significant decrease compared to males in having an empathic attitude, from nearly half (47%, 27/57) towards nurses to very few (14%, 8/57) towards supervisors. Males reported themselves to be twice as assertive toward supervisors than nurses, whereas females were about equally assertive towards both. Females rated themselves as more timid and appeasable towards supervisors, while males were more appeasable to nurses.

The objectives of the current exploratory study were to analyze the medical residents’ perception of when they negotiate and their level of proficiency in effective negotiation relating to knowledge, skills, and attitude. Our results indicate that very few (5%, 3/60) of all medical residents had ever attended negotiation training, which is in line with the need for negotiation training in the existing literature.1,2, 17-19 In the following sections, we discuss the main findings and implications regarding the medical residents’ NF, NK, NS, and NA during negotiations.

With respect to when medical residents negotiate (negotiation frequency), it became apparent that medical residents interacted more with nurses than with their supervisors. Nurses expect female medical residents to be more sympathetic and communicative as described by Linden et al.20 This could explain why medical residents interact more often with nurses than with supervisors to build trust and a good relationship.20-22 Even though medical residents interacted more frequently with nurses, negotiation frequency did not vary with WE, hierarchy, NS, NK or CS. This may be because nurses and medical residents do not have a choice whether or not to have these negotiations.

The frequency of medical residents’ interaction with supervisors was subject to their NS. Medical residents with better skills negotiated more often with supervisors, probably because of their higher level of confidence, which could also explain why more experienced medical residents negotiated more often. This is consistent with the findings of Olmos-Vega and colleagues who described how medical residents use negotiation as an adaptation strategy to their day-to-day changing supervisors and how they as their skills increase form their own working repertoire.23 This observation advocates for the incorporation of negotiation training in the first years of residency to improve medical residents’ NS, which we anticipate would have a positive influence on the frequency of negotiations, interaction with supervisors23 and empower medical residents in their future careers. Surprisingly, a hierarchical working environment was found to stimulate medical residents to negotiate more often with their supervisors. This is in contrast to the findings of Olde Bekkink and colleagues who described hierarchy as a continuous barrier in interprofessional communication.13 However, we believe that hierarchical environments increase medical residents’ awareness of the strength of their negotiation position, which in turn enables them to speak up for themselves and draw attention to their abilities as future specialists.

The majority of the medical residents had moderate knowledge of the principles of negotiation, i.e. (negotiation knowledge). We found that perceived levels of NK and NS were strongly correlated (beta=0.60), indicating that training medical residents in NK and in separate NS will each positively influence the other.

Besides the positive influence of NK, negotiation skills are also enhanced by collaborative skills. Medical residents with good collaborative skills are better at identifying common goals and remaining calm because they have a better understanding of their negotiation partner. Interestingly, it seems that a predominant hierarchical structure in the medical residents working environment had a small negative effect on the medical residents’ perception of their NS. Possibly medical residents feel more dependent on their negotiation partner in a hierarchical working environment that leads them to hold back during negotiations and therefore appreciate their NS less. Another possible explanation is that medical residents negotiate more in a hierarchical working environment but under the social pressures of the hierarchy the quality of their interactions as well as the quality of their NS-decreases, which is in line with the findings of Olde Bekkink et al.13

Despite the fact that more experienced medical residents negotiate more often, they did not score significantly higher on NS. This could be because they know their own limitations and place higher demands on themselves during negotiations, therefore scoring themselves lower on the survey.

The results also show differences in attitudes toward the position of the negotiation partner and more gender-specific attitudes, i.e. (negotiation attitude).

First, there are important differences in medical residents’ attitudes towards nurses and supervisors. Medical residents are more emphatic and emotionally engaged toward nurses and more assertive, timid, and appeasable toward their supervisors. This is consistent with the result that a hierarchic working environment stimulates NF but impairs the quality of medical residents’ NS.  Second, male and female medical residents have different attitudes during negotiations. This is consistent with the findings of Linden et al who describe that female medical residents prefer a more communicative and collaborative style.20 During interactions with supervisors, medical residents - especially female medical residents - were alarmingly less empathetic and emotionally engaged than in their interactions with nurses. With more than half (65%, 37/57) female medical residents, it is possible that this difference is linked to the majority male supervisors in the hospital, which would be consistent with the findings of Linden et al.20 The male to female supervisors ratio will undoubtedly change further as female medical residents finish their training and become supervisors themselves. This could potentially alter the perceived departmental hierarchy,24 NA, and level of NS.

Limitations

This study has several limitations. There was no existing theoretical framework or previous studies on which we could rely on making our questionnaire. The perspective on negotiation training was only investigated on the basis of the perception of the medical residents. Hence, objective data were not available. Due to the different nature of their jobs, the content of the questions regarding nurses and supervisors differed. Questions regarding supervisors were mainly about time management and preferred training, while questions regarding nurses were about direct patient care. Thus, negotiations with nurses and supervisors might necessitate different kinds of negotiation skills. This has to be taken into account when considering the difference in answers between these two groups of questions.

Concerning the reliability of the scales, in general values of Cronbach’s Alpha between 0.70-0.95 are accepted.25 We accepted a Cronbach’s Alpha of >0.60 because our sample size was relatively small for an EFA and because we were unable to test the validity of our questionnaire due to the lack of previous research regarding this subject. Despite these limitations, we considered reliability and internal consistency to be important aspects of validity.

Finally, the limited response rate may have introduced potential selection bias, with medical residents less interested in management and leadership development or feeling more time-pressured not responding to the questionnaire. Nevertheless, the male-to-female ratio was representative for the Netherlands.

This study shows that only 5% of medical residents ever attended negotiation training. The medical residents perceived their Negotiation Knowledge (NK) and Negotiation Skills (NS) to be moderate. In addition to the need for basic knowledge and skills regarding negotiation, a need for training programs focusing on the dynamics between gender, hierarchies, and attitude during negotiations was voiced. Our findings suggest that NK and NS have positive reciprocal and synergistic effects on each other, and the presence of NS in medical residents enhances their NF.

Two important steps in medical education are needed to improve medical residents’ negotiation capabilities. Firstly, teaching them to be aware of their attitudes during negotiation. Secondly, combining the assertiveness shown in interactions with supervisors with the empathy and emotional engagement present in interactions with nurses. Improving knowledge, skills, and attitude regarding negotiation will potentially help healthcare professionals tackle changes in the health care system more efficient. Future studies should focus on the development of a suitable training method to address the perceived needs.

Conflict of Interest

The authors declare that they have no conflict of interest.

  1. Berkenbosch L, Brouns JW, Heyligers I and Busari JO. How Dutch medical residents perceive their competency as manager in the revised postgraduate medical curriculum. Postgrad Med J. 2011; 87: 680-687.
    Full Text PubMed
  2. Brouns JWM, Berkenbosch L, Ploemen-Suijker FD, Heyligers I, Busari JO. Medical residents perceptions of the need for management education in the postgradu-ate curriculum: a preliminary study. Int J Med Educ. 2010;1:76-82. doi: 10.5116/ijme.4cd8.43f1
  3. Berkenbosch L, Schoenmaker SG, Ahern S, Søjnæs C, Snell L, Scherpbier AJ and Busari JO. Medical residents' perceptions of their competencies and training needs in health care management: an international comparison. BMC Med Educ. 2013; 13: 25.
    Full Text PubMed
  4. Berkenbosch L, Bax M, Scherpbier A, Heyligers I, Muijtjens AM and Busari JO. How Dutch medical specialists perceive the competencies and training needs of medical residents in healthcare management. Med Teach. 2013; 35: 1090-1102.
    Full Text PubMed
  5. Stockwell DC, Pollack MM, Turenne WM and Slonim AD. Leadership and management training of pediatric intensivists: how do we gain our skills? Pediatr Crit Care Med. 2005; 6: 665-670.
    PubMed
  6. Chan S. Management education during radiology residency: development of an educational practice. Acad Radiol. 2004; 11: 1308-1317.
    Full Text PubMed
  7. Horowitz RE, Naritoku W and Wagar EA. Management training for pathology residents: a regional approach. Arch Pathol Lab Med. 2004; 128: 59-63.
    Full Text
  8. Abbas MR, Quince TA, Wood DF and Benson JA. Attitudes of medical students to medical leadership and management: a systematic review to inform curriculum development. BMC Med Educ. 2011; 11: 93.
    Full Text PubMed
  9. Babitch LA. Teaching practice management skills to pediatric residents. Clin Pediatr (Phila). 2006; 45: 846-849.
    Full Text PubMed
  10. Department of Health. Equity and excellence: liberating the NHS. London; NHS; 2010.
  11. Zaleznik A. Managers and leaders: are they different. Harvard Business Review. 2004. [Cited 23 February 2019]; Available from: https://hbr.org/2004/01/managers-and-leaders-are-they-different.
  12. Lemieux-Charles L. Physicians in health care management: 10. Managing conflict through negotiation. CMAJ. 1994; 151: 1129-1132.
    PubMed
  13. Olde Bekkink M, Farrell SE and Takayesu JK. Interprofessional communication in the emergency department: residents' perceptions and implications for medical education. Int J Med Educ. 2018; 9: 262-270.
    Full Text PubMed
  14. Craver CB. Gender and negotiation performance. Sociological Practice. 2002;4(3):183-93.
  15. Cohen W. Statistical power analysis for the behavioural sciences. Hillsdale, NY, Lawrence Erlbaum Associates; 1988.
  16. Wagenvoort GH, Lagro-Janssen ALM. Feiten en cijfers over (aanstaande) artsen m/v. Nijmegen: Drukkerij UMC St Raboud; 2010.
  17. Busari JO, Yaldiz H and Verstegen D. Serious games as an educational strategy for management and leadership development in postgraduate medical education - an exploratory inquiry. Adv Med Educ Pract. 2018; 9: 571-579.
    Full Text PubMed
  18. Salib S, Valencia V and Moreno A. AAnd now, please sign on the dotted line: teaching residents about professional life after residency. South Med J. 2018; 111: 256-260.
    Full Text PubMed
  19. Turner AD, Stawicki SP and Guo WA. Competitive advantage of MBA for physician executives: a systematic literature review. World J Surg. 2018; 42: 1655-1665.
    Full Text PubMed
  20. Linden JA, Breaud AH, Mathews J, McCabe KK, Schneider JI, Liu JH, Halpern LE, Barron RJ, Clyne B, Smith JL, Kauffman DF, Dempsey MS, Dechert TA and Mitchell PM. The intersection of gender and Resuscitation leadership experience in emergency medicine residents: a qualitative study. AEM Educ Train. 2018; 2: 162-168.
    Full Text PubMed
  21. Eagly AH and Karau SJ. Role congruity theory of prejudice toward female leaders. Psychol Rev. 2002; 109: 573-598.
    PubMed
  22. Galvin SL, Parlier AB, Martino E, Scott KR and Buys E. Gender bias in nurse evaluations of residents in obstetrics and gynecology. Obstet Gynecol. 2015; 7-12.
    Full Text PubMed
  23. Olmos-Vega FM, Dolmans DH, Guzmán-Quintero C, Stalmeijer RE and Teunissen PW. Unravelling residents' and supervisors' workplace interactions: an intersubjectivity study. Med Educ. 2018; 52: 725-735.
    Full Text PubMed
  24. Zenger J, Folkman J. Are women better leaders than men? Harvard Business Review. 2012. [Cited 23 February 2019]; Available from: https://hbr.org/2012/03/a-study-in-leadership-women-do.
  25. Tavakol M and Dennick R. Making sense of Cronbach's alpha. Int J Med Educ. 2011; 2: 53-55.
    Full Text PubMed