No CrossRef data available.
Article contents
An epistemology for assessment and development: how do we know what we know?
Published online by Cambridge University Press: 18 March 2024
Abstract
To make informed decisions, assessment theorists, researchers, and practitioners can evaluate the overlap among (1) relevant theories, (2) empirical contributions, and (3) best practices. Unfortunately, such a task may seem daunting due to the so-called science-practice gap, which can thwart collaboration among these parties. This paper presents an epistemology for delineating the importance of integrating these three sources of knowledge. We then apply this epistemology to show that our current knowledge of assessment and development topics are well integrated in some places, but still quite lacking in others.
- Type
- Focal Article
- Information
- Copyright
- © The Author(s), 2024. Published by Cambridge University Press on behalf of Society for Industrial and Organizational Psychology
References
American Psychological Association. APA Dictionary of Psychology (2nd edn.) 2015. Retrieved July 19, 2022, from https://dictionary.apa.org/research.Google Scholar
American Psychological Association. APA Style Journal Article Reporting Standards. 2020. Retrieved July 19, 2022, from https://apastyle.apa.org/jars.Google Scholar
Arthur, W. Jr., Bennett, W. Jr., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88(2), 234–245. Doi: 10.1037/0021-9010.88.2.234.CrossRefGoogle ScholarPubMed
Arthur, W. Jr., Bennett, W. Jr., Stanush, P. L., & McNelly, T. L. (1998). Factors that influence skill decay and retention: A quantitative review and analysis. Human Performance, 11(1), 57–101. Doi: 10.1207/s15327043hup1101_3.CrossRefGoogle Scholar
Arthur, W. Jr., Doverspike, D., Munoz, G. J., Taylor, J. E., & Carr, A. E. (2014). The use of mobile devices in high-stakes remotely delivered assessments and testing. International Journal of Selection and Assessment, 22, 113–123.CrossRefGoogle Scholar
Association for Talent Development [ATD] (2020). State of the industry: Talent development benchmarks and trends. ATD Research.Google Scholar
Audi, R. (2011). Epistemology: A contemporary introduction to the theory of knowledge (3rd edn.) Routledge.Google Scholar
Bacharach, S. B. (1989). Organizational theories: Some criteria for evaluation. The Academy of Management Review, 14(4), 496. Doi: 10.2307/258555.CrossRefGoogle Scholar
Baldwin, T. T., Ford, J. K., & Blume, B. D. (2017). The state of transfer of training research: Moving toward more consumer-centric inquiry. Human Resource Development Quarterly, 28(1), 17–28. Doi: 10.1002/hrdq.21278.CrossRefGoogle Scholar
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall.Google Scholar
Banks, C. G., & Murphy, K. R. (1985). Toward narrowing the research-practice gap in performance appraisal. Personnel Psychology, 38(2), 335–345. Doi: 10.1111/j.1744-6570.1985.tb00551.x.CrossRefGoogle Scholar
Barends, E., & Rousseau, D. M. (2018). Evidence-based management: How to use evidence to make better organizational decisions. Kogan Page.Google Scholar
Barends, E., Rousseau, D. M., & Briner, R. B. (2014). Evidence-based management: The basic principles. The Center for Evidence-Based Management.Google Scholar
Bell, B. S., & Kozlowski, S. W. J. (2008). Active learning: Effects of core training design elements on self-regulatory processes, learning, and adaptability. Journal of Applied Psychology, 93(2), 296–316. Doi: 10.1037/0021-9010.93.2.296.CrossRefGoogle ScholarPubMed
Bell, B. S., Tannenbaum, S. I., Ford, J. K., Noe, R. A., & Kraiger, K. (2017). 100 years of training and development research: What we know and where we should go. Journal of Applied Psychology, 102(3), 305–323. Doi: 10.1037/apl0000142.CrossRefGoogle ScholarPubMed
Benjamin, L. T. Jr., & Baker, D. B. (2000). Boulder at 50: Introduction to the section. American Psychologist, 55(2), 233–254.CrossRefGoogle ScholarPubMed
Berger, P. L., & Luckmann, T. (1966). The social construction of reality: A treatise in the sociology of knowledge. Anchor Books.Google Scholar
Berry, W. D., & Sanders, M. S. (2018). Understanding multivariate research: A primer for beginning social scientists. Routledge.CrossRefGoogle Scholar
Birri, R., & Melcher, A. (2011). Building a talent for talent. In Povah, N., & Thornton, G. C. III (Eds.), Assessment centres and global talent management (pp. 175–192). Gower.Google Scholar
Bisbey, T. M., Grossman, R., Panton, K., Coultas, C., & Salas, E. (2021). Design, delivery, evaluation, and transfer of effective training systems. In Salvendy, G., & Karwowski, W. (Eds.), Handbook of human factors and ergonomics (pp. 414–433). John Wiley & Sons.CrossRefGoogle Scholar
Blume, B. D., Ford, J. K., Surface, E. A., & Olenick, J. (2019). A dynamic model of training transfer. Human Resource Management Review, 29(2), 270–283. Doi: 10.1016/j.hrmr.2017.11.004.CrossRefGoogle Scholar
Bray, D. W., & Grant, D. L. (1966). The assessment center in the measurement of potential for business management. Psychological Monographs: General and Applied, 80(17), 1–27. Doi: 10.1037/h0093895.CrossRefGoogle ScholarPubMed
Burke, L. A., & Hutchins, H. M. (2007). Training transfer: An integrative literature review. Human Resource Development Review, 6(3), 263–296. Doi: 10.1177/1534484307303035.CrossRefGoogle Scholar
Byham, W. C. (1970). Assessment centers for spotting future managers. Harvard Business Review, 48, 150–164.Google Scholar
Campion, M. C., Campion, M. A., Campion, E. D., & Reider, M. H. (2016). Initial investigation into computer scoring of candidate essays for personnel selection. Journal of Applied Psychology, 101(7), 958–975. Doi: 10.1037/apl0000108.CrossRefGoogle ScholarPubMed
Cascio, W. F. (2019). Training trends: Macro, micro, and policy issues. Human Resource Management Review, 29(2), 284–297. Doi: 10.1016/j.hrmr.2017.11.001.CrossRefGoogle Scholar
Cerasoli, C. P., Alliger, G. M., Donsbach, J. S., Mathieu, J. E., Tannenbaum, S. I., & Orvis, K. A. (2018). Antecedents and outcomes of informal learning behaviors: A meta-analysis. Journal of Business and Psychology, 33, 203–230. Doi: 10.1007/s10869-017-9492-y.CrossRefGoogle Scholar
Chen, K., Niu, M., & Chen, Q. (2022). A hierarchical reasoning graph neural network for the automatic scoring of answer transcriptions in video job interviews. International Journal of Machine Learning and Cybernetics, 13, 2507–2517. Doi: 10.1007/s13042-022-01540-8.CrossRefGoogle Scholar
Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings, vol. 351. Houghton Mifflin.Google Scholar
Cucina, J. M., Hayes, T. L., Walmsley, P. T., & Martin, N. R. (2014). It is time to get medieval on the overproduction of pseudotheory: How Bacon, 1267 and Alhazen, 1021 can save Industrial-Organizational Psychology. Industrial and Organizational Psychology: Perspectives on Science and Practice, 7(3), 356–364. Doi: 10.1111/iops.12163.CrossRefGoogle Scholar
Dastin, J. (2018). Amazon scraps secret AI recruiting tool that showed bias against women. Reuters, Retrieved from, https://www.reuters.com/article/us-amazon-comjobs-automation-insight/amazon-scraps-secret-ai-recruiting-tool-that-showedbias-against-women-idUSKCN1MK08G
Google Scholar
Dweck, C. S. (1986). Motivational processes affecting learning. American Psychologist, 41(10), 1040–1048. Doi: 10.1037/0003-066X.41.10.1040.CrossRefGoogle Scholar
Eurich, T. L., Krause, D. E., Cigularov, K., & Thornton, G. C. (2009). Assessment centers: Current practices in the United States. Journal of Business and Psychology, 24, 387. Doi: 10.1007/s10869-009-9123-3.CrossRefGoogle Scholar
Folger, R., & Stein, C. (2017). Abduction 101: Reasoning processes to aid discovery. Human Resource Management Review, 27(2), 306–315. Doi: 10.1016/j.hrmr.2016.08.007.CrossRefGoogle Scholar
Ford, J. K. (2021). Learning in organizations: An evidence-based approach. Taylor & Francis.Google Scholar
Funder, D. C. (2012). Accurate personality judgment. Current Directions in Psychological Science, 21(3), 177–182. Doi: 10.1177/0963721412445309.CrossRefGoogle Scholar
Gaugler, B. B., & Thornton, G. C. III (1989). Number of assessment center dimensions as a determinant of assessor accuracy. Journal of Applied Psychology, 74(4), 611–618. Doi: 10.1037/0021-9010.74.4.611.CrossRefGoogle Scholar
Grand, J. A., Rogelberg, S. G., Allen, T. D., Landis, R. S., Reynolds, D. H., Scott, J. C., Tonidandel, S., & Truxillo, D. M. (2018). A systems-based approach to fostering robust science in Industrial-Organizational Psychology. Industrial and Organizational Psychology, 11(1), 4–42. Doi: 10.1017/iop.2017.55.CrossRefGoogle Scholar
Groves, R. M. (2011). Three eras of survey research. Public Opinion Quarterly, 75(5), 861–871. Doi: 10.1093/poq/nfr057.CrossRefGoogle Scholar
Guidry, B., Rupp, D., & Lanik, M. (2013). Tracing cognition with assessment center simulations: Using technology to see in the dark. In Fetzer, M., & Tuzinsk, K. (Eds.), Simulations for Personnel Selection (pp. 231–258). Springer.CrossRefGoogle Scholar
Hambrick, D. C. (2007). The field of management’s devotion to theory: Too much of a good thing? Academy of Management Journal, 50(6), 1346–1352. Doi: 10.5465/amj.2007.28166119.CrossRefGoogle Scholar
Herde, C. N., & Lievens, F. (2020). Multiple speed assessments: Theory, practice, and research evidence. European Journal of Psychological Assessment, 36(2), 237–249. Doi: 10.1027/1015-5759/a000512.CrossRefGoogle Scholar
Hickman, L., Tay, L., & Woo, S. E. (2019). Validity evidence for off-the-shelf language-based personality assessment using video interviews: Convergent and discriminant relationships with self and observer ratings. Personnel Assessment and Decisions, 5(3), 12–20. Doi: 10.25035/pad.2019.03.003.CrossRefGoogle Scholar
Huffcutt, A. I. (2004). Research perspectives on meta-analysis. In Rogelberg, S. G. (Eds.), Handbook of research methods in industrial and organizational psychology (pp. 198–215). Blackwell Publishing.CrossRefGoogle Scholar
Hughes, A. M., Zajac, S., Spencer, J. M., & Salas, E. (2018). A checklist for facilitating training transfer in organizations. International Journal of Training and Development, 22(4), 334–345. Doi: 10.1111/ijtd.12141.CrossRefGoogle Scholar
Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings. Sage.CrossRefGoogle Scholar
Hutchins, H. M., Burke, L. A., & Berthelsen, A. M. (2010). A missing link in the transfer problem? Examining how trainers learn about training transfer. Human Resource Management, 49(4), 599–618. Doi: 10.1002/hrm.20371.CrossRefGoogle Scholar
Illingworth, A. J., Morelli, N. A., Scott, J. C., & Boyd, S. L. (2015). Internet-based, unproctored assessments on mobile and non-mobile devices: Usage, measurement equivalence, and outcomes. Journal of Business Psychology, 30, 325–343. Doi: 10.1007/s10869-014-9363-8.CrossRefGoogle Scholar
International Task Force on Assessment Center Guidelines [ITFACG] (2015). Guidelines and ethical considerations for assessment center operations. Journal of Management, 41(4), 1244–1273. Doi: 10.1177/0149206314567780.Google Scholar
Jackson, S. E., & Schuler, R. S. (1995). Understanding human resource management in the context of organizations and their environments. Annual Review of Psychology, 46(1), 237–264. Doi: 10.1146/annurev.ps.46.020195.001321.CrossRefGoogle ScholarPubMed
Johns, G. (1993). Constraints on the adoption of psychology-based personnel practices: Lessons from organizational innovation. Personnel Psychology, 46(3), 569–592. Doi: 10.1111/j.1744-6570.1993.tb00885.x.CrossRefGoogle Scholar
Kanfer, R., & Ackerman, P. L. (1989). Motivation and cognitive abilities: An integrative/ aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology, 74(4), 657–690. Doi: 10.1037/0021-9010.74.4.657.CrossRefGoogle Scholar
Keith, N., & Frese, M. (2008). Effectiveness of error management training: A meta-analysis. Journal of Applied Psychology, 93(1), 59–69. Doi: 10.1037/0021-9010.93.1.59.CrossRefGoogle ScholarPubMed
Klein, K. J., & Kozlowski, S. W. J. Eds (2000). Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions. Jossey-Bass.Google Scholar
Kleinmann, M., & Ingold, P. V. (2019). Toward a better understanding of assessment centers: A conceptual review. Annual Review of Organizational Psychology and Organizational Behavior, 6, 349–372. Doi: 10.1146/annurev-orgpsych-012218-014955.CrossRefGoogle Scholar
Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training. evaluation Journal of Applied Psychology, 78(2), 311–328. Doi: 10.1037/0021-9010.78.2.311.CrossRefGoogle Scholar
Lachman, R., Lachman, J. L., & Butterfield, E. C. (1979). Cognitive psychology and information processing: An introduction (1st edn.) Psychology Press.Google Scholar
Lanik, M. (2011). Breaking the tradition: AC 2.0. Presentation at the 31st
. Assessment Center Study Group Conference, Somerset West, South Africa.Google Scholar
Lazzara, E. H., Benishek, L. E., Hughes, A. M., Zajac, S., Spencer, J. M., Heyne, K. B., Rogers, J. E., & Salas, E. (2021). Enhancing the organization’s workforce: Guidance for effective training sustainment. Consulting Psychology Journal: Practice and Research, 73(1), 1–26. Doi: 10.1037/cpb0000185.CrossRefGoogle Scholar
LeBreton, J. M., Scherer, K. T., & James, L. R. (2014). Corrections for criterion reliability in validity generalization: A false prophet in a land of suspended judgment: Corrections for criterion. Industrial and Organizational Psychology, 7(4), 478–500. Doi: 10.1111/iops.12184.Google Scholar
Lievens, F., Chasteen, C. S., Day, E. A., & Christiansen, N. D. (2006). Large-scale investigation of the role of trait activation theory for understanding assessment center convergent and discriminant validity. Journal of Applied Psychology, 91(2), 247–258. Doi: 10.1037/0021-9010.91.2.247.CrossRefGoogle ScholarPubMed
Lievens, F., & Thornton, G. C. (2005). Assessment Centers: Recent Developments in Practice and Research. In Evers, A., Anderson, N., & Voskuijl, O. (Eds.), The Blackwell handbook of personnel selection (pp. 243–264).Google Scholar
Locke, E. A. (2007). The case for inductive theory building. Journal of Management, 33(6), 867–890. Doi: 10.1177/0149206307307636.CrossRefGoogle Scholar
Locke, E. A., & Latham, G. P. (1990). A theory of goal setting and task performance. Prentice Hall.Google Scholar
Longnecker, C. O. (2004). Maximizing transfer of learning from management education programs: Best practices for retention and application. Development and Learning in Organizations, 18(4), 4–6. Doi: 10.1108/14777280410544538.Google Scholar
Lowman, R. L., & Cooper, S. E. (2018). The ethical practice of consulting psychology. American Psychological Association.CrossRefGoogle Scholar
Lukacik, E. R., Bourdage, J. S., & Roulin, N. (2022). Into the void: A conceptual model and research agenda for the design and use of asynchronous video interviews. Human Resource Management Review, 32(1), 100789. Doi: 10.1016/j.hrmr.2020.100789.CrossRefGoogle Scholar
MacKinnon, D. W. (1977). From selecting spies to selecting managers—the OSS assessment program. In Moses, J. J., & Byham, W. C. (Eds.), Applying the assessment center method (pp. 13–30). Pergamon Press.CrossRefGoogle Scholar
Martocchio, J. J. (2020). Strategic compensation: A human resource management perspective (10th edn.) Pearson.Google Scholar
Mathieu, J. E., Tannenbaum, S. I., & Salas, E. (1992). Influences of individual and situational characteristics on measures of training effectiveness. Academy of Management Journal, 35(4), 828–847. Doi: 10.5465/256317.CrossRefGoogle Scholar
McAbee, S. T., Landis, R. S., & Burke, M. I. (2017). Inductive reasoning: The importance of big data. Human Resource Management Review, 27(2), 277–290. Doi: 10.1016/j.hrmr.2016.08.005.CrossRefGoogle Scholar
McLelland, C. V. (2006). The nature of science and the scientific method. The Geological Society of America.Google Scholar
Morelli, N. A., Mahan, A., & Illingworth, J. (2014). Establishing the measurement equivalence of online selection assessments delivered on mobile versus nonmobile devices. International Journal of Selection and Assessment, 22(2), 124–138. Doi: 10.1111/ijsa.12063.CrossRefGoogle Scholar
Murphy, K. R., Cleveland, J. N., & Hanscom, M. E. (2019). Performance appraisal and management. Sage.CrossRefGoogle Scholar
Nealon, J. T., & Giroux, S. S. (2012). The theory toolbox: Critical concepts for the humanities, arts, and social sciences (2nd edn.) Rowman & Littlefield Publishers.Google Scholar
Noe, R. A., Clarke, A. D. M., & Klein, H. J. (2014). Learning in the twenty-first-century workplace. Annual Review of Organizational Psychology and Organizational Behavior, 1, 245–275. Doi: 10.1146/annurev-orgpsych-031413-091321.CrossRefGoogle Scholar
Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78(4), 679–703. Doi: 10.1037/0021-9010.78.4.679.CrossRefGoogle Scholar
Pam, M. S. (2020). Dustbowl empiricism. Psychology Dictionary, Accessed April 3, 2020.Google Scholar
Parrigon, S., Woo, S. E., Tay, L., & Wang, T. (2017). CAPTION-ing the situation: A lexically-derived taxonomy of psychological situation characteristics. Journal of Personality and Social Psychology, 112(4), 642–681. Doi: 10.1037/pspp0000111.CrossRefGoogle ScholarPubMed
PayScale. 2016 workforce-skills preparedness report. 2016. Retrieved July 26, 2021, from https://www.payscale.com/data-packages/job-skills.Google Scholar
Platt, J. R. (1964). Strong inference. Science, 146(3642), 347–353. Doi: 10.1126/science.146.3642.347.CrossRefGoogle ScholarPubMed
Ployhart, R. E., & Bartunek, J. M. (2019). Editors’ comments: There is nothing so theoretical as good practice – A call for phenomenal theory. Academy of Management Review, 44, 493–497. Doi: 10.5465/amr.2019.0087.CrossRefGoogle Scholar
Povah, N. (2011). A review of recent international surveys into assessment centre practices. In Povah, N., & Thornton, G. C. III (Eds.), Assessment centres and global talent management (pp. 329–350).Google Scholar
Reynolds, D. H., & Rupp, D. E. (2010). Advances in technology-facilitated assessment. In Scott, J. C., & Reynolds, D. H. (Eds.), Handbook of workplace assessment: Evidence-based practices for selecting and developing organizational talent (pp. 609–641). Jossey-Bass.Google Scholar
Rouiller, J. Z., & Goldstein, I. L. (1993). The relationship between organizational transfer climate and positive transfer of training. Human Resource Development Quarterly, 4(4), 377–390. Doi: 10.1002/hrdq.3920040408.CrossRefGoogle Scholar
Rousseau, D. M., & Gunia, B. C. (2016). Evidence-based practice: The psychology of EBP implementation. Annual Review of Psychology, 67(1), 667–692. Doi: 10.1146/annurev-psych-122414-033336.CrossRefGoogle ScholarPubMed
Rupp, D. E., & Beal, D. (2007). Checking in with the scientist-practitioner model: How are we doing? The Industrial-Organizational Psychologist, 45(1), 35–40. Doi: 10.1037/e579082011-003.Google Scholar
Rupp, D. E., Gibbons, A. M., & Snyder, L. A. (2008). The role of technology in enabling third-generation training and development. Industrial and Organizational Psychology, 1(4), 496–500. Doi: 10.1111/j.1754-9434.2008.00095.x.CrossRefGoogle Scholar
Rupp, D. E., Gibbons, A. M., Snyder, L. A., Spain, S. M., Woo, S. E., Brummel, B. J., Sims, C. S., & Kim, M. (2006). An initial validation of developmental assessment centers as accurate assessments and effective training interventions. The Psychologist-Manager Journal, 9(2), 171–200. Doi: 10.1207/s15503461tpmj0902_7.CrossRefGoogle Scholar
Rupp, D. E., Shapiro, D. L., Folger, R., Skarlicki, D. P., & Shao, R. (2017). A critical analysis of the conceptualization and measurement of organizational justice: Is it time for reassessment? Academy of Management Annals, 11(2), 919–959. Doi: 10.5465/annals.2014.0051.CrossRefGoogle Scholar
Rynes, S. L., & Bartunek, J. M. (2017). Evidence-based management: Foundations, development, controversies and future. Annual Review of Organizational Psychology and Organizational Behavior, 4, 235–261. Doi: 10.1146/annurev-orgpsych-032516-113306.CrossRefGoogle Scholar
Rynes, S. L., Bartunek, J. M., & Daft, R. L. (2001). Across the great divide: Knowledge creation and transfer between practitioners and academics. Academy of Management Journal, 44(2), 340–355. Doi: 10.5465/3069460.CrossRefGoogle Scholar
Rynes-Weller, S. L. (2012). The research-practice gap in I/O Psychology and related fields: Challenges and potential solutions. In Kozlowksi, S. W. J. (Eds.), The Oxford Handbook of Organizational Psychology. Oxford Academic.Google Scholar
Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040–2068. Doi:10.1037/apl0000994.CrossRefGoogle ScholarPubMed
Salas, E., Tannenbaum, S. I., Kraiger, K., & Smith-Jentsch, K. A. (2012). The science of training and development in organizations: What matters in practice. Psychological Science in the Public Interest, 13(2), 74–101. Doi:10.1177/1529100612436661.CrossRefGoogle ScholarPubMed
Schlebusch, S., & Roodt, G. (Eds. 2019). Assessment centres: Unlocking potential for growth. 2nd Edition, Knowres.Google Scholar
Schleicher, D. J., Day, D. V., Mayes, B. T., & Riggio, R. E. (2002). A new frame for frame-of-reference training: Enhancing the construct validity of assessment centers. Journal of Applied Psychology, 87(4), 735–746. Doi: 10.1037/0021-9010.87.4.735.CrossRefGoogle ScholarPubMed
Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262–274. Doi: 10.1037/0033-2909.124.2.262.CrossRefGoogle Scholar
Schollaert, E., & Lievens, F. (2011). The use of role player prompts in assessment center exercises. International Journal of Selection and Assessment, 19(2), 190–197. Doi: 10.1111/j.1468-2389.2011.00546.x.CrossRefGoogle Scholar
Schollaert, E., & Lievens, F. (2012). Building situational stimuli in assessment center exercises: Do specific exercise instructions and role-player prompts increase observability of behavior? Human Performance, 25(3), 255–271. Doi: 10.1080/08959285.2012.683907.CrossRefGoogle Scholar
Serrat, O. (2017). Identifying and sharing good practices. In Serrat, O. (Eds.), Knowledge solutions: Tools, methods, and approaches to drive organizational performance (pp. 843–846). Springer.CrossRefGoogle Scholar
Shieber, J. N. (2019). Theories of knowledge: How to think about what we know. The Great Courses.Google Scholar
Snijders, T. A., & Bosker, R. J. (2011). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Sage.Google Scholar
Suddaby, R. (2014). Editor’s comments: Why theory? Academy of Management Review, 39(4), 407–411. Doi: 10.5465/amr.2014.0252.CrossRefGoogle Scholar
Sutton, R. I., & Staw, B. M. (1995). What theory is not. Administrative Science Quarterly, 40(3), 371–384. Doi: 10.2307/2393788.CrossRefGoogle Scholar
Tannenbaum, S. I., Cannon-Bowers, J. A., & Mathieu, J. E. (1993). Factors that influence training effectiveness: A conceptual model and longitudinal analysis (Report 93-011). Naval Training Systems Center.Google Scholar
Thornton, G. C., & Rupp, D. E. (2006). Assessment centers in human resource management: Strategies for prediction, diagnosis, and development. Lawrence Erlbaum Associates.CrossRefGoogle Scholar
Thornton, G. C. III, Rupp, D. E., & Hoffman, B. J. (2015). Assessment center perspectives for talent management strategies (2nd edn.) Routledge/Taylor & Francis Group.Google Scholar
Thornton, G. C. I. I. I., & Lievens, F. (2019). Theoretical principles relevant to assessment center design and implementation. In Schlebusch, S., & Roodt, G. (Eds.), Assessment centres: Unlocking potential for growth (2nd edn.) Knowres.Google Scholar
Tkachenko, O., Hahn, H.-J., & Peterson, S. L. (2017). Research-practice gap in applied fields: An integrative literature review. Human Resource Development Review, 16(3), 235–262. Doi: 10.1177/1534484317707562.CrossRefGoogle Scholar
Tonidandel, S., King, E., & Cortina, J. (2016). Big data methods: Leveraging modern data analytic techniques to build organizational science. Organizational Research Methods, 21(3), 525–547. Doi: 10.1177/1094428116677299.CrossRefGoogle Scholar
Van Iddekinge, C. H., Roth, P. L., Raymark, P. H., & Odle-Dusseau, H. N. (2012). The criterion-related validity of integrity tests: An updated meta-analysis. Journal of Applied Psychology, 97(3), 499–530. Doi: 10.1037/a0021196.CrossRefGoogle ScholarPubMed
Velada, R., Caetano, A., Michel, J. W., Lyons, B. D., & Kavanagh, M. J. (2007). The effects of training design, individual characteristics and work environment on transfer of training. International Journal of Training and Development, 11(4), 282–294. Doi: 10.1111/j.1468-2419.2007.00286.x.CrossRefGoogle Scholar
Woo, S. E., O’Boyle, E. H., & Spector, P. E. (2017). Best practices in developing, conducting, and evaluating inductive research. Human Resource Management, Review, 27(2), 255–264. Doi: 10.1016/j.hrmr.2016.08.004.CrossRefGoogle Scholar
Woo, S. E., Tay, L., & Proctor, R. W. Eds (2020). Big data in psychological research. American Psychological Association.CrossRefGoogle Scholar
Zhou, L., Song, Y., Alterman, V., Liu, Y., & Wang, M. (2019). Introduction to data collection in multilevel research. In Humphrey, S. E., & LeBreton, J. M. (Eds.), The handbook of multilevel theory, measurement, and analysis (pp. 225–252). American Psychological Association.CrossRefGoogle Scholar