{"id":4983,"date":"2020-03-17T18:41:40","date_gmt":"2020-03-17T17:41:40","guid":{"rendered":"https:\/\/www.savilleconsulting.dk\/?page_id=4983"},"modified":"2020-03-17T22:44:22","modified_gmt":"2020-03-17T21:44:22","slug":"paper-3-scales-of-potential","status":"publish","type":"page","link":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/","title":{"rendered":"Paper 3:  Scales of Potential"},"content":{"rendered":"<div id=\"pg-19925-1\" class=\"panel-grid panel-has-style\">\n<div class=\"max-width panel-row-style panel-row-style-for-19925-1\">\n<div id=\"pgc-19925-1-0\" class=\"panel-grid-cell\">\n<div id=\"panel-19925-1-0-0\" class=\"widget_text so-panel widget widget_custom_html panel-first-child panel-last-child\" data-index=\"1\">\n<div class=\"widget_text panel-widget-style panel-widget-style-for-19925-1-0-0\">\n<div class=\"textwidget custom-html-widget\">\n<p>This paper looked at hierarchical models of workplace competencies to establish the most useful level of the model for recruiters to maximize validity, and to provide a practical level of detail to identify distinct behaviors which are important for the role.<\/p>\n<p>We did this by exploring the <a href=\"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/glossary\/\" target=\"_blank\" rel=\"noopener noreferrer\">cross-validation<\/a> of equations to forecast potential across three studies. The studies involved individuals with self-report personality questionnaire scores (from Wave Professional Styles) and independent ratings of matched behaviors and overall performance, including \u2018Demonstrating Potential\u2019. The Wave Professional Styles and Rater questionnaire assess the Wave hierarchy of 108 facets, 36 dimensions, 12 sections and four clusters.<\/p>\n<\/div>\n<h3>Three samples were used in the study to attempt to answer the following questions:<\/h3>\n<div class=\"sav_editor_box clearfix sebox_light_yellow\">\n<ul>\n<li>Which level of the hierarchy performs the best in forecasting potential?<\/li>\n<li>Which level of the hierarchy provides the greatest level of <a href=\"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/glossary\/\" target=\"_blank\" rel=\"noopener noreferrer\">convergent<\/a> and <a href=\"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/glossary\/\" target=\"_blank\" rel=\"noopener noreferrer\">discriminant validity<\/a> for measuring specific behaviors?<\/li>\n<li>Which is the most useful level of the model for the recruiter in practical terms \u2013 balancing the above considerations?<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<\/div>\n<div id=\"pg-19925-3\" class=\"panel-grid panel-has-style\">\n<div class=\"max-width panel-row-style panel-row-style-for-19925-3\">\n<div id=\"pgc-19925-3-0\" class=\"panel-grid-cell\">\n<div id=\"panel-19925-3-0-0\" class=\"widget_text so-panel widget widget_custom_html panel-first-child panel-last-child\" data-index=\"3\">\n<div class=\"widget_text panel-widget-style panel-widget-style-for-19925-3-0-0\">\n<div class=\"textwidget custom-html-widget\">\n<p>Algorithms were created for each of the four scale levels (in each of the three samples) to compare how well we can forecast potential based on weighting different levels of detail. To create the equations, we correlated every scale with ratings of \u2018Demonstrating Potential\u2019 then ranked from best to worst at each level of the model \u2013 with the highest ranked receiving the biggest weighting and the lowest weighting applied to the scale with the lowest relationship with potential.<\/p>\n<p>After analysis of the data, we were able to conclude that there is good forecasting at all levels of the Wave hierarchy, with slightly stronger relationships generally demonstrated at the more detailed scale level (as opposed to the broader four cluster level). The equations tended to perform better in the sample they were based on (as we would expect), but there were significant and substantial correlations for the equations cross-validated into other samples. This provides clear evidence for the generalizability of this method of creating weightings based on ranking correlations for forecasting potential.<\/p>\n<p>The section level demonstrated the highest level of convergent validity (for forecasting specific behaviors) in all of the samples. Discriminant validity compares the matched, convergent validity correlations with the unmatched correlations. These were consistently lower across all levels and samples, indicating that the scales are measuring the specific behaviors they are designed to measure, rather than just being generally related to performance.<\/p>\n<\/div>\n<div id=\"pg-19925-4\" class=\"panel-grid panel-no-style\">\n<div id=\"pgc-19925-4-0\" class=\"panel-grid-cell\">\n<div id=\"panel-19925-4-0-0\" class=\"widget_text so-panel widget widget_custom_html panel-first-child panel-last-child\" data-index=\"4\">\n<div class=\"widget_text max-width panel-widget-style panel-widget-style-for-19925-4-0-0\">\n<div class=\"textwidget custom-html-widget\">\n<div>\n<div>\n<div class=\"sav_editor_box clearfix sebox_light_purple\">We found good levels of forecasting across the hierarchy. Forecasting potential was slightly stronger at the more detailed level, but it was noted that this can be less practical to work with and more time consuming for job-analysis. The mid-level (section level of Wave) performs well when it comes to predicting potential while balancing ease of use. By achieving good forecasting of potential while maximizing convergent validity, the sections can be particularly useful for streaming people into different jobs, flexible role fit and forecasting of specific behaviors which are important for the role.<strong><span class=\"b\">Based on this research, as well as the research discussed in earlier papers regarding the importance of both validity and time to candidates, we wanted to explore how we could utilize the validity benefits of working with the section level of the hierarchy to create a powerful assessment which delivers high validity in a short completion time.<\/span><\/strong><\/p>\n<div id=\"pg-19925-3\" class=\"panel-grid panel-has-style\">\n<div class=\"max-width panel-row-style panel-row-style-for-19925-3\">\n<div id=\"pgc-19925-3-0\" class=\"panel-grid-cell\">\n<div id=\"panel-19925-3-0-0\" class=\"widget_text so-panel widget widget_custom_html panel-first-child panel-last-child\" data-index=\"3\">\n<div class=\"widget_text panel-widget-style panel-widget-style-for-19925-3-0-0\">\n<div class=\"textwidget custom-html-widget\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>This paper looked at hierarchical models of workplace competencies to establish the most useful level of the model for recruiters to maximize validity, and to provide a practical level of detail to identify distinct behaviors which are important for the role. We did this by exploring the cross-validation of equations to forecast potential across three&hellip;<\/p>\n","protected":false},"author":3,"featured_media":0,"parent":4978,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"class_list":["post-4983","page","type-page","status-publish"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Paper 3: Scales of Potential - Saville Assessment Nordic<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Paper 3: Scales of Potential - Saville Assessment Nordic\" \/>\n<meta property=\"og:description\" content=\"This paper looked at hierarchical models of workplace competencies to establish the most useful level of the model for recruiters to maximize validity, and to provide a practical level of detail to identify distinct behaviors which are important for the role. We did this by exploring the cross-validation of equations to forecast potential across three&hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/\" \/>\n<meta property=\"og:site_name\" content=\"Saville Assessment Nordic\" \/>\n<meta property=\"article:modified_time\" content=\"2020-03-17T21:44:22+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@SavilleAssess\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/validity-the-long-and-short-of-it\\\/paper-3-scales-of-potential\\\/\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/validity-the-long-and-short-of-it\\\/paper-3-scales-of-potential\\\/\",\"name\":\"Paper 3: Scales of Potential - Saville Assessment Nordic\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#website\"},\"datePublished\":\"2020-03-17T17:41:40+00:00\",\"dateModified\":\"2020-03-17T21:44:22+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/validity-the-long-and-short-of-it\\\/paper-3-scales-of-potential\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/validity-the-long-and-short-of-it\\\/paper-3-scales-of-potential\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/validity-the-long-and-short-of-it\\\/paper-3-scales-of-potential\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Validity: The Long and Short of It\",\"item\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/validity-the-long-and-short-of-it\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Paper 3: Scales of Potential\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/\",\"name\":\"Saville Assessment Nordic\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#organization\",\"name\":\"Saville Consulting Danmark\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/wp-content\\\/uploads\\\/Saville-Consulting-Danmark-logo-2.png\",\"contentUrl\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/wp-content\\\/uploads\\\/Saville-Consulting-Danmark-logo-2.png\",\"width\":290,\"height\":78,\"caption\":\"Saville Consulting Danmark\"},\"image\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/SavilleAssess\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/saville-consulting-danmark\\\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Paper 3: Scales of Potential - Saville Assessment Nordic","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/","og_locale":"en_GB","og_type":"article","og_title":"Paper 3: Scales of Potential - Saville Assessment Nordic","og_description":"This paper looked at hierarchical models of workplace competencies to establish the most useful level of the model for recruiters to maximize validity, and to provide a practical level of detail to identify distinct behaviors which are important for the role. We did this by exploring the cross-validation of equations to forecast potential across three&hellip;","og_url":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/","og_site_name":"Saville Assessment Nordic","article_modified_time":"2020-03-17T21:44:22+00:00","twitter_card":"summary_large_image","twitter_site":"@SavilleAssess","twitter_misc":{"Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/","url":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/","name":"Paper 3: Scales of Potential - Saville Assessment Nordic","isPartOf":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/#website"},"datePublished":"2020-03-17T17:41:40+00:00","dateModified":"2020-03-17T21:44:22+00:00","breadcrumb":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/paper-3-scales-of-potential\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.savilleconsulting.dk\/en\/"},{"@type":"ListItem","position":2,"name":"Validity: The Long and Short of It","item":"https:\/\/www.savilleconsulting.dk\/en\/validity-the-long-and-short-of-it\/"},{"@type":"ListItem","position":3,"name":"Paper 3: Scales of Potential"}]},{"@type":"WebSite","@id":"https:\/\/www.savilleconsulting.dk\/en\/#website","url":"https:\/\/www.savilleconsulting.dk\/en\/","name":"Saville Assessment Nordic","description":"","publisher":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.savilleconsulting.dk\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.savilleconsulting.dk\/en\/#organization","name":"Saville Consulting Danmark","url":"https:\/\/www.savilleconsulting.dk\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.savilleconsulting.dk\/en\/#\/schema\/logo\/image\/","url":"https:\/\/www.savilleconsulting.dk\/wp-content\/uploads\/Saville-Consulting-Danmark-logo-2.png","contentUrl":"https:\/\/www.savilleconsulting.dk\/wp-content\/uploads\/Saville-Consulting-Danmark-logo-2.png","width":290,"height":78,"caption":"Saville Consulting Danmark"},"image":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/SavilleAssess","https:\/\/www.linkedin.com\/company\/saville-consulting-danmark\/"]}]}},"_links":{"self":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages\/4983","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/comments?post=4983"}],"version-history":[{"count":4,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages\/4983\/revisions"}],"predecessor-version":[{"id":5038,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages\/4983\/revisions\/5038"}],"up":[{"embeddable":true,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages\/4978"}],"wp:attachment":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/media?parent=4983"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}