{"id":5255,"date":"2020-05-05T13:26:52","date_gmt":"2020-05-05T11:26:52","guid":{"rendered":"https:\/\/www.savilleconsulting.dk\/?page_id=5255"},"modified":"2024-06-27T06:39:00","modified_gmt":"2024-06-27T04:39:00","slug":"the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it","status":"publish","type":"page","link":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/","title":{"rendered":"The Surprising Truth about Self-Report and Lessons We Can Learn from It"},"content":{"rendered":"
\n
\n
\n

\u201cIt\u2019s just what they think of themselves.\u201d <\/i>\u201cOthers might say differently.\u201d <\/i> \u201cThey\u2019ll just say what they think you want to hear.\u201d <\/i><\/h3>\n<\/div>\n<\/div>\n<\/div>\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n

Sound familiar? These are common views associated with \u2018self-report\u2019, but they actually reflect the myths and misconceptions that we will tackle in this short article.<\/p>\n

We learned a lot about the value of self-report during the two years we spent developing Wave, our market-leading personality questionnaire, and will share some practical tips around how to ensure data from all self-report measures, including interviews, are optimized for effectiveness.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

\n
\n
\n
\n
\n
\n
\n

Surprising Truth: You can\u2019t escape self-report<\/h2>\n

Interviews are self-report. CVs are self-report. Application forms are self-report. Yet all of these tools are used widely across the world to help recruiters make decisions about whether or not to hire someone. Imagine not using them; how else would you do it?<\/p>\n

Aptitude tests are not self-report and are highly effective screeners (when it comes to measuring how effective different types of tools are at predicting job performance, aptitude tests come up trumps), however, they don\u2019t get at how a person behaves. This is where we need to pull in personality assessments, (highly structured) interviews or observational techniques such as role plays and group exercises at an assessment center. The latter, though, can be riddled with problems.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

\n
\n
\n
\n
\n
\n

Surprising Truth: Self-report is better than observing someone at assessment center<\/h2>\n

There is strong evidence that interviews, when done properly, do a very good job of predicting workplace performance. The same can be said for personality questionnaires. In fact, the evidence suggests that both of these things are better at predicting job performance than observational techniques that are used as assessment center exercises.<\/p>\n

There are several reasons for this: <\/strong><\/p>\n

    \n
  • A lot of the time, assessment center exercises simply aren\u2019t getting at things that are relevant to the role; evidence suggests that work samples or trialing the job (Job Tryout) are both better at predicting performance.<\/li>\n
  • More recent research looking at assessment centers also suggests that their exercises don\u2019t actually measure competencies and so they can\u2019t tell you what an individual is good or bad at; they tell you how good or bad they might be at performing that particular task, which will only be predictive of workplace performance if that task is highly relevant to a major part of the job and therefore more akin to a work sample test (generally they are not!).<\/li>\n
  • And finally, with many assessment center exercises (particularly group exercises and role plays), there are just too many extraneous variables feeding in to provide a truly accurate picture; here are just some examples:\n
      \n
    • In group exercises, so much depends on how other people in the group behave.<\/li>\n
    • In role plays, however clear your scripts, there will be variability in actor style and performance.<\/li>\n
    • Some people might have experience or job knowledge that gives them an advantage in any particular exercise; others might lack that experience or job knowledge and get marked down, even if they have the underlying competency.<\/li>\n
    • Assessment centers usually have multiple observers covering a number of candidates; even with the best training and calibration in the world, there will still be variability in observers\u2019 notetaking, scoring and final assessment.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n

      The graph below summarizes how effective different assessment methodologies are at predicting workplace performance. As we have already mentioned, aptitude tests lead the field. Structured interviews and Wave follow close behind.Assessment center exercises in comparison do very poorly and struggle to even reach the industry standard of a 0.3 validity. A tool\u2019s validity determines its effectiveness; the lower the validity score, the greater the risk of making the wrong selection decision and hiring a poor performer.<\/p>\n

      With no validity (a score of 0), the chances of making a poor hire are 1\/5. Bring in an assessment which meets the industry standard for validity (0.3) and you reduce this to 1\/10. But use a tool with a validity score of 0.6 and you reduce this to 1\/50.<\/p>\n

      The relationship between validity and getting the right people, rather than the wrong people, is exponential. To maximize your hit rate, you have to climb up the validity graph and use the assessment methods proven to be most effective.<\/p>\n

      \n

      Effectiveness of assessment methods*<\/h4>\n

      *Includes all assessment methods generally deemed acceptable for use in hiring across different occupations<\/p>\n

      \"Effectiveness<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

      \n
      \n
      \n
      \n
      \n

      Surprising Truth: You Can Improve the Effectiveness of Your Assessment<\/h2>\n

      We are often asked why Wave also has such strong validity. The answer is actually very simple; it is all in the questions. One of the main lessons we took from developing Wave is that exact wording of questions is critical and small differences really do matter; the slightest change can impact on a question\u2019s ability to predict performance.<\/p>\n

      There are 216 questions in the Wave Professional Styles questionnaire. We started with over 4000 questions, carefully crafted by a team of four highly-skilled psychometricians, who between them had over 100 years\u2019 experience. We selected the very best of those questions based on how well they targeted the key behavior and then used data to identify those most effective at predicting performance.<\/p>\n

      Have a look at the list of questions below and decide whether you think they are \u2018good\u2019 or \u2018bad\u2019 in terms of effectiveness at predicting performance at work. They would usually be presented in a way that meant you had to state the extent to which you agreed or disagreed with each item. <\/strong><\/p>\n

      Click on the item below to reveal the answers. <\/strong><\/p>\n


      \n\n\t\t\t\t\t

      \n\t\t\t\t1. I am someone who has lots of random ideas\t\t\t<\/h3>\n\t\t\n\t\t
      \n\t\t\t<\/p>\n

      Bad item. The problem here is the word random. Random ideas are often going to be irrelevant and so the question isn\u2019t going to do particularly well at telling you how effective someone is likely to be at creating innovation at work. Simply removing the word random makes this a much stronger item.
      \n\t\t<\/div>\n\n\t\t<\/div>\n


      \n\n\t\t\t\t\t

      \n\t\t\t\t2. I am very concerned about how others are feeling\t\t\t<\/h3>\n\t\t\n\t\t
      \n\t\t\t<\/p>\n

      Bad item. The problem here is that it isn\u2019t an active behavior. You might have concern but not actually do anything about it. A better item is \u201cI show empathy for others\u201d.
      \n\t\t<\/div>\n\n\t\t<\/div>\n


      \n\n\t\t\t\t\t

      \n\t\t\t\t3. I am very bold in what I do\t\t\t<\/h3>\n\t\t\n\t\t
      \n\t\t\t<\/p>\n

      Bad item. This is problematic because the word bold has multiple meanings; in England it means courageous, however in Ireland it means naughty. As soon as you bring in ambiguity, you lose effectiveness.
      \n\t\t<\/div>\n\n\t\t<\/div>\n


      \n\n\t\t\t\t\t

      \n\t\t\t\t4. I rarely make mistakes\t\t\t<\/h3>\n\t\t\n\t\t
      \n\t\t\t<\/p>\n

      Bad item. This is one you could disagree with because you believe you never make mistakes, when in disagreeing to it, the questionnaire assumes you always make mistakes. This is bringing in complexity and adding to the cognitive load of the assessment, which means you end up measuring cognitive skills rather than behavior.
      \n\t\t<\/div>\n\n\t\t<\/div>\n


      \n\n\t\t\t\t\t

      \n\t\t\t\t5. I am not easily difficult to convince\t\t\t<\/h3>\n\t\t\n\t\t
      \n\t\t\t<\/p>\n

      Bad item. Double negatives again significantly increase cognitive load. Simplicity is key.
      \n\t\t<\/div>\n\n\t\t<\/div>\n


      \n\n\t\t\t\t\t

      \n\t\t\t\t6. I do things by gut feel\t\t\t<\/h3>\n\t\t\n\t\t
      \n\t\t\t<\/p>\n

      Bad item. This one has translation issues and in some languages is translated to roughly \u201cI do things by feeling my stomach\u201d.
      \n\t\t<\/div>\n\n\t\t<\/div>\n


      \n\n\t\t\t\t\t

      \n\t\t\t\t7. I am quiet and reserved\t\t\t<\/h3>\n\t\t\n\t\t
      \n\t\t\t<\/p>\n

      Bad item. We want to avoid \u2018and\u2019 because this means what you are getting at is much less targeted. It is also possible to be quiet but not reserved and reserved but not quiet.
      \n\t\t<\/div>\n\n\t\t<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

       <\/p>\n

      Article written by Hannah Mullaney.
      \nApril, 2020 <\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

      \u201cIt\u2019s just what they think of themselves.\u201d \u201cOthers might say differently.\u201d \u201cThey\u2019ll just say what they think you want to hear.\u201d Sound familiar? These are common views associated with \u2018self-report\u2019, but they actually reflect the myths and misconceptions that we will tackle in this short article. We learned a lot about the value of self-report…<\/p>\n","protected":false},"author":3,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"class_list":["post-5255","page","type-page","status-publish"],"acf":[],"yoast_head":"\nSelf-Report: Myths & Misconceptions. Market-leading personality tests<\/title>\n<meta name=\"description\" content=\"Market-leading personality questionnaire. Practical tips around how to ensure data from all self-report measures, including interviews.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Self-Report: Myths & Misconceptions. Market-leading personality tests\" \/>\n<meta property=\"og:description\" content=\"Market-leading personality questionnaire. Practical tips around how to ensure data from all self-report measures, including interviews.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/\" \/>\n<meta property=\"og:site_name\" content=\"Saville Assessment Nordic\" \/>\n<meta property=\"article:modified_time\" content=\"2024-06-27T04:39:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.savilleassessment.com\/wp-content\/uploads\/2020\/04\/Effectiveness-of-assessment-methods-graph3.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@SavilleAssess\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/\",\"name\":\"Self-Report: Myths & Misconceptions. Market-leading personality tests\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.savilleassessment.com\\\/wp-content\\\/uploads\\\/2020\\\/04\\\/Effectiveness-of-assessment-methods-graph3.png\",\"datePublished\":\"2020-05-05T11:26:52+00:00\",\"dateModified\":\"2024-06-27T04:39:00+00:00\",\"description\":\"Market-leading personality questionnaire. Practical tips around how to ensure data from all self-report measures, including interviews.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.savilleassessment.com\\\/wp-content\\\/uploads\\\/2020\\\/04\\\/Effectiveness-of-assessment-methods-graph3.png\",\"contentUrl\":\"https:\\\/\\\/www.savilleassessment.com\\\/wp-content\\\/uploads\\\/2020\\\/04\\\/Effectiveness-of-assessment-methods-graph3.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Surprising Truth about Self-Report and Lessons We Can Learn from It\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/\",\"name\":\"Saville Assessment Nordic\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#organization\",\"name\":\"Saville Consulting Danmark\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/wp-content\\\/uploads\\\/Saville-Consulting-Danmark-logo-2.png\",\"contentUrl\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/wp-content\\\/uploads\\\/Saville-Consulting-Danmark-logo-2.png\",\"width\":290,\"height\":78,\"caption\":\"Saville Consulting Danmark\"},\"image\":{\"@id\":\"https:\\\/\\\/www.savilleconsulting.dk\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/SavilleAssess\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/saville-consulting-danmark\\\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Self-Report: Myths & Misconceptions. Market-leading personality tests","description":"Market-leading personality questionnaire. Practical tips around how to ensure data from all self-report measures, including interviews.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/","og_locale":"en_GB","og_type":"article","og_title":"Self-Report: Myths & Misconceptions. Market-leading personality tests","og_description":"Market-leading personality questionnaire. Practical tips around how to ensure data from all self-report measures, including interviews.","og_url":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/","og_site_name":"Saville Assessment Nordic","article_modified_time":"2024-06-27T04:39:00+00:00","og_image":[{"url":"https:\/\/www.savilleassessment.com\/wp-content\/uploads\/2020\/04\/Effectiveness-of-assessment-methods-graph3.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_site":"@SavilleAssess","twitter_misc":{"Estimated reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/","url":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/","name":"Self-Report: Myths & Misconceptions. Market-leading personality tests","isPartOf":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/#primaryimage"},"image":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/#primaryimage"},"thumbnailUrl":"https:\/\/www.savilleassessment.com\/wp-content\/uploads\/2020\/04\/Effectiveness-of-assessment-methods-graph3.png","datePublished":"2020-05-05T11:26:52+00:00","dateModified":"2024-06-27T04:39:00+00:00","description":"Market-leading personality questionnaire. Practical tips around how to ensure data from all self-report measures, including interviews.","breadcrumb":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/#primaryimage","url":"https:\/\/www.savilleassessment.com\/wp-content\/uploads\/2020\/04\/Effectiveness-of-assessment-methods-graph3.png","contentUrl":"https:\/\/www.savilleassessment.com\/wp-content\/uploads\/2020\/04\/Effectiveness-of-assessment-methods-graph3.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.savilleconsulting.dk\/en\/the-surprising-truth-about-self-report-and-lessons-we-can-learn-from-it\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.savilleconsulting.dk\/en\/"},{"@type":"ListItem","position":2,"name":"The Surprising Truth about Self-Report and Lessons We Can Learn from It"}]},{"@type":"WebSite","@id":"https:\/\/www.savilleconsulting.dk\/en\/#website","url":"https:\/\/www.savilleconsulting.dk\/en\/","name":"Saville Assessment Nordic","description":"","publisher":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.savilleconsulting.dk\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.savilleconsulting.dk\/en\/#organization","name":"Saville Consulting Danmark","url":"https:\/\/www.savilleconsulting.dk\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.savilleconsulting.dk\/en\/#\/schema\/logo\/image\/","url":"https:\/\/www.savilleconsulting.dk\/wp-content\/uploads\/Saville-Consulting-Danmark-logo-2.png","contentUrl":"https:\/\/www.savilleconsulting.dk\/wp-content\/uploads\/Saville-Consulting-Danmark-logo-2.png","width":290,"height":78,"caption":"Saville Consulting Danmark"},"image":{"@id":"https:\/\/www.savilleconsulting.dk\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/SavilleAssess","https:\/\/www.linkedin.com\/company\/saville-consulting-danmark\/"]}]}},"_links":{"self":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages\/5255","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/comments?post=5255"}],"version-history":[{"count":5,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages\/5255\/revisions"}],"predecessor-version":[{"id":5277,"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/pages\/5255\/revisions\/5277"}],"wp:attachment":[{"href":"https:\/\/www.savilleconsulting.dk\/en\/wp-json\/wp\/v2\/media?parent=5255"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}