How to Scrutinize Popular Cognitive Profiling Methods (Part 2)

How to Scrutinize Popular Cognitive Profiling Methods (Part 2)

Part 1 of this two-article episode introduced you to a variety of well-known personality tests or cognitive profiling methods. You may have already heard of —or even been tested in— tools such as Myers-Briggs Type Indicator (MBTI), Herrmann’s Brain Dominance Instrument (HBDI), DISC or the Enneagram. In today’s part 2, allow me to share how to scrutinize the underlying conceptual constructs and design architecture of a cognitive profiling method by answering the following questions: What conceptual features do almost all of these methods have in common? What shortcomings did I notice in many of the profiling tools that I tested? 

In general, cognitive profiling methods add value because they allow us to learn more about ourselves and other people at work. Unfortunately, most traditional methods are only to a limited extent able to provide insights on how everyone can contribute to an organization’s innovation efforts, as I discovered while hunting for years for a suitable cognitive profiling tool to support the people-side of innovation. This is because most methods that I investigated suffer from one or more common methodological shortcomings. In the end, thinking about how to fix these perceived “bugs” led me to come up with a new cognitive profiling method for innovation: TIPS, Thinkergy’s Innovator Profiling System.

What are common design features of most cognitive profiling concepts?

Most cognitive profiling concepts share a set of common design features as follows: 

  • Use of dimensions: Most tools use between one and four dimensions to capture differences in personal styles. These theoretical constructs typically relate to particular cognitive or psychological theories. For example, the Myers-Briggs Type Indicator (MBTI) uses four “preferences” linked to Carl Jung’s psychological theories to profile people; Herrmann’s Brain Dominance Instrument (HBDI) draws upon brain theories to profile people using two dimensions mapped out in a four-by-four matrix; and Kirton’s Adaption-Innovation Inventory (KAI) falls back on his own theory to profile people using a one-dimensional construct. 
  • Use of a questionnaire to measure differences: All concepts capture individual differences by asking people to complete a profiling questionnaire. While the questionnaire design varies based on the overall architecture of each concept, a popular modus operandi is a four-box forced-choice questionnaire (e.g., DISC, M.I.N.D.). 
  • Numerical scoring of profiling results: After completing the questionnaire, most methods present the results in the form of numerical test scores (e.g., M Score of 0 + I Score of 11 + N Score of 0 + D Score of 1 = 12 is a sample result that I got after doing Black’s M.I.N.D. Design concept).
  • Use of a profiling map or table: The numerical test scores are often visualized in a profiling map and/or profiling matrix (e.g., HBDI, Wealth Dynamics). 
  • Assignment of profile types: Some but not all concepts assign distinct profile types to a person based on the test results. At times, these profiles carry an abstract and technical label (e.g., ENTP is one of sixteen profile types of MBTI that I mostly was assigned as a test result); at other times, they use descriptive names that relate to well-known professional roles (e.g., the supervisor and the architect are two of sixteen profile labels of Keirsey’s KTS). The number of profile types of concepts I came across varies between two and forty-nine in those concepts I got myself tested in. 

What are common shortcomings of many cognitive profiling concepts?

By testing a great variety of different cognitive profiling tools over almost a decade, I also noticed certain shortcomings, perceptual blindspots and application delivery gaps that got me thinking about how to fix these perceived suboptimal, missing or even “wrong” elements. So what are some of these suboptimal things I noticed? 

  1. Varying and limited number of construct dimensions:
    What is the best number of dimensions or theoretical constructs needed to adequately profile a person? While MBTI and KTS use four dimensions, many concepts suffice with only two-dimensional (WD, HBDI, MIND, Insights Discovery) or even one-dimensional constructs (KAI). Concepts with few dimensions emphasize certain aspects of personal style, but tend to neglect other facets relevant for business and innovation. Interestingly, for a few profiling concepts (including some popular ones that I won’t name), I was unable to understand their methodological design architecture and discern the underlying theoretical constructs. 
  2. Binary design of constructs:
    Many profiling tools interpret the test scores for a cognitive construct as an “either-or” result. For example, in MBTI, you ultimately come out as either an extravert or introvert. But could there be people who are both? Yes, I am one of them, and depending on the contextual situation and the required task at hand, I am as energized running a full-day innovation event in front of a large crowd as spending a day at my desk writing an article or a chapter of a book. Moreover, depending on the test version, I tend to come out more often as an Extravert, but at other times get profiled as an introvert.
  3. Profile allocation even in cases of nearly identical scores:
    In many profiling methods such as MBTI, you’re assigned a profile even when there are only tiny score differences for one or more tested dimensions. Suppose your test results in MBTI would be Extraversion vs. Introversion 51-49, iNtuition vs. Sensing 51-49, Thinking vs. Feeling 51-49 and Judging vs. Perceiving 51-49. In this case, MBTI assigns you a personality type (ENTJ), and that’s how everyone familiar with the method will look at you from now onwards. However, had 2-3 questions been formulated in a slightly different way, or had you not “overthought” your answers, you might have come out as an INFP instead. Of course, this problem is amplified if the expressions for two, three or even all four expressions are identical, making it difficult to classify such a balanced person within one of the 16 MBTI-profile “boxes” with confidence. 
  4. Too many or too few profiling questions:
    What is a fair number of questions to reliably measure the surveyed variables and to adequately profile a candidate? Here the art is to strike a right balance between time effectiveness of taking the test, and the accuracy of its result. While many candidates appreciate how quickly they can complete a short survey, some object that a short questionnaire is inadequate to capture sufficient aspects of their personal style — and vice versa in the case of a long questionnaire. Questions vary in number from as few as nine (M.I.N.D.) to more than a hundred (HBTI, some versions of MBTI).
  5. Too many or too few profiles:
    Suppose you’re a team manager using a cognitive profiling concept to capture the different personalities of your subordinates. Would you prefer to have no profiling types at all and having to recall the test scores only? Probably not. So we agree that having profiles is useful. But what is the best number of profiles to provide sufficient distinctions in style differences without overwhelming users? Are two profile types (KAI) or four profile types (Foresight) adequate to capture sufficient differences in style? Can you easily remember how sixteen profiles (MBTI, KTS) differ from each other? Here, eight to ten profiles seem to be a good number to strike a balance between offering diversity and avoiding over-complexity. 
  6. No descriptive profile labels:
    What do we call someone with a certain cognitive test score? Some profiling concepts (e.g., HBDI, MIND.) give candidates profile scores and detailed descriptions, but don’t use catchy names to describe a profile. Although the profile letters have become technical labels for trained insiders, MBTI suffers from this phenomenon, too. KTS resolved this problem by designating a more descriptive name related to well-known professional roles to each MBTI letter label. Laypeople shrug on hearing that I am an ENTP, but nod their heads when learning this means I am an innovator.
  7. No follow-up application suggestions:
    While providing detailed descriptions of a resulting profile, a number of concepts don’t offer enough concrete follow-up action recommendations to answer the questions: “So what? How to use a particular profiling result to make meaning? Specifically, how to use this result to better perform in business in general and with innovation in particular?” 
  8. No consideration of the dynamic and cyclical nature of business:
    Like many natural phenomena, most parameters in business (e.g., products, technologies, industries, and economies) pass through cyclical wave patterns. For example, Vernon’s product life cycle concept suggests that successful products go through the phases of introduction, growth, maturity and decline. With the exception of Hamilton’s Wealth Dynamics concept (and later on my own concept TIPS), I came across no other profiling method that entertained the idea that certain personality profiles are more suited to lead an organization through different phases of the life cycle of a venture or a product.

How does TIPS conceptually cure these perceived ills?

Let’s go through the eight problematic areas identified above one by one, and allow me to explain how TIPS aims to improve on the perceived shortcomings of other profiling methods.

  1. Elegant, enhanced design architecture:
    TIPS uses an elegant multi-layered design architecture that employs five theoretical constructs: the four TIPS styles (to think, work, interact and live) and the TIPS bases (Theories, Ideas, People, Systems). Together, they feed the TIPS questionnaire and span the TIPS profiling map.
  2. Trinary construct design:
    TIPS uses a trinary interpretation of the cognitive styles, meaning you prefer either this style expression or the other, or equally enjoy drawing on both. For example, in my interaction style, I prefer to communicate and make a case using both fact and feeling (and not just one of these style expressions).
  3. Own neutral profile type for close cases:
    TIPS assigns a neutral profile, the All-Rounder, to balanced profiling results where the test scores for three or even all four dimensions are near-identical. So we avoid the problem to “lock someone into a potentially wrong profile box” because of a tiny score difference.
  4. Adequate number of profiling questions:
    With 60 profiling questions, TIPS aims for the middle ground between high accuracy and complexity on one hand and time-effectiveness and simplicity on the other. As we gather more data over time, we aim to reduce the number of profiling questions to 50 or even 40 without losing accuracy (with the help of certain statistical procedures such as factor analysis).
  5. Handy number of profiles:
    TIPS proposes 10+1 profile types. So if you can recall the eleven players of a football (or soccer) team, you’ll also will be able to recall all the TIPS profiles. (By the way, the 11th “special” profile is that of the All-Rounder, see above).
  6. Business-oriented profile names:
    TIPS uses business-related role names to capture the essence of its 10+1 profile types (all labeled with business-related role names). Do you get a rough idea what a person is all about if you hear she is either a Theorist, Ideator, Partner, Systematizer, Conceptualizer, Promoter, Organizer, Technocrat or All-Rounder?
  7. Lots of applications to business and innovation:
    I created TIPS with the intent to help companies to better deal with the people side of innovation. As such, TIPS can give answer to questions such as:
    • What’s my style to innovate?
    • How can I best contribute to the innovation-efforts of a firm in line with my natural talents and preferred styles?
    • Should I rather lead or create innovation at the front, or manage and administer from behind?
    • At what process stages of an innovation project can I add most value with my cognitive styles?
    • What innovation types are closest to my natural interests?
    • What is my typical response to creative change in our organization?
    • What is my potential to be developed into a creative leader for the innovation economy?
    • Who are the profile types who make game-changing innovations happen?
      In addition, TIPS also offers a wide range of business applications, such as:
    • How to hire the most suitable candidate for a position?
    • How to better align the members of a work team to produce better results and higher work satisfaction?
    • How to use my talent in the most conducive work ecosystem?
    • How to manage people in line with their cognitive style?
    • How to understand and mitigate conflict at work?
  8. Reflection of the dynamic, cyclical nature of business:
    Theoretically grounded in constructs from social science and evolutionary economics, the theoretical construct of the TIPS bases allows TIPS to describe how the different TIPS profiles influence performance as a product or a venture moves through the business cycle. The TIPS bases connect two concepts from evolutionary economics, Kontratiev’s long waves and Schumpeter’s concept of creative destruction, which can explain how technological and social change gradually unfolds over longer periods of time.


Methods to profile people’s personality and cognitive styles potentially have a wide range of applications in business and innovation. They can be useful for individuals and organizations alike, provided they:

  • paint an accurate picture of the preferred cognitive style and psychological make-up of a person (Who am I? Who are they?), and then 
  • transfer these novel insights into meaningful action recommendations (So what? How to turn this heightened awareness of self and others into tangible results and meaningful contributions? How to make better use of a person’s unique talents and styles?).

Do you want to learn more about TIPS? Would you like find out more about our TIPS training for your organization? Or would you like to take the TIPS profiling test yourself? Contact us and let us know more how we may help you. 

© Dr. Detlef Reis 2018

25 comments (Add your own)

1. wrote:
I just could not depart your web site prior to suggesting that I really loved the usual info an individual provide
in your guests? Is gonna be again incessantly in order to investigate cross-check new

Sat, May 11, 2019 @ 8:49 PM

2. wrote:
I'm extremely impressed with your writing skills and also with the layout on your blog.
Is this a paid theme or did you customize it yourself? Either way keep up the nice quality writing, it's rare to see
a great blog like this one these days.

Mon, May 13, 2019 @ 8:31 AM

3. wrote:
It's actually a cool and useful piece of information. I am glad that you just shared this helpful info with us.
Please stay us informed like this. Thanks for sharing.

Thu, May 16, 2019 @ 1:10 AM

4. wrote:
Hello, Neat post. There's a problem with your site in web explorer, may test this?
IE nonetheless is the market chief and a good component of other people will pass over your magnificent writing because of
this problem.

Sat, May 18, 2019 @ 2:09 AM

5. wrote:
I think that is among the most important information for me.
And i'm happy reading your article. However should commentary on some basic issues,
The web site taste is great, the articles is actually nice :
D. Excellent process, cheers

Wed, June 12, 2019 @ 10:57 AM

6. wrote:
I love your blog.. very nice colors & theme. Did you design this website yourself or did you
hire someone to do it for you? Plz reply as I'm looking to construct my own blog and would like to know where
u got this from. cheers

Mon, July 8, 2019 @ 11:59 PM

7. wrote:
Fantastic items from you, man. I've have in mind your stuff previous to and you are just extremely excellent.
I really like what you've acquired right here, certainly like what you're saying and the way wherein you are saying it.
You make it enjoyable and you still take care of to stay it
smart. I cant wait to learn much more from you.
That is actually a terrific web site.

Tue, July 23, 2019 @ 10:45 AM

8. wrote:
I don't even understand how I finished up right here, however I believed this post was once good.
I don't understand who you might be however certainly
you're going to a well-known blogger in case you
aren't already. Cheers!

Thu, August 1, 2019 @ 4:17 AM

9. wrote:
If some one wants to be updated with most up-to-date technologies afterward he must be pay a quick
visit this site and be up to date everyday.

Sat, August 24, 2019 @ 5:16 AM

10. wrote:
This is really interesting, You're a very skilled blogger.
I've joined your feed and look forward to seeking more of your
wonderful post. Also, I've shared your web site in my
social networks!

Mon, September 16, 2019 @ 7:57 AM

11. wrote:
An interesting discussion is worth comment. I believe that you
ought to publish more on this topic, it might not be a taboo
matter but generally people do not speak about these issues.
To the next! Many thanks!!

Sun, October 13, 2019 @ 7:34 PM

12. wrote:
I am really enjoying the theme/design of your weblog. Do you ever run into any web browser compatibility problems?
A number of my blog readers have complained about my site not operating correctly in Explorer but looks great in Safari.
Do you have any ideas to help fix this issue?

Tue, October 29, 2019 @ 1:30 AM

13. wrote:
If you are going for most excellent contents like myself, simply pay a
visit this web page every day because it offers feature contents, thanks

Tue, November 12, 2019 @ 6:40 AM

14. wrote:
This is very interesting, You are an excessively professional blogger.

I have joined your rss feed and sit up for in the hunt for extra of your magnificent
post. Also, I've shared your site in my social networks

Mon, November 25, 2019 @ 12:11 AM

15. wrote:
It's going to be finish of mine day, except before ending I am reading this great piece of writing
to improve my experience.

Sun, December 15, 2019 @ 5:37 AM

16. wrote:
Wow! This blog looks just like my old one! It's on a
entirely different topic but it has pretty much the same page layout and design. Outstanding choice of colors!

Sun, December 15, 2019 @ 5:19 PM

17. wrote:
Do you have any video of that? I'd like to find out some additional information.

Mon, December 16, 2019 @ 12:59 AM

18. wrote:
Hello, yes this paragraph is actually nice and I have learned lot of things from it regarding blogging.

Fri, December 20, 2019 @ 2:20 AM

19. wrote:
I was recommended this blog by my cousin. I'm now not positive whether or not this put up is written through him as no one else recognize such distinctive approximately
my trouble. You're incredible! Thank you!

Tue, December 31, 2019 @ 6:27 AM

20. wrote:
Hi there, just became aware of your blog through Google,
and found that it's truly informative. I am gonna watch
out for brussels. I'll appreciate if you continue this in future.
Many people will be benefited from your writing. Cheers!

Sat, January 4, 2020 @ 9:55 PM

21. wrote:
This is a topic that is near to my heart... Take care!
Where are your contact details though?

Sat, January 18, 2020 @ 7:13 AM

22. wrote:
Your style is unique in comparison to other people I've read stuff from.
Thank you for posting when you have the opportunity,
Guess I will just bookmark this web site.

Sun, March 29, 2020 @ 8:13 PM

23. wrote:
Cbd oil that works 2020
Thanks for your marvelous posting! I quite enjoyed reading it, you could be a
great author.I will remember to bookmark your blog and will eventually come back someday.
I want to encourage you to continue your great work, have a nice holiday weekend!

best cbd oil for pain http://tinyurl.com/cbd-oil-that-works-2020 cbd oil that works 2020 http://tinyurl.com/cbd-oil-that-works-2020

Tue, June 23, 2020 @ 11:06 PM

24. wrote:
Very energetic blog, I liked that bit. Will
there be a part 2?

Thu, August 6, 2020 @ 1:00 PM

25. wrote:
What's up, this weekend is nice designed for me, for the reason that this point in time i am reading this fantastic
educational paragraph here at my house.

Tue, August 18, 2020 @ 9:59 AM

Add a New Comment


Comment Guidelines: No HTML is allowed. Off-topic or inappropriate comments will be edited or deleted. Thanks.