Go Back   Socionics Forums > Ramble Mumble

Ramble Mumble Anything goes, but please make an effort to stay positive and keep it socionics related.


Reply
 
Thread Tools
  #1  
Old 14/03/2006, 04:24 PM
Isha Isha is offline
Junior Member
 
Join Date: Mar 2006
Posts: 5
Default Distortions in Self-Report Data

We all know this is a big problem with testing, so I thought maybe we should collaborate and put our insights and ideas into one place for easy access if anyone wants to develop a new test or improve on an old one, etc.

Here's a list of some common distortions (lists and definitions are incredibly useful things).

Social-desirability bias
- a tendency to give "socially approved" answers
- subjects try to create a favourable impression

Misunderstanding
- respondents misunderstand questions
- the way questions are worded can shape participants' responses

Memory errors
(pretty much self-explanatory)

Tendency to agree
- respondent tends to agree with nearly all items

Tendency to disagree
- respondent tends to disagree with nearly all items

There's probably not a great deal one can do about the last three distortions (although a large scale like rmcnew's might help somewhat for the last two).

Social-desirability bias is likely responsible for the "ENTp bias" that SG illustrated here. Maybe test-developers need to make sure that they don't make any functions sound better than others. (I don't have any answer's, I'm just speculating for the moment).

The distortion I'm particularly interested in is the misunderstanding. How does a test developer minimise misunderstanding? Maybe rather than have 1 statement per item, there should be 2 statements which illustrate the same concept in different wordings? Or maybe pairs of positive and negative statements in each item?

Anyway, ideas are wonderful! This is an area that deserves our focus.
Reply With Quote
  #2  
Old 14/03/2006, 04:34 PM
Vibration Vibration is offline
Senior Member
 
Join Date: Mar 2006
Posts: 452
Default Re: Distortions in Self-Report Data

Quote:
Originally posted by Isha:
Anyway, ideas are wonderful! [/QB]
Hey Isha,

You're beautiful...!

Does the company have a name yet...?


PS. You're ISFP.
Reply With Quote
  #3  
Old 14/03/2006, 05:50 PM
SG's Avatar
SG SG is offline
Moderator
 
Join Date: Dec 2005
Posts: 2,521
Default Re: Distortions in Self-Report Data

What about if someone is just cuckoo mad?
Reply With Quote
  #4  
Old 15/03/2006, 01:24 AM
Isha Isha is offline
Junior Member
 
Join Date: Mar 2006
Posts: 5
Default Re: Distortions in Self-Report Data

I'd say "cuckoo mad" is one of those things you couldn't do much about...

@Vibration: How did you get ISFp from that?
Reply With Quote
  #5  
Old 15/03/2006, 01:48 AM
Vibration Vibration is offline
Senior Member
 
Join Date: Mar 2006
Posts: 452
Default Re: Distortions in Self-Report Data

Quote:
Originally posted by Isha:

@Vibration: How did you get ISFp from that?
You resemble someone I'v known for four years whom I think is ISFp. Your text look a little bit ISFp too I think.
Still I'm just 60% certain.
Let SG be the judge...
Reply With Quote
  #6  
Old 15/03/2006, 01:49 AM
Gilligan Gilligan is offline
Member
 
Join Date: Mar 2006
Posts: 48
Default Re: Distortions in Self-Report Data

I said the same thing about her facial expressions. They remind me vaguely of my girlfriend (who happens to be ISFp).
Reply With Quote
  #7  
Old 15/03/2006, 02:42 AM
Vibration Vibration is offline
Senior Member
 
Join Date: Mar 2006
Posts: 452
Default Re: Distortions in Self-Report Data

Quote:
Originally posted by Gilligan:
I said the same thing about her facial expressions. They remind me vaguely of my girlfriend (who happens to be ISFp).
Could you be ENTp?
Reply With Quote
  #8  
Old 15/03/2006, 04:36 AM
Gilligan Gilligan is offline
Member
 
Join Date: Mar 2006
Posts: 48
Default Re: Distortions in Self-Report Data

It's possible. It's also possible that I'm ESTp. Ask Sergei, and see the "Type me, type me!" thread.
Reply With Quote
  #9  
Old 15/03/2006, 06:43 AM
Vibration Vibration is offline
Senior Member
 
Join Date: Mar 2006
Posts: 452
Default Re: Distortions in Self-Report Data

Quote:
Originally posted by Gilligan:
It's possible. It's also possible that I'm ESTp.
Have you got ENFp-result on any test?
Reply With Quote
  #10  
Old 15/03/2006, 02:37 PM
Gilligan Gilligan is offline
Member
 
Join Date: Mar 2006
Posts: 48
Default Re: Distortions in Self-Report Data

A while ago. But it's clear to me that I almost definitey have Fe hidden agenda, and the descriptions always fit better for ENTp. In addition, I see alot of Alpha Quadra values in myself, as opposed to Delta. I also exhibit very little introverted feeling (lack of tact/regard for others' feelings).
Reply With Quote
  #11  
Old 15/03/2006, 04:32 PM
Isha Isha is offline
Junior Member
 
Join Date: Mar 2006
Posts: 5
Default Re: Distortions in Self-Report Data

So aside from me not being ISFp, any real ideas on the issue?
Reply With Quote
  #12  
Old 16/03/2006, 02:23 PM
Vibration Vibration is offline
Senior Member
 
Join Date: Mar 2006
Posts: 452
Default Re: Distortions in Self-Report Data

Quote:
Originally posted by Isha:
So aside from me not being ISFp, any real ideas on the issue?
So your NOT an ISFp??????????
Reply With Quote
  #13  
Old 16/03/2006, 02:50 PM
Epic's Avatar
Epic Epic is offline
Senior Member
 
Join Date: Dec 2005
Posts: 460
Default Re: Distortions in Self-Report Data

Personality testing is usually exclusively self report, which is always subjective. Now the most effective way to test people, would be to identify human universals which vary little from population to population and also are confirmed to relate to a "function".

Now the problem here is no one knows what functions really are, its just all an intuitive mess. 'judgement is sorta like "this" and its constituent components are sorta like "that" and "the other"

It isn't objective so it isn't experimentally valid.

I would think a statistical approach in a longitudinal study would be best. That is, you trace development over time by exposing different people to different stimuli.

At once is silly. For example

Researcher: "do you like math?"
Subject: "no, i hate math"
Researcher: "Are you interested in science and technology?"
Subject: "well, most of it uses math, so no"
Researcher: "Are you a social person?"
Subject: "no."
Researcher: "oh... Well, do you rely more on your feelings than your logic"
Subject: "umm"

It just seems like the questions are setting the person up to decide as the test goes on. Also, the words used and the contemporary associations with functions(like logic is being interested in science and ethics is liking being around people or something) A person might associate the word logic with something different than the researcher.

In a longitudinal study you could "teach" groups. Ultimately the future is being set up rather than assuming the past definitions of the subject are the same as the present definitions used by the tester.

In the end you would be able to see the directions certain people in a controlled context "gravitate" towards. You would also notice intertype relations at work, perhaps(depending on the design of the experiment, which should have minimal internal variations).

Then, of course, you can test for results and note patterns in the end.

That's a pretty general idea, but basically what I am saying is that asking a person questions with assumed connotations might not necessarily be the way to go. You'd also want the people tested to have the same background, that way they don't use their past to mask insecurities or their insecurities to mask their strengths.
Reply With Quote
  #14  
Old 21/03/2006, 08:50 AM
FDG FDG is offline
Junior Member
 
Join Date: Mar 2006
Posts: 5
Default Re: Distortions in Self-Report Data

Quote:
Originally posted by SG:
What about if someone is just cuckoo mad?
What about a serious reply to a serious question?
Reply With Quote
  #15  
Old 21/03/2006, 08:55 AM
SG's Avatar
SG SG is offline
Moderator
 
Join Date: Dec 2005
Posts: 2,521
Default Re: Distortions in Self-Report Data

Quote:
Originally posted by FDG:
Quote:
Originally posted by SG:
What about if someone is just cuckoo mad?
What about a serious reply to a serious question?
Good morning, sunshine!
Reply With Quote
  #16  
Old 21/03/2006, 11:01 AM
Human s/n #098621's Avatar
Human s/n #098621 Human s/n #098621 is offline
Member
 
Join Date: Mar 2006
Posts: 63
Default Re: Distortions in Self-Report Data

Quote:
Personality testing is usually exclusively self report, which is always subjective.
Probably all self testing is incorrect then.

Quote:
quote:Originally posted by FDG:

quote:Originally posted by SG:
What about if someone is just cuckoo mad?

What about a serious reply to a serious question?
To Nietzsche, madness was the behavior of believing and stating things that the common people would never understand, much less agree with. Madness, then, is "abnormal behavior" that is not indicative of mental instability. Madness is found in people who try to relate wisdom through humor or metaphor. Madness is the expression of a unique idea in unique way. Madness isn't really harmful (although those with unique ideas do tend to be harassed if they are particularly deviant). In a way, Madness is just an expression of individuality.
Why should this interfer with testing? A mad person is not insane.
Reply With Quote
  #17  
Old 29/04/2018, 02:49 PM
shadowpuppet's Avatar
shadowpuppet shadowpuppet is offline
the Omniscient
 
Join Date: Jun 2008
Posts: 642
Default

Quote:
Originally Posted by Epic View Post
Now the most effective way to test people, would be to identify human universals which vary little from population to population and also are confirmed to relate to a "function".
That seems like foundationalism.
__________________

u!




Quote:
Originally Posted by Vibration View Post
Thanks. Now I understand why Prom thinks you are the most intelligent person at this forum.
Reply With Quote
Reply


Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



All times are GMT +1. The time now is 02:35 AM.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
Copyright 2007 SOCIONICS.COM