Determining the Internal Validity and Test Reliability of the Dream Home Assessment: A Performance-Based Measure of Executive Function for Adults with Mental Illness

Emily I. Raphael-Greenfield; Lenin C. Grajo; Lee Ann Westover; Karen Fong

doi:10.1080/0164212X.2019.1678446

Determining the Internal Validity and Test Reliability of the Dream Home Assessment: A Performance-Based Measure of Executive Function for Adults with Mental Illness

Emily I. Raphael-Greenfield, Lenin C. Grajo, Lee Ann Westover, Karen Fong

Program in Occupational Therapy

Research output: Contribution to journal › Article › peer-review

2 Scopus citations

Abstract

To determine the internal validity and test reliability of the Dream Home Assessment (DHA), an executive function assessment. Participants included 59 adults with and without mental illness. Rasch model of measurement was used to analyze goodness of fit and item reliability. The majority of the test items (70%) indicated good fit and the over-all tool shows minimal distortion with the Rasch model of measurement. Three test items were removed; six test items will be refined to strengthen internal validity. Items can reliably detect 2–5 levels of executive functioning ability and detect change over time. The study provides preliminary evidence of validity and reliability of the DHA.

Original language	English
Pages (from-to)	188-203
Number of pages	16
Journal	Occupational Therapy in Mental Health
Volume	36
Issue number	2
DOIs	https://doi.org/10.1080/0164212X.2019.1678446
State	Published - Apr 2 2020

Keywords

Homelessness
Rasch analysis
executive function
mental illness
psychometric testing

Access to Document

10.1080/0164212X.2019.1678446

Cite this

@article{d31fb89876e64228a18dbd635eaeed08,

title = "Determining the Internal Validity and Test Reliability of the Dream Home Assessment: A Performance-Based Measure of Executive Function for Adults with Mental Illness",

abstract = "To determine the internal validity and test reliability of the Dream Home Assessment (DHA), an executive function assessment. Participants included 59 adults with and without mental illness. Rasch model of measurement was used to analyze goodness of fit and item reliability. The majority of the test items (70%) indicated good fit and the over-all tool shows minimal distortion with the Rasch model of measurement. Three test items were removed; six test items will be refined to strengthen internal validity. Items can reliably detect 2–5 levels of executive functioning ability and detect change over time. The study provides preliminary evidence of validity and reliability of the DHA.",

keywords = "Homelessness, Rasch analysis, executive function, mental illness, psychometric testing",

author = "Raphael-Greenfield, {Emily I.} and Grajo, {Lenin C.} and Westover, {Lee Ann} and Karen Fong",

note = "Funding Information: We would like to thank Kimberlee Baltich, MSW, Sharon A. Gutman, PhD, OTR, FAOTA, Franklin Stein, PhD, OTR/L, FAOTA, the clients at PIBLY, and the Columbia University OT graduate students and recent graduates who participated in this research. Publisher Copyright: {\textcopyright} 2019, {\textcopyright} 2019 Taylor & Francis Group, LLC.",

year = "2020",

month = apr,

day = "2",

doi = "10.1080/0164212X.2019.1678446",

language = "English",

volume = "36",

pages = "188--203",

journal = "Occupational Therapy in Mental Health",

issn = "0164-212X",

number = "2",

}

Determining the Internal Validity and Test Reliability of the Dream Home Assessment: A Performance-Based Measure of Executive Function for Adults with Mental Illness. / Raphael-Greenfield, Emily I.; Grajo, Lenin C.; Westover, Lee Ann et al.
In: Occupational Therapy in Mental Health, Vol. 36, No. 2, 02.04.2020, p. 188-203.

Research output: Contribution to journal › Article › peer-review

TY - JOUR

T1 - Determining the Internal Validity and Test Reliability of the Dream Home Assessment

T2 - A Performance-Based Measure of Executive Function for Adults with Mental Illness

AU - Raphael-Greenfield, Emily I.

AU - Grajo, Lenin C.

AU - Westover, Lee Ann

AU - Fong, Karen

N1 - Funding Information: We would like to thank Kimberlee Baltich, MSW, Sharon A. Gutman, PhD, OTR, FAOTA, Franklin Stein, PhD, OTR/L, FAOTA, the clients at PIBLY, and the Columbia University OT graduate students and recent graduates who participated in this research. Publisher Copyright: © 2019, © 2019 Taylor & Francis Group, LLC.

PY - 2020/4/2

Y1 - 2020/4/2

N2 - To determine the internal validity and test reliability of the Dream Home Assessment (DHA), an executive function assessment. Participants included 59 adults with and without mental illness. Rasch model of measurement was used to analyze goodness of fit and item reliability. The majority of the test items (70%) indicated good fit and the over-all tool shows minimal distortion with the Rasch model of measurement. Three test items were removed; six test items will be refined to strengthen internal validity. Items can reliably detect 2–5 levels of executive functioning ability and detect change over time. The study provides preliminary evidence of validity and reliability of the DHA.

AB - To determine the internal validity and test reliability of the Dream Home Assessment (DHA), an executive function assessment. Participants included 59 adults with and without mental illness. Rasch model of measurement was used to analyze goodness of fit and item reliability. The majority of the test items (70%) indicated good fit and the over-all tool shows minimal distortion with the Rasch model of measurement. Three test items were removed; six test items will be refined to strengthen internal validity. Items can reliably detect 2–5 levels of executive functioning ability and detect change over time. The study provides preliminary evidence of validity and reliability of the DHA.

KW - Homelessness

KW - Rasch analysis

KW - executive function

KW - mental illness

KW - psychometric testing

UR - http://www.scopus.com/inward/record.url?scp=85074406436&partnerID=8YFLogxK

U2 - 10.1080/0164212X.2019.1678446

DO - 10.1080/0164212X.2019.1678446

M3 - Article

AN - SCOPUS:85074406436

SN - 0164-212X

VL - 36

SP - 188

EP - 203

JO - Occupational Therapy in Mental Health

JF - Occupational Therapy in Mental Health

IS - 2

ER -

Determining the Internal Validity and Test Reliability of the Dream Home Assessment: A Performance-Based Measure of Executive Function for Adults with Mental Illness

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this