Earticle

The current study aims to design The current study aims to design an analytic writing scale with reference to the TOEFL iBT® Scoring rubric from the Educational Testing Service (ETS) and to examine the reliability of the newly designed analytic rubric using English argumentative writing collected from 26 Korean undergraduate and graduate students. There are three main findings in this study: First, intra-rater reliability was examined among three raters showing a high correlation between the holistic and the analytic scorings. Second, inter-rater reliability was explored in terms of correlation coefficients, agreement rates (adjacent and perfect), Cohen’s Kappa coefficients, and Fleiss Kappa coefficients. In addition, the intraclass correlation coefficient (ICC) revealed a high correlation between the score on a new analytic rubric and the original holistic TOEFL score. Among the four rubric dimensions, ‘unity-progression-coherence’ and ‘language use’ showed relatively lower correlations than the other two dimensions (topic and task, organization and development). Also, the dimension that showed the highest correlation with the holistic ETS score is ‘organization and development.’ Moreover, ‘unity-progression-coherence’ contributed notably to the analytic assessment. A survey on raters’ perceptions of rubrics and scoring, and interviews suggested that they had challenges scoring based on the descriptors of two rubrics (analytic and holistic). This study has pedagogical implications for scoring writing, designing rubrics, and rater training.

인터넷 환경에서 이러닝 시스템과 같은 고신뢰성의 정보를 원한다. 인터넷 시스템에서 프로그램과 데이터의 결함이 발생할 수 있기 때문에 신뢰성 분석이 매우 어렵다. 이 논문에서는 인터넷 환경에서 프로그램 신뢰성을 예측하기 위해서 유색 패트리넷 모델을 이용하는 신뢰도 예측 모델을 제안한다. 제안한 모델에 적용하는 신뢰도 분석 절차는 다음과 같다. 먼저, 인터넷 프로그램 모델을 만든다. 이를 유색 패트리넷으로 변환한 후 인터넷 시스템 모델의 신뢰도를 예측한다. 이 방법은 신뢰성 있는 인터넷 프로그램을 개발하는 데 도움을 줄 수 있고, 신뢰도 예측 방법이 매우 간단하기 때문에 적용하기 편리하다.

We want to achieve the reliable information system such as e learning system in the internet environments. The difficulty of the program reliability estimation comes from faults that occurred from program and data files are distributed among several servers. This paper is focus on a modeling approach based on Colored Petri Nets to estimate the program reliability in an internet environment. The procedure of analyzing the reliability is as follows. At first, we propose an internet program model. This model is transformed into a Colored Petri net, and the reliability is estimated. We adapt this model to the analyzing the reliability in the internet environment. This method is very simple, and is very helpful to develope program

Although extensively used, concerns have been expressed about the reliability and generalizability of grammaticality judgment tasks (GJTs; Alanazi, 2015). It has been argued that learners might guess grammaticality based on feel (Bialystock, 1979) and that the GJT-based results ignore grammatical complexity (Ellis, 1991). While several studies have attempted to validate the results of a GJT against other tasks, the tasks used in these studies required language production (e.g., Leow, 1996; Mandell, 1999), which is different from error identification and correction. The current study used an editing task (ET) to validate learners’ performance on a GJT. An editing task, like a GJT, requires identification of grammatical inaccuracies. Besides, it situates errors in a meaningful context and offers opportunities for multiple corrections of the same error. Overall, 311 participants took part in the study. A paired sample t-test showed a significant difference (t = 24.10, p = .00, d = 1.91) between the two tasks. Fifteen percent of the data (45 participants) was further inspected to have a better understanding of learners’ error correction-pattern on the editing task. The results revealed that about 20% of the errors identified were wrongly corrected, which exposes limitations of the GJTs that only require judging the well-formedness of a construction. Moreover, performance on the editing task revealed a greater level of diversity in learners’ responses. On average, eight of the total twelve grammatical features were corrected in 5.87 (SD = 2.47) different ways. The variety of responses on the ET reveals the dynamic nature of learners’ interlanguage that allows for multiple ways for correction. The ET, as compared to the GJT, provides an ecologically more valid way to assess L2 learners’ grammatical proficiency.

The usefulness of self-assessment for evaluation purposes has been controversial among language testers and teachers, pointing to the long-held psychometric concerns of its low-leveled reliability for assessment. This study aimed at exploring the possibility of enhancing the reliability of self-assessment used in a college English classroom (n=32) by diagnosing a cause of deteriorating the reliability quality of self-assessment and seeking measures to offset the negative factor for future use. In order to achieve the goals of the study, internal consistency reliabilities were obtained before and after an improvement was made in the self-assessment. Students’ feedback on the self-assessment was sought through a focus-group interview. Next, a multiple regression analysis was conducted to see if self-assessment can be a significant predictor in students’ final grades in the course. The independent variables used for this study were final exam, midterm exam, and five self-assessments. The results of the analyses are as follows: 1) from the focus-group interview on the 6th week of semester, a subjectivity problem of self-assessments was found and a new set of items in a quiz format were added for its modified version, 2) Cronbach’s α’s of self-assessments have drastically gone up from its original ones (.514-.546) to modified ones (.614-.850), and 3) four variables were included in the final model predicting students’ final grades: final exam, midterm exam, third and second self-assessments. Based on the findings, a new perspective on reliability issues in self-assessment was proposed.

Researchers interested in the relationship between working memory and interpreting tend to adopt working memory (WM) span tasks developed by psychologists as WM measurement tools. Among the most commonly used are those that consist of words and sentences such as the reading span task. The reliability of such tasks has been verified in several studies in cognitive psychology. However, no study has been found to demonstrate that reliability is maintained when the WM span tasks are administered to interpreters. This study aimed to examine and compare the reliability of reading span tasks which involve linguistic elements and that of an operation span task, a language-independent WM span task. For this purpose, student interpreters were invited to perform the WM span tasks and then the equivalent form test reliability and the test-retest reliability of the tasks were measured. The results suggest that only the operation span task is a reliable tool for testing the WM capacity of interpreters.

Traditionally, the reliability of the power distribution system is calculated by considering the failure rate of the section and the outage duration time based on the switch that separates the load section. The on/off operation of the protection facility can be considered in a more advanced manner, but it is generally assumed that the operation of the protection facility is perfect.The power distribution system switch is an opening and shutting facility that does not shut down the fault current and operates after the protection facility operates. Therefore, on/off control through communication after protective equipment operation is important.In this paper, discuss the reliability calculation of the distribution system considering the failure of communication in the power distribution system.

이 연구는 Rice와 Preusser(2002)가 개발한 아동용 적응적-부적응적 완벽주의 척도의 신뢰도와 타당도를 알아보는데 목적이 있다. 이를 위해 초등학교 4~6학년 1,071명의 아동들을 대상으 로 AMPS와 8가지 척도를 실시하여 자료를 수집한 뒤, SPSS 20.0과 AMOS 20.0을 사용하여 신 뢰도와 타당도를 분석하였다. 이 연구에서 도출한 결과를 요약하면 다음과 같다. 첫째, 탐색 적, 확인적 요인 분석 결과에서 AMPS는 3가지 하위요인으로 이루어진 요인구조가 가장 적합 한 것으로 나타났다. 둘째, 한국판 AMPS 전체 문항의 내적 합치도와 3가지 하위요인의 내적 합치도는 양호한 것으로 나타났다. 셋째, AMPS는 아동청소년 완벽주의 척도(K-CAPS)와 유의 미한 정적 상관, 완벽주의의 부적응적 하위요인인 실수 민감성은 우울, 불안, 부정적 평가에 대한 두려움, 분노표현과 정적 상관, 적응적 하위요인인 인정욕구와 강박성은 자아존중감, 자 기효능감과 유의미한 정적 상관이 있는 것으로 나타났다. 넷째, 성별과 학년에 따른 완벽주 의 점수의 평균 차이를 비교한 결과, 완벽주의 점수는 여학생이 남학생, 6학년이 4, 5학년 학 생보다 유의미하게 높은 것으로 나타났고, 실수 민감성이 높은 집단은 낮은 집단보다 우울, 불안, 부정적 평가에 대한 두려움, 분노표현, 자기자비 점수가 높은 것으로 나타났다. 마지막 으로 이 연구의 의의와 한계점을 논의하였다.

The purpose of this study was to examine reliability and validity of the Adaptive/Maladaptive Perfectionism Scale for children (AMPS) developed by Rice and Preusser(2002). We collected data on 1,071 elementary school children (grades 4~6) using eight scales to examine AMPS and validity, and used SPSS 20.0 and AMOS 20.0 to analyze collected data. The results of this study are summarized as follows. First, the results of exploratory factor analysis and confirmatory factor analysis shows that the K-AMPS was found to be most suitable for the factor consisting of three factors. Second, the internal consistency of the K-AMPS total items and the internal consistency of the three sub-factors would be indicative of good internal consistency and reliability. Third, nine validity indices used to examine AMPS’s concurrent, convergent and discriminant validity. The result shows that K-AMPS was significantly correlated to the K-CAPS. And ‘Sensitivity to Mistakes’ has a positive correlation with depression, anxiety, fear of negative evaluation, and anger expressions. ‘Need for Admiration’, ‘Compulsiveness’ have a significant positive correlation with self-esteem and self-efficiency. Fourth, we analyzed difference of perfectionism tendency depends on gender, grade and average between measures depends on perfectionism subfactor score. The result shows that perfectionist score is higher for girls than for boys and higher for sixth graders than for fourth and fifth graders. Group with high ‘Sensitivity to Mistakes’ revealed higher score on depression, anxiety, fear of negative evaluation, anger expression and self-compassion than group with low ‘Sensitivity to Mistakes’. In contrast, group with high ‘Compulsiveness’ revealed higher score on self-esteem. Finally, this study discusses the limitation and direction of future research.

Hofmann, Carpenter와 Curtiss(2016)에 의해 개발된 ‘대인관계적 정서조절 질문지(Interpersonal Emotion Regulation Questionnaire, IERQ)’를 우리나라 말로 번역하고 한국인에게 고유한 문항을 추가한 후, 대학생 표 본을 대상으로 심리측정적 속성들을 확인하고자 세 가지 연구를 수행하였다. 우선, 예비연구에서는 한국인 대학생 표본(n=36)을 대상으로 우리나라 사람들의 대인관계적 정서조절전략을 반영한 새로운 문항들을 탐 색하여 한국인들에게 고유한 문항 3개를 개발하였다. 연구 1에서는 또 다른 대학생표본(n=345)으로부터 원 판 IERQ의 문항 20개와 예비연구를 통해 개발된 3개 문항 등 총 23문항에 대한 자료를 수집하여 탐색적 요인분석을 수행하였다. 그 결과, 요인패턴과 각 문항의 변인 복잡도에 기초하여 2개 문항을 삭제함으로써 21문항을 최종 선정하였다. 21문항의 한국판 IERQ는, 원판과 동일하게, ‘긍정정서의 강화’, ‘위로’, ‘사회적 모델링’, ‘조망수용’의 4개 요인으로 구성된 것으로 나타났다. 한국판 IERQ의 네 하위척도 모두 검사-재검 사 신뢰도와, 조망수용을 제외한 세 가지 하위척도들의 내적 일치도는 양호하였다. 연구 1의 요인분석 결 과는 연구 2에서 확인적 요인분석을 통하여 나머지 다른 독립된 표본(n=216)에 의해 반복 검증되었다. 또 한 한국판 IERQ의 하위척도들의 수렴 및 변별타당도, 준거관련타당도, 그리고 증분타당도 역시 전반적으로 지지되었다. 결론적으로, 이 결과들은 한국판 IERQ가 한국인 대학생들의 대인관계적 정서조절을 측정하는 데 있어 비교적 신뢰롭고 타당한 도구임을 시사한다.

Three studies were conducted to validate the Interpersonal Emotion Regulation Questionnaire(IERQ) developed by Hofmann, Carpenter and Curtiss(2016) into Korean. Psychometric properties of the Korean version of the IERQ after adding three items unique to Koreans were examined using three samples of undergraduate students. First, in the preliminary study designed to explore new items for Koreans’ interpersonal emotion regulation strategies, three items unique to Koreans were developed with a sample of Korean undergraduate students(n=36). Thus, an initial Korean version of the IERQ consisted of 23 items, 20 items from the original IERQ and 3 items from the preliminary study. In Study 1, exploratory factor analyses (EFAs) were conducted utilizing an independent sample of undergraduate students(n=345). Based on the factor pattern and the complexity of each variable, 21 items were finally selected for the Korean version of the IERQ by deleting 2 items. Consistent with the original IERQ, the results of EFAs revealed a four-factor structure representing enhancing positive affect, soothing, perspective taking, and social modeling. The four subscales of the 21-item Korean IERQ have satisfactory test-retest reliability and its three subscales, with the exception of perspective taking, have good internal consistency. The factor structure found in Study 1 was replicated in the other independent sample of undergraduate students(n=216) using confirmatory factor analysis in Study 2. The convergent and discriminant validity, criterion-related validity, and incremental validity were generally supported. In conclusion, the Korean IERQ appears to be a reliable and valid measure of interpersonal emotion regulation among undergraduate students.

This study was aimed at investigating the reliability of ultrasonography for imaging the thickness of abdominal muscles during abdominal stabilization strategies in the supine and standing positions in young and older adults. Sixty adults, including 30 young and 30 older adults, voluntarily participated in this study. We captured the ultrasonographic image of the anterolateral wall of the trunk during rest, hollowing, and bracing strategies in the supine position at 90 knee flexion (crook-lying) and standing position. The thicknesses of the abdominal muscles, which are the external oblique, internal oblique, and transversus abdominis muscles, were measured. To analyze the reliability of the thickness of the abdominal muscles, intraclass correlation coefficient (ICC) and 95% confidential interval (CI) were calculated. The young adults group showed a high level of reliability in all abdominal muscles during rest, hollowing, and bracing strategies regardless of measuring position. The older adults group showed a high level of reliability in the external and internal oblique muscles during rest, hollowing, and bracing strategies in both the supine and standing positions. However, in the standing position, the older adults group showed a medium level of ICC value in the transversus abdominis during hollowing (ICC: 0.76, 95% CI: 0.49-0.90) and bracing strategies (ICC: 0.72, 95% CI: 0.43-0.88). Our results suggest that ultrasonography is a reliable tool for measuring the thickness of all abdominal muscles of young adults during hollowing and bracing strategies. However, the deep abdominal muscles of the older adults were affected by the measuring position on ultrasonography. Thus, when using ultrasonography during hollowing and bracing strategies, researchers should consider the subject's age and measuring positions.

Purpose: The aim of this study was to determine the reliability and accuracy of measurements in digital models(CEREC AC) compared to stone models. Methods: A master model(500B-1, Nissin Dental Product, Japan) with the prepared upper full arch tooth was used. Conventional impression and then stone model(n=10) were produced from this master model, and on the other hands, digital impressions were made with the CEREC AC intra-oral scanner(n=10). One examiner measured two times the intercanine, intermolar distance, dental arch length. The stone model were measured using a digital caliper. The t-student test for paired samples and intraclass correlation coefficient(ICC) were used for statistical analysis. Results: The measurement of two methods showed very good reliability. At the intra-examiner reliability of measurement, ICC at the stone and CEREC AC model were 0.81 and 0.94. The mean difference between measurements made directly on the stone models and those made on the CEREC AC model was 0.20~0.28 , and was statistically significant(P=0.001). Conclusion: These in vitro studies show that accuracy of the digital impression is similar to that of the conventional impression. These results will have to be confirmed in further clinical studies.

목적 : 본 연구의 목적은 주의력결핍 과잉행동장애 아동을 대상으로 놀이의 질적수준을 평가하는 놀이다움 평정척 도(Test of Playfulness: ToP)의 신뢰도를 알아보고자 한다. 연구방법 : 연구대상은 G시에 거주하는 초등학교 2학년∼3학년의 주의력결핍 과잉행동장애 아동 20명이다. 놀이다 움 평정척도의 신뢰도를 알아보기 위하여 측정자간 일치율과 Kappa계수로 제시하였고, 측정자간 신뢰도 분석은 급간내 상관계수(Intraclass Correlation Coefficient: ICC)를 사용하여 제시하였다. 결과 : 놀이다움 평정척도의 각 항목간 측정자간 일치율은 75∼95%이었다. 각 항목의 Kappa계수의 범위는 .45∼ 1.00이었다. 각 요소에 대한 측정자간 신뢰도를 급간내 상관계수로 분석한 결과 내적동기는 .96, 통제지각은 .98, 현실감 부재는 .90, 참조체계는 .98, 총점은 .99로 매우 높은 신뢰도를 보였다. 결론 : 연구결과를 통하여 주의력결핍 과잉행동장애 아동의 놀이다움 평정척도의 측정자간 신뢰도는 높은 것으로 나타났다. 이를 근거로 하여 주의력결핍 과잉행동장애 아동의 임상적인 평가의 유용성을 제공하고, 주의력결핍 과잉행동장애 아동의 놀이연구에 대한 기초자료를 제공하고자 한다.

Objective : The purpose of this study was to determine the reliability of Test of Playfulness (ToP) in Attention Deficit Hyperactivity Disorder (ADHD) children. Methods : Twenty ADHD children participated in this study. To determine inter-rater reliability, two raters was evaluated by Test of Playfulness scores and analyzed Kappa coefficient and total agreement and intraclass correlation coefficient (ICC). Results : Total agreement was the range of 75%∼95% and the Kappa coefficients was the range of. 45∼1.00. Analyzing inter-rater reliability by ICC showed very high reliability: Intrinsic motivation was .96, internal control was .98, suspension of reality was .90, framing was .98, total score was .99. Conclusion : A reliability of Test of Playflness of children with ADHD showed that high. On the basis of this study, it will provide availability for clinical evaluation of children with ADHD, and basic study on the play of children with ADHD.

The purpose of this study was to compare the reliability of various methods of normalization electromyograms (EMGs) and categorize according to the magnitude and form of muscle contraction. We searched Scopus and Pubmed database for articles that published last 15 years, using following combinations of the key words: normalization method, EMGs and reliability. To compare the reliability, we chose the articles that analyzed the intra/inter class correlation coefficient (ICC) value such as test-retest, within-days and between-days each methods. Five normalization methods were identified and presented their reliability, benefit and limitation for providing the guidelines. Maximal voluntary isometric contraction (MVIC) can be a reliable method for within-days to healthy subjects but not to patients and the elderly. Submaximal voluntary isometric contraction (Sub-VIC) showed the good reliability both of within days and between days than MVIC. However, both of MVIC and Sub-VIC may be affected by internal effects such as muscle fatigue, the presence of synergist contribution, motivation, and pathologic conditions. Reference voluntary contraction (RVC) showed moderate reliable method for patients who are unable to produce the maximal voluntary contraction and repeated tests. Isokinetic MVC showed less reliability than other normalization methods. Mean and peak dynamic method (MDM and PMD) reduce the inter-subject variability than other normalization methods. However, it does not directly reflect the ability of maximal voluntary contraction of target muscle. When designing the clinical research by using EMGs, we must consider the characteristics of subjects, tasks and target muscles for improving the reliability and validity. In addition, it is necessary to develop the new normalization method which complements the limitation of traditional methods.

본 연구는 Gilbert(2004)가 개발한 자기비판/자기공격과 자기위안형태 척도(Form of Self Criticizing/attacking and self Reassurance Scale: FSCRS)의 신뢰도 및 타당도를 검증하고자 수행하였다. 연구방법은 연구에 동의한 대학생 401명이며, 이들은 한 달 간격으로 K-FSCRS와 관련 질문지를 완성하였다. 연구결과, K-FSCRS는 탐색적 요인분석에서 총 18문항의 3요인이 추출되었으며, 이들의 설명량은 총 50.43%로 나타났다. 확인적 요인분석에서 자기비판, 자기공격, 자기위안 3요인 모델과 자기비판과 자기위안 2요인 모델을 비교한 결과, 3요인 모델이 2요인 모델보다 적합도가 다소 우수한 것으로 나타났다. 한국판 자기비판/자기공격과 위안형태 척도의 내적 신뢰도는 .66-.87로 나타났고, 검사-재검사 신뢰도는 .64-.87로 수용할만한 수준으로 나타났다. 한국판 자기비판 요인은 Blatt(1974)의 자기비판과 그리고 자기위안 요인은 Neff(2003)의 자기자비와 매우 높은 정적 상관 관계가 나타나 수렴 타당도가 검증되었다. 그 외 자기비판과 자기공격 요인은 반추, 우울, 불안, 부정 정서와는 정적 상관을 보인 반면 긍정 정서, 삶의 만족도, 자존감과는 부적 상관이 나타났다. 자기위안은 긍정 정서, 삶의 만족도, 자존감과 정적 상관을 보인 반면 자기비판, 반추, 우울, 불안, 부적 정서와 부적 상관이 나타나, 공존 타당도가 검증되었다. 또한 자기비판과 자기공격은 반추를 통제한 뒤 그리고 자기위안은 자존감을 통제한 뒤에도, 여전히 정신병리 및 정신건강 관련 변인들을 유의하게 설명하는 것으로 나타나 증분 타당도가 검증되었다. 마지막으로 한국판 자기비판/자기공격과 위안형태 척도의 임상적 활용과 미래 연구 방향에 대해 논의하였다.

The purpose of this study was to translate Gibert(2004)’s FSCRS and to examine the reliability and validity of the Korean Forms of Self-Criticism/attacking and self-Reassuring Scale. Four hundred and one university students who agreed to take part in this study completed the K-FSCRS along with psychological variables in a one month interval. As a result of a exploratory factor analyse showed that three factor structure accounted for 50.43% of the variance on the K-FSCRS including 18 items. Confirmatory factor analysis demonstrated a satisfactory construct validity for three factor model contrast to two factor model by showing good factor loadings of the K-FSCRS. The internal consistency for the K- FSCRS was .66-.87 and the test-retest reliability for it was also high .64-.87 as acceptability. Self criticism/attacking were significantly correlated with Blatt(1974)'s the self-criticism, and self reassuring were significantly correlated with Neff(2003)’s the self compassion, which supported the convergent validity. In concurrent validity supported that self criticism/attacking were positive correlated with reflection, depression, anxiety, negative affect, and it was negative correlated with life satisfaction and self-esteem. Self reassuring was significantly correlated with life satisfaction and self-esteem, and it was negative correlated with other variables. Self criticism/attacking maintained a strong association with psychopathology even after controlling for self-criticism and self reassuring maintained a strong association with mental health even after controlling for self esteem, which supported incremental validity. The this findings suggest that the K-FSCRS is a reliable and valid instrument to assess self criticism and self reassuring. Finally, limitations of the current study, and future directions for this research are discussed.

최근 극심함 교통혼잡 및 유류비 상승으로 인해 대중교통(특히 버스)의 역할이 더욱 크게 부각되고 있으나, 일부 황금노선을 제외한 대부분의 버스노선이 지속적인 이용수요감소, 수입감소, 경영수지악화, 서비스질 저하, 이용자감소의 악순환을 끊기 위해 버스의 공공성 강화의 한 방편인 준공영제(관리는 공공, 운영은 민영)를 도입하였으나, 당초 민간의 효율성을 제고하고자 했던 의도와는 다르게 운수회사의 자발적인 운행관리가 이루어지지 않는 등 부작용을 해결하기 위한 공공부분의 운행관리가 매우 중요한 요소가 되었다. 본 연구에서는 준공영제 하에서, APTS 자료를 활용하여 민간 운수회사의 평가관리가 가능하고, 시민이 피부로 느낄 수 있는 버스신뢰성 제고를 위해 서울시에서 관리중인 운행관리항목의 종류와 분석방법론, 운행관리결과, 문제점 및 향후 대책에 대하여 고찰하였으며, 이러한 연구내용이 이미 준공영제를 도입하였거나, 도입을 준비하고 있는 타 시도의 운행관리정책에 기여할 수 있을 것이다.

Recently, the roll of bus transit is critical more than before because of the dramatical increase in congestions and oil prices, but bus companies seriously encounter into vicious circle situation such as decrease in passenger demand, income reduction, and revenue deterioration. To tackle this, major metropolitan cities, Seoul, Busan, DaeGu, etc. have introduced a semi-public system to reinforce public function of bus. However, it was resulted in side effects that the main board of bus company did not control theirselves voluntarily, and the management and control of public sectors on bus become very important elements. In this research, the types, limitations, and development of operation-management items, and a methodology for analysis, and changes in those trends are addressed under semi-public system using APTS data. Conclusively, this study could be one of the useful application results and alternatives for the operation-management policy of bus transit-related agencies.

This study attempts to explore the reliability of the English poetry assessment and students’ perceptions of the assessment. The study has two research questions. First, does the English poetry assessment yield acceptable psychometric reliability? Second, how do learners who conducted self- and peer-rating perceive the English poetry assessment? Forty-nine university students wrote their own poems, conducted self- and peer-assessment with a given rubric, and responded to a questionnaire which measured whether they had self-confidence in the accuracy of their rating and how they viewed creativity assessment in English poetry. For research question 1, the researcher conducted FACETS analyses and found that inter-rater differences among self, peer, and expert rater were not so notable, which led to a decent degree of reliability. Four sub-areas (task observance, metaphor use, organization, creative language use) except accuracy were judged as fitting areas. For research question 2, the researcher found that students had relatively low confidence in their ratings of the poetry assessment. Students considered creative language use, metaphor use, poetic imagery and its acceptability to readers, innovative approach to the poetic theme in assessing creativity in English poetry.

본 연구에서는 기존에 소프트웨어 품질 평가를 위해서 사용되었던 ISO/IEC 9126-2와의 차이점을 비교하기 위해서 소프트웨어 품질 평가를 위해서 새롭게 제시된 ISO/IEC 25023의 소프트웨어 품질 측정 메트릭을 제시하고 제시된 메트릭에 대해서 품질을 측정하는 방안을 제시한다. ISO/IEC 25023에 제시된 8가지 품질 특성 중에서 신뢰성에 대한 품질 측정 방안 을 소프트웨어 신뢰성 성장 모델을 기반으로 평가하는 방안을 제시한다. ISO/IEC 25023을 기반으로 소프트웨어 품질을 평 가하게 되어지면 신뢰성에 대한 평가에 있어 다소 리스크가 있을 수 있음을 데이터를 기반으로 하여 입증한다.

In this paper, we propose a software quality measurement metrics of ISO / IEC 25023, which is newly proposed for software quality evaluation, to compare the difference with ISO / IEC 9126-2 which was used for software quality evaluation. In this paper, we propose a method for evaluating the quality of reliability based on the software reliability growth model among the eight quality characteristics presented in ISO / IEC 25023. Based on ISO / IEC 25023, software-quality evaluations demonstrate that there is some risk in evaluating reliability when based on data.

The grammaticality judgment test is a research instrument frequently used in second language acquisition studies. However, a number of studies raised an issue with grammaticality judgment data. Given that doubts exist regarding the reliability and validity of grammaticality judgments, the present study investigated grammaticality judgment data employed in a project done by the researcher. The examination was done following the suggestions previous studies proposed. The results of the data analyses showed that the grammaticality judgment tests were not found to manifest a high level of reliability. Fairly high internal consistency reliability suggested that they measured a single general trait. The response pattern analyses, however, indicated some doubts about the extent to which grammaticality judgment data represent learners’ grammatical knowledge. Finally, grammaticality judgment data were not validated by other measure of performance, the oral elicited imitation test. Results were discussed and limitations and suggestions for future research were provided

목적 : 본 연구는 Peabody Developmental Motor Scale 2(PDMS-2)의 국내사용을 위하여 번역연 구와 검사자간 신뢰도 및 동시타당도를 검증하는 것이다. 연구방법 : PDMS-2의 번역연구는 2명의 작업치료사가 각각 번역하여, 3명의 작업치료학과 교수 를 통해 번역 내용타당도를 검증하였다. 그 후 임상 작업치료사 5명을 대상으로 내용이해도 검 증을 받아 수정보완 후 한글판 PDMS-2를 제시 하였다. 일반 아동 50명을 대상으로 검사자간 신뢰도는 두 작업치료사가 한글판 PDMS-2를 각각 평가하여 검사자간 신뢰도를 측정하였고, 동시타당도는 한글판 PDMS-2와 한국판 Bruininks-Oseretsky Test of Motor Proficiency- 2(BOT-2)를 사용하여 검증하였다. 결과 : 연구결과 번역에 대한 내용일치도는 평균3.45점으로 일치하였고, 내용이해도는 평균 3.69점으 로 높은 이해도를 보였다. 검사자간 신뢰도는 급내상관계수의 범위가 .941에서 .994로 나타났다. 동시타당도는 상관계수 r값이 항목에 따라 .951-.651으로 통계적 유의미한 상관관계를 보였다. 결론 : 한글판 PDMS-2는 아동의 운동기능을 평가하는 도구로서 높은 신뢰도와 타당도를 가진 것 으로 나타났다. 한글판 PDMS-2는 아동의 운동기능 평가와 치료의 효과를 측정하는 도구로 사 용가능하며, 치료의 중재나 목표 설정과 교육 및 연구를 위해 유용하게 사용될 수 있을 것이다.

Objective : This study aims to verify the content validity and inter-rater reliability of the Korean version of the Peabody Developmental Motor Scale 2 (PDMS-2) and to identify the concurrent validity by comparing it with the Korean version of the Bruininks-Oseretsky Test of Motor Proficiency-2 (BOT-2). Methods : PDMS-2 was translated by the researcher and an eighth-year clinical occupational therapist. The content consistency of the Korean version of the PDMS-2 was verified by three professors with experience using it. After the verification of the content consistency of the PDMS-2 by the five clinical occupational therapists and the additional revision, the Korean version of the PDMS-2 was completed. The researcher and another occupational therapist evaluated the Korean version of PDMS-2 in 50 children and measured the inter-rater reliability. Concurrent validity was measured by comparing the results of the Korean version of PDMS-2 and Korean version of BOT-2. Results : The content consistency test showed overall agreement of mean 3.45, and the content understanding test showed a high level of understanding of mean 3.69. The inter-rater reliability and concurrent validity of the Korean version of the PDMS-2 showed a statistically significant correlation. Conclusion : The Korean version of the PDMS-2 showed high content understanding, reliability, and validity. It can assist clinicians and researchers who work in fields related to child treatment or development.