Earticle

In generally, the resolution of reconstructed three-dimensional images can be seriously degraded by undesired occlusions in the integral imaging system, because the undesired information of the occlusion overlap the three-dimensional images to be reconstructed. To solve the problem of the undesired occlusion, we present an exemplar-based image restoration method in integral imaging system. In the proposed method, a minimum spanning tree-based stereo matching method is used to remove the region of undesired occlusions in each elemental image. After that, the removed occlusion region of each elemental images are re-established by using the exemplar-based image restoration method. For further improve the performance of the image restoration, the structure tensor is used to solve the filling error cause by discontinuous structures. Finally, the resolution enhanced three-dimensional images are reconstructed by using the restored elemental images. The preliminary experiments are presented to demonstrate the feasibility of the proposed method.

영상 인페인팅(image inpainting)은 영상에서 훼손된 부분을 복원하거나 영상 내의 불필요한 문자나 특정 물체를 제거한 후 삭제된 영역을 자연스럽게 채우기 위해 널리 사용되는 기법이다. 예제기반 인페인팅은 비어있는 영역에서 어떤 부분부터 채울 것인지를 결정하는 패치 우선순위 결정과 결정된 패치를 어떤 패치로 채울 것인지 결정하는 패치탐색의 두 부분으로 구성되어 있다. 기존 예제기반 인페인팅에서는 패치 내의 알고 있는 영역의 화소 값만을 이용하여 유사패치를 탐색한다. 이는 패치의 일부분만 이용하여 비교하게 되므로 비교 대상이 아닌 영역에 상관성이 없는 화소 값을 갖는 패치가 선택될 수 있다. 이를 개선하기 위해 본 논문에서는 패치외삽을 이용한 예제기반 인페인팅 방식을 제안한다. 제안 방식은 우선순위가 결정된 패치에 대해 패치 내 이미 알고 있는 영역의 화소 값을 이용하여 패치 내 비어있는 영역의 화소 값을 외삽 방식으로 예측치를 구하여 채운 후 유사 패치를 탐색한다. 실험 결과를 통해 제안방식이 기존 예제기반 인페인팅 방식에 비해 자연스러운 결과 영상을 얻을 수 있음을 보여준다.

Image inpainting is the widely used technique to restore a damaged region or to fill a hole in an image. The exemplar-based technique effectively generates new texture by copying colour values of the most correlated patch in the source into the empty region of the current patch. In traditional exemplar-based synthesis, the patch correlation is computed using only the already filled pixels of the current patch. Thus, by ignoring the correlation between the hole regions of the two patches, an undesirable patch which is highly correlated with the current patch in the already filled area but considerably dissimilar in the area to be filled can be selected, which results in bad texture propagation. To avoid such problems, a new exemplar-based inpainting method using patch extrapolation is proposed. The empty part of the current patch is extrapolated beforehand, and then the complete patch is used for finding its exemplar. Experimental results show that the proposed method provides more natural synthesis results than the conventional ones.

An exemplar based inpainting method on a projection framework is presented. A ker- nel based projection is adopted to detect dominant gradient in the neighbor regions of the restoration target. The priority function which determines the patching order is redened based on the projection framework. In addition, considering the observation that similar patches are usually found near the reference points, a distance based weighting is added to the similarity metric between two patches. It reduces the artifact eects caused by exhaus- tive patch searching. It improves the plausibility of the restoration especially when global structures are involved in the target region. The experimental results show that the proposed method enhances the plausibility of restored regions, especially when global structures are overlaid on the target region.

Exemplar-based image inpainting method is widely used for recovering the missing regions, especially when the missing regions are large. The method fills in the target region patch by patch, and a target patch is compared to each candidate patch in whole image to get a best one. In this paper we propose a method to speed up the best candidate searching process. Inspired by the fact that the patches near to a target patch are more likely to be the best candidate than the farther ones, the similarity measure is modified to cooperate with the distance weighting and bounded search is adopted. It has been shown by experiments that the proposed method greatly reduces the number of pixel error computations.

We propose a novel image inpainting approach in which the exemplar and the sparse representation are combined together skillfully. In the process of image inpainting, often there will be such a situation: although the sum of squared differences (SSD) of exemplar patch is the smallest among all the candidate patches, there may be a noticeable visual discontinuity in the recovered image when using the exemplar patch to replace the target patch. In this case, we cleverly use the sparse representation of image over a redundant dictionary to recover the target patch, instead of using the exemplar patch to replace it, so that we can promptly prevent the occurrence and accumulation of errors, and obtain satisfied results. Experiments on a number of real and synthetic images demonstrate the effectiveness of proposed algorithm, and the recovered images can better meet the requirements of human vision.

The purpose of this paper is three-fold: 1) to suggest a way to effectively teach movie expressions in the EFL classroom; 2) to explain why movie expressions should be taught; and 3) to show how to select the expressions. Two concepts were imported: exemplar-based sequences and the idea of a speech community. In usage-based linguistics, actual expressions (exemplars) are a starting point for language acquisition. Such expressions should be used in a speech community. In this paper, a movie was regarded as a type of speech community. The American superhero film, Push (McGuigan, 2009), was selected. This paper shows how EFL teachers can conceive of Push as a speech community. All members of the Push community had psychic abilities. Expressions were grouped according to these psychic aspects. This process is believed to create a community of psychics. After the grouping activities were done, each expression serves as a reminder of the psychic world. This paper also shows that language development can take place when EFL students learn grouped expressions. According to exemplar-based sequences, language development can move from actual expressions or exemplars to the abstract schema. We believe that EFL teachers can teach movie expressions systematically and coherently with the help of exemplar-based learning and the idea of a speech community.

This study compared metalinguistic and exemplar-based written corrective feedback (CF) for their effects on Korean university students’ grammatical accuracy improvement regarding English verb complementation errors. This study was conducted in a writing class where two types of multimedia components were used for writing instruction: mini-lessons based on PowerPoint slides and a movie. This study also investigated how learners perceived the CF they received. Fifty-two learners, divided into two groups (i.e., metalinguistic and exemplar), participated in this class for 10 weeks. A sentence completion test and a narrative writing test were administered to measure learners’ verb complementation knowledge before and after the treatment. In the treatment sessions, learners were given a mini-lesson on English verb complementation using PowerPoint slides, watched part of a Korean movie, and then wrote a summary of the given movie part. Learners received either of the two types of CF on their written errors. This treatment procedure lasted for eight weeks. The results revealed that both feedback types were beneficial. Learners in both groups significantly improved their verb complementation knowledge. Though no significant difference between both groups was found, more learners preferred exemplar-based to metalinguistic CF.

In this paper, we propose a new method for template matching, patch ratio, to inpaint unknown pixels. Before this paper, many inpainting methods used sum of squared differences(SSD) or sum of absolute differences(SAD) to calculate distance between patches and it was very useful for closest patches for the template that we want to fill in. However, those methods don't consider about geometric similarity and that causes unnatural inpainting results for human visuality. Patch ratio can cover the geometric problem and moreover computational cost is less than using SSD or SAD. It is guaranteed about finding the most similar patches by Cauchy-Schwarz inequality. For ignoring unnecessary process, we compare only selected candidates by priority calculations. Exeperimental results show that the proposed algorithm is more efficent than Criminisi's one.

We propose a partial occlusion removal method for computational integral imaging reconstruction (CIIR) based on the usage of the exemplar based inpainting technique. The proposed method is an improved version of the original linear inpainting based CIIR (LI-CIIR), which uses the inpainting technique to fill in the data missing region. The LI-CIIR shows good results for images which contain objects with smooth surfaces. However, if the object has a textured surface, the result of the LI-CIIR deteriorates, since the linear inpainting cannot recover the textured data in the data missing region well. In this work, we utilize the exemplar based inpainting to fill in the textured data in the data missing region. We call the proposed method the neighboring elemental image exemplar based inpainting (NEI-exemplar inpainting) method, since it uses sources from neighboring elemental images to fill in the data missing region. Furthermore, we also propose an automatic occluding region extraction method based on the use of the mutual constraint using depth estimation (MC-DE) and the level set based bimodal segmentation. Experimental results show the validity of the proposed system.

This study tests the hypothesis that the ambiguity of a null argument construction in Korean like Lwummeituka mwusewun ka poayo (The roommate must be scared/scary) can be prosodically resolved. The null argument construction is tested with two-place psychological predicates such as mwusewun (scared/scary) and kwichanun (bothered/bothersome). A naturalness rating experiment shows the following: (1) when the NP Lwummeituka is the experiencer of the psychological predicate scare and the sentence means ‘The roommate must be scared,’ both an Accentual Phrase (AP) boundary and an Intonational Phrase (IP) boundary are equally accepted between the NP and the VP; (2) when the NP is the stimulus (The roommate must be scary), only an AP boundary is perceived natural. Reaction time and comprehension question accuracy data further display the role played by prosody in ambiguity resolution. The results are discussed within the exemplar framework.

In this paper, a new algorithm by using 3D warping technique to effectively fill holes that are produced when creating a virtual-viewpoint image is proposed. A hole is defined as the region that cannot be seen in the reference view when a virtual view is created. In the proposed algorithm, to reduce the blurring effect that occurs on the hole region filled by conventional algorithms and to enhance the texture quality of the generated virtual view, Exemplar Based In-painting algorithm is used. The boundary noise which occurs in the initial virtual view obtained by 3D warping is also removed. After 3D warping, we estimate the relative location of the background to the holes and then pixels adjacent to the background are filled in priority to get better result by not using only adjacent object's information. Also, the temporal inconsistency between frames can be reduced by expanding the search region up to the previous frame when searching for most similar patch. The superiority of the proposed algorithm compared to the existing algorithms can be shown through the experimental results.

평면 대 평면 간 기하 변환에 기반을 두는 기존 영상처리 기술들은 구면 파노라마 영상에서의 픽셀 좌표에는 적용될 수 없다. 본 논문에서는 평면 영상을 전제로 개발된 표본 기반 영상 인페인팅 기술을 구면 파노라마 영상에 적용할 수 있는 방법을 제안한다. 구면 영상에서 위도에 따라 다른 표본을 추출하는 방법을 이용하여 평면 영상에서의 표본 기반 인페인팅을 구면 파노라마 영상에서도 동일하게 사용할 수 있도록 하는 것이 본 논문에서 제안하는 방법의 목적이다. 기존의 표본 기반 영상 인페인팅은 정사각형 표본을 그대로 사용하기 때문에 좌표계가 다른 구면 파노라마 영상에서는 사용할 수 없다. 본 논문에서는 구면 파노라마 영상의 위도에 따른 각기 다른 모양의 표본을 취득한 후 이를 정사각형으로 균일화하는 방법을 사용한다. 이후 균일화된 표본을 이용하여 표본 기반 영상 인페인팅을 수행하는 방법으로 영상을 복원한다. 실험 결과 본 논문에서 제안하는 방법은 구면 파노라마 영상에서 표본 기반 영상 인페인팅을 성공적으로 수행함을 확인하였다.

Previous image processing techniques based on plane-to-plane transformations cannot be utilized for spherical panoramic images. In this paper, we propose a new method to inpaint a spherical panoramic image using exemplar, which is deformed by the location of the patch. Our proposed method makes the deformed exemplar patch by latitude and uses it as the reference patch to restore the damaged area. The exemplar-based inpainting method is based on the planar image coordinate system and thus the classical method cannot be applied to the spherical panoramic image. The merit of our proposed method is the fact that it is not dependent on the location of the damaged area. From the experimental results, we proved that our proposed method satisfies the original purpose of the exemplar-based inpainting technique for the spherical panoramic image.

본 논문에서는 픽셀 그레디언트의 방향성 정보를 이용하여 복원하는 예제기반 인페인팅 방법을 제안한다. 제안하는 방법에서는 영상 내에서 픽셀 그레디언트의 방향성을 검출하여 강도가 높은 그레디언트를 가지는 픽셀들을 먼저 복원하는 특징을 가진다. 지역적인 그래디언트의 특성을 이용하여 복원 영역의 연결성을 높이고 에러의 파급 효과를 줄임으로써, 기존의 예제기반 인페인팅 방법보다 개선된 결과를 보여준다.

본 논문에서는 기존 인페인팅 방법에서 발생하는 탐색순서 의존성 문제와 패치 간 유사도 연산의 문제점을 해결하는 방법을 제안한다. 기존의 방법에서는 두 패치의 유사도를 판정할 때 패치 내의 일부 화소만 비교하는 특성과 탐색 방향 및 순서에 따라 인페인팅 결과가 크게 달라지는 문제점이 있었다. 본 논문에서는 부분적인 판정으로 발생하는 문제점을 해결하기 위해서 탐색 범위를 제한하고, 복원 대상 패치의 화소 값 평균과 비교대상 패치의 화소 값 평균의 차를 이용하여 유사도를 판정하도록 개선하였다. 또한, 신뢰도 항이 급격히 감소하는 급감 효과를 해결하기 위한 새로운 신뢰도 항 수식을 제안한다. 여러 개의 정지 영상에서 네 종류의 복원 실험을 진행한 결과, 손상 범위가 클수록 제안하는 방법의 결과가 기존 방법보다 원본 대비 더 작은 오차를 가짐을 확인할 수 있었다. 본 논문의 방법에서는 오차 수준이 줄어들어 시각적인 자연스러움이 증대되었다. 또한 일상생활에서 촬영한 사진에서 불필요한 물체를 제거하는 능력을 실용적인 수준으로 적용할 수 있는 가능성을 보였다.

In this paper, we propose a new method to resolve the dependency problem of search sequence and the similarity calculation problem in the Criminisi's inpainting algorithm. Previous methods have two problems: they partially compare two patches and they give different results depending on the search sequence. To solve the problem, we propose a new method that restricts the search area and compares two patches by using the difference between the mean of RGB values in the patch. We improved the problem by using the difference of pixel mean values in the similarity computation. Also, we proposed a new equation for confidence term to solve the 'dropping effect' problem. In the experimental results from our four test data sets, we verified that our method gives more similarity degree between original images and result images even when the damaged area is wider and bigger. Our method shows the potential of the image inpainting in practical use to remove unnecessary objects in pictures that captured in daily life.

본 논문에서는 가상 시점 생성 시 발생하는 홀 영역의 메움 기법에 관하여 기하학적 제약조건을 이용한 예제 기반 영상 인페인팅 기술을 제안한다. 생성된 가상 시점이 실제 카메라들의 중간에 위치하는 경우, 이 때 발생하는 홀 영역은 시점 간 보상으로 메울 수 있다. 하지만, 가상 시점이 실제 카메라들의 Field-of-View를 벗어난 경우에는 홀 영역에 대한 정보가 없기 때문에 이를 메우는데 어려운 문제가 따른다. 이러한 문제를 해결하기 위해 제안한 방법은 예제 기반의 영상 인페인팅 기술을 이용하여 홀 영역을 메운다. 제안한 방법은 홀 영역의 기하학적 특성을 제약조건으로 우선순위(Priority)를 계산한다. 최적의 패치를 찾기 위해 컬러 정보뿐만 아니라 깊이 정보(Depth)를 활용한다. 또한, 전경 물체의 텍스쳐로 인하여 잘못된 패치가 선택되는 문제를 해결하기 위해 적응적으로 패치 크기를 변경한다. 실험 결과에서 제안한 방법은 일반적인 홀 메움 방식과 비교하여 객관적 평가와 주관적 평가 모두에서 시각적으로 우수한 결과를 보여주었다.

본 논문에서는 다수의 회전 이미지를 생성, 이용해 결과의 다양성을 추구하고 기존 기법들의 문제인 예제 가장자리 경계면의 Neighborhood를 이용해 생기는 경계선을 완화한 합성 결과물을 생성하는 새 예제 기반 텍스처 합성 방법을 제안한다. 논문에서 제안하는 방법은 구현하기에 따라 공간 결정적인 형태로 구축할 수 있으며 병렬 처리가 가능한 하드웨어를 이용한 병렬 연산처리로 합성 속도 가속을 하는데도 유리한 구조를 가지고 있다.

We present a simple new idea to improve the quality of exemplar based texture synthesis using multiple rotated input exemplars. Our algorithm successfully obtain rotational synthesis feature variations and manages to reduce the artifacts in the results, especially patch seams due to the structure of the exemplars provided which have been inappropriate for previous neighborhood matching synthesis algorithms. Our algorithm is parallel in nature, thus it is possible to implement our algorithm using GPU or multi-core CPU to accelerate synthesis process.

영상 인페인팅(image inpainting)이란 입력 영상에 훼손되거나 빈 영영이 존재할 경우 이 영역을 자연스럽게 채워 영상을 복원해내는 영상처리 기법이다. 본 논문에서는 기존의 예제 기반(exemplar-based) 영상 인페인팅의 단점 중 하나인 텍스쳐 가비지(texture garbage)의 생성을 억제할 수 있는 새로운 영상 인페인팅 기법을 제시한다. 기존 기법과 달리 영상의 텍스쳐는 통계적으로 정적(stationary)이라는 가정 하에 정적인 소스 패치만을 후보 패치로 샘플링 한다. 이를 통해 주변 신호와 일치하지 않는 신호인 텍스쳐 가비지가 타겟 영역에 복사되는 것을 방지할 수 있다. 실험을 통해 제안 기법을 이용한 텍스쳐 합성이 기존 기법에 비해 더욱 자연스러운 영상 인페인팅 결과를 생성함을 확인한다.

Image inpainting is an image processing technique that restores an image by naturally filling the empty or damaged regions in an image. In this paper, we present a new image inpainting technique that can suppress the generation of texture garbage which is one of the artifacts of existing exemplar-based image inpainting. Unlike the existing technique, only the stationary source patch is sampled as the exemplar patch based on the assumption of spatial stationarity of the texture. This prevents the texture garbage, which is an inconsistent piece of texture from being copied to the target region. Experimental results show that the texture synthesis using the proposed method produces more natural inpainting results than the existing method.

본 연구는 범주화를 포함한 자극등가성 기반의 다중반응교수가 자폐스펙트럼장애 및 발달지연 아동의 파생된 언어 관계에 미치는 영향을 검증하였다. 이를 위해 참여자 간 중다프로브 설계를 적용하였으며, 연구 참여자는 만 4~6세의 자폐스펙트럼장애 및 발달지연 아동 3명이었다. 독립변인은 자극등가성 기반의 다중반응교수였으며, 5개의 자극 세트를 사용하였다. 중재는 A-B(포인팅), B-C(매칭), B-A(택트), C-B(매칭), A-C(포인팅), C-A(인트라버벌) 관계를 교차 제시하여 교수하는 방식으로 진행되었다. 종속변인은 A-B 및 B-C 관계를 직접 교수한 후, 파생된 B-A, C-B, A-C, C-A 관계에서 나타난 정반응으로 측정하였으며, 사전․사후 프로브의 수행 변화와 새로운 자극 세트에서의 관계 출현을 확인하였다. 연구 결과, 참여자 A와 B는 사전 프로브와 비교하여 사후 프로브에서 B-A, C-B, A-C, C-A 관계 모두 정반응 수가 증가하였으나, C-A 관계의 정반응 수는 다른 세 관계에 비해 상대적으로 낮게 나타났다. 참여자 C 역시 사전 프로브와 비교하여 사후 프로브에서 네 관계 모두 정반응 수가 증가하였으며, 새로운 자극 세트에서도 네 가지 파생된 언어 관계의 출현이 관찰되었다.

This study examined the effects of stimulus equivalence-based multiple exemplar instruction (MEI) including categorization on derived verbal relations in children with autism spectrum disorder and developmental delay. A multiple-probe design across participants was employed, and three children aged 4-6 years with autism spectrum disorder or developmental delay participated in the study. The independent variable was stimulus equivalence-based MEI, implemented using five stimulus sets. During the intervention, A?B (pointing), B?C (matching), B-A (tact), C-B (matching), A-C (pointing), and C-A (intraverbal) relations were taught in an interspersed sequence. The dependent variable was measured by correct responses in the derived B-A, C-B, A-C, and C-A relations following direct instruction of only the A-B and B-C relations. Changes in performance from pre- to post-probe and the emergence of these relations with a novel stimulus set were also examined. The results showed that Participants A and B demonstrated increases in the number of correct responses across all four relations-B-A, C-B, A-C, and C-A-from pre- to post-probe; however, the number of correct responses in the C-A relation was relatively lower than those in the other three relations. Participant C likewise showed increases in correct responses across all four relations from pre- to post-probe, and the emergence of all four derived verbal relations was also observed with the novel stimulus set.

본 연구에서는 최근에 새로운 학습과학의 요체인 뇌과학 기반의 인지심리학을 기저로 하는 새로운 교육과정 설계 방식에 주목하였다. 기존 피상적 학습을 극복할 수 있는 심층적 이해 중심 학습의 구현 수단으로 평가받고 있는 백워드 설계와 뇌신경과학 간의 관련성을 이론적 차원에서 문헌 분석을 통해 탐구하고, 연구 결과를 반영하여 뇌 친화적 교육과정 설계 방안을 제안하는 데 목적이 있다. 이 목적을 달성하기 위하여 본 연구에서는 뇌의 학습의 특징과 원리 및 백워드 설계의 목표, 단계, 원리를 각각 분석하였다. 이것을 토대로 하여 뇌 학습 원리와 백워드 설계의 관련성을 도출하고 이를 바탕으로 백워드 설계의 모든 단계마다 뇌 학습의 원리를 적용하여 통합 설계 원리 12가지(1단계: 3개, 2단계: 3개, 3단계: 6개)를 제안하였다. 마지막으로 이상의 결과를 기반으로 하여 통합 설계 원리를 적용하여 사회과 뇌신경과학 기반의 백워드 설계 사례를 개발하여 제시하였으며, 향후 연구 방향을 제안하였다.

This study focused on a new approach of curriculum design based on the neuroscience and cognitive psychology which has been recently emphasized as a new learning science. The purpose of this study is to explore the relationship between backward design and neuroscience. The former is highly acclaimed as a means of implementing understanding-centered learning that can overcome superficial learning, the latter is developing tool of educational design and neuroscience. As research method, this study firstly adopted literature review at the theoretical level, and secondly adopted research synthesis at practical level to propose a brain-friendly curriculum design method. The researchers analyzed the features of brain-based learning and backward design, respectively. After that, based on the relationship between the two, 12 integrated design principles (stage 1: three principles, stage 2: three principles, stage 3: six principles) were proposed by applying the principle of brain-based learning to every step of backward design. Finally, a case and exemplar of backward design based on neuroscience of social studies were developed by applying the integrated design principles.

This study explores the effect of using exemplar texts for text revision by comparing text quality and writers’ perception based on their levels of essay writing. To this end, a theoretical framework was built based on prior research on exemplar texts and text revision. This study analyzed 42 high school students’ essays and survey results, and found that revision using exemplar texts is effective in terms of improving content, organization, and overall quality of texts. Specifically, students in the low level group improved in terms of their content, organization, expression, and overall quality of texts, whereas students in the high level group improved only in terms of organization and overall quality of texts. Hence, it can be concluded that students in the low level group benefited more from revision using exemplar texts than students in the high level group. The survey on students’ perception of the effect of using exemplar texts for text revision revealed that most students considered it effective, and there was no difference in perception by students’ essay writing level. Potential implications of this on writing education are also discussed.