LayoutBench Release of LayoutBench dataset from Diagnostic Benchmark and Iterative Inpainting for Layout Guided Image Generation (CVPR 2024 Workshop) See also LayoutBench COCO for zero shot evaluation on OOD layouts with real objects. [Project Page] [Paper] Authors: Jaemin Cho, Linjie Li, Zhengyuan Yang, Zhe Gan, Lijuan Wang, Mohit Bansal Summary LayoutBench is a diagnostic benchmark that examines layout guided image generation models on arbitrary, unseen layouts. LayoutBench consists of 8K images with 1K images per task: number few number many position center position boundary size tiny size large shape horizontal shape vertical . We assume that the layout to image generation models were trained on CLEVR dataset (in distribution). Then we evaluate the models on LayoutBench (out of distribution). Below we compare CLEVR and LayoutBench examples. How was it created? To disentangle spatial control from other aspects in image generation, such as generating diverse objects, LayoutBench keeps the object configurations of CLEVR whose objects have 3 shapes, 2 materials, and 8 colors (48 combinations in total), and changes the spatial layouts. Images in LayoutBench are collected in two step…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy