VisionSketch: Integrated Support for Example-Centric Programming of Image Processing Applications

'13-14 IDE NUI ACM PLDI '13 Student Research Competition Graphics Interface '14

Source code is available on GitHub! It works on both Windows and Mac OS X.


We propose an integrated development environment (IDE) called "VisionSketch", which supports example-centric programming for easily building image processing pipelines.

With VisionSketch, a programmer is first asked to select the input video. Then, he can start building the pipeline with a visual programming language that provides immediate graphical feedback for algorithms applied to the video. He can also use a text-based editor to create or edit the implementation of each algorithm.

During the development, the pipeline is always ready for execution with a video player-like interface enabling rapid iterative prototyping. In a preliminary user study, VisionSketch was positively received by five programmers, who had prior experience of writing text-based image processing programs and could successfully build interesting applications.

VisionSketch IDE

Overview of VisionSketch IDE


Prototype of VisionSketch IDE presented at PLDI '13

Overview (original version)

Example pipeline

Example use case #1: counting grinds