UW Interactive Data Lab
IDL logo

Proactive Wrangling: Mixed-Initiative End-User Programming of Data Transformation Scripts

Philip J. Guo, Sean Kandel, Joseph Hellerstein, Jeffrey Heer. ACM User Interface Software & Technology (UIST), 2011
Figure for Proactive Wrangling: Mixed-Initiative End-User Programming of Data Transformation Scripts
The Wrangler User Interface. Clockwise from the top: (a) tool bar for transform specification, (b) data table display, (c) history viewer containing an exportable transformation script, (d) suggested transforms. The effect of the selected Fold transform is previewed in the data table display using before (top) and after (bottom) views.
Materials
Abstract
Analysts regularly wrangle data into a form suitable for computational tools through a tedious process that delays more substantive analysis. While interactive tools can assist data transformation, analysts must still conceptualize the desired output state, formulate a transformation strategy, and specify complex transforms. We present a model to proactively suggest data transforms which map input data to a relational format expected by analysis tools. To guide search through the space of transforms, we propose a metric that scores tables according to type homogeneity, sparsity and the presence of delimiters. When compared to "ideal" hand-crafted transformations, our model suggests over half of the needed steps; in these cases the top-ranked suggestion is preferred 77% of the time. User study results indicate that suggestions produced by our model can assist analysts' transformation tasks, but that users do not always value proactive assistance, instead preferring to maintain the initiative. We discuss some implications of these results for mixed-initiative interfaces.
BibTeX
@inproceedings{2011-proactive-wrangling,
  title = {Proactive Wrangling: Mixed-Initiative End-User Programming of Data Transformation Scripts},
  author = {Guo, Philip AND Kandel, Sean AND Hellerstein, Joseph AND Heer, Jeffrey},
  booktitle = {ACM User Interface Software \& Technology (UIST)},
  year = {2011},
  url = {https://idl.uw.edu/papers/proactive-wrangling},
  doi = {10.1145/2047196.2047205}
}