Visual Programming

A programming language that uses a visual representation
(such as graphics, drawings, animation or icons,
partially or completely)
A visual language manipulates visual information or supports visual interaction, or allows programming with visual expressions [Golin 90]
Any system where the user writes a program using two or more dimensions [Myers 90]
A visual language is a set of spatial arrangements of text-graphic symbols with a semantic interpretation that is used in carrying out communication actions in the world
VP Taxonomy by Burnett and Baker (1994)

Software paradigm, language level, application domain,
visual extent (icon, form, diagram,...)

Doesn't everyone agree that VP is great?

No. In fact, some well-respected people have nothing but contempt for the visual representation of software. In a very famous article [Brooks87] Fred Brooks says this:

A favorite subject for PhD dissertations in software engineering is graphical, or visual, programming - the application of computer graphics to software design.... Nothing even convincing, much less exciting, has yet emerged from such efforts. I am persuaded that nothing will.

Of course, Brooks' arguments contain several weaknesses:

He focuses on flowchart-based control-flow diagrams.
He is worried about screen size in pixels. Phil Cox has presented a strong argument why this may not be meaningful.
I think he misunderstands the power of multiple views - not superimposed views.

What about Visual Basic and Visual C++?

Visual Basic and the entire Microsoft Visual (tm) family are not, despite their names, visual programming languages. They are textual languages which use a graphical gui builder to make programming decent interfaces easier on the programmer.

What is the Deutsch Limit?

A term made up by Fred Lakin describing a comment Peter Deutsch made at a VL talk by Scott Kim and Warren Robinett about a visual machine language they had invented.

Deutsch said something like:

"Well, this is all fine and well, but the problem with visual programming languages is that you can't have more than 50 visual primitives on the screen at the same time. How are you going to write an operating system?"

This points out the obvious density advantage of text. This barrier has become known as the "Deutsch Limit," stated as:

The problem with visual programming is that you can't have more than 50 visual primitives on the screen at the same time.

This is clearly a problem with visual representations. However, it is not immediately clear to me that a similar limit does not also exist in textual languages. Visual Programming Bibliography

Visual Programming Books

Visual Programming,
Nan C. Shu,
Van Nostrand Reinhold, New York, NY. 1988
Principles of Visual Programming Systems
Shi-Kuo Chang,
Prentice Hall, Englewood Cliffs, NJ. 1990
Visual Programming Environments,
P. Ephraim,
Computer Society Press, 1990.
Volume I: Paradigms and Systems
Volume II: Applications and Issues
Watch What I Do: Programming by Demonstration,
Allen Cypher,
MIT Press, Cambridge, MA. 1993
Visual Object-Oriented Programming,
Margaret Burnett, Adele Goldberg, Ted Lewis,
Manning Publications, Greenwich, CT. 1995

Visual Programming

Visual Programming Languages

Elements

Language paradigm
Batch or Interactive
Visual representation vs. visual object
Diagrams, icons or forms
By example or demonstration?
Number of dimensions
Specific application domain
Examples: AVS, VisSim, Cantata

Visual Programming Examples

...when we teach children English, it is not our intent to teach them a pidgin language, but to gradually reveal the whole thing: the language that Jefferson and Russell wrote in, and with a few style shifts, the language that Shakespeare wrote in...We want learners of English to be able to aspire to the full range of expression the language makes possible. In Computer terms, the range of aspiration should extend at least to the kinds of applications purchased from professionals. By comparison, systems like Hypercard offer no more than a pidgin version of what is possible on the Macintosh.

- Alan Kay from the foreword to
Watch What I Do: Programming by Demonstration

Early Systems: 1966-1980

Graphical Program Editor
Ambit	Grail
AutoProgrammer	Query by Example
Plan2D	Pygmalion
Tinker	Outline

Visual Systems: 1981-1990

ML-like VL	Prograph
Pict	Programming by Rehearsal
Formal	GAL
SmallStar	PIGS
HI-Visual	LanView
PC-Tiles	Show and Tell
ThingLab	Tinker Toy
ARK	C^2
Fabrik	SunPICT
Miro	NoPumpG
Novis	Chimera

Modern Systems: 1991-1995

Cube	Forms/3
Cantata	AVS
Hence 1.4	Mondrian
SchemePaint	ChemTrains
CODE 2.0	HyperPascal
Iconicode	Vampire
Viasvis	VIPR
MViews	SPE
Starlogo	Escalante
PhonePro	WinPict
Agentsheets	Self
VisSim

Hypercard, Visual Basic or Visual C++
are NOT Visual Languages

Early Work

Pygmalion, David Canfield Smith, 1975

is built on top of Smalltalk
uses a freeform workspace, similar to a whiteboard
flow of control is specified by choosing elements
from a menu
the user demonstrates how the program works
Main problem: scalability

Visual Systems

GAL, Albizuri and Romero, 1984
- Structured flow diagram
- Uses Nassi-Shneiderman flowcharts
- Uses two dimensions to compress the logical structure of a program
- Is compiled into Pascal
Prograph, Pietryzchowski 1983
- is one of the few (general purpose)
  commercial systems
- uses a data-flow functional model of computation
- elements: definition frame, operation box, wires
- forces the programmer to use modularity
Pict, Glinert 1984
- Uses icons that represent data structures
- Algorithms are drawn in two dimensions
- Emphasis in the use of color
- Only numbers and messages are textual
Hi-Visual, Ichikawa et al, 1986
- Icon based
- data, primitive operations, output panels, programs, control flow and comands
- Two iteration icons:
  "counter loop" and "condition loop"
The Alternate Reality Kit, Randy Smith, 1987
- is built on top of Smalltalk
- allows users to directly manipulate objects
- a menu of classes and methods is available
- to invoke a method drag and drop is used
  A visionary work done at Xerox PARC
Chimera, David Kurlander, 1990
- uses "example-based graphical editing."
- allows editing operations on graphics
- has a graphical search and replace feature
- has "editable graphical histories" or storyboards
- cleverly combines multiple actions into single, logical events
- each frame conveys information in useful and concise ways

Modern Systems

VIPR, W. Citrin, M. Doherty, B. Zorn, 1993
- Images used are not simply a representation of a textual language, but themselves are used to produce executable code
- Programs are represented by a series of nested rings
- local variables and parameters are represented textually in specific positions
- Problems: it is better than just text?
Starlogo, Mitch Resnick
- Logo language derivative designed to explore distributed systems
- Many turtles travel in a square grid
- The user gives commands to the turtles (movement, color, interactions)
Agentsheets, Alex Repenning
- Domain-oriented environment with agents in a grid of cells
- Each agent has a set of icons which describe a state
- Agents accept user input or messages from other agents
- Agents know about position and orientation
Self, SUN Labs
- general purpose OO programming language and environment
- uses a prototype/delegation model of programming
- each object has a single visual representation as a program element
- uses a workplace where many visual representations live together
- it supports live editing

Taxonomy of Visual Languages and Bibliography

Authors are encouraged to contribute bibiography entries for their own papers. Submissions should be e-mailed to Margaret Burnett at Oregon State University (burnett@cs.orst.edu) with the phrase "VPL Classification" in the subject header. A more detailed explanation of the classification scheme is available in the technical report, which, if you are using Mosaic, can be downloaded in PostScript form by selecting "Load to local disk" from the "Options" menu and clicking here. The tech report is also available via anonymous FTP at ftp.cs.orst.edu in the pub/burnett directory under the filename of VPLclassification.tr.ps.

VPL: Visual Programming Languages

VPL-I. Environments and Tools for VPLs
VPL-II. Language Classifications
- A. Paradigms
- B. Visual Representations
VPL-III. Language Features
VPL-IV. Language Implementation Issues
- A. Computational approaches (e.g. demand-driven, data-driven)
- B. Efficiency
- C. Parsing
- D. Translators (interpreters and compilers)
VPL-V. Language Purpose
VPL-VI. Theory of VPLs
- A. Formal definition of VPLs
- B. Icon theory
- C. Language Design issues
  1. Cognitive and user-interface design issues (e.g. usability studies, graphical perception)
  2. Effective use of screen real estate
  3. Liveness
  4. Scope
  5. Type checking and type theory
  6. Visual representation issues (e.g. static representation, animation)

Acknowledgments
Related Information

VPL: VISUAL PROGRAMMING LANGUAGES

Burnett, Margaret M. and Marla J. Baker, A Classification System for Visual Programming Languages, Journal of Visual Languages and Computing, 287-300, September 1994.
Keywords and Phrases: VPL: Visual Programming Languages

Burnett, Margaret, Richard Hossli, Timothy Pulliam, Brian VanVoorst, and Xiaoyang Yang, Toward Visual Programming Languages for Steering in Scientific Visualization: a Taxonomy, IEEE Computational Science & Engineering, 44-62, Winter 1994.
Keywords and Phrases: VPL: Visual Programming Languages, VPL-V.D: Scientific visualization languages

VPL-I: Environments and Tools for VPLs

Nagl M., Andreas Schuerr, A Specification Environment for Graph Grammars, Proc. 4th Int. Workshop on Graph-Grammars and Their Application to Computer Science, LNCS 532, Springer Verlag, 599-609, 1991.
Keywords and Phrases: VPL-I: Environments and Tools for VPLs

Schuerr, Andreas, PROGRES, A Visual Language and Environment for Programming with Graph Rewrite Systems, Technical Report AIB 94-11, RWTH Aachen, Germany, 1994.
Keywords and Phrases: VPL-I: Environments and Tools for VPLs

VPL-II: Language Classifications

Boursier, P. and M. Mainguenaud, Spatial Query Languages : Extended SQL vs. Visual Languages vs. Hypermaps, 5th International Symposium on Spatial Data Handling, Charleston, USA, August 3-7, 1992.
Keywords and Phrases: VPL-II: Language Classifications

VPL-II.A: Paradigms

VPL-II.A.1: Concurrent languages

Glinert, Ephraim P. and Charles D. Norton, Novis: A Visual Laboratory for Exploring the Design of Processor Arrays, Journal of Visual Languages and Computing, Vol. 3, Number 2, 135-159, June 1992.
Keywords and Phrases: Novis, VPL-II.A.1: Concurrent languages, VPL-II.B.2: Iconic languages, VPL-IV.A: Computational approaches, VPL-VI.C.6: Visual representation issues

Norton, Charles D. and Ephraim P. Glinert, A Visual Environment for Designing and Simulating Execution of Processor Arrays, 1990 IEEE Workshop on Visual Languages, Skokie, Illinois, 227-232, October 1990.
Keywords and Phrases: Novis, VPL-II.A.1: Concurrent languages, VPL-II.B.2: Iconic languages, VPL-IV.A: Computational approaches, VPL-VI.C.6: Visual representation issues

VPL-II.A.2: Constraint-based languages

M. Paltrinieri, A Visual Environment for Constraint Programming (Poster Paper), 11th IEEE International Symposium on Visual Languages, Darmstadt, Germany, September 5-9, 1995.
Keywords and Phrases: VPL-II.A.2: Constraint-based languages

VPL-II.A.3: Data-flow languages

Harvey, N. and J. Morris, NL: A General Purpose Visual Dataflow Language, Technical Report, University of Tasmania, October 1993.
Keywords and Phrases: VPL-II.A.3: Data-flow languages, VPL-V.A: General-purpose languages

Koelma, D., R. van Balen, and A. Smeulders, SCIL-VP: a multi-purpose visual programming environment, Proceedings of the 1992 ACM/SIGAPP Symposium on Applied Computing, 1188-1198, 1992.
Keywords and Phrases: VPL-II.A.3: Data-flow languages, VPL-III.A.2: Procedural abstraction, VPL-VI.C.4: Scope

VPL-II.A.4: Form-based and spreadsheet-based languages

Ambler, Allen L. and Margaret M. Burnett, Visual Languages and the Conflict Between Single Assignment and Iteration, 1989 IEEE Workshop on Visual Languages, Rome, Italy, 138-143, Oct. 1989.
Keywords and Phrases: Forms/2, VPL-II.A.4: Form-based and spreadsheet-based languages, VPL-III.B: Control flow

Ambler, Allen L. and Margaret M. Burnett, Visual Forms of Iteration that Preserve Single Assignment, Journal of Visual Languages and Computing, 1(2), Academic Press, June 1990.
Keywords and Phrases: Forms/2, VPL-II.A.4: Form-based and spreadsheet-based languages, VPL-III.B: Control flow

Burnett, Margaret M. and Allen L. Ambler, Generalizing Event Detection and Response in Visual Programming Languages, 1992 Proceedings of Advanced Visual Interfaces International Workshop, Rome, Italy, May 27-29, 1992.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages, VPL-III.A: Abstraction, VPL-III.E: Event handling

Burnett, Margaret M. and Allen L. Ambler, A Declarative Approach to Event-Handling in Visual Programming Languages, 1992 IEEE Workshop on Visual Languages, Seattle, WA, 34-40, Sept. 15-18, 1992.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages, VPL-III.A: Abstraction, VPL-III.E: Event handling

Burnett, Margaret M. and Allen L. Ambler, Interactive Visual Data Abstraction in a Declarative Visual Programming Language, Journal of Visual Languages and Computing, 29-60, March 1994.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages, VPL-III.A.1: Data abstraction, VPL-III.E: Event handling

Carlson, Paul and Margaret Burnett, Integrating Algorithm Animation into a Declarative Visual Programming Language (poster paper), 1995 IEEE Symposium on Visual Languages, Darmstadt, Germany, September 1995.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages

Hays, Judith G. and Margaret M. Burnett, A Guided Tour of Forms/3, Oregon State University, Dept. of Computer Science, TR 95-60-6, June 1995.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages

Pandey, Rajeev and Margaret Burnett, Is It Easier to Write Matrix Manipulation Programs Visually or Textually? An Empirical Study, 1993 IEEE Symposium on Visual Languages, Bergen, Norway, August 24-27, 1993.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages, VPL-VI.C.1: Cognitive and user-interface design issues

Yang, S. and M. Burnett, From Concrete Forms to Generalized Abstractions through Perspective-Oriented Analysis of Logical Relationships, 1994 IEEE Symposium on Visual Languages, St. Louis, MO, 6-14, October 4-7, 1994.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages

van Zee, P. and M. Burnett, Exception Handling in the Visual Programming Language Forms/3, Oregon State University, Dept. of Computer Science, TR 95-60-1, March 1995.
Keywords and Phrases: Forms/3, VPL-II.A.4: Form-based and spreadsheet-based languages, VPL-III.A.F: Exception handling

VPL-II.A.5: Functional languages

Cordy, James R. and T. C. Nicholas Graham, GVL: Visual Specification of Graphical Output, Journal of Visual Languages and Computing, 3, 1992.
Keywords and Phrases: VPL-II.A.5: Functional languages, VPL-V.E: User-interface generation languages

Graham, T. C. Nicholas and Tore Urnes, Relational Views as a Model for Automatic Distributed Implementation of Multi-User Applications, Proceedings of the Fourth Conference on Computer-Supported Cooperative Work, Toronto, October 1992.
Keywords and Phrases: VPL-II.A.5: Functional languages, VPL-V.E: User-interface generation languages

Lakin, Fred, Computing with Text-Graphic Forms, Proceedings of the LISP Conference, Stanford University, August 1980.
Keywords and Phrases: computing with text-graphic forms, visual pattern manipulation language, visual lisp, VPL-II.A.5: Functional languages, VPL-V.A: General-purpose languages, VPL-IV.D: Translators (interpreters and compilers)

Standing, C. and G. Roy, A Functional, Visual Programming Interface to Geographical Information Systems, Proceedings of OZCHI, Melbourne, Australia, 209-214, Nov. 28 - Dec. 1, 1994.
Keywords and Phrases: VPL-II.A.5: Functional languages

Standing, C. and G. Roy, The Integration of Functional and Visual Programming for the Development of a Knowledge Based Interface, Proceedings of the IFIP 2.6 International Conference on Visual Database Systems (VDB-3), Lausanne, Switzerland, 287-298, March 27-29, 1995.
Keywords and Phrases: VPL-II.A.5: Functional languages

VPL-II.A.6: Imperative languages

Schuerr, Andreas, Introduction to PROGRES, an Attribute Graph Grammar Based Specification Language, Proc. WG'89 Workshop on Graphtheoretic Concepts in Computer Science, LNCS 411, (Nagl M., ed.), Springer Verlag, 151-165, 1989.
Keywords and Phrases: VPL-II.A.6: Imperative languages, VPL-II.A.8: Multi-paradigm languages, VPL-II.A.11: Rule-based languages, VPL-II.B.1: Diagrammatic languages

Schuerr, Andreas, PROGRES: A VHL-Language Based on Graph Grammars, Proc. 4th Int. Workshop on Graph-Grammars and Their Application to Computer Science, LNCS 532, Springer Verlag, 641-659, 1991. also: Technical Report AIB 90-16, RWTH Aachen, Germany, 1990.
Keywords and Phrases: VPL-II.A.6: Imperative languages, VPL-II.A.8: Multi-paradigm languages, VPL-II.A.11: Rule-based languages, VPL-II.B.1: Diagrammatic languages

Schuerr, Andreas, Rapid Programming with Graph Rewrite Rules, USENIX Symposium Proc. on Very High Level Languages (VHLL), USENIX Association, 83-100, 1994.
Keywords and Phrases: VPL-II.A.6: Imperative languages, VPL-II.A.8: Multi-paradigm languages, VPL-II.A.11: Rule-based languages, VPL-II.B.1: Diagrammatic languages

Schuerr, Andreas, A. Zuendorf, Nondeterministic Control Structures for Graph Rewriting Systems, Proc. WG'91 Workshop in Graph-theoretic Concepts in Computer Science, LNCS 570, Springer Verlag, 48-62, 1991. also: Technical Report AIB 91-17, RWTH Aachen, Germany, 1991.
Keywords and Phrases: VPL-II.A.6: Imperative languages, VPL-II.A.8: Multi-paradigm languages, VPL-II.A.11: Rule-based languages, VPL-II.B.1: Diagrammatic languages

VPL-II.A.7: Logic languages

Lakin, Fred, Visual Grammars for Visual Languages, Proceedings of the American Association for Artificial Intelligence, Seattle, Washington, July 1987.
Keywords and Phrases: visual grammar notation, declarative programming, visual rules, formal visual languages, informal conversational graphics, visual lisp, visual emacs, vmacs, VPL-IV.C: Parsing, VPL-VI.A: Formal definition of VPLs, VPL-II.A.7: Logic languages

Meyer, Bernd, Beyond Icons: Towards New Metaphors for Visual Query Languages for Spatial Information Systems, Proceedings of the International Workshop on Interfaces to Database Systems, Glasgow, 113-135, July 1992. (published by Springer, London, 1993).
Keywords and Phrases: VPL-II.A.7: Logic languages, VPL-II.B.1: Diagrammatic languages, VPL-V.B: Database languages

Meyer, Bernd, Pictures Depicting Pictures - On the Specification of Visual Languages by Visual Grammars, Proceedings of the IEEE Workshop on Visual Languages, Seattle, WA, 41-48, 1992.
Keywords and Phrases: VPL-II.A.7: Logic languages, VPL-IV.C: Parsing, VPL-VI.A: Formal definition of VPLs

Meyer, Bernd, Beyond Icons: Towards New Metaphors for Visual Query Languages for Spatial Information Systems, Computer Science Research Report No. 127, (Informatik Bericht Nr. 127), University of Hagen, Germany, 1992.
Keywords and Phrases: VPL-II.A.7: Logic languages, VPL-IV.C: Parsing, VPL-VI.A: Formal definition of VPLs

Meyer, Bernd, Deklarative Spezifikation visueller Sprachen durch graphische Beispiele oder: Ein Bild sagt mehr als tausend Formeln, 23. GI Jahrestagung, (Horst Reichel, ed.), (in German), Dresden, Germany, Springer Verlag, Berlin, 316-321, October 1993.
Keywords and Phrases: VPL-II.A.7: Logic languages, VPL-IV.C: Parsing, VPL-VI.A: Formal definition of VPLs

Meyer, Bernd, Logic and the Structure of Space Towards a Visual Logic for Spatial Reasoning, Proceedings of the International Logic Programming Symposium, Vancouver, Canada, October 1993, (to appear). (published by MIT Press, 1993).
Keywords and Phrases: VPL-II.A.7: Logic languages, VPL-IV.C: Parsing, VPL-VI.A: Formal definition of VPLs

VPL-II.A.8: Multi-paradigm languages

VPL-II.A.9: Object oriented languages

Burnett, M., A. Goldberg, and T. Lewis (editors), Visual Object-Oriented Programming: Concepts and Environments, Prentice-Hall/Manning, 1995.
Keywords and Phrases: VPL-II.A.9: Object oriented languages

VPL-II.A.10: Programming-by-demonstration languages

Calcinelli, D. and M. Mainguenaud, The Management of the Ambiguities in a Graphical Query Language for Geographical Information Systems, 2nd Symposium on Large Spatial Databases, Lecture Notes in Computer Science no. 525, Zurich, Switzerland, August 28-30, 1991.
Keywords and Phrases: VPL-II.A.10: Programming-by-demonstration languages

Calcinelli, D. and M. Mainguenaud, Cigales : A Visual Query Language for Geographical Information System : The User Interface, Journal of Visual Languages and Computing, Academic press, (to appear).
Keywords and Phrases: VPL-II.A.10: Programming-by-demonstration languages

Mainguenaud, M., GEOG: Geographical Queries Using Graphs, Advanced Database System Symposium, Kyoto, Japan, December 7-8, 1989. (published by Information Processing Society of Japan, 1989).
Keywords and Phrases: VPL-II.A.10: Programming-by-demonstration languages

Mainguenaud, M. and M. A. Portier, CIGALES : A Graphical Query Language for Geographical Information Systems, 4th International Symposium on Spatial Data Handling, Zurich, Switzerland, July 22-28, 1990.
Keywords and Phrases: VPL-II.A.10: Programming-by-demonstration languages

VPL-II.A.11: Rule-based languages

Bell, B., Using Programming Walkthroughs to Design a Visual Language, Ph.D. Thesis, Tech. Report CU-CS-581-92, University of Colorado, February 1992.
Keywords and Phrases: VPL-II.A.11: Rule-based languages, VPL-VI.C.1: Cognitive and user-interface design issues

Bell, B., W. Citrin, Specifying Network Communication Protocols with Graphical Transformation Rules. Proceedings of the International Workshop on Advanced Visual Interfaces, Rome, Italy, May 1992.
Keywords and Phrases: VPL-II.A.11: Rule-based languages

Bell, B., C. Lewis, ChemTrains: A Language for Creating Behaving Pictures. Proceedings of the IEEE Symposium on Visual Languages, Bergen, Norway, 281-289, August 1993.
Keywords and Phrases: VPL-II.A.11: Rule-based languages

Bell, B., J. Rieman, C. Lewis, Usability Testing of a Graphical Programming System: Things we missed in a programming walkthrough. Proceedings of CHI'91, New Orleans, 7-13, April 1991.
Keywords and Phrases: VPL-II.A.11: Rule-based languages, VPL-VI.C.1: Cognitive and user-interface design issues

Gindling, J., A. Ioannidou, J. Loh, O. Lokkebo and A. Repenning, LEGOsheets: A Rule-Based Programming, Simulation and Manipulation Environment for the LEGO Programmable Brick, Proceedings of IEEE Symposium on Visual Languages, Darmstadt, Germany, September 1995.
Keywords and Phrases: VPL-II.A.11: Rule-based languages

Repenning, A., Bending the Rules: Steps toward Semantically enriched Graphical Rewrite Rules, Proceedings of IEEE Symposium on Visual Languages, Darmstadt, Germany, September 1995.
Keywords and Phrases: VPL-II.A.11: Rule-based languages

VPL-II.B: Visual representations

VPL-II.B.1: Diagrammatic languages

Lakin, Fred, Visual Languages for Cooperation, NSF workshop on Technology and Cooperative Work, Tucson, Arizona, February 1988; reprinted as a chapter in Intellectual Teamwork: Social and Technical Bases of Collaborative Work, (Carmen Egido, Jolene Galegher, and Robert Kraut, eds.), Lawrence Erlbaum Publishers, 453-488, 1990.
Keywords and Phrases: text-graphic query, visual languages for collaborative work, task structure diagrams, visual lisp, visual emacs, vmacs, VPL-II.B.1: Diagrammatic languages, VPL-V.B: Database languages

Papantonakis, Anthony, Peter J.H. King, Gql, a Declarative Graphical Query Language Based on the Functional Data Model, Proceedings of the Workshop on Advanced Visual Interfaces AVI 1994, Bari Italy, (T.Catarci,M. Costabile, S. Levialdi, G. Santucci, eds.), ACM Press, 113-122, 1994.
Keywords and Phrases: VPL-II.B.1: Diagrammatic languages, VPL-V.B: Database languages

Papantonakis, Anthony, Peter J.H. King, Syntax and Semantics of Gql, a Graphical Query Language, Journal of Visual Languages and Computing, Special issue on Visual Query Systems, March 1995 (to appear).
Keywords and Phrases: VPL-II.B.1: Diagrammatic languages, VPL-IV.D: Translators, VPL-V.B: Database languages, VPL-VI.A: Formal definition of VPLs

VPL-II.B.2: Iconic languages

VPL.II.B.3: Languages based on static pictorial sequences

Chang, S. K., M. F. Costabile and S. Levialdi, A Framework for Intelligent Visual Interface Design for Database Systems, International Workshop on Interfaces to Database Systems, IDS92, Glasgow, 377-391, 1992. (published by Springer-Verlag, Heidelberg, 1992).
Keywords and Phrases: User model features, user classification, VPL-II.B.3: Languages based on static pictorial sequences, VPL-VI.C.2: Effective use of screen real estate

VPL-III: Language Features

VPL-III.A: Abstraction

VPL-III.A.1: Data abstraction

VPL-III.A.2: Procedural abstraction

VPL-III.B: Control flow

VPL-III.C: Data types and structures

VPL-III.D: Documentation

VPL-III.E Event handling

VPL-III.F: Exception handling

VPL-IV: Language Implementation Issues

VPL-IV.A: Computational approaches (e.g. demand-driven, data driven)

Jourdas, C. and M. Mainguenaud, A Query Resolution Model to Manage Networks : Application to an Extended Relational DBMS, 2nd European Geographical Information System Conference, Brussels, Belgium, April 2-5, 1991.
Keywords and Phrases: VPL-IV.A: Computational approaches

Mainguenaud, M., Is an Extended Relational DBMS Powerful Enough to Deal with Network Applications, 1st European Geographical Information System Conference, Amsterdam, The Netherlands, April 9-13, 1990.
Keywords and Phrases: VPL-IV.A: Computational approaches

Mainguenaud, M., What is Happening after the Definition of an End-user Query?, 3rd European Geographical Information System Conference, Munich, Germany, March 23-26, 1992.
Keywords and Phrases: VPL-IV.A: Computational approaches

Mainguenaud, M., The Results of Geographical Information System Queries, IEEE/CS Visual Languages '93, Bergen, Norway, August 25-27, 1993.
Keywords and Phrases: VPL-IV.A: Computational approaches

VPL-IV.B: Efficiency

Burnett, Margaret M. and Allen L. Ambler, Efficiency Issues in a Class of Visual Languages, 1990 IEEE Workshop on Visual Languages, Skokie, IL, October 1990.
Keywords and Phrases: Forms/2, VPL-IV.B: Efficiency

VPL-IV.C: Parsing

Lakin, Fred, Spatial Parsing for Visual Languages, Visual Languages, (Shi-Kuo Chang, Tadao Ichikawa, and Panos. A. Ligomenides, eds.), Plenum Press, New York, 1986.
Keywords and Phrases: executable graphics, spatial parsing, formal visual languages, informal conversational graphics, visual lisp, visual emacs, vmacs, VPL-IV.C: Parsing, VPL-VI.A: Formal definition of VPLs, VPL-IV.D: Translators (interpreters and compilers)

VPL-IV.D Translators (interpreters and compilers)

Mainguenaud, M., From the User Interface to the Database Management System : Application to a Geographical Information System, 5th International Conference on Human Computer Interaction, Orlando, USA, August 8-13, 1993.
Keywords and Phrases: VPL-IV.D: Translators (interpreters and compilers)

Zuendorf A., Implementation of the Imperative/Rule Based Language PROGRES, Technical Report AIB 92-38, RWTH Aachen, Germany, 1992.
Keywords and Phrases: VPL-IV.D: Translators

Zuendorf A., A Heuristic Solution for the (Sub-) GraphIsomorphism Problem in Executing PROGRES, Technical Report AIB 93-5, RWTH Aachen, Germany, 1993. Keywords and Phrases: VPL-IV.D: Translators

VPL-V: Language Purpose

VPL-V.A: General-purpose languages

VPL-V.B: Database languages

Batini, C, T. Catarci, M. F. Costabile and S. Levialdi, On Visual Representations for Database Query Systems, Proceedings of the Interface to Real and Virtual Worlds Conference, Montpellier, France, 273-283, March 22-26, 1993.
Keywords and Phrases: visual structures and taxonomy, visual queries, VPL-V.B: Database languages,VPL-VI: Theory of VPLs

Catarci, T., S. K. Chang, M. F. Costabile, S. Levialdi and G. S. Santucci, An Adaptive Visual Interface for Database Querying, PD-Vol49, Computer Applications and Design Abstraction, ASME, (D. E. Cooke and M. M. Tanik, eds.), Houston, 75-85, 1993.
Keywords and Phrases: user model, graph model, atomic query, visual interface, VPL-V.B: Database languages, VPL-VI.B: Icon theory

Catarci, T., S. K. Chang, M. F. Costabile, S. Levialdi and G. S. Santucci, A Multiparadigmatic Visual Environment for Adaptive Access to Databases, Proceedings of 1993 Conference on Human Factors in Computing Systems, INTERCHI '93, Amsterdam, 11-12, April 1993.
Keywords and Phrases: visual queries, adaptive interface, atomic query, VPL-V.B: Database languages, VPL-VI.C: Language design issues

Mainguenaud, M., The Semantics of Geographical Database Query Language, 4th European Geographical Information System Conference, Genoa, Italy, March/April 29-1, 1993.
Keywords and Phrases: VPL-V.B: Database languages

Mainguenaud, M., J. L. Raffy, and X. T. Simatic, Graph Manipulations for Network Oriented Management : Application to a Telecommunication Network, 14th Uraban Data Management Symposium, Odense, Denmark, May 29-31, 1991.
Keywords and Phrases: VPL-V.B: Database languages

Mainguenaud, M. and X. T. Simatic, A Data Model to Deal with Multi-Scaled Networks, IGU-UGI Conference on Multi-Scale and Multi-Use, Brno, Czechoslovakia, also published in Computer, Environment and Urban Systems, 16, 281-288, April 22-25, 1991.
Keywords and Phrases: VPL-V.B: Database languages

VPL-V.C: Image-processing languages

VPL-V.D: Scientific visualization languages

Burnett, Margaret, Richard Hossli, Timothy Pulliam, Brian VanVoorst, and Xiaoyang Yang, Toward Visual Programming Languages for Steering in Scientific Visualization: a Taxonomy, CS-TR 92-12, Michigan Technological University, December 1992.
Keywords and Phrases: VPL: Visual Programming Languages, VPL-V.D: Scientific visualization languages

VPL-V.E: User-interface generation languages

VPL-VI: Theory of VPLs

VPL-VI.A: Formal definition of VPLs

Raymond, Darrell R., Characterizing Visual Languages, IEEE Workshop on Visual Languages, Kobe, Japan, 176-182, October 9-11, 1991.
Keywords and Phrases: VPL-VI.A: Formal definition of VPLs

Schuerr, Andreas, Logic Based Structure Rewriting Systems, Proc. Dagstuhl- Seminar 9301 on Graph Transformation in Computer Science, LNCS 776, Springer Verlag, 341-357, 1994. also: Technical Report AIB 94-13, RWTH Aachen, Germany, 1994.
Keywords and Phrases: VPL-VI.A: Formal definition of VPLs

Schuerr, Andreas, Operational Specifications with Programmed Graph Rewriting Systems (in German), Dissertation, RWTH Aachen, Deutscher Universitaetsverlag, Germany, 1991.
Keywords and Phrases: VPL-VI.A: Formal definition of VPLs

VPL-VI.B: Icon theory

Levialdi, S., P. Mussio, M. Protti and L. Tosoni, Reflections on Icons, IEEE Symposium on Visual Languages, Bergen, Norway, 1993.
Keywords and Phrases: surface, navigational structure, icon definition, paratext, VPL-VI.B: Icon theory

Repenning, A., Bending Icons: Syntactic and Semantic Transformation of Icons, Proceedings of the 1994 IEEE Symposium on Visual Languages, St. Louis, MO, 296-303, October 1994.
Keywords and Phrases: VPL-VI.B: Icon theory

VPL-VI.C: Language design issues

Burnett, M., M. Baker, C. Bohus, P. Carlson, S. Yang, and P. van Zee, Scaling Up Visual Programming Languages, Computer, 45-54, March 1995.
Keywords and Phrases: VPL-VI.C: Language design issues

Levialdi, S., Using images: two case studies, On Representation: relationship between images and languages, (Carlo Bernardelli and Stefano Levialdi, eds.), World Scientific Publishing Co. Pte Ltd, Singapore, (to appear).
Keywords and Phrases: images and icons, communication, modelling, working environment, VPL-VI.C: Language design issues

VPL-VI.C.1: Cognitive and user-interface design issues (e.g. usability studies, graphical perception)

Catarci, T., M. F. Costabile and S. Levialdi, eds., Advanced Visual Interfaces, Proceedings of the International Workshop AVI '92, Rome, World Scientific Publishing Co. Pte Ltd, Singapore, December 1992.
Keywords and Phrases: Visual interfaces, user, icon design, VPL-VI.C.1: Cognitive and user-interface design issues

Repenning, A. and W. Citrin, Agentsheets: Applying Grid-Based Spatial Reasoning to Human-Computer Interaction, 1993 IEEE Workshop on Visual Languages, Bergen, Norway, 77-82, August 1993.
Keywords and Phrases: VPL-VI.C.1: Cognitive and user-interface design issues

Repenning, A., Creating User Interfaces with Agentsheets, 1991 Symposium on Applied Computing, Kansas City, MO,190-196, 1991.
Keywords and Phrases: VPL-VI.C.1: Cognitive and user-interface design issues

Repenning, A., Agentsheets: A Tool for Building Domain-Oriented Dynamic, Visual Environments, University of Colorado at Boulder, Ph.D. dissertation, Dept. of Department of Computer Science, 1993.
Keywords and Phrases: VPL-VI.C.1: Cognitive and user-interface design issues

Repenning, A., Programming Substrates to Create Interactive Learning Environments, Journal of Interactive Learning Environments, Special Issue on End-User Environments, Vol. 4, 45-74, 1994.
Keywords and Phrases: VPL-VI.C.1: Cognitive and user-interface design issues

Repenning, A. and T. Sumner, Using Agentsheets to Create a Voice Dialog Design Environment, Proceedings of the 1992 ACM/SIGAPP Symposium on Applied Computing, Kansas City, MO, 1199-1207, 1992.
Keywords and Phrases: VPL-VI.C.1: Cognitive and user-interface design issues

Repenning, A. and T. Sumner, Programming as Problem Solving: A Participatory Theater Approach, Workshop on Advanced Visual Interfaces '94, Bari, Italy, 182-191, 1994.
Keywords and Phrases: VPL-VI.C.1: Cognitive and user-interface design issues

Repenning, A. and T. Sumner, Agentsheets: A Medium for Creating Domain-Oriented Visual Languages, Computer, Vol. 28, 17-25, March 1995.
Keywords and Phrases: VPL-VI.C.1: Cognitive and user-interface design issues