Stack-based graph traversal ≠ depth first search
I just finished teaching our required undergraduate algorithms class, and in grading their final exams I discovered that a few of the students have (not from me) acquired the incorrect belief that modifying the standard version of the breadth first search algorithm by replacing the stack with a queue makes it into depth first search. Embarrassingly, the Wikipedia depth first search article made the same mistake (until today), as do some textbooks (for example Skiena's Algorithm Design Manual p. 169; Jeff Edmonds' How to Think about Algorithms, pp. 175–178; Gilberg and Forouzan Data Structures: A Pseudocode Approach Using C, 2nd ed., p. 497).
Here's what you get if you swap a stack for the queue in breadth first search:
In trees, or in AI search contexts where the visited set is not used to eliminate duplicate vertices, this idea does indeed produce a depth-first search. But in arbitrary graphs with a visited set, the traversal that you get from this routine is not depth first. The problem is that nodes high in the tree push some of their neighbors as children too early; in a proper depth first search those children would instead be discovered as descendants farther down in the tree. Here's an example, illustrating (as usual) the tree whose edges link each vertex with the earlier vertex it was discovered from:
In a depth first search tree, all edges connect ancestors and descendants. In a breadth-first search tree, all edges connect vertices in the same or adjacent levels. But in the stack traversal tree, all non-tree edges connect pairs of vertices that are not ancestors and descendants of each other, the opposite property to the depth first tree property. Or, to put it another way, if \( w \) is a descendant of \( v \), and is adjacent to \( v \), then \( w \) must be a direct child of \( v \).
Goodrich and Tamassia (whose book I used for my class) and CLRS avoid this mistake by only discussing recursive depth-first search; CLRS has an exercise of writing an iterative stack-based depth-first search but doesn't state the answer. One text that discusses the subject of using a stack for an iterative depth first search but gets it right is Sedgewick's Algorithms in Java. There are (at least) two different ways of doing it, both discussed by Sedgewick. You can use a stack of iterators instead of a stack of vertices:
Alternatively, you can push all neighbors and delay the check for whether a vertex has been visited until it is popped. This is the approach taken by Kleinberg and Tardos's Algorithm Design:Both of these have the property that replacing the stack by a queue gives a breadth-first search, implemented in a somewhat nonstandard way. They don't give the same traversal as each other (the first one matches the usual recursive dfs while the second one reverses the order of the children at each vertex), and the second one uses more space because of duplicated entries on the stack, but they at least both give a valid depth-first search.
Depth-first search and breadth-first search (and lexicographic breadth-first search) are all useful in algorithm design because of the restricted way the rest of the graph can be attached to the search tree. The non-dfs stack traversal is a different type of graph traversal, so conceivably it could also be useful in this way. But I don't know of any examples of algorithms that deliberately use it instead of bfs or dfs.
Comments:
2013-12-18T11:16:34Z
I have some tangential question. How do you define BFS tree for a graph? I always thought that any unweighted shortest path tree is a BFS tree. However most definitions I find are much more restrictive and use queue, so there is some linear order on the set of vertices.
2013-12-18T16:50:21Z
I would define it as a tree in which each vertex is connected to the vertex from which it was first discovered, its leftmost neighbor on the previous tree level.
2013-12-21T03:18:18Z
Phew. I used what you call dfs2 in Open Data Structures. Glad I didn't screw that up.
2013-12-21T03:29:35Z
I used the other iterative dfs (with the stack of iterators) in http://www.ics.uci.edu/~eppstein/PADS/DFS.py. It is a bit more space-efficient than dfs2. But dfs2 is definitely simpler, and the difference between \( O(n) \) and \( O(m) \) space usage isn't usually that important, so if you have to remember only one I think it's a good choice.
2014-01-04T19:36:31Z
Your writeup is an excellent illustration of a reader's need to confirm to himself or herself the veracity of material available (oftentimes from reputable sources).
I recently discovered the following article that does a similarly excellent job with dispelling profoundly incorrect interpretations frequently espoused in a lot of the quantum mechanics literature. Just thought that some of your quantum computing inclined readers might benefit as well. Given my non-physics background I did not understand all that is in the article but with additional effort I believe that this resource should clarify a great deal of the mystery (in my mind, atleast) that sorrounds quantum mechanics. The khet and tensor product notation is a pain to parse through but perhaps is not an insurmountable obstacle.
http://jamesowenweatherall.com/SCPPRG/EllermanDavid2012Man_QuantumEraser2.pdf
2014-01-07T13:44:59Z
I'm teaching graph searching with the following pseudocode that explicitly constructs a tree. The active vertices are kept in a data structure A that supports insert, delete and active, where active refers to the element that would be deleted. If A is implemented by a queue resp. a stack you get a BFS-Tree resp. DFS-Tree
(Stefan Felsner)
2014-01-07T15:42:06Z
Ok, but then how do you find an unvisited neighbor in constant time? Don't you need to store for each active vertex some sort of pointer into its neighbor list? I think for an algorithms class these things should be explicit.