dodgr
Mark Padgham
2017-10-27
1 Background: Directed Graphs
dodgr is an R package for calculating Distances On Directed Graphs. It does so very efficiently, and is able to process larger graphs than many other comparable R packages. Skip straight to the Intro if you know what directed graphs are (but maybe make a brief stop-in to Dual-Weighted Directed Graphs below.) Directed graphs are ones in which the “distance” (or some equivalent measure) from A to B is not necessarily equal to that from B to A. In Fig. 1, for example, the weights between the graph vertices (A, B, C, and D) differ depending on the direction of travel, and it is only possible to traverse the entire graph in an anti-clockwise direction.
Figure 1: A weighted, directed graph
Graphs in dodgr are represented by simple flat data.frame objects, so the graph of Fig. 1, presuming the edge weights to take values of 1, 2, and 3, would be,
## from to d
## 1 A B 1
## 2 B A 2
## 3 B C 1
## 4 B D 3
## 5 C B 2
## 6 C D 1
## 7 D C 2
## 8 D A 1The primary function of dodgr is dodgr_dists, which calculates pair-wise shortest distances between all vertices of a graph.
dodgr_dists (graph)## A B C D
## A 0 1 2 3
## B 2 0 1 2
## C 2 2 0 1
## D 1 2 2 0dodgr_dists (graph, from = c ("A", "C"), to = c ("B", "C", "D"))## B C D
## A 1 2 3
## C 2 0 11.1 Dual-Weighted Directed Graphs
Shortest-path distances on weighted graphs can be calculated using a number of other R packages, such as igraph or e1071. dodgr comes into its own through its ability to trace paths through dual-weighted directed graphs, illustrated in Fig. 2.
Figure 2: A dual-weighted, directed graph in which the weights (represented by thicknesses) of the grey arrows differ from those of the black arrows.
Dual-weighted directed graphs are common in many areas, a foremost example being routing through street networks. Routes through street networks depends on mode of transport: the route a pedestrian might take will generally differ markedly from the route the same person might take if behind the wheel of an automobile. Routing through street networks thus generally requires each edge to be specified with two weights or distances: one quantifying the physical distance, and a second weighted version reflecting the mode of transport (or some other preferential weighting).
dodgr calculates shortest paths using one set of weights (called “weights” or anything else starting with “w”), but returns the actual lengths of them using a second set of weights (called “distances”, or anything else starting with “d”). If no weights are specified, distances alone are used both for routing and final distance calculations. Consider that the weights and distances of Fig. 2 are the black and grey lines, respectively, with the latter all equal to one. In this case, the graph and associated shortest distances are,
## from to w d
## 1 A B 1 1
## 2 B A 2 1
## 3 B C 1 1
## 4 B D 3 1
## 5 C B 2 1
## 6 C D 1 1
## 7 D C 2 1
## 8 D A 1 1## A B C D
## A 0 1 2 3
## B 1 0 1 2
## C 2 1 0 1
## D 1 2 1 0Note that even though the shortest “distance” from A to D is actually A\(\to\)B\(\to\)D with a distance of only 2, that path has a weighted distance of 1 + 3 = 4. The shortest weighted path is A\(\to\)B\(\to\)C\(\to\)D, with a distance both weighted and unweighted of 1 + 1 + 1 = 3. Thus d(A,D) = 3 and not 2.
2 Introduction to dodgr
Although the package has been intentionally developed to be adaptable to any kinds of networks, most of the applications illustrated here concern street networks, and also illustrate several helper functions the package offers for working with street networks. The basic graph object of dodgr is nevertheless arbitrary, and need only minimally contain three or four columns as demonstrated in the simple examples at the outset.
The package may be used to calculate a matrix of distances between a given set of geographic coordinates. We can start by simply generating some random coordinates, in this case within the bounding box defining the city of York in the U.K.
bb <- osmdata::getbb ("york uk")
npts <- 1000
xy <- apply (bb, 1, function (i) min (i) + runif (npts) * diff (i))
bb; head (xy)## min max
## x -1.241536 -0.9215361
## y 53.799056 54.1190555## x y
## [1,] -1.1713502 53.89409
## [2,] -1.2216108 54.01065
## [3,] -1.0457199 53.83613
## [4,] -0.9384666 53.93545
## [5,] -0.9445541 53.89436
## [6,] -1.1207099 54.01262Those points can simply be passed to dodgr_dists():
system.time(
d <- dodgr_dists (from = xy, to = xy,
wt_profile = "foot", quiet = FALSE)
)## No graph submitted to dodgr_dists; downloading street network ... done
## Converting network to dodgr graph ... done
## Calculating shortest paths ... done## user system elapsed
## 26.620 0.132 28.567dim (d); range (d, na.rm = TRUE)## [1] 1000 1000## [1] 0.00000 46.60609The result is a matrix of 1000-by-1000 distances of up to 47km long, measured along routes weighted for optimal pedestrian travel. In this case, the single call to dodgr_dists() automatically downloaded the entire street network of York and calculated one million shortest-path distances, all in under 30 seconds.
3 Graphs and Street Networks
Although the above code is short and fast, most users will probably want more control over their graphs and routing possibilities. Each of the steps indicated above (through the quiet = FALSE option) can be implemented separately. To illustrate, the remainder of this vignette analyses the much smaller street network of Hampi, Karnataka, India, included in the dodgr package as the dataset hampi. This data set may be re-created with the following single line:
hampi <- dodgr_streetnet ("hampi india")Or with the equivalent version bundled with the package:
class (hampi)## [1] "sf" "data.frame"class (hampi$geometry)## [1] "sfc_LINESTRING" "sfc"dim (hampi)## [1] 189 4The streetnet is an sf (Simple Features) object containing 189 LINESTRING geometries. In other words, it’s got an sf representation of 189 street segments. The R package osmplotr can be used to visualise this street network (with the help of magrittr pipe operator, %>%):
library (osmplotr)
library (magrittr)
map <- osm_basemap (hampi, bg = "gray95") %>%
add_osm_objects (hampi, col = "gray5") %>%
add_axes () %>%
print_osm_map ()
(Note that this requires current dev version of osmplotr, which can be installed with devtools::install_github ("ropensci/osmplotr").)
The sf class data representing the street network of Hampi can then be converted into a flat data.frame object by
graph <- weight_streetnet (hampi, wt_profile = "foot")
dim (graph)## [1] 6096 12head (graph)## edge_id from_id from_lon from_lat to_id to_lon to_lat
## 1 1 339318500 76.47489 15.34169 339318502 76.47612 15.34173
## 2 2 339318502 76.47612 15.34173 339318500 76.47489 15.34169
## 3 3 339318502 76.47612 15.34173 2398958028 76.47620 15.34174
## 4 4 2398958028 76.47620 15.34174 339318502 76.47612 15.34173
## 5 5 2398958028 76.47620 15.34174 1427116077 76.47627 15.34179
## 6 6 1427116077 76.47627 15.34179 2398958028 76.47620 15.34174
## d d_weighted highway way_id component
## 1 0.075941518 0.084379472 service 28565950 1
## 2 0.075941518 0.084379472 service 28565950 1
## 3 0.005191200 0.005768001 service 28565950 1
## 4 0.005191200 0.005768001 service 28565950 1
## 5 0.005337372 0.005930413 service 28565950 1
## 6 0.005337372 0.005930413 service 28565950 1Note that the actual graph contains around 30 times as many edges as there are streets, indicating that each street is composed on average of around 30 individual segments. The individual points points or vertices from those segments can be extracted with,
vt <- dodgr_vertices (graph)
head(vt)## id x y n
## 1 339318500 76.47489 15.34169 0
## 2 339318502 76.47612 15.34173 1
## 4 2398958028 76.47620 15.34174 2
## 6 1427116077 76.47627 15.34179 3
## 8 339318503 76.47641 15.34190 4
## 10 2398958034 76.47650 15.34199 5dim (vt)## [1] 2987 4From which we see that the OpenStreetMap representation of the streets of Hampi has 189 line segments with 2,987 unique points and 6,096 edges between those points. The number of edges per vertex in the entire network is thus,
nrow (graph) / nrow (vt)## [1] 2.040844A simple straight line has two edges between all intermediate nodes, and this thus indicates that the network in it’s entirety is quite simple. The data.frame resulting from weight_streetnet() is what dodgr uses to calculate shortest path routes, as will be described below, following a brief description of weighting street networks.
3.1 Graph Components
The foregoing graph object returned from weight_streetnet() also includes a $component column enumerating all of the distinct inter-connected components of the graph.
table (graph$component)##
## 1 2 3
## 3934 2144 18Components are numbered in order of decreasing size, with $component = 1 always denoting the largest component. In this case, that component contains 3,934 edges, representing 65% of the graph. There are clearly only three distinct components, but this number may be much larger for larger graphs, and may be obtained from,
length (unique (graph$component))## [1] 3Component numbers can be determined for any types of graph with the dodgr_components() function. For example, the following lines reduce the previous graph to a minmial (non-spatial) structure of four columns, and then (re-)calculate a fifth column of $components:
cols <- c ("edge_id", "from_id", "to_id", "d")
graph_min <- graph [, which (names (graph) %in% cols)]
graph_min <- dodgr_components (graph_min)
head (graph_min)## edge_id from_id to_id d component
## 1 1 339318500 339318502 0.075941518 1
## 2 2 339318502 339318500 0.075941518 1
## 3 3 339318502 2398958028 0.005191200 1
## 4 4 2398958028 339318502 0.005191200 1
## 5 5 2398958028 1427116077 0.005337372 1
## 6 6 1427116077 2398958028 0.005337372 1The component column column can be used to select or filter any component in a graph. It is particularly useful to ensure routing calculations consider only connected vertices through simply removing all minor components:
graph_connected <- graph [graph$component == 1, ]This is explored further below (under Distance Matrices).
3.2 Weighting Profiles
Dual-weights for street networks are generally obtained by multiplying the distance of each segment by a weighting factor reflecting the type of highway. As demonstrated above, this can be done easily within dodgr with the weight_streetnet() function, which applies the named weighting profiles included with the dodgr package to OpenStreetMap networks extracted with the osmdata package. Each profile assigns weights to each distinct type of highway.
names (weighting_profiles)## [1] "name" "way" "value"class (weighting_profiles)## [1] "data.frame"unique (weighting_profiles$name)## [1] "foot" "horse" "wheelchair" "bicycle" "moped"
## [6] "motorcycle" "motorcar" "goods" "hgv" "psv"weighting_profiles [weighting_profiles$name == "foot", ]## name way value
## 1 foot motorway 0
## 2 foot trunk 40
## 3 foot primary 50
## 4 foot secondary 60
## 5 foot tertiary 70
## 6 foot unclassified 80
## 7 foot residential 90
## 8 foot service 90
## 9 foot track 95
## 10 foot cycleway 95
## 11 foot path 100
## 12 foot steps 80
## 13 foot ferry 20Each profile is defined by a series of percentage weights quantifying highway-type preferences for a particular mode of travel. The distinct types of highways within the Hampi graph obtained above can be tabulated with:
table (graph$highway)##
## footway living_street path pedestrian primary
## 424 116 2200 142 1194
## residential service steps tertiary track
## 94 176 128 396 912
## unclassified
## 314Hampi is unlike most other human settlements on the planet in being a Unesco World Heritage area in which automobiles are generally prohibited. Accordingly, numbers of "footway", "path", and "pedestrian" ways far exceed typical categories denoting automobile traffic ("primary", "residential", "tertiary")
It is also possible to use other types of (non-OpenStreetMap) street networks, an example of which is the os_roads_bristol data provided with the package. “OS” is the U.K. Ordnance Survey, and these data are provided as a Simple Features (sf) data.frame with a decidedly different structure to osmdata data.frame objects:
names (hampi) # many fields manually removed to reduce size of this object## [1] "osm_id" "highway" "oneway" "geometry"names (os_roads_bristol)## [1] "fictitious" "identifier" "class" "roadNumber" "name1"
## [6] "name1_lang" "name2" "name2_lang" "formOfWay" "length"
## [11] "primary" "trunkRoad" "loop" "startNode" "endNode"
## [16] "structure" "nameTOID" "numberTOID" "function." "geometry"The latter may be converted to a dodgr network by first specifying a weighting profile, here based on the formOfWay column:
colnm <- "formOfWay"
table (os_roads_bristol [[colnm]])##
## Collapsed Dual Carriageway Dual Carriageway
## 14 6
## Single Carriageway Slip Road
## 1 8wts <- c (0.1, 0.2, 0.8, 1)
names (wts) <- unique (os_roads_bristol [[colnm]])
net <- weight_streetnet (os_roads_bristol, wt_profile = wts,
type_col = colnm, id_col = "identifier")The resultant net object contains the street network of os_roads_bristol weighted by the specified profile, and in a format suitable for submission to any dodgr routine.
3.3 Random Sub-Graphs
The dodgr packages includes a function to select a random connected portion of graph including a specified number of vertices. This function is used in the compare_heaps() function described below, but is also useful for general statistical analyses of large graphs which may otherwise take too long to compute.
graph_sub <- dodgr_sample (graph, nverts = 100)
nrow (graph_sub)## [1] 197The random sample has around twice as many edges as vertices, in accordance with the statistics calculated above.
nrow (dodgr_vertices (graph_sub))## [1] 1004 Distance Matrices: dodgr_dists()
As demonstrated at the outset, an entire network can simply be submitted to dodgr_dists(), in which case a square matrix will be returned containing pair-wise distances between all vertices. Doing that for the graph of York will return a square matrix of around 90,000-times-90,000 (or 8 billion) distances. It might be possible to do that on some computers, but is possibly neither recommended nor desirable. The dodgr_dists() function accepts additional arguments of from and to defining points from and to which distances are to be calculated. If only from is provided, a square matrix is returned of pair-wise distances between all listed points.
4.1 Aligning Routing Points to Graphs
For spatial graphs—that is, those containing columns of latitudes and longitudes (or “x” and “y”)—routing points can be represented by a simple matrix of arbitrary latitudes and longitudes (or, again, “x” and “y”). dodgr_dists() will map these points to the closest network points, and return corresponding shortest-path distances. This may be illustrated by generating random points within the bounding box of the above map of Hampi. As demonstrated above, the coordinates of all vertices may be extracted with the dodgr_vertices() function, enabling random points to be generated with the following lines:
vt <- dodgr_vertices (graph)
n <- 100 # number of points to generate
xy <- data.frame (x = min (vt$x) + runif (n) * diff (range (vt$x)),
y = min (vt$y) + runif (n) * diff (range (vt$y)))Submitting these to dodgr_dists() as points from which to route will generate a distance matrix from each of these 100 points to every other point in the graph:
d <- dodgr_dists (graph, from = xy)
dim (d); range (d, na.rm = TRUE)## [1] 100 2987## [1] 0.00000 15.55436If the to argument is also specified, the matrix returned will have rows matching from and columns matching to
d <- dodgr_dists (graph, from = xy, to = xy [1:10, ])
dim (d)## [1] 100 10Some of the resultant distances in the above cases are NA because the points were sampled from the entire bounding box, and the street network near the boundaries may be cut off from the rest. As demonstrated above, the weight_streetnet() function returns a component vector, and such disconnected edges will have graph$component > 1, because graph$component == 1 always denotes the largest connected component. This means that the graph can always be reduced to the single largest component with the following single line:
graph_connected <- graph [graph$component == 1, ]A distance matrix obtained from running dodgr_dists on graph_connected should generally contain no NA values, although some points may still be effectively unreachable due to one-way connections (or streets). Thus, routing on the largest connected component of a directed graph ought to be expected to yield the minimal number of NA values, which may sometimes be more than zero. Note further that spatial routing points (expressed as from and/or to arguments) will in this case be mapped to the nearest vertices of graph_connected, rather than the potentially closer nearest points of the full graph. This may make the spatial mapping of routing points less accurate than results obtained by repeating extraction of the street network using an expanded bounding box. For automatic extraction of street networks with dodgr_dists(), the extent by which the bounding box exceeds the range of routing points (from and to arguments) is determined by an extra parameter expand, quantifying the relative extent to which the bounding box should exceed the spatial range of the routing points. This is illustrated in the following code which calculates distances between 100 random points:
bb <- osmdata::getbb ("york uk")
npts <- 100
xy <- apply (bb, 1, function (i) min (i) + runif (npts) * diff (i))
routed_points <- function (expand = 0, pts)
{
gr0 <- dodgr_streetnet (pts = pts, expand = expand) %>%
weight_streetnet ()
d0 <- dodgr_dists (gr0, from = pts)
length (which (is.na (d0))) / length (d0)
}vapply (c (0, 0.05, 0.1), function (i) routed_points (i, pts = xy),
numeric (1))## [1] 0.0780 0.0586 0.0000With a street network that precisely encompasses the submitted routing points (expand = 0), 7.8% of pairwise distances are unable to be calculated; with a bounding box expanded to 5% larger than the submitted points, this is reduced to 5.9%, and with expansion to 10%, all points can be connected.
For non-spatial graphs, from and to must match precisely on to vertices named in the graph itself. In the graph considered above, these vertex names were contained in the columns, from_id and to_id. The minimum that a dodgr graph requires is,
head (graph [, names (graph) %in% c ("from_id", "to_id", "d")])## from_id to_id d
## 1 339318500 339318502 0.075941518
## 2 339318502 339318500 0.075941518
## 3 339318502 2398958028 0.005191200
## 4 2398958028 339318502 0.005191200
## 5 2398958028 1427116077 0.005337372
## 6 1427116077 2398958028 0.005337372in which case the from values submitted to dodgr_dists() (and to, if given) must directly name the vertices in the from_id and to_id columns of the graph. This is illustrated in the following code:
graph_min <- graph [, names (graph) %in% c ("from_id", "to_id", "d")]
fr <- sample (graph_min$from_id, size = 10) # 10 random points
to <- sample (graph_min$to_id, size = 20)
d <- dodgr_dists (graph_min, from = fr, to = to)
dim (d)## [1] 10 20The result is a 10-by-20 matrix of distances between these named graph vertices.
4.2 Shortest Path Calculations: Priority Queues
dodgr uses an internal library (S. Saunders and Takaoka 2003, Shane Saunders (2004)) for the calculation of shortest paths using a variety of priority queues (see Miller 1960 for an overview). In the context of shortest paths, priority queues determine the order in which a graph is traversed (R. Tarjan 1983), and the choice of priority queue can have a considerable effect on computational efficiency for different kinds of graphs (Johnson 1977). In contrast to dodgr, most other R packages for shortest path calculations do not use priority queues, and so may often be less efficient. Shortest path distances can be calculated in dodgr with priority queues that use the following heaps:
- Binary heaps;
- Fibonacci heaps (Fredman and Tarjan 1987);
- Trinomial and extended trinomial heaps (T. Takaoka 2000); and
- 2-3 heaps (T. Takaoka 1999).
Differences in how these heaps operate are often largely extraneous to direct application of routing algorithms, even though heap choice may strongly affect performance. To avoid users needing to know anything about algorithmic details, dodgr provides a function compare_heaps to which a particular graph may be submitted in order to determine the optimal kind of heap.
The comparisons are actually made on a randomly selected sub-component of the graph containing a defined number of vertices (with a default of 1,000, or the entire graph if it contains fewer than 1,000 vertices).
compare_heaps (graph, nverts = 100, replications = 1)## test
## 6 d <- dodgr_dists(graph_contracted, from = from_id, to = to_id, heap = "BHeap")
## 8 d <- dodgr_dists(graph_contracted, from = from_id, to = to_id, heap = "TriHeap")
## 9 d <- dodgr_dists(graph_contracted, from = from_id, to = to_id, heap = "TriHeapExt")
## 10 d <- dodgr_dists(graph_contracted, from = from_id, to = to_id, heap = "Heap23")
## 7 d <- dodgr_dists(graph_contracted, from = from_id, to = to_id, heap = "FHeap")
## 1 d <- dodgr_dists(graph, from = from_id, to = to_id, heap = "BHeap")
## 2 d <- dodgr_dists(graph, from = from_id, to = to_id, heap = "FHeap")
## 3 d <- dodgr_dists(graph, from = from_id, to = to_id, heap = "TriHeap")
## 4 d <- dodgr_dists(graph, from = from_id, to = to_id, heap = "TriHeapExt")
## 5 d <- dodgr_dists(graph, from = from_id, to = to_id, heap = "Heap23")
## 11 d <- igraph::distances(igr, v = from_id, to = to_id, mode = "out")
## replications elapsed relative user.self sys.self user.child sys.child
## 6 10 0.009 1.000 0.012 0 0 0
## 8 10 0.009 1.000 0.008 0 0 0
## 9 10 0.009 1.000 0.008 0 0 0
## 10 10 0.009 1.000 0.008 0 0 0
## 7 10 0.011 1.222 0.012 0 0 0
## 1 10 0.012 1.333 0.012 0 0 0
## 2 10 0.012 1.333 0.012 0 0 0
## 3 10 0.012 1.333 0.012 0 0 0
## 4 10 0.013 1.444 0.016 0 0 0
## 5 10 0.018 2.000 0.016 0 0 0
## 11 10 0.038 4.222 0.040 0 0 0The key column of that data.frame is relative, which quantifies the relative performance of each test in relation to the best which is given a score of 1. dodgr using the default heap = "BHeap", which is a binary heap priority queue, performs faster than igraph (Csardi and Nepusz 2006) for these graphs. Different kind of graphs will perform differently with different priority queue structures, and this function enables users to empirically discern the optimal heap for their kind of graph.
Note, however, that this is not an entirely fair comparison, because dodgr calculates dual-weighted distances, whereas igraph—and indeed all other R packages—only directly calculate distances based on a single set of weights. Implementing dual-weighted routing in these cases requires explicitly re-tracing all paths and summing the second set of weights along each path. A time comparison in that case would be very strongly in favour of dodgr. Moreover, dodgr can convert graphs to contracted form through removing redundant vertices, as detailed in the following section. Doing so greatly improves performance with respect to igraph.
For those wishing to do explicit comparisons themselves, the following code generates the igraph equivalent of dodgr_dists(), although of course for single-weighted graphs only:
edges <- cbind (graph$from_id, graph$to_id)
pts <- sample (unique (as.vector (edges)), 100) # set of random routing points
edges <- as.vector (t (edges))
igr <- igraph::make_directed_graph (edges)
igraph::E (igr)$weight <- graph$d
d <- igraph::distances (igr, v = pts, to = pts, mode = "out")5 Graph Contraction
A further unique feature of dodgr is the ability to remove redundant vertices from graphs (see Fig. 3), thereby speeding up routing calculations.
Figure 3: (A) Vertex#2 is redundant for routing calculations from anywhere other than that point itself. (B) Equivalent graph to (A) contracted through removal of vertex#2. (C) Vertex#2 is not redundant.
In Fig. 3(A), the only way to get from vertex 1 to 3, 4 or 5 is through C. The intermediate vertex B is redundant for routing purposes (and than to or from that precise point) and may simply be removed, with directional edges inserted directly between vertices 1 and 3. This yields the equivalent contracted graph of Fig. 3(B), in which, for example, the distance (or weight) between 1 and 3 is the sum of previous distances (or weights) between 1 \(\to\) 2 and 2 \(\to\) 3. Note that if one of the two edges between, say, 3 and 2 were removed, vertex 2 would no longer be redundant (Fig. 3(C)).
Different kinds of graphs have different degrees of redundancy, and even street networks differ, through for example dense inner-urban networks generally being less redundant than less dense extra-urban or rural networks. The contracted version of a graph can be obtained with the function dodgr_compact_graph(), illustrated here with the York example from above.
grc <- dodgr_contract_graph (graph)$graphThe function dodgr_compact_graph() returns a list with the compact graph and a table relating the contracted edges to the corresponding original edges in the full graph. Relative sizes are
nrow (graph); nrow (grc); nrow (grc) / nrow (graph)## [1] 6096## [1] 866## [1] 0.1420604equivalent to the removal of around 90% of all edges. The difference in routing efficiency can then be seen with the following code
from <- sample (grc$from_id, size = 100)
to <- sample (grc$to_id, size = 100)
rbenchmark::benchmark (
d2 <- dodgr_dists (grc, from = from, to = to),
d2 <- dodgr_dists (graph, from = from, to = to),
replications = 2)## test replications elapsed
## 2 d2 <- dodgr_dists(graph, from = from, to = to) 2 0.043
## 1 d2 <- dodgr_dists(grc, from = from, to = to) 2 0.009
## relative user.self sys.self user.child sys.child
## 2 4.778 0.044 0 0 0
## 1 1.000 0.008 0 0 0And contracting the graph has a similar effect of speeding up pairwise routing between these 100 points. All routing algorithms scale non-linearly with size, and relative improvements in efficiency will be even greater for larger graphs.
5.1 Routing on Contracted Graphs
Routing is often desired between defined points, and these points may inadvertedly be removed in graph contraction. The dodgr_contract_graph() function accepts an additional argument specifying vertices to keep within the contracted graph. This list of vertices must directly match the vertex ID values in the graph.
The following code illustrates how to retain specific vertices within contracted graphs:
grc <- dodgr_contract_graph (graph)$graph
nrow (grc)## [1] 866verts <- sample (dodgr_vertices (graph)$id, size = 100)
head (verts) # a character vector## [1] "3544918711" "1054866750" "2398957727" "2588155764" "2398957713"
## [6] "339577285"grc <- dodgr_contract_graph (graph, verts)$graph
nrow (grc)## [1] 1048Retaining the nominated vertices yields a graph with considerably more edges than the fully contracted graph excluding these vertices. The dodgr_dists() function can be applied to the latter graph to obtain accurate distances precisely routed between these points, yet using the speed advantages of graph contraction.
6 Shortest Paths
Shortest paths can also be extracted with the dodgr_paths() function. For given vectors of from and to points, this returns a nested list so that if,
dp <- dodgr_paths (graph, from = from, to = to)then dp [[i]] [[j]] will contain the path from from [i] to to [j]. The paths are represented as sequences of vertex names. Consider the following example,
graph <- weight_streetnet (hampi)
head (graph)## edge_id from_id from_lon from_lat to_id to_lon to_lat
## 1 1 339318500 76.47489 15.34169 339318502 76.47612 15.34173
## 2 2 339318502 76.47612 15.34173 339318500 76.47489 15.34169
## 3 3 339318502 76.47612 15.34173 2398958028 76.47620 15.34174
## 4 4 2398958028 76.47620 15.34174 339318502 76.47612 15.34173
## 5 5 2398958028 76.47620 15.34174 1427116077 76.47627 15.34179
## 6 6 1427116077 76.47627 15.34179 2398958028 76.47620 15.34174
## d d_weighted highway way_id component
## 1 0.075941518 0.084379472 service 28565950 1
## 2 0.075941518 0.084379472 service 28565950 1
## 3 0.005191200 0.005768001 service 28565950 1
## 4 0.005191200 0.005768001 service 28565950 1
## 5 0.005337372 0.005930413 service 28565950 1
## 6 0.005337372 0.005930413 service 28565950 1The columns of from_id and to_id contain the names of the vertices. To extract shortest paths between some of these, first take some small samples of from and to points, and submit them to dodgr_paths():
from <- sample (graph$from_id, size = 10)
to <- sample (graph$to_id, size = 5)
dp <- dodgr_paths (graph, from = from, to = to)
length (dp)## [1] 10The result (dp) is a list of 10 items, each of which contains 5 vectors. An example is,
dp [[1]] [[1]]## [1] "977472616" "977472988" "977473142" "1148815227" "2627465893"
## [6] "2636414339" "2636414340" "2636414343" "2627465887" "2627465884"
## [11] "339932428" "339932440" "339932425" "339932421" "339932419"
## [16] "339318479" "3818709604" "3818709605" "977472882" "3818709606"
## [21] "3818709607" "3818709608" "3818709609" "3818709610" "3818709611"
## [26] "3818709612" "339318473" "339318471" "339318470" "2636414337"
## [31] "339318467" "2636414331" "2636414338" "339059754" "977478675"
## [36] "1676740773" "4474520824" "245631133" "339059758" "977478643"
## [41] "4474520825" "2627477681" "286632904" "2398957897" "3338186982"
## [46] "286632903" "2398957894" "2398957893" "1148814827" "2398957892"
## [51] "2398957891" "286632902" "339574320" "2398957885" "2398957883"
## [56] "286632901" "1148815150" "676875132" "2398957865" "286632900"
## [61] "1148814896" "338908589" "2398957843" "338904455" "3697938024"
## [66] "3697938023" "3697938021" "3697938022" "3697938335" "3697938334"
## [71] "3697938333" "3697938338" "3697938337" "3697938336" "3697938331"
## [76] "3697938330" "3697938329" "3697938332" "3697938328" "3697938327"
## [81] "3697938326" "3697938325" "3697937571" "3697937610" "3697937615"
## [86] "3697937614" "3697937613" "3697937611" "3697937612" "3697937616"
## [91] "3697937609" "3697937608" "3697937607" "1376769110" "1376768828"
## [96] "1376768464" "1376768862" "1376768398" "1376768975" "1376768614"
## [101] "1376769209" "1376768918" "1376768559" "2717241302" "2717241300"
## [106] "2717241331" "2717241317" "2717241339" "2717241332" "2717241309"
## [111] "2717241321" "2717241306" "2717241323" "2717241312" "1376768738"
## [116] "1376768369" "1376768946" "1376768586" "1560930407" "1376768478"
## [121] "1376769039" "1376768690" "1376768324" "1376768985" "1376768626"
## [126] "339574829" "339574828" "1560930420" "1560930408" "339574827"
## [131] "339574826" "339574825" "339574824" "339574823" "1668645472"
## [136] "1668645470" "3818714154" "339574820" "339574819" "3818714155"
## [141] "2398957686" "339574631" "2717241324" "1148814809" "2398957654"
## [146] "2398957639" "339574630" "339574629" "2398957619" "339574628"
## [151] "1427115955" "338905128" "1376769164" "1376768779" "338905219"
## [156] "2398957589" "2398957588" "1376768510" "1376769086" "2398957584"
## [161] "338905220" "2398957576" "1427594104" "2398957571" "2398957570"
## [166] "2398957568" "338905221" "2398957564" "338905227" "2398957561"
## [171] "2398957557" "2398957549" "338905245" "2398957546" "2398957544"
## [176] "2398957543" "2398957542" "676635860" "2398957537" "2398957532"
## [181] "2398957526" "2398957521" "676875267" "2398957539" "2419196948"
## [186] "313796433" "1376768773" "2398957554" "2398957555" "313796432"
## [191] "3338186986" "2398957563" "2398957567" "313796431" "313796430"
## [196] "1376769158" "1427594112" "313796429" "2398957603" "313796428"
## [201] "313796427" "1128374399" "313796426" "1128374495" "2398957696"
## [206] "2398957701" "1376768565" "2398957713" "1376769010" "2398957720"
## [211] "313796425" "313796423" "2398957737" "2398957743" "313796421"
## [216] "2398957755" "2398957757" "2398957763" "1427594113" "2398957772"
## [221] "313796420" "313796419" "2398957776" "2398957777" "2398957778"
## [226] "313796418" "2398957779" "2398957780" "313796417" "2398957789"
## [231] "2398957790" "1427594114" "313796416" "2398957799" "313796415"
## [236] "2398957800" "2398957801" "2398957802"For spatial graphs, the coordinates of these paths can be obtained by extracting the vertices with dodgr_vertices() and matching the vertex IDs:
verts <- dodgr_vertices (graph)
path1 <- verts [match (dp [[1]] [[1]], verts$id), ]
head (path1)## id x y n
## 1952 977472616 76.46951 15.33250 988
## 1954 977472988 76.46964 15.33211 989
## 1956 977473142 76.46964 15.33202 990
## 616 1148815227 76.46965 15.33197 315
## 614 2627465893 76.46978 15.33197 314
## 4556 2636414339 76.46997 15.33197 2259Paths calculated on contracted graphs will of course have fewer vertices than those calculated on full graphs.
7 Aggregated Flows
The final major function of dodgr is dodgr_flows(), which aggregates ‘’flows’’ throughout a network from a set of origin (from) and destination (to) points. Flows commonly arise in origin-destination matrices used in transport studies, but may be any kind of generic flows on graphs. A flow matrix specifies the flow between each pair of origin and destination points, and the dodgr_flows() function aggregates all of these flows throughout a network and assigns a resultant aggregate flow to each edge.
For a set of nf points of origin and nt points of destination, flow are defined by a simple nf-by-nt matrix of values, as in the following code:
graph <- weight_streetnet (hampi)
from <- sample (graph$from_id, size = 10)
to <- sample (graph$to_id, size = 10)
flows <- matrix (10 * runif (length (from) * length (to)),
nrow = length (from))This flows matrix is then submitted to dodgr_flows(), which simply appends an additional column of flows to the submitted graph:
graph_f <- dodgr_flows (graph, from = from, to = to, flows = flows)
head (graph_f)## edge_id from_id from_lon from_lat to_id to_lon to_lat
## 1 1 339318500 76.47489 15.34169 339318502 76.47612 15.34173
## 2 2 339318502 76.47612 15.34173 339318500 76.47489 15.34169
## 3 3 339318502 76.47612 15.34173 2398958028 76.47620 15.34174
## 4 4 2398958028 76.47620 15.34174 339318502 76.47612 15.34173
## 5 5 2398958028 76.47620 15.34174 1427116077 76.47627 15.34179
## 6 6 1427116077 76.47627 15.34179 2398958028 76.47620 15.34174
## d d_weighted highway way_id component flow
## 1 0.075941518 0.084379472 service 28565950 1 32.88572
## 2 0.075941518 0.084379472 service 28565950 1 0.00000
## 3 0.005191200 0.005768001 service 28565950 1 32.88572
## 4 0.005191200 0.005768001 service 28565950 1 0.00000
## 5 0.005337372 0.005930413 service 28565950 1 32.88572
## 6 0.005337372 0.005930413 service 28565950 1 0.00000Most flows are zero because they have only been calculated between very few points in the graph.
summary (graph_f$flow)## Min. 1st Qu. Median Mean 3rd Qu. Max.
## 0.000 0.000 0.000 4.361 0.000 58.407Note that these flows are directed, so the flow from ‘A’ to ‘B’ will not necessarily equal the flow from ‘B’ to ‘A’. It is often desirable to aggregate flows in an undirected manner, for example for visualisations where plotting pairs of directed flows between each edge if often not feasible for large graphs. Directed flows can be aggregated to equivalent undirected flows with the merge_directed_flows() function:
graph_undir <- merge_directed_flows (graph_f)Resultant graphs produced by merge_directed_flows() only include those edges having non-zero flows, and so:
nrow (graph_f); nrow (graph_undir) # the latter is much smaller## [1] 6096## [1] 1626The resultant graph can readily be merged with the original graph to regain the original data on vertex coordinates through
graph <- graph [graph_undir$edge_id, ]
graph$flow <- graph_undir$flowThis graph may then be used to visalise flows, as in the following simple example:
library (ggplot2)
ggplot() + labs (x = "longitude", y = "latitude") +
geom_segment (data = graph, size = 5 * graph$flow / max (graph$flow),
aes (x = from_lon, y = from_lat, xend = to_lon, yend = to_lat,
colour = flow, size = flow)) +
scale_colour_gradient (low = "lawngreen", high = "dodgerblue")
Bibliography
Csardi, Gabor, and Tamas Nepusz. 2006. “The Igraph Software Package for Complex Network Research.” InterJournal Complex Systems: 1695. http://igraph.org.
Fredman, Michael L., and Robert Endre Tarjan. 1987. “Fibonacci Heaps and Their Uses in Improved Network Optimization Algorithms.” J. ACM 34 (3). New York, NY, USA: ACM: 596–615. doi:10.1145/28869.28874.
Johnson, Donald B. 1977. “Efficient Algorithms for Shortest Paths in Sparse Networks.” J. ACM 24 (1). New York, NY, USA: ACM: 1–13. doi:10.1145/321992.321993.
Miller, Rupert G. 1960. “Priority Queues.” The Annals of Mathematical Statistics 31 (1). Institute of Mathematical Statistics: 86–103. http://www.jstor.org/stable/2237496.
Saunders, S., and T. Takaoka. 2003. “Improved Shortest Path Algorithms for Nearly Acyclic Graphs.” Theoretical Computer Science 293 (3): 535–56.
Saunders, Shane. 2004. “Improved Shortest Path Algorithms for Nearly Acyclic Graphs.” PhD thesis, Department of Computer Science; Software Engineering, University of Canterbury, New Zealand.
Takaoka, Tadao. 1999. “Theory of 2-3 Heaps.” In Computing and Combinatorics: 5th Annual International Conference, Cocoon’99 Tokyo, Japan, July 26–28, 1999 Proceedings, edited by Takano Asano, Hideki Imai, D. T. Lee, Shin-ichi Nakano, and Takeshi Tokuyama, 41–50. Springer Berlin Heidelberg. doi:10.1007/3-540-48686-0_4.
———. 2000. “Theory of Trinomial Heaps.” In Computing and Combinatorics: 6th Annual International Conference, Cocoon 2000 Sydney, Australia, July 26–28, 2000 Proceedings, edited by Ding-Zhu Du, Peter Eades, Vladimir Estivill-Castro, Xuemin Lin, and Arun Sharma, 362–72. Springer Berlin Heidelberg. doi:10.1007/3-540-44968-X_36.
Tarjan, R. 1983. Data Structures and Network Algorithms. Society for Industrial; Applied Mathematics. doi:10.1137/1.9781611970265.