The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.
German districts were merged and split several times since 2003, most
of them in the reforms of Sachsen-Anhalt (2007), Sachsen (2008) and
Mecklenburg-Vorpommern (2011). A district code in 2005 may not exist in
2025, and a district of 2025 may combine parts of several earlier ones.
Comparing districts over time therefore needs the data of every year on
one boundary (Gebietsstand). This vignette describes how
pksR and its data pipeline do that, and which assumptions
the results rest on. A German version is
vignette("harmonization-de").
The territorial crosswalk comes from the transition keys (Umsteigeschlüssel) of the Bundesinstitut für Bau-, Stadt- und Raumforschung (BBSR). For every year it maps each district at 31 December of year t to the districts at 31 December of t + 1, with two kinds of weights:
Each data release contains the crosswalk it used,
boundary_map.csv, with one row per year, source district
and target district. Three kinds of rows:
source |
Meaning |
|---|---|
bbsr |
Row of the BBSR file, unchanged |
manual |
Replaces a BBSR row that is wrong, with a reason (for example a
source code error in the BBSR sheet 2011-2012, where a piece of
Bernkastel-Wittlich 07231 is listed under Trier-Saarburg
07235) |
destatis |
A transfer of a municipality between districts that BBSR omits, taken from the Destatis lists of municipal changes, with a reason |
Manual and Destatis rows that have not yet been reviewed by the
maintainer carry status = "draft".
For a target boundary year T, the yearly steps are chained from each year’s own boundary to T. Then, per year:
hz = cases / population * 1e5,
clearance_rate = cleared / cases * 100. Districts that did
not change keep the published values.pks_offences()). A published
key is never added to its parent or child key implicitly.Merges are exact (weight 1). Splits are estimates: the weights assume
that cases are distributed like inhabitants (or like area) within the
old district. Rows that rest on such a share are marked
estimated = TRUE, as are the PDF years 2003 to 2012, whose
counts are derived from the published rates.
# Latest boundary, population weights: the released panel
latest <- pks_get(years = 2005:2015)
# Boundary of 2011, after the reform in Mecklenburg-Vorpommern
d2011 <- pks_get(years = 2005:2011, harmonize_to = 2011)
# Area weights instead of population weights
area <- pks_get(years = 2005:2015, weights = "area")The latest boundary is read as released and is fastest. Other target years are computed in your session from the data as published and the crosswalk of the same release; for the latest boundary both ways give the same panel (checked to 1e-10 on all years 2003 to 2025).
Every harmonized panel rests on two choices: the weights for split districts, and harmonizing at all. Results that hold under every choice rest less on the assumptions above.
The weights differ only where districts were split.
pks_compare_weights() puts both versions of a panel side by
side:
d <- pks_get(years = 2005:2012, offence = "total")
w <- pks_compare_weights(d) # downloads the same request with area weights
w[abs(w$relative_difference) > 0.01, c("year", "ags", "region_name", "cases_population", "cases_area")]The result has the cases and the recomputed HZ under both weights, the difference and the relative difference. Merged and unchanged districts are identical; national totals are the same under both weights. A regression can be run twice, once on each column, to see whether a coefficient moves:
Not harmonizing at all is the third choice.
harmonize_to = NULL gives each year with its own districts,
an unbalanced panel: districts that were merged or split appear and
disappear, and no value is estimated.
published <- pks_get(years = 2005:2012, offence = "total", harmonize_to = NULL)
table(published$year) # the number of districts changes with the reforms
harmonized <- pks_get(years = 2005:2012, offence = "total")
table(harmonized$year) # the same 400 districts every yearTwo common ways to use the published data:
# Districts that exist with the same code in every year of the period.
# A district that absorbed another keeps its code (the Wartburgkreis in
# 2021): drop such districts too, using the crosswalk of the release.
stable <- Reduce(intersect, split(published$ags, published$year))
balanced <- published[published$ags %in% stable, ]
# Harmonized rows that rest on split weights
sum(harmonized$estimated)Comparing an estimate on the harmonized panel (population weights), the harmonized panel (area weights), the unbalanced panel and the balanced panel of unchanged districts shows how much it depends on harmonization.
The BKA divides the cases of year t by the population of 31 December
of year t - 1, on the census base of its time: older registers until
2012, Zensus 2011 for 2013 to 2023 and Zensus 2022 from 2024. Both
censuses found fewer inhabitants than the registers, by up to 8 percent
in single districts. Rates therefore jump in 2013 and 2024 without any
change in crime (pks_breaks(), BRK-004 and BRK-005).
Column population_corrected holds the census-corrected
population of the BBSR (INKAR indicator “Bevölkerung mit
BBSR-Zensuskorrekturen”): the gap found at each census is spread back
linearly over the years before, so the series has no census break. It is
dated to the same 31 December as the HZ and moved to the boundary of
each row like the counts. pks_rates() uses it with
population = "corrected":
d <- pks_example()
r <- pks_rates(d, population = "corrected")
head(r[, c("year", "ags", "offence_key", "hz", "rate_population")])
#> # A tibble: 6 x 5
#> year ags offence_key hz rate_population
#> <int> <chr> <chr> <dbl> <dbl>
#> 1 2019 01001 ------ 9383. 91838
#> 2 2019 02000 ------ 11467. 1803349
#> 3 2019 03159 ------ 6354. 327807
#> 4 2019 11000 ------ 14394. 3566936
#> 5 2019 16063 ------ 4449. 163267.
#> 6 2019 01001 890000 9076. 91838The correction is an estimate of the BBSR, not an official revision; for 2025 the population behind the HZ is used, which is already on the Zensus 2022 base.
The population used for the rates is the published one where the BKA prints it (the PDF years and 2020), otherwise derived from cases and HZ. An official population series can replace it:
d <- pks_example()
pop <- unique(data.frame(year = d$year, ags = d$ags, population = d$derived_population))
head(pks_rates(d, population = pop)[, c("year", "ags", "offence_key", "hz")])
#> # A tibble: 6 x 4
#> year ags offence_key hz
#> <int> <chr> <chr> <dbl>
#> 1 2019 01001 ------ 9628.
#> 2 2019 02000 ------ 11231.
#> 3 2019 03159 ------ 6349.
#> 4 2019 11000 ------ 14086.
#> 5 2019 16063 ------ 4397.
#> 6 2019 01001 890000 9312.These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.