General introduction to justifier

Justification frameworks

To this end, justifier work with the concept of justification frameworks. These frameworks provide the context for the decisions and justifications. The justification frameworks, therefore, enable one to extend the justifier format to attach context to decisions, for example in terms of which part of a process they pertain to, or in terms of what part of the world they relate to. These contexts or domains are hierarchically structured within the justification framework. In addition to their position in the wider framework, each context can specify constraints for decisions in that context. When justifier processes a set of justifications in this framework, it will notice violations of this specification. Such values can achieve additional attributes, such as scores, ranks, or strings with comments. These attributes can then be aggregated for all justifications in a domain, or collapsed to lower levels of the context tree. This makes justification frameworks ‘judgemental’, where justifications in themselves are not judgemental; they simply document. However, when placed in a context, such justifications can be categorized as better or worse using the metadata provided by the justification framework.

For example, imagine a social activity committee at a faculty at a university somewhere in the world. Since social cohesion is an important factor in staff happiness, it would make sense that such a vital organ as the social activity committee would decide to document their minutes using justifier, after all. In a meeting, they could decide to organise the next annual faculty outing as a bowling match, and to not include dinner, but include lunch. The underying reasoning could be that last year, there was a non-sporty activity, and the dinner got quite out of hand. These choices therefore cater to people’s perceived need for variation and hopefully avoid embarrassing (but fun) scenarios like those witnessed last year.

By imposing a justification framework, one could, for example, attach a ‘decision quality’ value to these decisions. Imagine a framework for a faculty that values democracy very highly. In this framework, decisions’ justifications pertaining to the context of ‘activity’ have to have one of three values: ‘survey under staff’, ‘discussion at staff meeting’, or ‘internally generated’. It is then possible to easily generate overview of types of justifications in different meetings. For example, it could, hypothetically, turn out to be the case that decision bodies at higher levels make more internally generated decisions, whereas decisions at lower levels are more often based on discussions with staff members.

Two examples of such frameworks are provided in the ‘justifier in behavior change intervention development’ and ‘justifier in study design’ vignettes.

For example, when designing an empirical study, some form of data will often be gathered. In the design phase, therefore, decisions are taken as to the amount of data that will be required. These decisions share a role in the study design process, and once such context is clear, further specification of the decisions becomes possible. For example, for quantitative studies in psychology, a decision could pertain to whether sample size calculations are based on a frequentist approach, such as on null hpothesis significance testing, accuracy in parameter estimation, or a Bayesian approach.

For example, a framework could contain a context called study type that specifies that decisions in that context can only have one of two values: “confirmatory” or “exploratory”.

In addition, the relative contextual information enables collapsing the justifi

Justification frameworks can be specified in three ways. First, using YAML stored in a local file; second, using a spreadsheet stored in a local file; and third, using a spreadsheet loaded from Google Sheets. Of these,

Efficient specification and scope

When specifying something for multiple justifications, the eponymous justifier element can be used, making that the fifth justifier element. Contents of a justifier element pertain to all other elements in a file (scope: local), or in a project directory (scope: global), or all files that are read by the justifier package in a project (scope: universal).

For example, to specify that the justification framework is stored in file justifier-framework-specification.jmd, and that this framework should be applied to all justifications in this directory that do not have another framework attached:

---
justifier:
  framework: justifier-framework-specification.jmd
  scope: global
---

To specify that all justifications in this file are produced at date the sixth of March 2019:

---
justifier:
  date: 2019-03-06
  scope: local
---

The type metadata can be used to impose more constraints by providing conditions. For example, to specify that all decisions in the project of the type “global_design” must have either “experimental” or “observational” as value, one would use:

---
justifier:
  scope: universal
  condition:
    element: decision
    type: global_method
    values: ["experimental", "observational"]
---

justifier will then check the type of all decisions in the project. If a decision has the type “global_design”, justifier will check whether whether it has a value and whether the value is “experimental” or “observational”; if not, justifier will indicate this.

It is also possible to attach additional attributes to these values, such as scores or weights, by including another vector:

---
justifier:
  scope: universal
  condition:
    element: decision
    type: global_method
    values: ["experimental", "observational"]
    scores: [1, 2]
---