Home

Awesome

Terrifically Simple JSON

Introduction

The goal of Terrifically Simple JSON is to define the simplest and most regular way possible of using JSON to represent data in Web APIs<a href="#footnote1" id="ref1"><sup>1</sup></a>. The syntax of Terrifically Simple JSON is exactly the same as the syntax of regular JSON—Terrifically Simple JSON concerns itself only with how you use JSON.

Regular JSON describes an object as "an unordered set of name/value pairs"<a href="#footnote2" id="ref2"><sup>2</sup></a>. It does not otherwise say what an object is, what a name is or what a value is (beyond defining basic datatypes). This gives designers a lot of flexibility, which often leads to complex JSON.

Terrifically Simple JSON reduces complexity by adding 3 constraints:

  1. Every Terrifically Simple JSON object must correspond to an entity in the data model of the API.
  2. The name of a name/value pair must refer to a property or relationship in the state of the corresponding entity.
  3. The value of a name/value pair must be the value of the entity property referenced by the name.

Terrifically Simple JSON defines a special name/value pair whose name is self, that allows you to declare explicitly which data model entity a particular JSON object corresponds to. Its value is an identifier encoded as a JSON string. self is not a property of the entity; it specifies the identity of the entity whose property values are given by the other name/value pairs in the same JSON object.

The only requirements of Terrifically Simple JSON are that you follow the 3 constraints above, and use the self name/value pair to express constraint #1 explicitly.

There is a generalization of the self concept that allows arbitrary datatypes to be expressed in JSON in a consistent fashion. This generalization is expressed with the optional _value and _datatype name/value pairs. Terrifically Simple JSON does not require you to use them, but they are there if you want an explicit way to handle arbitrary datatypes in Terrifically Simple JSON.

The special meanings assigned to self, _value and _datatype suggest a new media type, however minimal. There is no registered media type for Terrifically Simple JSON — just use application/json. Since they are conceptually part of the media type, the self, _value and _datatype JSON name/value pairs are exempt from constraints #2 and #3.

Tutorial

The following is a Terrifically Simple JSON document:

{
 "name": "Martin",
 "bornOn": "1957-01-05",
 "bornIn": "http://www.scotland.org#"
}

Because of Terrifically Simple JSON's 3 constraints, we know that this single JSON object with 3 name/value pairs represents a single entity in the API data model with 3 property values.

The primary idea and primary value of Terrifically Simple JSON is that each JSON object will follow this simple pattern, without exception.

The following JSON document encodes the same information in a different style. It is not Terrifically Simple JSON—it violates all 3 of the constraints above. That does not mean it's a bad design, just that it follows a different set of rules than Terrifically Simple JSON; it is its own media type.

 1. {
 2.  "properties": 
 3.     {
 4.      "name": "Martin",
 5.      "bornOn": "1957-01-05"
 6.     },
 7.  "links": [
 8.     {
 9.      "rel": "bornIn",
10.      "href": "http://www.scotland.org#"
11.     } 
12.  ]
13. }

Lines 3-6 and 8-11 violate constraint 1—these JSON objects have no corresponding entity in the data model.
Lines 2, 7, 9, and 10 violate constraint 2—these JSON names are not properties of a corresponding entity.
Line 9 violates constraint 3—bornIn is a property (or relationship) name in the data model, not a value.

self

Constraint #1 of Terrifically Simple JSON is that every JSON object corresponds to an entity in the API data model. The self name/value pair provides a direct way of specifying which entity. Its value is an identifier encoded as a JSON string. Here is an example of its use:

{
 "self": "http://martin-nally.name#",
 "firstName": "Martin"
}

This example says simply that the entity whose id is http://martin-nally.name# has the first name Martin. Constraints 2 and 3 tell us that the first name of the entity is Martin and the self name/value pair tells us which entity we are talking about.

You might think that in a web API it would be natural for all identifiers to be URIs, specifically HTTP URLs since those are the URIs of the web. In reality, using HTTP URLs for identifiers, as I do in the examples, is unusual in web APIs. It is much more common to use simple identifiers that look like database primary keys, and require the client to learn rules specific to the API to translate these identifiers into HTTP URLs whenever necessary. Terrifically Simple JSON does not mandate any particular syntax or semantics for identifiers, and can be used with the identifiers of your choice.

The self name/value pair can be used in nested objects too, like this:

{
 "self": "http://martin-nally.name#",
 "bornIn": 
    {
    "self": "http://www.scotland.org#",
    "gaelicName": "Alba"
    }
}

This example encodes two separate pieces of information:

When self is missing

When the self name/value pair of a Terrifically Simple JSON object is missing, the object still must correspond to an entity in the API data model. A JSON object with no self should be read as a noun clause that references an entity. The following example

{
 "isA": "Person",
 "name": "Martin",
 "eyeColor": 
    {
     "isA": "RGBColor",
     "red": 0,
     "green": 0,
     "blue": 155
    }
}

should be read as meaning, "the Person whose name is Martin has eyes colored the RGBColor whose red value is zero, green value is 0 and blue value is 155".

<a name="explicit-identifiers"></a>An explicit way of encoding identifiers

The following two examples are both Terrifically Simple JSON (you can verify that they follow the constraints).

{
 "self": "http://martin-nally.name#",
 "bornIn": "http://www.scotland.org#"
}

{
 "self": "http://martin-nally.name#",
 "bornIn": {"self": "http://www.scotland.org#"}
}

Interpreted strictly, the second example says I was born in a country while the first says I was born in a string. Common sense tells us that the intent of the first is the same as that of the second. Computers are not very good at common sense, but humans are if they have some context. Whether you use the first or second form in your API might depend on who the audience is and whether you want to require them to already know that the value of bornIn will be a reference to another entity. This choice involves a trade-off between ease-of-use and precision— the first form is simpler to read and code for a human who has the required knowledge and the second form can be reliably interpreted without that prior knowledge <a href="#footnote3" id="ref3"><sup>3</sup></a>.

That's it

That is it for the required part of Terrifically Simple JSON. The next section describes an optional extension.

<a name="datatypes"></a>Datatypes

One of the challenges of JSON is that it only supports 4 useful datatypes: number, string, boolean and array (the null value is the unique member of a 5th datatype). Two common datatypes in Web API programming that are not covered by JSON are URL and date/time. Unless you are willing to invent extensions or conventions on top of JSON—in other words, a new media type—the best you can do is to encode them as strings. The example above shows how the self name/value pair can be used in Terrifically Simple JSON to encode URLs more precisely, at some cost to simplicity and ease-of-programming. This idea can be extended to other datatypes by defining the following two Terrifically Simple JSON examples to be equivalent.

{
 "self": "http://martin-nally.name#",
 "bornIn": {"self": "http://www.scotland.org#"}
}

{
 "self": "http://martin-nally.name#",
 "bornIn": {
    "_value": "http://www.scotland.org#",
    "_datatype": "entity"
    }
}

The _datatype value tells you the datatype of the entity referenced in the _value field, and by inference the syntax of the datatype values. _datatype and _value must both appear in an object, or neither must appear. A Terrifically Simple JSON object may have self or _value, but not both. The self name/value pair is a shorthand way to express an identifier _value for entities whose _datatype is entity.

Other values for _datatype can be used for other datatypes, e.g. dates, like this:

{
 "self": "http://martin-nally.name#",
 "bornOn": {
    "_value": "1957-01-05",
    "_datatype": "https://tools.ietf.org/html/rfc3339"
    }
}

In principle, the JSON built-in types can be handled the same way. In other words, the following are equivalent:

{
 "self": "http://martin-nally.name#",
 "heightInCM": 178
}

{
 "self": "http://martin-nally.name#",
 "heightInCM": {
    "_value": "178",
    "_datatype": "http://www.json.org/#number"
    }
}

[<a href="#footnote4" id="ref4"><sup>4</sup></a>] If this example seems unintuitive, consider that when you write 178 in JSON, you are writing a reference to an entity. The number 178 is an entity that has been around a lot longer than JSON—the notation you are using to write this reference was developed over 3 millenia. Other notations for writing references to the same entity exist—it can be written as CLXXVIII in Roman numerals. When you write true or false in JSON, you are writing a reference using a notation that is specific to booleans. Strings can be viewed the same way, although it may take a little more thought to see why this is true (think of different notions for designating the same string). Any datatype can be thought of as consisting of a pre-defined set of entities with a notation for writing references to those entities [and perhaps some operators on them, but operators are outside of the scope of JSON]. JSON has built-in notations for referencing numbers, booleans and strings—for other datatypes, we must state explicitly which datatype and notation we're using, or rely on contextual knowledge. This view of datatypes says that in Terrifically Simple JSON, values as well as objects must correspond to entities in the API model.

I'm not suggesting that anyone would actually encode a number in JSON in this way<a href="#footnote5" id="ref5"><sup>5</sup></a>—the point is to show that the concept works for all datatypes. If you need a way to encode dates and other dataypes that distinguishes them from strings, this is the way you should do it in Terrifically Simple JSON. If you don't need to distinguish dates from strings—that is, you rely on the client having enough context to know which values are dates— then you can represent dates as simple strings.

No Collections?

Many media types include special support for collections. Terrifically Simple JSON considers collections to be simply entities that are exposed using the normal rules of Terrifically Simple JSON. Here is an example:

{"self": "http://scotland.org/native-sons",
 "contents": [
    {"self": "http://martin-nally.name#"},
    {"self": "many more like this"}
    ]
}

In summary, Terrifically Simple JSON considers that standardization of collection representations is a data modelling (ontology) problem, not a media-type problem. It takes the same view of classes and types.

Prior Art and Acknowledgements

If you know RDF, you will recognize that Terrifically Simple JSON is a representation format for an information model that is similar to that of RDF; adding a self name/value pair to a JSON object converts JSON's name/value pairs into triples, with the value of self providing the subject. Terrifically Simple JSON objects without a self name/value pair are like RDF blank nodes. Terrifically Simple JSON is not trying to define a new RDF format or a new information model—its goal is to constrain the patterns of use of JSON to make Web APIs easier to design and use.

Compared to the RDF information model model, Terrifically Simple JSON lacks the requirements that predicates and classes be entities identified with URLs and lacks the ability to express multi-valued properties. Having done a couple of projects adhereing faithfully to the RDF model, we've seen that those RDF features cause significant friction in practical API programming. Those features also contribute significantly to the complexity of standard JSON representations of RDF, especially JSON-LD, whose complexity is likely to be fatal in my opinion, but also, to a lesser degree, RDF/JSON. Terrifically Simple JSON inherits JSON's array feature for expressing list-valued properties, and leaves concepts like a type predicate and classes to the API data model designer.

Terrifically Simple JSON has very few concepts, and those it has are mostly stolen from elsewhere. The value is in what is left out, not what was put in. The self name/value pair of Terrifically Simple JSON corresponds fairly exactly to the @id name/value pair of JSON-LD. This is the only concept found in JSON-LD that also appears in Terrifically Simple JSON. We chose self instead of @id because @id is awkward for Javascript programming, and self is used by others (standardized by ATOM, and often copied). _value and _datatype perform the same functions as value, type and datatype from RDF/JSON. We use _value and _datatype (only 2 are needed) to reduce the likelihood of collisions with property names.

_

<a name="footnote1"><sup>1</sup></a> Terrifically Simple JSON could also be used in other contexts where JSON is used. <a href="#ref1">↩</a>

<a name="footnote2"><sup>2</sup></a> Although this is what the JSON site says, it is not what is generally implemented for JSON. What is implemented is an unordered set of names, each with an associated value. The definition as written implies that there can be more than one name/value pair with the same name but different values. The full IETF spec for JSON says that "The names within an object SHOULD be unique". This restriction allows JSON to map simply to common programming language constructs, which is the primary value of JSON and reason for its success.<a href="#ref2">↩</a>

<a name="footnote3"><sup>3</sup></a> To understand what it is like to lack the required context, imagine both examples with all property names and values in Chinese characters (unless you can actually read Chinese, in which case use Cryllic or Arabic). <a href="#ref3">↩</a>

<a name="footnote4"><sup>4</sup>I invented this identifier for the JSON number notation—I'm not aware of an official one.</a><a href="#ref4">↩</a>

<a name="footnote5"><sup>5</sup></a> RDF/JSON encodes even types for which JSON has built-in support this way.<a href="#ref5">↩</a>