Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Exploring Finite Factored Sets with some toy examples, published by Thomas Kehrenberg on March 19, 2022 on The AI Alignment Forum.
Seeing as there is little secondary literature for the Finite Factored Set formalism, I thought I’d write up my experience of exploring it through some toy examples that are classic examples in the Pearlian paradigm. My goal was to see how these models that I understood very well in the Pearlian paradigm would work in Finite Factored Sets.
As a warning, this doesn’t make any use of the more exciting properties of Finite Factored Sets. It’s just an exploration of how this formalism handles the mundane stuff. This also means that I’m using the factored set directly, without the abstractions of the orthogonality database. Which I think is fine here, because these are tiny toy examples whose structure is fully known. (However, it’s possible that I’ve missed the entire point of Finite Factored Sets.)
The first example is the 3-variable collider that is very central to Pearl’s formalism. It is given by the following Causal Diagram:
A, B, and C are all binary variables (0=false, 1=true).
The intended meaning of a Causal Diagram (or rather, function causal model) is that the value of a node xi is given by a deterministic function that takes as input the parents, pa(xi), (indicated by the arrows) and an “error”, or “noise”, variable ui that is governed by a probability distribution that is independent from the other error/noise variables: xi=fi(pa(xi),ui). Thus, the value of C is given by c=fc(a,b,uC) where uC is noise or uncertainty that is not explicitly modeled, which we can visualize like this:
We could also split up A and B into a deterministic and a random part, but as they are root nodes, there is little point. It would just be a=fa(uA).
The Pearlian formalism runs on graphs, but Finite Factored Sets run on the set S of all possible outcomes – the sample space. So, the goal is now to construct a sample space that is consistent to the above graph. After that, we’ll find a factorization of that sample space.
I think it should be clear that to cover the whole sample space S, it is sufficient to consider all possible combinations of the outcomes of A, B, and UC (but not C), because if we know the value of these three, then we also know the value of C, via fc.
So, we simply define S as the Cartesian product of the sets of possible values of A and B: A={0,1}, B={0,1}, and the possible values of UC: UC, which I’ll leave undefined for the moment (except to note that it must be a finite set): S=A×B×UC,(a,b,uC)∈S (We use the lowercase letters to represent elements of sets that make up the Cartesian product: a∈A, b∈B, and uC∈UC.)
Then – as is custom in the formalism of Finite Factored Sets – the variables A, B, UC are defined as partitions on S. For example, A is a partition consisting of two parts: 1) the set of elements of S where a=0 and 2) those where a=1: A={{(a,b,uC)∈S|a=0},{(a,b,uC)∈S|a=1}} This captures exactly what the variable A is supposed to represent: the question of whether the first element of the Cartesian product is 0 or 1. B is defined analogously: B={{(a,b,uC)∈S|b=0},{(a,b,uC)∈S|b=1}} And UC as well: UC={{(a,b,uC)∈S|uC=0},.} with an as of yet undefined number of parts in the partition.
Now, given the way we constructed S, the set of partitions G={A,B,UC} is a factorization of S: F=(S,G), because any element of S can be uniquely identified by knowing in which part of A, B, and UC it is, because S is just the Cartesian product of A, B, and UC.
Now that we have the set, let’s look at the probability distribution over S. Let P(A=a′) be shorthand for P({(a,b,uC)∈S|a=a′}), i.e., the probability that the outcome lands in the subset {(a,b,uC)∈S|a=a′} of the sample space S, where the first element of the Cartesian product is equal to a′. We ...