SE-VGAE: Unsupervised Disentangled Representation Learning for Interpretable Architectural Layout Design Graph Generation

Bengio et al. [17] define disentangled representation as the separation of distinct, independent, and informative generative factors in observed data, crucial for understanding real-world data distributions, including complex graph structures. This concept is essential in deep graph representation learning models, where it is beneficial to discern which latent variables influence specific graph generation properties. Studies using disentanglement-oriented neural networks have demonstrated potential in this area. Stoehr et al. [11] used $\beta$-Variational Autoencoders ($\beta$-VAE) [18] to discover generative parameters in graphs but neglected edge features and node order independence, compromising reconstruction fidelity. Guo et al. [12, 13] addressed some of these issues with NED-VAE, a framework with sub-encoders and sub-decoders for disentangling node, edge, and graph-level features, though they overlooked graph node permutation invariance and did not use highly expressive graph aggregation methods. The expressive power of graph representation learning is crucial for identifying and differentiating subtle variations within graph structures. Graph neural networks (GNNs) extend the Weisfeiler-Lehman (WL) isomorphism test by representing graphs as vectors in continuous space, capturing relationships between different topologies [19]. However, conventional GNNs are only as powerful as the 1-dimensional WL test [20, 21]. Zhang et al. [22] categorize efforts to enhance GNN expressiveness into three approaches: graph feature enhancement [23], graph topology enhancement [24, 25, 26, 21], and model architecture enhancement [21, 26]. While model architecture enhancement increases complexity and parameters, feature and topology enhancements are more lightweight and easier to implement. These enhancements include adding local and global topological information to each node and using random node attributes or positional information to improve representation [25, 27, 24, 28].

Robust quantitative evaluation is crucial for graph generative modelling, focusing on the difference between learned and reference graph distributions. Evaluating these distributions is challenging due to the unique properties of graph data. Traditional methods calculate the statistical distribution distance between real and generated graphs but often overlook continuous node and edge features [29]. Recently, neural network classifier-based metrics have gained popularity for aligning learned and real graph distributions [30, 29]. However, metrics from image generation, which use task-specific neural networks, have limitations in graph generative modelling due to the adaptability issues of pre-trained graph neural networks. To address this, studies have shown that randomly initialized graph neural networks can effectively evaluate graph generative models without the need for further training [21, 20, 29].

Architectural layout design can be naturally represented as graphs. Specifically, a floor plan layout can be converted into a dual graph, emphasizing space adjacency with nodes as spaces and edges as connectivity [31, 1]. These adjacency graphs can also embed three-dimensional architectural information [32]. Neural network-based graph generation is a burgeoning field explored in various domains like molecules, protein structures, and scene graphs [12, 14, 15, 16]. However, in architectural design research, while many studies focus on generating architectural data in Euclidean formats like images and 3D models [9, 8, 10], the specific task of generating architectural layout design graphs has been notably unexplored.

Design space is crucial in architectural design research, with its exploration often used to approximate the design process [3, 4, 7, 5, 6]. Previous studies primarily focused on superior exploration strategies, leaving the intrinsic structure of design representation space vague [4]. As design activities are made possible because of designers’ mental models of design representation spaces that designers constantly perceive and formulate [4, 5, 6], Chen & Stouffs [6, 8] promote two explicit models of design representation spaces: the sparse human-learned model and the compressed machine-learned model, arguing that designers may enhance design performance by interacting with simulated design representation spaces. In this context, converting architectural design data into machine-interpretable formats is necessary, requiring flexible representation learning schemes. Recent data-driven techniques have demonstrated the ability to interpret design concepts by converting data into vectors of neural activities [8, 33]. However, current studies on architectural design representation focus mainly on Euclidean data, with limited exploration of non-Euclidean data like graphs.

Formally, a graph is denoted as $G=\left(V,E\right)$ where $V$ is the set of nodes, and $E$ is the set of edges. We denote an edge going from node $v_{i}\in V$ to node $v_{j}\in V$ as $\left(v_{i},v_{j}\right)\in E$. This study does not consider self-loop edges, namely a node connecting to itself. The number of nodes $n=\left|V\right|$ is called the order of graph $G$, and the number of edges $e=\left|E\right|$ is called the size of graph $G$. In this study, we consider multi-graphs within which there can be more than one edge between a pair of nodes. Also, only undirected graphs are discussed, s.t., $\left(v_{i},v_{j}\right)\in E\Leftrightarrow\left(v_{j},v_{i}\right)\in E$.

A convenient way to represent a graph is through an adjacency matrix. An adjacency matrix $A$ for a multi-graph is a symmetric square matrix with $A_{u,v}=a$ if $\left(u,v\right)\in E$ and $a$ is the number of edges connecting nodes $u$ and $v$. To represent a graph $G$ with an adjacency matrix $A$, the node set $V$ of graph $G$ needs to be ordered previously so that every node indexes a particular row and column in the adjacency matrix $A$. There are $n!$ possible node orderings for a graph with order $n$, each corresponding to a unique, arbitrary node ordering $\pi$. Thus, if we choose an ordering $\pi$, the graph can be represented by the corresponding adjacency matrix $A^{\pi}\in\mathbb{R}^{n\times n}$. Considering the multiplicity of possible representations of a single graph, this necessitates the formulation of training mechanisms of graph representation learning models invariant or equivariant to different node permutations of the same graph. That is to say, any arbitrary node permutations of the same graph should result in identical graph representations, and ideally, deep graph representation learning and generative modelling need to learn permutation-invariant graph distributions.

The learning objective of deep graph representation learning, especially a graph generative model, is to maximize the likelihood of $p\left(G\right)=\sum_{\pi}P\left(G,\pi\right)$. However, while graph encoding can abstract away the ordering of nodes with permutation-invariant node aggregation operations, graph decoding must establish certain node orderings as concrete expressions. Under relatively lenient conditions, graph decoders can attain permutation-equivariance; when presented with a permuted graph, the graph generative model can produce correspondingly permuted graph representations. For sequential generation methods, attaining permutation equivariance is far from trivial and presents a complex challenge, yet achieving this can be straightforward for one-shot generation methods. This is usually done by redefining one or a series of node ordering (e.g., breadth-first search, depth-first search, node degree, or a family of canonical orderings) [30, 34]. Specifically, canonical ordering refers to systematically arranging the nodes of a graph according to specific rules or algorithms, resulting in a consistent and standardized ordering [34]. A family of canonical orderings can be predefined as $K=\left\{\pi_{1},\ldots,\pi_{k}\right\}$ and can be used to learn an evidence lower bound (ELBO) of $\sum_{\pi}P\left(G,\pi\right)$, namely $\sum_{\pi\in K}P\left(G,\pi\right)$, as $K$ is a strict subset of the full factorial range of node orderings. It is also a tighter lower bound than any single arbitrary canonical ordering likelihood $P\left(G,\pi\right)$. Additionally, enlarging the size of $K$ can result in a tighter lower bound. Selecting an appropriately sized set $K$ can thus strike an optimal balance between the tightness of the bound – which typically corresponds to improved model quality – and the computational costs involved.

Meanwhile, a graph can have both node and edge attributes; such a graph is referred to as an attributed graph. An attributed graph is defined as $G=\left(V,E,X,A^{e}\right)$. The node feature matrix is denoted as $X\in\mathbb{R}^{n\times d}$, where we assume that the ordering of the nodes is consistent with the ordering in the corresponding adjacency matrix $A$, with $x_{\nu}\in\mathbb{R}^{d}$ denoting the feature vector of node $v$, while $d$ is the dimension of the node attributes. While the edge feature matrix can be denoted as $A^{e}\in\mathbb{R}^{n\times n\times c}$, with $x_{u,v}^{e}\in\mathbb{R}^{c}$ representing the feature vector of edge $\left(u,v\right)\in A$, while $c$ is the dimension of the edge attributes. The edge feature matrix can also be understood as the original adjacency matrix $A$ with the edge feature dimension $c$ added to each $A_{u,v}$.

Given a set of observed graphs, $D_{G}=\left\{G_{1},\ldots,G_{s}\right\}$ with underlying data distribution $p\left(G\right)$, where each graph $G_{i}$ may have different order $n_{i}$ and size $e_{i}$, we have $G\sim p\left(G\right)$ for each graph $G$ in the dataset. The goal is to have a deep graph representation learning model that is able to learn a close enough estimation $p_{model}\left(G\right)$ of the real graph distribution $p\left(G\right)$ without being constrained to a predetermined order or size of the graphs. Such a model would be capable of generating novel, previously unseen graphs of various orders and sizes drawn from the learned probabilistic model $p_{model}\left(G\right)$.

The representation map** encoders and decoders are essential for acquiring such graph representation learning models. Formally, a graph encoder, denoted as $f\left(z|G\right)$, maps a real discrete graph object as a dense, continuous vector $z$ of a low-dimensional stochastic latent space that follows a prior distribution $p\left(z\right)$; the graph encoder $f\left(z|G\right)$ outputs the parameters of the stochastic distribution. While a graph decoder, denoted as $f\left(G|z\right)$, accepts a latent vector $z\sim p\left(z\right)$ sampled from the same stochastic distribution $p\left(z\right)$ and performs the inverse function of the graph encoder. Graphs and corresponding features are transformed into a continuous vector space during encoding. Translating continuous data representations back into discrete graph structures, including nodes and edges, is non-trivial. This reconstruction task can take various forms, ranging from the sequential generation of the nodes and edges of the graphs step by step to the one-shot generation of the adjacency matrices or edge lists. Sequential generation leverages local decision-making efficiently and is flexible when the number of nodes is unknown. However, it struggles with maintaining long-range dependencies, which can result in omitting crucial global graph properties. Conversely, one-shot generation can capture a graph’s global properties by simultaneously generating and refining the entire graph structure across multiple iterations [14]. This study adopts the one-shot generation method, as it can learn to map entire graphs into unified latent representations and generate an entire graph directly through a single-step sampling, allowing the extraction of crucial global graph properties without sacrificing computational efficiency.

The ultimate problem this study tries to solve is disentangling local and global graph generative dependencies, which can provide insights into architectural layout design graph topologies. Ideally, upon mastering a latent space that accurately represents the distribution of real graphs, one can sample new latent code $z\sim p\left(z\right)$ from this space to control the characteristics of the generated graphs. Disentangled sampling can be then applied by segmenting the latent vector $z$ into distinct dimensions, with each dimension $z_{n}$ focusing on a unique property. As a result, altering a single latent dimension $z_{n}$ can induce specific property changes in the generated graphs, enabling precise manipulation of graph characteristics.

This study introduces the Style-based Edge-augmented Variational Graph Auto-Encoder (SE-VGAE), a novel framework designed for unsupervised disentangled representation learning aimed at automatically decomposing latent generative factors within architectural layout design graphs represented in the form of attributed adjacency multi-graphs. The framework comprises three alternative disentanglement pipelines tailored for interpreting the layout design graph data space (refer to Fig. 1). Each pipeline consists of three primary components.

The first component features a transformer-based edge-augmented encoder designed with permutation equivariance to integrate both node and edge features. This encoder takes the node feature matrix and the edge feature matrix of an attributed adjacency multi-graph as input, producing updated node and edge embeddings integrating both local and global nodes and edges’ features as output. Addressing the node ordering challenge, we employ a selected family of canonical orderings, enabling the model to consider various orderings with distinct structural biases while circumventing the challenges associated with factorial permutations.

The latent space disentanglement module follows the edge-augmented encoder. It is essential for decomposing latent factors influencing the interpretation and disentanglement of architectural layout design graph representations. This module employs Graph Isomorphism Network (GIN) [20] layers as building blocks, known for their superior expressive power and ability to generalize the Weisfeiler-Lehman (WL) test. This module takes the node and edge embeddings as input and outputs latent code vectors, the specifics of which vary depending on the chosen module scheme. We leverage different disentanglement regularisation methods to guide the representation disentanglement process and promote independence among the learned latent variables. Specifically, we propose three alternative disentanglement module schemes: 1) a vanilla VAE scheme that outputs a single latent code vector embedding the entire input graph, 2) a Vector Quantization (VQ) scheme that models probability density functions through the distribution of prototype vectors, resulting in a quantized latent code vector embedding the entire input graph, and 3) a node-edge co-disentanglement scheme utilizing three specialized sub-encoders to separate features at node, edge, and graph levels, outputting three latent code vectors embedding node, edge, and graph level features of the input graph, respectively.

The final component is a style-based decoder, which incorporates the layer-wise stochasticity feature decoding strategy [35] by introducing stochastic variations at different layers of the network. The decoder consists of two sub-decoders: a node-decoder and an edge-decoder. The node-decoder reconstructs node features by translating the provided latent representation back into the node-specific attributes of the graph, while the edge-decoder focuses on reconstructing edge features, converting the latent representation into meaningful edge attributes of the graph.

To the best of our knowledge, this study presents a pioneering effort in generating architectural layout design graphs with a primary focus on representation disentanglement. Unlike previous approaches, our work takes into account both node and edge features, as well as the critical issue of graph node permutation invariance. By integrating graph aggregation methods with high expressive power, we aim to acquire high-quality learned graph representations at various levels and, consequently, high effectiveness of feature disentanglement.

For the edge-augmented encoder of our proposed model frameworks, we leverage the Edge-augmented Graph Transformer (EGT) [36] as the backbone to integrate both node and edge features. The EGT backbone inherits the permutation equivariance characteristic from the original transformer mechanism [37] and employs global self-attention as its primary aggregation mechanism. This approach markedly differs from the conventional static, localized convolutional node aggregation, enabling the model to facilitate unconstrained long-range dynamic interactions between nodes. A key aspect of the transformer-based edge-augmented encoder is its ability to handle both node and edge features within a unified framework. The residual channels of the original transformer structure are utilized as node channels, while additional edge channels enable the graph’s edge information to evolve across different layers of the model, allowing the model to dynamically update and refine the representation of both nodes and edges through successive layers. As a result, the encoder continuously updates both node and edge embeddings at each layer.

The edge-augmented encoder, denoted as $f\left((X^{\prime},A^{e^{\prime}})|(X,A^{e})\right)$, intakes the node feature matrix $X\in\mathbb{R}^{n\times d}$ and the edge feature matrix $A^{e}\in\mathbb{R}^{n\times n\times c}$ of an attributed adjacency multi-graph $G=\left(V,E,X,A^{e}\right)$ as input, and produces updated node feature matrix $X^{\prime}\in\mathbb{R}^{n\times d}$ and edge feature matrix $A^{e^{\prime}}\in\mathbb{R}^{n\times n\times c}$ with respectively augmented node and edge embeddings, incorporating intricate relationships and features from both local and global levels of the nodes and edges. Specifically, $x_{v}\in\mathbb{R}^{d}$ denotes the feature vector of node $v$, while $d$ is the dimension of the node features, and $x_{u,v}^{e}\in\mathbb{R}^{c}$ represents the feature vector of edge $\left(u,v\right)\in E$, while $c$ is the dimension of the edge features.

Concretely, at the $o$-th attention head of the $l$-th layer of the $L$-layer encoder, the attention mechanism is defined as follows: $Attn\left(Q_{n}^{o,l},K_{n}^{o,l},V_{n}^{o,l}\right)=softmax\left(clip\left(\dfrac{Q_{n}^{o,l}\cdot\left(K_{n}^{o,l}\right)^{T}}{\sqrt{b_{k}}}\right)+E_{e}^{o,l}\right)\odot\sigma\left(G_{e}^{o,l}\right)\cdot V_{n}^{o,l}$. Here, $Q_{n}^{o,l},K_{n}^{o,l},V_{n}^{o,l}\in\mathbb{R}^{n\times b_{k}}$ represent the queries, keys, and values obtained from linear transformations of node embeddings, with $Q_{n}^{o,l}\cdot\left(k_{n}^{o,l}\right)^{T}\in\mathbb{R}^{n\times n}$ denoting the dot product of $Q_{n,}^{o,l}$ and $K_{n}^{o,l}$, $b_{k}=d/O$ is the dimension of the keys for normalizing the dot product and $O$ is the total number of attention heads. The normalized dot product is clipped to a certain range for better numerical stability ($\left[-5,+5\right]$ is used following [36]). $E_{e}^{o,l},G_{e}^{o,l}\in\mathbb{R}^{n\times n}$ are the learned linear transformations of the edge embeddings. $E_{e}^{o,l}$ acts as a bias term added to the normalized dot product of the queries and keys of the node embeddings, enabling edge embeddings to influence node embedding attention. While $\sigma\left(G_{e}^{o,l}\right)\in\mathbb{R}^{n\times n}$ gates the softmax values before aggregation, regulating information flow between nodes, $\odot$ is the element-wise product operation and $\cdot$ is matrix multiplication. With $O$ number of attention heads in total, we have,

for edge embedding updates at the $l$-th layer, and

for node embedding updates at the $l$-th layer, where $LN$ is layer normalization applied right before and after the attention mechanism, $FFN$ is a feed-forward network layer for learnable linear transformation, $||$ refers to the concatenation operation. $C^{o,l}$ represents the logarithm of the sum of Sigmoid-transformed edge embeddings, scaling node centrality to enhance network sensitivity and expressiveness in identifying non-isomorphic (sub-)graphs through adaptive self-attention [36].

For an input attributed adjacency multi-graph $G=\left(V,E,X,A^{e}\right)$, the node feature embedding $\widehat{X}$ and the edge feature embedding $\widehat{A}^{e}$ are obtained through a series of learnable linear transformations using original node feature matrix $X$ and the edge feature matrix $A^{e}$, accommodating both continuous and discrete values. The edge feature embedding $\widehat{A^{e}}$ is further processed by adding the distance matrix $D^{m}$, with $D_{u,v}^{m}\in\{0,1,\ldots,m\}$ being the shortest distances between node $u$ and $v$ while clipped to the $m$-hop distance if exceed. A masking vector is employed in lieu of an edge feature for non-existing edges. The resulting node and edge embeddings are then forwarded to the latent space disentanglement module.

The major difference among the three alternative pipelines is the latent space disentanglement module between the transformer-based edge-augmented encoder and the style-based decoder. Generally, the latent space disentanglement module, denoted as $g\left(z|(X^{\prime},A^{e^{\prime}})\right)$, maps the augmented node and edge embeddings $X^{\prime}$ and $A^{e^{\prime}}$ to a dense, continuous vector $z$ of a low-dimensional stochastic latent space that follows a prior distribution $p\left(z\right)$; the disentanglement module $g\left(z|(X^{\prime},A^{e^{\prime}})\right)$ learns the parameters of the stochastic distribution. We propose three different disentanglement modules to achieve this task, all implemented in an unsupervised manner.

The style-based decoder of our proposed model frameworks is constructed by incorporating the layer-wise stochasticity mechanism, a feature decoding strategy initially proposed by StyleGAN [35, 40] for generating image data. This mechanism has proved to be effective in generating high-quality and diverse imagery by introducing stochastic variations at different layers of the network [39, 8]. By grafting the layer-wise stochasticity feature decoding strategy from StyleGAN into our proposed framework, we aim to enhance the model’s capability to generate rich, diverse, and realistic architectural graph representations of both node and edge features, not only leveraging the strengths of StyleGAN’s generative capabilities but also tailoring them to the specific needs of graph representation learning, which is crucial for capturing the complexity and diversity inherent in the architectural layout design graph data.

Our proposed style-based decoder is designed to include two sub-decoders: a node-decoder and an edge-decoder. These two sub-decoders are composed of node-transposed (1D) and edge-transposed (2D) convolution layers to decode node and edge representations and generate the features for nodes and edges simultaneously. The node-decoder is responsible for reconstructing the node features, taking the latent representation provided by the encoder and translating it back into the node-specific attributes of the graph. At the same time, the edge-decoder focuses on the reconstruction of edge features, converting the latent representation provided by the encoder into meaningful edge attributes of the graph. Concretely, the node decoder, denoted as $f^{\prime}_{n}\left((X^{\prime\prime}|z_{n}\right)$, accepts a latent vector $z_{n}\sim p\left(z\right)$ and produces the reconstructed/generated node feature matrix $X^{\prime\prime}\in\mathbb{R}^{n\times d}$, while the edge decoder, denoted as $f^{\prime}_{e}\left((A^{e^{\prime\prime}}|z_{e}\right)$, accepts a latent vector $z_{e}\sim p\left(z\right)$ and outputs the reconstructed/generated edge feature matrix $A^{e^{\prime\prime}}\in\mathbb{R}^{n\times n\times c}$. The latent code vector $z$ can be either provided by the previous disentanglement module or sampled from the same learned stochastic distribution $p\left(z\right)$. Specifically, a predefined maximum number of nodes needs to be set in advance for the decoder to concurrently output two continuous and dense matrices, $A^{e,\pi^{\prime\prime}}\in\mathbb{R}^{n\times n\times c}$ and $\widehat{X}^{\pi^{\prime\prime}}\in\mathbb{R}^{n\times d}$ with a particular ordering $\pi$, which define the edge and node attributes of the reconstructed/generated graph $G^{\prime\prime}$.

Internally, both the node decoder and the edge decoder are composed of a non-linear 8-layer Multi-layer Perceptron (MLP) map** network $f^{\prime}_{1}$ and a synthesis network $f^{\prime}_{2}$. Each sub-decoder intakes the latent vector $z\in\mathbb{R}^{M}$ of input latent space $Z$ with dimension $M$ and processes it through the map** network $f^{\prime}_{1}:Z\rightarrow W$ to obtain a transformed latent vector $w\in\mathbb{R}^{M}$ of another intermediate latent space $W$ of the same dimensionality. This structural configuration adheres to the established convention outlined in StyleGAN [35, 40]. The transformed latent vector $w$ is further processed with a learned affine transformation using a fully connected layer [35, 40]. The processed vector $w$ with varied affinement then serves as synthesis control factors by being fed to different convolution layers. Specifically, at each synthesis layer $l$ of the synthesis network $f^{\prime}_{2}$, we have:

and for the node decoder, we have:

where $X_{l},\widehat{X}_{l},X_{l+1}\in\mathbb{R}^{c\times n_{l}}$, with $n_{l}$ being the ’resolution’ (i.e., number of ’super nodes’) of the synthesized graph node feature matrix at layer $l$, and $conv1d$ refers to a 1-dimensional convolution layer. As for the edge decoder, we have:

where $A_{l},\widehat{A}_{l},A_{l+1}\in\mathbb{R}^{d\times n_{l}\times n_{l}}$, where $conv2d$ refers to a 2-dimensional convolution layer.

Access to large-scale layout graph databases with quasi-exhaustive coverage and enough instances to cover the diversity of real-world architecture layout design data space is essential for examining the performance of the proposed disentanglement graph representation learning framework. However, large-scale attributed adjacency graph datasets of real-world architectural design are scant in the current literature. Although the graph extraction outputs can be more accurate using 3D building models, the accessibility of real-world 3D architectural design models in bulk is difficult. Given that traditional orthographic drawings of existing architectural design, such as floor plans, are fairly easy to acquire from the internet, it is possible to acquire attributed adjacency graphs from real-world architectural floor plan images and construct large-scale architectural layout design graph datasets. In this study, we harness the floor plan image parsing methods provided in [1] and [41] to extract attributed adjacency graphs from a customized repository of real-world architectural floor plan images of 159 architectural categories retrieved from ArchDaily®, a professional architectural design project website. The distribution of extracted layout graphs per architectural category is illustrated in Fig. 2. Specifically, we have curated two graph datasets with different numbers of architectural element categories (Table I): the first dataset is constructed using the ensemble-based supervised floor plan parsing schemes provided by [1] with 6 architectural element categories, while the second one is constructed using the semi-weakly-supervised scheme offered in [41] with 25 architectural element categories.

We define a concatenated set of baseline node features composed of three major components. 1) Node class represents the categorical classification of each node (as shown in Table I), providing essential information about the type or function of the corresponding element in the architectural layout graph; the class labels are transformed into one-hot encoding. 2) The space area ratio quantifies the proportion of the area occupied by the corresponding original polygon of the node relative to the total layout area. 3) Normalized coordinates of the original space polygon centre; the normalization is to ensure consistency and comparability across different graphs, offering valuable spatial information about the positioning of the spaces within the overall architectural layout. Regarding edge labels, the two graph datasets with different numbers of element categories also provide varied sets of edge labels, as shown in Table I. We transform the edge labels into one-hot encoding for training purposes, denoting the connections between two neighbouring nodes. This feature is instrumental in capturing the architectural layout graph’s relationships and interactions among various spaces. These node and edge features jointly offer a rich and detailed representation of architectural layout data, enabling the proposed disentangled graph representation learning framework to learn and interpret architectural layout designs’ complex and nuanced characteristics.

With these tailored datasets, we embark on experiments to extract high-level structural features from the attributed adjacency graphs and probe into the potential for interpreting and navigating the latent design representation space that the architectural graphs may reveal using the disentangled graph representation learning frameworks proposed in this study. Please refer to Appendix D for the visualization of the graph extraction process, samples of attributed adjacency graphs and other relevant details.

We experiment with a series of attributed adjacency multi-graph feature augmentation schemes and examine their impact on model performance.

We experiment with various training implementation schemes and disentanglement module variations of the proposed framework to explore how varied training schemes and latent space disentanglement modules can influence the model’s ability to learn and represent the complexities of architectural layout design graph data and assess their impact on the model’s performance regarding representation disentanglement.

The design of appropriate loss functions is essential to ensure that the representation remains disentangled while retaining the information inherent in the data [45]. The components of the loss function $L$ used in this study can be categorised into two parts based on their distinct purposes: reconstruction loss and disentanglement loss. The reconstruction loss is crucial in generation tasks for preserving data integrity by encouraging the accurate reconstruction of the original data, which ensures that learned disentangled representations are semantically meaningful. The disentanglement loss is specifically designed to enforce the separation of the representation, ensuring that each part of the disentangled representation corresponds to unique and independent aspects of the data. These two loss function parts work together to ensure a harmonious balance between maintaining the quality and integrity of the data and effectively achieving disentanglement.

Specifically, we have two respective reconstruction losses for the reconstruction of the node feature matrix and the edge feature matrix. For the node feature matrix reconstruction, we have:

where $\overline{x_{v}^{i}}$ is the reconstructed feature value at dimension $i$ of node $v$ and $x_{v}^{i}$ is the corresponding ground truth value. Similarly, for the edge feature matrix reconstruction, we have:

where $\overline{a_{u,v}^{i}}$ is the reconstructed feature value at dimension $i$ of edge $(u,v)$ and $a_{u,v}^{i}$ is the corresponding ground truth value. Consequently, we have the total reconstruction loss $L_{rec}$ as:

Meanwhile, as the proposed frameworks are VAE-based, we adopt Kullback-Leibler (KL) divergence to optimize the disentanglement latent space by quantifying the distance between the estimated posterior distributions and the isotropic Gaussian prior, and we optimize the KL divergence loss $L_{KL}$ to minimize the estimation losses. Specifically, for the baseline framework with the vanilla VAE module, we have

where $p\left(z\right)$ is the isotropic Gaussian prior $\mathcal{N}\left(0,\textbf{I}\right)$ and $q_{\theta}\left(z|(X,A^{e})\right)$ is the estimated posterior distribution, $z_{\mu}^{m}$ and $z_{\sigma}^{m}$ are respectively the estimated mean value and log-variance at latent dimension $m$. While for the framework with the NED-based disentanglement module, we have

For the Vector Quantization module, the distance between the embedding vectors $k$ and the latent codes $z$ is optimized using Mean Squared Error (MSE). Specifically, the VQ loss $L_{VQ}$ is composed of two parts: the dictionary learning component and the commitment loss component. The former aligns the embedding vectors $k$ towards the latent codes $z$, thereby refining the quantization dictionary. The latter guarantees that the latent codes $z$ reliably correspond to specific embeddings $k$ within the quantization dictionary, preventing unchecked dimensionality expansion of the intermediate embedding space $K$. Concretely, we have:

where $const$ denotes the operation of detaching from the computational graph and renders the variable as a constant during optimization. The first term of the RHS of equation 28 refers to the dictionary learning loss, and the second term is the commitment loss. When both the Vector Quantization module and the Node-edge co-disentanglement module are implemented, we have: