The resulting language is shown in the following article https://medium.com/itnext/the-list-of-architectural-metapatterns-ed64d8ba125d
It is not going to grow much as it contains most of the imaginable simple geometries (of structural diagrams) - and I doubt that anything with a complex geometry is going to be a pattern, as opposed to a combination of patterns. Any new pattern is likely to have a structural diagram that belongs to one of the existing clusters (metapatterns).
However, that approach works only when structure and function correlate, that is when the structures are drawn in the same space, which is achievable for architectural but not design patterns.