Emergent Architectures and Growing Pains

The original emergent design.

Occasionally I hear people still raising the agile mantra against Big Design/Requirements Up Front. The thing is that Agile Manifesto never said to intentionally bury your head in the sand with regards to the purpose of the system. It was a push-back against spending months in analysis without anything but documents coming out, but the goal was to reach a middle ground. Nobody ever said “no design up-front” or “no requirements up front”.
(Udi Dahan from “A CQRS Journey – with and without Microsoft”)

In my premier post, I touched on the concept of emergent architecture in passing, noting that Wikipedia’s definition of architecture should be amended to read “Architecture should be both the process and product of planning, designing and construction, although it may just be the product of construction.” (my additions in bold). In essence, an architecture will develop regardless of whether that development is managed or not. The key question is whether the architecture provides value or headaches.

Lately the topic has been a popular one. A discussion on The Enterprise Architecture Network group on LinkedIn was active all last week. This weekend Igor Lobanov posted an excellent take on the subject, titled “Can an architecture emerge?”. Raja Bavani just posted “Can Software Projects Mature by Accident?”. It even made its way into the comments of the post where Dan North announced that he had reprinted “The Art of Misdirection” on his site. The person commenting took issue with a limitation of Test Driven Development (TDD) identified by Dan North:

“You need an overarching vision, a “big picture” design or architecture. TDD won’t give you that.” Wrong. TDD will give you precisely that: when you’re working on a large project, TDD allows you to build the code in small steps, where each step is the simplest thing that can possibly work. The architecture follows immediately from that: the architecture is just the accumulation of these small steps. The architecture is a product of TDD, not a pre-designed constraint.

It should come as little surprise that I find the concept of emergent architecture highly suspect, and the attitude in the quote above illustrates why. The “simplest thing that can possibly work” may or may not be sufficiently flexible. If that need for flexibility can be foreseen, then the “simplest thing that can possibly work” represents wasted time and effort. Likewise, an architecture that is “just the accumulation of these small steps” is unlikely to be robust or cohesive. It is extremely naive to expect a system’s requirements to exist without conflict. Working piecemeal, I find it unlikely that these natural tensions (such as security versus usability and performance versus simplicity) will be adequately addressed. Cross-cutting concerns ensure that a system must be more than the sum of its individual parts.

Igor Lobanov’s post compares the organic evolution of a system with Darwinian evolution, which is a compelling analogy. Left to its own devices, a solution will accumulate technical debt. Techniques such as TDD may allow the system to remain fit for purpose on a feature level, but the overall flexibility and robustness of the system will suffer. The more complex the system, the less amenable it will be to emergent architecture.


10 thoughts on “Emergent Architectures and Growing Pains

  1. The Winchester Mystery House is featured in PEAF Training Courses.

    Interestingly I went and took the full tour today (24/6/12) before flying back to the UK.

    Even more Interestingly – while the The Winchester Mystery House is used to show people what happens if you have “bad architecture” …..

    …the Winchester Mystery House is actually a very good example of Excellent Architecture.

    Want to know why? Mail me on Kevin@PragmaticEA.com


    • I’d imagine that the house could be construed as an example of “good” architecture in that it met the needs and wants of its owner (though the batty factor was pretty high there). That’s why rather than characterizing it as “good” or not, I stuck to terms like “robust” and “flexible”.


  2. Pingback: Closing a door « Form Follows Function

  3. Pingback: Products, not Projects « Form Follows Function

  4. Pingback: Emergence versus Evolution | Form Follows Function

  5. Pingback: Emergence versus Evolution | Iasa Global

  6. Pingback: Accidental Architecture | Form Follows Function

  7. Pingback: Quick Fixes That Last a Lifetime | Form Follows Function

  8. Pingback: Emergence versus Evolution | IasaGlobal

  9. Pingback: Emergence: Babies and Bathwater, Plans and Planning | Form Follows Function

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.