Orders of Agility

Two weeks ago, Ruth Malan (@ruthmalan) of Bredemeyer Consulting and contributing author to the Cutter Consortium commented in her online journal (being maintained since 2006 and recommended!) that between the metaphor used by Tom Graves (@tetradian) in Agility Needs a Backbone and what I covered in Architecture and the Remainder of Design, there is a great way to talk about architecture and agility.

I agree. And more there is, there is definitely more to talk about…

In Architecture and the Remainder of Design and further comments, I argued that architecture provides an agility distribution instrument; that architecture is inherently not agile but simultaneously an instrument to push desired variation points out, to the boundary with or into agile territory.

Likewise it is an instrument to inhibit non-differentiating change, by burying the opportunity. Actually, to quote Dana Bredemeyer (@DanaBredemeyer), one can “prune the opportunity tree”. In Enterprise Agility, an Attempt to Get to the Bone I shortly covered the apparent paradox that agility also increases by reducing change, albeit the non-differentiating change, thereby leading to “leaner” structure. Clearly I am using the word “lean” here only as an adjective, a marker, no decorated meanings intended! Leaner structure is more coherent, carries less weight or — using a better word — mass, thus eases coordination, and so enhances the ability to move quickly and easily.

In fact, both “desired” and “non-differentiating” change options need to be addressed and to be brought in balance and that is what agility distribution is about. One could think that a start-up, with a small team and hardly any structure, with a lot of things happening by self-organisation (which in fact turns into structure too), is the summit of enterprise agility. But without much rigid structure, it is missing “non-differentiating” change being addressed, more often than not painfully experienced as soon as the start-up grows bigger and has to start fending off contenders. Simply put, there is hardly anything to balance the variability with. There is hardly any distribution that can be done. Thus no or little structure does not make agile! It offers plenty of room for change but hardly any quick and easy amplification of coordinated, directed change.

Indeed, Agility Needs a Backbone and it is architecture that can provide that, in fact architecture is that backbone! Of course, not withstanding all engineering (attempts), structure and the distribution thereof can be (partly) emergent. It may be what we simply find and often is. It may not be readily apparent, (partly) hidden in its complexity, something one can never be fully aware of, and not necessarily be well aligned with what is desired. But it will have specific quality characteristics nevertheless!

Much of the confusion about agility originates however from the unawareness of different orders of agility. All the above is not presenting the whole picture. What I tackled in Architecture and the Remainder of Design is about 2nd order agility, agility as a quality or state, the distribution of structure as it is that defines the rigid backbone and the set of variation points. The praises that for example the cloud receives is about 2nd order agility. But 2nd order agility in itself is useless if it is not aligned with and for a higher purpose: 1st order agility! If it is not, it simply adds to the non-differentiating change options and is counter-productive.

In explaining to the full extent what I mean with 1st and 2nd order agility, I would like to start with the framework described in the paper An Integrative Perspective on Information Management by Prof. Rik Maes (@hoogleerling), and which can be seen as an elaboration of the Strategic Alignment framework by Henderson & Venkatraman:

I have a particular interest in the structure layer that Prof. Rik Maes positions rightfully between strategy and operations.

The picture that I presented in Architecture and the Remainder of Design actually maps to these layers:

2nd order agility is represented by architecture and the remainder of, secondary, design. 2nd order agility determines the configuration set in support of 1st order agility.

1st order agility is change that can be performed abruptly while leaving competence intact. It represents the ready ability. It is agility that is embedded into the genes of the whole. There is no way to get outside the set that is provided. Even different combinations will bring no relief. But if the set does not suffice, there is still the choice of re-framing by changing structure so to change the set, hence by falling back on 2nd order agility. But doing so will come with a latency price tag, it will not happen abruptly and worse, will disrupt competence. If however structural agility distribution is handled well, it can still mean a world of difference: secondary design instead of architecture, with definitely superior latency. In fact regarding latency one could reasonably expect the following for an “enterprise” whole:

configuration → abrupt → seconds to months

secondary design → quick → months to years

architecture → slow → years to …

Many organisations neglect “real” enterprise architecture because it takes so long before benefits start to arrive — and thus much doubt exists if they will ever arrive — but surely miss grand opportunities: configuration and secondary design can never generate the abrupt or quick effect that they could potentially have. The backbone is lacking.

What is 1st order agility ultimately offering? Hopefully both strategic and operational agility. In a next round it determines the territory that can be explored for doing “right” things as well as the territory that can be exploited for doing things “right”. These round-trips ultimately determine how wholes, e.g. enterprises, are able to grow, improve and adapt over time, or collapse.

In effect:

Architecture has the potential to be the instrument to fixate the principles, either the aspiration for reliability in maintaining specific constants, or in maintaining specific variables, in a coherent manner.

So in conclusion: agility = structural agility (2nd order) + strategic agility (1st order) + operational agility (1st order). And architecture is the backbone.

Agility and Agile are Brand Names!

In Enterprise Agility, an Attempt to Get to the Bone, I mentioned that agility and agile are not brand names although vendors would like the idea.  Apparently, I was wrong.  I admit the mistake!

When reading all that is being written about agility and agile I can only conclude that I was terribly wrong.  Seemingly the tsunami of marketing indoctrination by vendors and consultants has done its work: Agile and agility have become brand names!

Why am I writing all of this? Just a few (contradictory) statements that I have found:

  • Agile is a method, a production method in fact, of course delivering agility.
  • Agility is an attribute of an organisation or a business unit.
  • Organizations don’t simply become agile. They’re either agile or not.

Once again,  for just a small moment, let’s return to the original meaning of both words:

Agility noun the ability of moving quickly and easily

Agile adjective marked by the ability of moving quickly and easily

As an act of freedom, I broaden “moving” by replacing “moving” with “changing”, as moving is changing and changing is moving, and that word is better suited for what I am interested in:

Agility noun the ability of changing quickly and easily

Agile adjective marked by the ability of changing quickly and easily

First of all,  agile is a marker, or better an attribute, in fact a “quality” attribute associated with and exhibited by “something”, the object being marked.

Agility is neither a binary “present” or “absent”, and agile neither “true” or “false”. It is however better or worse, and that only with a specific purpose in mind.

I don’t read anything of a method, neither a production method.  Consultants have seemingly made many believe that everything agile is about, is their method.  And seemingly that has worked.  Agile is about methods, isn’t it?

No, it isn’t!  Or better, not necessarily. If “something” is the method, or better the method is the object, agile can be an attribute associated with the method.  Can that method be agile?  It depends what the purpose is. For one purpose the method can be agile, for an other it may be not at all.  Enterprise agility is yet an other matter, it is about an other object, and probably an other purpose as well.

I’ll illustrate further with an example:

If someone – a human as object – is wandering across the savanna, to be suddenly surprised by leopards approaching and that someone is able to move quickly and easily so to escape and survive, that someone is agile (marked by the ability) for the purpose of escaping and surviving. The ability could be better or worse. There is a tipping point when worse becomes too bad. With a Land Rover nearby that (s)he could drive, having foreseen the future purpose, (s)he would have been in a superior state of agility than with no means at all.  But there may be even less risky states to be in.  What if (s)he could be beamed up? Wouldn’t that be even a better state to be in? Because, what if the leopards would be able to run faster as the Land Rover could progress?

The state of agility may be good or better aligned with the purpose of escaping leopards. If however the area is abruptly and majorly flooded, the Land Rover may not help at all, and (s)he may drown.  The state of agility may not be aligned with an other purpose, surviving a flood. The more advanced technology solution would still help. Technology doesn’t matter?

Object and purpose!  All that matters is object and purpose!  In fact agility is about the ready ability of an object to timely arrive at a purpose legitimate in a suddenly changing context, here the ability to survive.

With the enterprise as the object that enterprise architects apparently care about:  What is the purpose of the enterprise?

In Re-Creating the Corporation and in even greater detail in On purposeful SystemsRussell L. Ackoff has offered great explanation that systems – and for the purpose of illustration I just accept the abstraction of the enterprise as a system – come in 4 flavors:

System Parts Whole
Deterministic Not purposeful Not Purposeful
Animated Not purposeful Purposeful
Social Purposeful Purposeful
Ecological Purposeful Not purposeful

An IT system is deterministic, having no purpose of its own, neither its parts. A human is animated, having a purpose of his/her own, but for example his/her stomach, being a part, hasn’t. An enterprise is social, having a purpose of its own, and humans, being parts, having as well.

So what is an enterprise’s primary purpose?  Russel L. Ackoff goes to great lengths to explain that social systems have one  primary purpose and that is surprisingly enough survival.  Hence:

If for an enterprise survival matters, in an ever changing context, the ability of changing quickly and easily is essential because, one day, its state of agility may be too bad.

So next question is:  what are events that the enterprise wants to survive?  One cannot have it all.  Choices will need to be made. Next, getting the enterprise in an aligned state to survive, is what increasing enterprise agility is about.

I admit: the prime purpose of surviving may sound abstract in relation with the enterprise. Therefore I really recommend Russell L. Ackoff’s work.

What about this one?

  • It solves world hunger too.

In fact, it may.  If that is the purpose!  Let’s think about the object!

Architecture and the Remainder of Design

In the one comment made to the earlier post Architecture in Context [Revision 1], different aspects are put forward that I also see as key elements in a defining story but in quite different ways as proposed.

One, on which I fundamentally differ in opinion, is about the interpretation of a quote by Grady Booch (@Grady_Booch), a well-known and widely accepted truth about architecture:

All architecture is design but not all design is architecture.

The deduction that I make is that architecture is a part of a whole called design which leaves another part, the remainder of design, resulting in following questions:

  • Is there any primacy in these parts?
  • Where does architecture end and the remainder of design begin?

In the comment referred to above, is stated that Grady Booch meant to differentiate otherwise, between objective/subjective aspects.   No doubt the objective versus subjective stand towards fit-for-purpose is an important element in a defining story – one that I will later come back to  – but I disagree that the concern is what differentiates design from architecture.  It plays a role but in an other way.

In fact, I cannot find any proof of Grady stating so. Moreover, there is a well-known addition to the quote by Grady Booch (original reference) that points in quite a different direction.

What followed is:

Architecture represents the significant design decisions that shape a system, where significant is measured by cost of change.

That more or less has always been my understanding and has a consequence.  It means that the part representing architecture is a relative notion.  Significant means “significant when compared to the cost of change of the whole”.

I’ll present an example taken from the tangible world, to clarify.  If urban architecture is your perspective, the architecture of one specific building is usually not significant. It is therefore part of the remainder of design, at least from that perspective.  If only the building is your perspective, architecture is made up by a part of a whole that in the former perspective completely ended up in the remainder of design.

Grady Booch refers to significant “cost of change” which seems to point to financial measure.  I believe that such an understanding is too restrictive.
Therefore I refer to significant “barriers to change” instead, thereby generalizing more specific barriers like:

  • significant number of dependencies. In fact the remainder of design is secondary design as it depends on the architecture and thus will be seriously impacted by change to the architecture
  • significant reach, level and/or period of non-operation due to change in progress
  • the need for significant transition architecture(s) to overcome the previous
  • significant financial cost to change in comparison with the financial cost of the whole, for sure
  • significantly hard to gain empowerment needed to enact the change

The latter specific barrier is a reason why most cities have retained old structures over centuries but Paris is an exception.  Napoleon III had not only a considerable amount of power at his disposal but was also a good communicator, hence he succeeded in acquiring the necessary empowerment, to have realized what has been referred to as Haussmann’s renovation.

Hence significant in this context also means that such a change when started abruptly and incautiously is likely to cause anything close to destruction and subsequent recreation with the newly desired fundamental structure. In between old and new, the action would cause the whole to be significantly non-operational.

This all leads to following observation:

Architecture itself is that what is inherently not agile.

The remainder of design is on the other side of the barrier, thus:

The remainder of design is that what is inherently agile.

Thus this makes architecture about agility distribution, structures that can be changed easily and others that cannot:

Agility Distribution

That distribution may be a reality that we simply find or it may be something that can be influenced through the act of designing thereby turning architecture into an agility distribution instrument, in fact:

Although architecture is “the” prime enabler of agility, architecture itself is that what is inherently not agile.

Architecture in Context [Revision 1]

Context carries tremendous importance in disambiguation of meanings as well as in understanding of the actual meaning of words.  The word “architecture” is exemplary in this regard.

So first I will focus on the contexts in which the word “architecture” is being used. Without understanding the different contexts,  there is no clear road to a defining story.  For the moment, I will just ignore the enterprise, the domain of prime interest. It is just about “architecture” in general as there must be a reason that the word is used across widely diverse domains.

So then, what are the different contexts? One fact is clear. Dictionaries offer only limited assistance as they show little formal recognition of those contexts.

The start is a quote from Grady Booch (@Grady_Booch) that intuitively feels right:

“All architecture is design but not all design is architecture.”

With a little further help of dictionaries, one can already discover different usages:

  • design / architecture as a noun (state): a design / an architecture
  • design / architecture as practice of doing design / architecture, thus a verb (action): to design / to architect

Without yet trying to determine the difference between architecture and the remainder of design, it feels right to state that, both design and architecture represent arrangement or structure.

With that in mind I have come up with a first revision of a model in an attempt to capture all arrangement- or structure-related concerns:

Structure / Arrangement

Centre piece is concrete structure (A), the actual state of structure (states are boxes) as it exists in the reality of a building, a city, a software-intensive system or a social system (for example an enterprise); any object or system really. Concrete structure is often not really static, thus not a state but in order to get to understanding it is conceived as an image being taken thereby capturing the moment and so turning it into something static (The same recipe is applied for the other states for which the notion of a baseline is common practice). Mostly, the dynamic aspects of especially architecture over a small period of time are of limited concern anyway.  There are reasons why, that I will tackle later.

An immediate question that arises from above notion, is how concrete structure comes into existence, an actual action to structure (actions are arrows). Another quote from Grady Booch provides some further clues here:

“Most architectures are accidental, some are intentional.”

In other words, concrete structure either emerges (1), is engineered, or is a mixture of both.  Engineering is a composite action; it consists out of several other.

A key means in an engineering effort of any concrete structure is a structure plan (E), either a mental plan or a material plan that, by addressing necessary action and targeted concrete structure, assists in the realization (3).

The conception (7, 2) of any structure plan seems to be either based on something that has been proven to be wrong, hence the negative outcome of structure assessment (C) or to be right, the structure template (D).

Structure templates are structure styles, patterns and/or tactics, or combinations of those in the form of reference models, with both structure as state and as action, that have been recognized (6) as proven to be right for specific purposes based on the positive outcome of structure assessment.  Typical examples of structure templates in building architecture, styles in fact, are Romanesque architecture, Gothic architecture, etc.

Of course there is the action of selecting proper and/or recognizing improper structure templates and properly (re-)combining for the now targeted concrete structure, the conception (2, 7) of the structure plan.  Hence it is in this action that the purpose of  the targeted concrete structure is to be taken in account.

Concrete structure is often difficult to understand, especially when it is at least in part result of emergence for which obviously no structure plan can be available.  Hence, it is appropriate to analyse (4) concrete structure in order to build an understanding through the creation of a structure model (B).  Structure plan and structure model can show similarity only when the concrete structure is highly engineered.  Anyhow, the structure model will only offer a representation based on specific concerns, a simplification for the further purpose of either single or comparative assessment (5).  Single assessment can lead to re-engineering so to better align structure with purpose.  Comparative assessment can lead to the recognition (6) of structure templates.

The words design and architecture are used as being all of the above, as the concrete structure, the structure plan, the structure model, the structure assessment and the structure template, as well as the practice of conceiving, realizing, analysing, assessing and recognizing.