Tag: communication

Posted on

Performance management systems and technical debt

Last updated on July 7th, 2021 at 07:57 pm

Treats are a performance management system for dogs
A dog receiving a reward. Many performance management systems implement a model that assumes that the correct configuration of incentives and disincentives will produce the desired result. This theory is questionable.

Few performance management systems provide guidance with respect to behaviors relating to technical debt. One reason, perhaps, is that technical debt isn’t widely understood. Or perhaps only engineers and their managers regard technical debt as a concern. Still, to gain control of technical debt organizations must ensure that performance standards are clear. They must clearly state expectations with respect to behaviors that could affect technical debt. If changes are necessary, policymakers can be effective advocates—provided that they understand what the appropriate role for performance management is in controlling technical debt. This post should be helpful.

A fundamental premise of many performance management systems is that incentives can encourage desirable behavior. Likewise, disincentives can discourage undesirable behavior. Unfortunately, serious questions have arisen about the effectiveness of these behavioral control mechanisms in general [Kohn 1999]. Employees find ways to harvest incentives without exhibiting the desired behavior. Similarly, they find ways to circumvent disincentives while continuing to engage in undesired behavior.

Behavioral control for technical debt is problematic

Moreover, specifically for technical debt management, behavioral control is especially problematic. Troubles arise because some of the desirable behaviors are inherently immeasurable. For example, the design of an incentive structure to encourage legacy technical debt retirement is debatable. The technical difficulties involved relate to the problems of defining legacy technical debt.

Managing performance vis-à-vis technical debt, therefore, presents a problem of the kind Austin calls partially supervised [Austin 1996]. Supervising engineers whose work can affect technical debt can only be partial. The issue is that measuring technical debt is only partially practical given the state of the art. Austin shows how partial supervision frequently leads to dysfunctional performance management. But the problem is especially vexing for managing technical debt. For example, engineers’ work can sometimes incur technical debt that remains unrecognized for months or years after the work is completed. To fully supervise such work would require inventing retroactive incentives and disincentives. This class of motivators doesn’t exist, but even if they did, they’re of questionable legality in most jurisdictions.

The doctrine of commander’s intent

Although incentives and disincentives cannot serve to manage performance relative to technical debt, a very effective model is available. Enterprise leaders could communicate their intentions relative to technical debt, and empower the people of the organization to take steps to reduce debt. In the United States military, and others as well, a doctrine that implements this approach is called commander’s intent [Mattis 2008][US Army 2010].

Gen. Mattis offers five principles that guide what the military calls “effect-based operations.” For technical debt management, the effect we seek is rational control of the technical debt portfolio. Here are his five principles, transformed to the field of technical debt.

  1. Technology development, maintenance, and cyberdefense in the future will require a balance of conventional and unconventional approaches.
  2. Technology evolves rapidly, and we must be willing to adapt our methods.
  3. Technologies are dynamic, with an infinite number of variables; therefore, it isn’t scientifically possible to accurately predict the level of technical debt that will result from any given effort. To suggest otherwise runs contrary to historical experience and the nature of modern technological assets.
  4. We are in error when we think that what works (or does not work) in efforts involving one technology in one enterprise will be universally applicable to all technologies in all enterprises.
  5. Finally, to paraphrase General Sherman, “Every attempt to make technical debt management easy and safe will result in humiliation and disaster.”

Limitations of the doctrine of commander’s intent

Most organizations rely on supervisors to communicate the analog of commander’s intent to their subordinates. Currently, it’s fair to say that few supervisors outside the technology-oriented elements of the enterprise communicate much about technical debt to their subordinates.

That situation might explain why most performance management systems encourage behaviors that unwittingly expand the body of technical debt, especially for non-technologist performers. There are situations in which the widely applauded actions of the outstanding performer actually incur technical debt strategically and responsibly. Technical debt so incurred is what McConnell calls Type II [McConnell 2008] and what Fowler calls Deliberate and Prudent [Fowler 2009]. But most performance management systems, especially for non-technologists, say nothing about technical debt. They risk encouraging behaviors that indirectly exacerbate the problems associated with technical debt.

An illustrative story

Distinguishing responsible and irresponsible behaviors is possible only if understanding of the nature of technical debt is widespread in the organization, even beyond the technologists. Here’s an example:

It was ambitious. It was what advocates called a “stretch goal.” But the VP of Marketing approved the plan to release the new app by the end of the fiscal quarter. After a month of meetings, and much jawboning, the CTO agreed. The VP of New Product had serious objections, but the executive team set them aside. Engineers and testers were able to meet the date, but they had to incur significant technical debt. When they asked for resources to retire that debt after the release, the VP of Marketing opposed the request. She needed additional resources for the promotional campaign due to our late entry into the market.

Stories like this illustrate scenarios in which technical debt considerations are subordinate to “business priorities.” These latter include market timing, market development, and revenue generation. Standards for setting priorities closely parallel the standards defined in the performance management system. Indeed, performance management should support enterprise goals. In the scenario above, the organization might meet the immediate goal of a successful release. But it does so by incurring technical debt, thereby imperiling the next release. This scenario illustrates why changing the performance management system might achieve a better balance between immediate goals responsible technical debt management.

Last words

Since anyone in the enterprise can take actions or make decisions that lead to incurring new technical debt, or cause existing technical debt to remain in place, organizations need performance standards that guide employees with respect to technical debt. To provide guidance for distinguishing responsible behavior from irresponsible behavior, performance management systems must acknowledge the potential of any employee to affect technical debt. Performance management systems must be reviewed with respect to alignment with technical debt policy. They might then support a mechanism analogous to Gen. Mattis’s vision of commander’s intent.

References

[Austin 1996] Robert D. Austin. Measuring and Managing Performance in Organizations. New York: Dorset House, 1996. ISBN:0-932633-36-6

Contains an extensive discussion of the consequences of partial supervision of performance. Since technical debt can only be partially supervised, the concept is relevant to understanding the effects of performance management systems on technical debt. Order from Amazon

Cited in:

[Fowler 2009] Martin Fowler. “Technical Debt Quadrant.” Martin Fowler (blog), October 14, 2009.

Available here; Retrieved January 10, 2016.

Cited in:

[Kohn 1999] Alfie Kohn. Punished by rewards: The trouble with gold stars, incentive plans, A's, praise, and other bribes. Boston: Houghton Mifflin Harcourt, 1999. ISBN:0-395-71090-1

Order from Amazon

Cited in:

[Mattis 2008] James N. Mattis. “USJFCOM Commander’s Guidance for Effects-based Operations,” Joint Force Quarterly 51, Autumn 2008 105-108.

Available: here; Retrieved November 9, 2017.

Cited in:

[McConnell 2008] Steve McConnell. Managing Technical Debt, white paper, Construx Software, 2008.

Available: here; Retrieved November 10, 2017.

Cited in:

[US Army 2010] U.S. Army (2010) Field Manual 5.0 – The Operations Process U.S. Department of the Army.

Describes the concept, value, and importance of the doctrine of commander’s intent. See the index for “commander’s intent,” and especially paragraphs 2-90 and 2-91. Available: here; Retrieved: Dec. 22, 2019.

Cited in:

Other posts in this thread

Posted on

Technological communication risk

Last updated on July 7th, 2021 at 07:50 pm

See no evil, hear no evil, speak no evil
Hear no evil, see no evil, speak no evil—the iconic representation of communication failure. Technical debt can result from communication failures due to unwillingness to inform others of what you know, and unwillingness to receive information from others more knowledgeable.

Technologists must convey what they know about long-term technology trends to enterprise strategists and others. In addition to strategists, the interested parties include internal customers of technology, product owners, product managers, project sponsors, and senior management. Within the enterprise, technologists tend to be among those most knowledgeable regarding the relative alignment between enterprise technological assets and long-term technology trends. Yet technologists frequently fail to communicate this knowledge effectively to those who need it, and that can lead to nonstrategic technical debt. I call this phenomenon technological communication risk.

Technological communication risk is the risk that knowledgeable people within the enterprise don’t communicate important knowledge about technology. Within the enterprise are people who need this information and people who possess it. The risk is that people who possess it might be barred from distributing it, and people who need it might be unwilling to receive it. Policymakers can address this problem by working to define roles to clarify communication responsibilities. Role definitions must specify the need for this communication, and the need to be receptive to it.

A clear understanding of long-term technology trends is important in managing technical debt. Any significant misalignment between enterprise technological assets and long-term technology trends creates a risk of incurring new technical debt. As technologies evolve, enterprise assets must evolve with them. The gap between those assets and the state of the art is a source of lost productivity and depressed organizational agility, which is our definition of technical debt.

The root causes of technological communication risk

Some technologists are better informed about technology trends than are their internal customers, product owners, product managers, project sponsors, or senior management. Technologists often do attempt to communicate what they know on an informal basis, but unless such communication is expected and defined as an official duty, their superiors and internal customers don’t always welcome the information, especially if they haven’t heard it elsewhere, or if it conflicts with what they’ve learned elsewhere, or if its implications conflict with established strategic positions.

Many technologists are aware that their superiors might not welcome their observations about technological trends. And they are also aware that their superiors do not welcome observations about technology-based strategic vulnerabilities or opportunities. For example, a technologist might be reluctant to mention a cybersecurity risk that would be expensive to mitigate. This mechanism is especially strong when deploying adequate cyberdefense would compete for resources with other initiatives already underway. The mechanism is also important when the negative consequences of the vulnerability are unlikely to materialize. And some tend to question technologists’ credibility when they blame the technologists for the vulnerability itself.

Situations like these can lead to the formation of new nonstrategic technical debt in circumstances such as when Management directs technologists to…

  • …produce capabilities using approaches known to the technologists to be technological dead ends.
  • …implement capabilities that don’t exploit known approaches that could open new and vital lines of business.
  • …focus resources on initiatives that in the view of the technologists lack sufficient technological imperative.

Last words

Policymakers can mitigate technological communication risk by establishing internal standards that encourage knowledgeable technologists to share what they know. The parties that most benefit from the information are internal customers, project sponsors, or senior management. Similarly, those standards can encourage people in such roles to take heed when knowledgeable technologists do speak up.

References

[Austin 1996] Robert D. Austin. Measuring and Managing Performance in Organizations. New York: Dorset House, 1996. ISBN:0-932633-36-6

Contains an extensive discussion of the consequences of partial supervision of performance. Since technical debt can only be partially supervised, the concept is relevant to understanding the effects of performance management systems on technical debt. Order from Amazon

Cited in:

[Fowler 2009] Martin Fowler. “Technical Debt Quadrant.” Martin Fowler (blog), October 14, 2009.

Available here; Retrieved January 10, 2016.

Cited in:

[Kohn 1999] Alfie Kohn. Punished by rewards: The trouble with gold stars, incentive plans, A's, praise, and other bribes. Boston: Houghton Mifflin Harcourt, 1999. ISBN:0-395-71090-1

Order from Amazon

Cited in:

[Mattis 2008] James N. Mattis. “USJFCOM Commander’s Guidance for Effects-based Operations,” Joint Force Quarterly 51, Autumn 2008 105-108.

Available: here; Retrieved November 9, 2017.

Cited in:

[McConnell 2008] Steve McConnell. Managing Technical Debt, white paper, Construx Software, 2008.

Available: here; Retrieved November 10, 2017.

Cited in:

[US Army 2010] U.S. Army (2010) Field Manual 5.0 – The Operations Process U.S. Department of the Army.

Describes the concept, value, and importance of the doctrine of commander’s intent. See the index for “commander’s intent,” and especially paragraphs 2-90 and 2-91. Available: here; Retrieved: Dec. 22, 2019.

Cited in:

Other posts in this thread

Show Buttons
Hide Buttons