{"id":1319,"date":"2025-12-26T22:00:00","date_gmt":"2025-12-27T03:00:00","guid":{"rendered":"https:\/\/commoncents.blogwyrm.com\/?p=1319"},"modified":"2025-12-22T09:10:24","modified_gmt":"2025-12-22T14:10:24","slug":"the-brutal-truth-of-what-and-how","status":"publish","type":"post","link":"https:\/\/commoncents.blogwyrm.com\/?p=1319","title":{"rendered":"The Brutal Truth of \u2018What\u2019 and \u2018How\u2019"},"content":{"rendered":"\n

Many years ago (over a decade, in fact), in the space of this very blog, I spoke about why Kodak lost is way (along with its market share)<\/a> by focusing on \u2018the how\u2019 versus \u2018the what\u2019.  Insisting that they were a company that made photographic emulsion films rather than a company that embraced their founder\u2019s goal of capturing memories, Kodak allowed other companies to market their ideas, take their customers, and, eventually, almost completely marginalize a once titan of industry.<\/p>\n\n\n

\n
\"\"<\/a><\/figure><\/div>\n\n\n

In the years that have followed that post, I have become more and more convinced of the brutal truth behind the Kodak lesson.  Keeping \u2018the what\u2019 separate from the \u2018the how\u2019 and then treating both of them appropriately (without mixing ideas and methods designed for one with the other) is vital to the success of any endeavor as the next two stories show.  In the first vignette, we\u2019ll see a cautionary tale about how slavish devotion to a \u2018how\u2019 undermined \u2018what\u2019 a software project was trying to do.  The second vignette, plucked from the most recent political headlines, weaves the story of how a quasi-government agency, with grandiose dreams of achieving a \u2018what\u2019, failed to focus on the \u2018how\u2019 which ultimately doomed it to failure.<\/p>\n\n\n\n

Story #1 \u2013 Too Much \u2018How\u2019<\/h2>\n\n\n\n

A few days ago. I sat down to eat lunch. And, as is my wont, I fired up YouTube on my phone and decided to watch a short video.  One particular thumbnail (mysteriously suggested by the algorithm) caught my eye:<\/p>\n\n\n

\n
\"\"<\/a><\/figure><\/div>\n\n\n

The title of the video, Why Spaghetti Code Beat Clean Architecture<\/em><\/a>, was nearly as provocative and the whole story, told by one Eric Roby, was riveting for the entire 15 minutes run time.  Eric\u2019s story is about a colossal failure he was forced to be a party of when he was a junior developer working for an online retailer with an annual revenue of roughly $50 million. <\/p>\n\n\n\n

Eric was assigned to a team that was going to clean up the old, \u2018horrible\u2019, \u2018spaghetti\u2019, legacy code into some brilliant, shiny new \u2018clean code\u2019 example.  Steven, the team lead, was a subject matter expert brought in to set the vision (based on his \u201cwhy code quality is your competitive advantage\u201d message), motivate the team, and supervise the development and deployment of a new system.  Central to Steven\u2019s approach was the \u2018clean code\u2019 idea in which the level of abstraction and esthetic look-and-feel of the code were of paramount importance.  The code needed to have \u201cgood patterns\u201d and \u201csolid test coverage\u201d.<\/p>\n\n\n\n

Eric says that he was initially impressed by Steven\u2019s approach but the lead\u2019s way of presenting seemed to be \u201cconfidence that borders on dismissiveness\u201d \u2013 a foreshadowing of things to come. <\/p>\n\n\n\n

Eric began looking at the legacy code as directed by Steven.\u00a0 He found that while it is true that the old system's code was nearly impossible to read and maintain without a huge investment in a learning curve it was also true that it worked really, really well.\u00a0 Over the previous Black Friday, the legacy code handled 85,000 concurrent users, fulfilled over 77,000 orders, all with a latency of only about a quarter of a second, and an uptime of 99.4%. In addition to this sterling performance, the legacy system provided the development team a huge number of metrics to monitor and diagnose system health.\u00a0 When he shared these observations, Steven brushed them aside saying that all that infrastructure was the legacy system\u2019s way of compensating for the bad way it was written and that clean code didn\u2019t need that.<\/p>\n\n\n\n

As development and testing proceeded, Eric again tried to sway Steven on two subsequent occasions.\u00a0 First, Eric meticulously documented many side-by-side comparisons between the clean and legacy codes which showed that the legacy code had more metrics and more observability, indicating that the legacy code was more resilient. Steven\u2019s response was that Eric was over-engineering. Later Eric pointed out that factory testing used a way too small and far too sanitized group of users to be a valid test.\u00a0 He was told the \u201cdon\u2019t let perfect be the enemy of good-enough\u201d line.<\/p>\n\n\n\n

As is often said, pride foes before the fall, and the fall came in Autumn as the firm was beta testing in advance of Black Friday.\u00a0 The beta test consisted of running the clean code for 5% of the users (maximum of maybe 1,000) and monitoring its performance.\u00a0 For a very brief time, the system looked like it might be working but soon reports came in from the help desk of long checkout times and other errors. Shortly after it became clear that the clean code version was a bust when it consumed all available resources and effectively crashed.\u00a0 This embarrassing fail was further compounded by the fact that without ample metrics there was no clear way of knowing where the problems was.\u00a0 The firm reverted back to a sole dependence on the legacy code, essentially admitting that their clean code experiment was a colossal failure.<\/p>\n\n\n\n

Eric explains this failure on the fact that Steven emphasized one and only one \u2018pillar\u2019 (clean code) of the four he believes need to be addressed \u2013 the others being infrastructure & scaling, observability, operational culture.  Of these, Eric emphasizes the failures in the last pillar, the lack of an operational culture.  The firms culture \u201ctreated [Steven\u2019s] confidence as expertise\u201d, \u201crewarded elegance over resilience\u201d, and \u201ctreated production readiness as a nice-to-have\u201d.  In other words, the firm focused on \u2018the how\u2019 and not on \u2018the what\u2019 and paid the price.<\/p>\n\n\n\n

Story #2 \u2013 Too Much \u2018What<\/h2>\n\n\n\n

Our second story comes from one of the most controversial political situations to emerge from the Trump 2.0 administration: The Department of Government Efficiency, aka DOGE.\u00a0 Just after President Trump's election in November of 2024, there was this incredible enthusiasm and energy associated with having the Department of Government Efficiency being formed, being led by Elon Musk and Vivek Ramaswamy, and that this agency was going to go and clean house across the government.<\/p>\n\n\n\n

Having worked around the federal government for over 30 years and being frustrated by the sclerotic pace of the bureaucracy, I actually considered the possibility of volunteering for DOGE.  After all, I knew where all the bodies were buried and I had very strong ideas about how to make government efficient, having learned how to navigate through various useless processes and procedures.  I ultimately demurred because of the possible conflict of interest, but I was enthusiastic that DOGE would be able to produce the kind of fiscal responsibility I believe the government needs, or at least some fiscal responsibility.<\/p>\n\n\n\n

The country\u2019s initial reaction to DOGE just after President Trump\u2019s inauguration can be best described as \u2018shock and awe\u2019, borrowing a phrase from Desert Storm.  DOGE claimed to be routing out billions of dollars of waste, well on its way to the ultimate goal of 2 trillion dollars.<\/p>\n\n\n\n

However, if one were to query current headlines a mere 8 months later using the search string \u201cMusk DOGE\u201d, one comes up with a host of articles with headlines that essentially say quote Elon Musk saying \u201cDOGE somewhat efficient, but I wouldn't do it again\u201d.<\/p>\n\n\n

\n
\"\"<\/a><\/figure><\/div>\n\n\n

Skimming any of the articles, looking past all the bloviating and padding the standard reporter does in order to get their word count up, one sees that each article contains two basic points:  1) DOGE was nowhere near as efficient or as sweeping in its changes as Musk had hoped it to be and 2) Musk had anticipated it would have worked properly because it had worked in all his companies in the past.<\/p>\n\n\n\n

What is the reason for this even more colossal failure than the one in Story #1 above?  Put simply, DOGE focused on \u2018the what\u2019 of reducing governmental bloat without ever stopping to ask themselves how they would recognize the bloat when they see it.  When Musk took over Twitter, as big as that company might have been, as many computers and employees and mocha lattes and yoga rooms that it might have had under Jack Dorsey, it was still fundamentally a simple company with a simple single vision.  A user types something stupid or wise or fun or mean or whatever and then tweets it to the universe. That was it. That's all there was to it. SpaceX also has only one simple, solitary vision. Put some high explosives underneath a payload made of metal and plastic and silicon and ignite them to push the payload off the Earth (and hopefully not blow it up).  Simple, clean, straightforward. In other words, even if Musk had a million people working for him, he only had to navigate a few corporate visions.<\/p>\n\n\n\n

The federal government, in contrast, has not only a million people literally working for it, but it has millions of visions, many of them often competing with or in contradiction to other visions by the very nature of the democratic process.  Musk's team failed to take into account the nature of what they were trying to change. They failed to take into account \u2018how\u2019 they would implement those changes.  Being charitable, all they wanted to do was make government smaller and more efficient, a laudable goal, but they failed miserably because they were unable to understand how to make the changes they claimed they wanted. <\/p>\n\n\n\n

To close, what is the lesson we can draw from these tales of woe and incompetence?\u00a0 The answer is it's important in any endeavor to sit and think clearly about \u2018what\u2019 is being done and \u2018how\u2019 it should be accomplished.\u00a0 The more complicated the task is, the greater amount of care that is needed in making these distinctions.\u00a0 Focusing too much on a particular \u2018how\u2019 ends up with the project falling into the trap best described by the old adage that when one only has a hammer every problem tends to look like a nail.\u00a0 Likewise, overly focusing on \u2018what\u2019 runs an equally dangerous risk best thought of as reaching into the toolbox indiscriminately for any heavy object, say a wrench, when one needs to pound a nail.\u00a0 Neither of these two approaches is a good idea.<\/p>\n","protected":false},"excerpt":{"rendered":"

Many years ago (over a decade, in fact), in the space of this very blog, I spoke about why Kodak lost is way (along with its market share) by focusing... Read more ><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1319","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1319","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1319"}],"version-history":[{"count":2,"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1319\/revisions"}],"predecessor-version":[{"id":1323,"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1319\/revisions\/1323"}],"wp:attachment":[{"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1319"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1319"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/commoncents.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1319"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}