Irving Wladawsky-Berger

Can We Trust Our Impressive AI Language Models?

One of the key findings of the 2022 AI Index Report was that large language models (LLMs) are setting records on technical benchmarks thanks to advances in deep neural networks and computational power that allows them to be trained using huge amounts of data. LLMs are now surpassing human baselines in a number of complex language tasks, including English language understanding, text summarization, natural language inference, and machine translation.

A.I. Is Mastering Language. Should We Trust What It Says?, a recent NY Times Magazine article by science writer Steven Johnson, took a close look at one such LLM, the Generative Pre-Trained Transformer 3, generally referred to as GPT-3. GPT-3 was created by the AI research company OpenAI. It’s been trained with over 700 gigabytes of data from across the web, along with a large collection of text from digitized books. “Since GPT-3’s release, the internet has been awash with examples of the software’s eerie facility with language - along with its blind spots and foibles and other more sinister tendencies,” said Johnson.

“So far, the experiments with large language models have been mostly that: experiments probing the model for signs of true intelligence, exploring its creative uses, exposing its biases. But the ultimate commercial potential is enormous. If the existing trajectory continues, software like GPT-3 could revolutionize how we search for information in the next few years.” Instead of typing a few keywords into Google and getting back a long list of links that might have the answer, you’d ask GPT-3 what you’re looking for in English and get back a well-written, accurate answer. “Customer service could be utterly transformed: Any company with a product that currently requires a human tech-support team might be able to train an L.L.M. to replace them.”

A Human-Compatible Safe, Controllable AI

“Even in its present state, the technology of artificial intelligence raises many concerns as it transitions from research into widespread use,” wrote UC Berkeley professor Stuart Russell in a recent essay, If We Succeed. “These concerns include potential misuses such as cybercrime, surveillance, disinformation, and political manipulation; the exacerbation of inequality and of many forms of bias in society; the creation and deployment of lethal autonomous weapons; and the usurpation of human roles in the economy and in social relationships.”

“My concern here, however, is with the potential consequences of success in creating general-purpose AI: that is, systems capable of quickly learning to perform at a high level in any task environment where humans (or collections of humans) can perform well.” Decades ago, Alan Turing expressed a similar concern. While answering a question during a lecture in 1951, Turing said: “It seems probable that once the machine thinking method had started, it would not take long to outstrip our feeble powers. … At some stage therefore we should have to expect the machines to take control.” Over the past decade, a number of public figures like Stephen Hawking and Nick Bostrom have argued that a superintelligent AI could become difficult or impossible for humans to control, and might even pose an existential threat to humanity.

Until recently, we didn’t have to worry about the consequences of such superhuman AIs because AI applications weren’t all that smart and were mostly confined to research labs. But, powerful AI systems have now matched or surpassed human levels of performance in a number of application- specific tasks such as image and speech recognition, skin cancer classification, breast cancer detection, and complex games like Jeopardy and Go. While these application-specific breakthroughs, - generally referred to as soft, or narrow AI, - were once viewed as the exclusive domain of humans, AI still lacks the deeper, general-purpose human intelligence that’s long been measured in IQ tests.

The MIT Digital Insider Podcast with Sinan Aral

Earlier this week, MIT’s Initiative on the Digital Economy launched a new podcast, The Digital Insider with Sinan Aral. Aral is Professor in the MIT Sloan School of Management and Director of the Initiative on the Digital Economy, where I’ve been a Fellow since it was founded in 2012. He’s the author of the 2020 book The Hype Machine.

I like to take a walk every day, weather permitting, and one of the reasons I enjoy my walks is the opportunity to listen to a podcast. I just listened to the first episode of The Digital Insider. It was truly excellent.

In the episode, Sinan interviewed Maria Ressa, a Filipino-American journalist and author, and co-founder and CEO of Rappler, a Philippine online new website. Maria has been a prominent critic of the human right abuses of Philippine President Rodrigo Duterte, for which she’s been arrested and convicted. Along with Russian journalist Dmitry Muratov, Maria was awarded the 2021 Nobel Peace Prize for “their efforts to safeguard freedom of expression, which is a precondition for democracy and lasting peace.”

The Digital Insider podcast aims to explore the hard science behind the digital economy as well as how the digital economy actually works. “From AI bias to NFTs; fake news to two-sided markets; cryptocurrencies to quantum computing, Sinan and guests make sense of the lightning-fast changes taking place in the tech driven world.”

I highly recommend it.

The Digital Divide in How We Use the Internet

A few weeks ago I attended an MIT seminar by Esteban Moro, professor at Universidad Carlos III in Madrid and visiting professor at MIT. Moro’s talk discussed the socio-economic digital divide based on how we use the internet, focused on two key questions: how profound is the digital usage gap in our society?; and can we use mobile phone traffic to infer socioeconomic status? His seminar was based on a recently published article in the Journal of the Royal Society Interface co-authored with four collaborators, - News or social media? Socio-economic divide of mobile service consumption.

“Inequality is a central societal problem, especially within rapidly expanding urban areas,” wrote the authors. “While it is a crucial driver for economic growth, the progressive clusterization of workers, industries, companies and services in cities has a tremendous cost in terms of segregation and discrimination. This cost is not only economic: in the same city, different areas can have a 10- to 15-year imbalance in life expectancy and highly divergent education levels, with little chances of social mobility.”

“The design and successful implementation of policies to alleviate these problems require fine-grained, frequently updated information about income, education or inequality across metropolitan areas,” they added. “However, most data sources employed today, such as population censuses or surveys, suffer from sparsity in population coverage or infrequent updating, hence they do not allow the swift evolution that urban societies experience nowadays to be followed. Thus, the traditional ways of understanding cities tend to explain what happened 5 years earlier rather than nowcasting or even predicting urban transformations.”

In his seminar, Moro referred to the socio-economic divide based on how we use the internet as the second digital divide, in contrast to the original digital divide which was based on access to the internet.

(I Can’t Keep No) Satisfaction

(I Can’t Get No) Satisfaction, the Rolling Stones’ 1965 megahit, should have more appropriately been titled (I Can’t Keep No) Satisfaction, wrote social scientist and author Arthur C. Brooks in How to Want Less: The secret to satisfaction has nothing to do with achievement, money, or stuff, - a recent essay in The Atlantic. Brooks has been in the faculty of the Harvard Kennedy School for the past two years, after being president of the American Enterprise Institute from 2009 to 2019.

Satisfaction, he explained, “is the greatest paradox of human life. We crave it, we believe we can get it, we glimpse it and maybe even experience it for a brief moment, and then it vanishes. … In fact, our natural state is dissatisfaction, punctuated by brief moments of satisfaction.”

Our human tendency to pursue satisfaction despite its fleeing nature condemns us to continuously live in a so-called hedonic treadmill. We might not like it, “but Mother Nature thinks it’s pretty great. She likes watching you strive to achieve an elusive goal, because strivers get the goods - even if they don’t enjoy them for long. More mates, better mates, better chances of survival for our children - these ancient mandates are responsible for much of the code that runs incessantly in the deep recesses of our brains.”

The 2022 Work Trend Index: How to Get Hybrid Right

“The people returning to the office are not the same as those who left in March 2020,” wrote Jared Spataro, Microsoft Corporate VP for Modern Work, in a recent Harvard Business Review (HBR) article, 5 Key Trends Leaders Need to Understand to Get Hybrid Right. The article summarized the findings of Microsoft’s 2022 Work Trend Index, a report based on various sources of information, including a survey of 31,000 people in 31 countries, labor trends from LinkedIn, and trillions of signals from Microsoft 365 suite of productivity apps.

“The data shows that the past two years left an indelible mark on the psyche of workers, altering their expectations and fundamentally shifting the way work gets done,” said Spataro. “This is a pivotal moment, where leadership matters more than ever. Those who embrace a new mindset and shift cultural norms will best position their people and their business for long-term success. Adapting to the influx of change in this business environment is no easy feat.”

“After many false starts, organizations are finally making the shift into a true hybrid work model. Like every other turning point over the past two years, there’s no shortage of perspectives on what this next phase will look like.” However, there’s no going back to the way work once was. Adapting to the many changes in this business environment is a challenge now facing every leader. To navigate the transition to hybrid work, leaders need to understand five key trends.

How Can You Trust the Predictions of a Large Machine Learning Model?

Artificial intelligence has emerged as the defining technology of our era, as transformative over time as the steam engine, electricity, computers, and the Internet. AI technologies are approaching or surpassing human levels of performance in vision, speech recognition, language translation, and other human domains. Machine learning (ML) advances, like deep learning, have played a central role in AI’s recent achievements, giving computers the ability to be trained by ingesting and analyzing large amounts of data instead of being explicitly programmed.

Deep learning is a powerful statistical technique for classifying patterns using large training data sets and multi-layer AI neural networks. Each artificial neural unit is connected to many other such units, and the links can be statistically strengthened or decreased based on the data used to train the system. But such statistical methods are not equally suitable for all tasks. Tasks that are particularly suitable for machine learning, exhibit several key criteria, such as the availability of large data sets of well-defined input-output pairs for training ML classifiers, - e.g., carefully labeled cat, not-cat pictures for cat recognition classifiers, and english-french document pairs for machine translation algorithms.

The methods behind a machine learning prediction, - subtle adjustments to the numerical weights that interconnect its huge number of artificial neurons, - are very difficult to explain because they’re so different from the methods used by humans. The bigger the training data set, the more accurate the prediction, but the more difficult it will be to provide a detailed, understandable explanation to a human of how the prediction was made.

A few weeks ago I attended an online seminar, - How Can You Trust Machine Learning? by Stanford professor Carlos Guestrin, - on the difficulty of understanding machine learning predictions. Guestrin’s seminar was based on a 2016 article he co-authored with Marco Tulio Ribeiro and Sameer Singh , “Why Should I Trust You?” Explaining the Predictions of Any Classifier.

Beyond GDP: A Framework for Measuring Economic Progress

“What is meant by economic progress, and how should it be measured?,” asked economists Diane Coyle and Leonard Nakamura in a recent paper, Time Use and Household-Centric Measurement of Welfare in the Digital Economy. “The conventional answer is growth in real GDP over time or compared across countries, a monetary measure adjusted for the general rate of increase in prices. However, there is increasing interest in developing an alternative understanding of economic progress, particularly in the context of digitalization of the economy and the consequent significant changes Internet use is bringing about in production and household activity.”

Gross Domestic Product (GDP) became the accepted international measure of economic progress in the 1940s. It was a good measure for an industrial economy dominated by the production of physical goods, but GDP doesn’t reflect important economic activity beyond production, such as income, consumption and quality of life, nor does it capture measures of economic welfare or utility, that is, the extent to which a service or good satisfies an individual’s wants and needs. In addition, GDP doesn’t include the value of the increasing amounts of free information goods now available in the Internet-based digital economy, including email, texts, social media, maps, apps and videos.

In their paper, Coyle and Nakamura propose an alternative approach for measuring economic progress based on how much time people spend on different daily activities - e.g., paid work, household tasks, leisure, and consumption - combined with measures of well-being while engaged in these different activities. “In an economy that is four-fifths services rather than goods, with time to consume therefore inherent in the majority of economic activity, the utility of the different uses of time seems key to understanding economic welfare as well as productivity.”

Beatlemania: Why Are Success and Failure So Unpredictable?

“Why did the Beatles become a worldwide sensation? Why do some cultural products succeed and others fail? Why are some musicians, poets, and novelists, unsuccessful or unknown in their lifetimes, iconic figures decades or generation after their deaths? Why are success and failure so unpredictable?,” these are among the questions explored in Beatlemania, a draft paper by Harvard professor Cass Sunstein that will be published later this year in the inaugural issue of The Journal of Beatles Studies.

“On one view, the simplest and most general explanation is best, and it points to quality, appropriately measured: success is a result of quality, and the Beatles succeeded because of the sheer quality of their music,” wrote Sunstein. “On another view, social influences are critical: timely enthusiasm or timely indifference can make the difference for all, including the Beatles, leading extraordinary books, movies, and songs to fail even if they are indistinguishable in quality from those that succeed.”

In 1961 the Beatles  were an obscure English rock band from Liverpool, with no manager and modest prospects. They tried to release a debut single, Love Me Do, but every record label they approached rejected them and the band came close to splitting. In January of 1962 Brian Epstein became their manager. Epstein had no experience in managing artists, but he liked their music and sense of humor. He eventually persuaded EMI producer George Martin to audition the band in June of 1962, who despite feeling that they were “a rather raw group” with “not very good songs,” agreed to sign them to a recording contract.

How Do Young People See the World Compared to Older Generations?

“There is an emerging narrative about a growing intergenerational divide worldwide,” said a recent international survey conducted by The Changing Childhood Project. “In the media and in popular culture, the young are often portrayed as impatient, militant, outspoken, and even entitled, in contrast to more sober temperaments among older people. The concept of intergenerational tension is not new. What may be new, however, is the speed with which our world is changing – and with it, childhood.”

The Changing Childhood Project is a collaboration between UNICEF, - the UN agency responsible for providing humanitarian and developmental aid to children around the world, - and Gallup, - the analytics company best known for its international opinion polls. Created to explore these intergenerational shifts, the project seeks to answer a few key questions: what is it like growing up today?; how do young people see the world differently?; and, is there an intergenerational gap?

The 2022 AI Index Report: AI’s Emerging Real-World Impact

On March 16, Stanford’s Institute for Human-Centered Artificial Intelligence (HAI) released the 2022 AI Index report, its fifth annual study on the impact and progress of AI. The comprehensive study was led by an interdisciplinary group of experts from across academia and industry, and highlights the rapid rate of technical and marketplace AI advances, as well as the growing ethical and regulatory concerns associated with AI.

“2021 was the year that AI went from an emerging technology to a mature technology - we’re no longer dealing with a speculative part of scientific research, but instead something that has real-world impact, both positive and negative,” said Jack Clark, co-chair of the AI Index. “This year’s AI Index tells us that AI is being integrated into the economy and the effects of it are beginning to go global across research, deployment, and even funding.” Two weeks ago I attended an online HAI seminar where Clark gave this excellent presentation on the AI Index.

The report is organized into five chapters: Technical Performance, AI Ethics, R&D, Economy and Education, and Policy and Governance. Let me summarize the key findings of each chapter.

The Tech Trends that Will Most Reshape Companies Over the Next Decade

“In the next decade, we’ll experience more progress than in the past 100 years combined, as technology reshapes health and materials sciences, energy, transportation, and a wide range of other industries and domains,” notes a recent McKinsey study on the The top trends in tech. “The implications for corporations are broad.”

“These trends may not represent the coolest, most bleeding-edge technologies. But they’re the ones drawing the most venture money, producing the most patent filings, and generating the biggest implications for how and where to compete and the capabilities you need to accelerate performance.”

“Unifying and underlying them all is the combinatorial effect of massively faster computation propelling new convergences between technologies; startling breakthroughs in health and materials sciences; an array of new product and service functionalities; and a strong foundation for the reinvention of companies, markets, industries, and sectors.”

What Is Web3, and Could It Usher a New Economic System?

Bitcoin was introduced in 2008 with the release of Bitcoin: A Peer-to-Peer Electronic Cash System, which explained how to design a decentralized cryptocurrency and digital payment system without the need for central banks or trusted intermediaries. Blockchain, the digital ledger for managing and certifying the validity of bitcoin transactions, was introduced in the same paper.

Over the years blockchain has transcended its original objectives, and has evolved in two major directions. One continues to focus on blockchain as the underlying platform for bitcoin, but it’s also become the platform for the large number of cryptocurrencies, digital tokens, and other cryptoassets that have since been created. The other is focused on the use of blockchain as a trusted distributed data base for private and public sector applications involving multiple institutions, such as supply chains, financial services and healthcare. The cryptocurrency camp is based on public permissionless blockchains, which anyone can join and require some kind of proof-of-work or proof-of-stake systems. The multi-institution camp is based primarily on private permissioned blockchains where participation is restricted to the institutions transacting with each other.

Given my professional interests, I’m particularly interested in the use of blockchains in business and public sector applications for two major reasons. First, I consider blockchain as a major next step in the continuing evolution of the Internet, helping us enhance the security of Internet transactions and data by developing a layer with the standard encrypted services for secure communication, storage and data access. And, longer term, blockchain technologies can significantly improve the efficiency, resilience, and management of complex global applications involving multiple institutions.

But, while I’ve been somewhat skeptical of the crypto camp, a number of intriguing crypto-related topics have recently captured my attention, including Non-Fungible Tokens (NFTs), Decentralized Finance (DeFi), and especially Web3. These various topics were nicely explained by technology columnist Kevin Roose in The Latecomer’s Guide to Crypto, an article in the March 20 SundayBusiness section of the NY Times.

The Widening Gap Between Technological and Institutional Change

A few weeks ago I read The Exponential Age Will Transform Economics Forever, an article in Wired by Azeem Azhar based on his recently published book The Exponential Age. Azhar’s central thesis is that the chasm between what technology allows us to do and what our institutions are prepared to handle has been rapidly widening. New technologies are being invented and scaled at an ever-faster pace. But our institutions, - including our economic systems, political organizations and social norms, - are changing much more slowly. While technological advances follow an exponential curve, institutional adaptation follow a straight, incremental line.

The gap between technological and institutional change is nothing new. Ever since the advent of the Industrial Revolution, there’s been a significant time lag between the emergence of a transformative technology and its ensuing impact on economies and societies. Even after reaching a tipping point of market acceptance, it takes considerable time, - often decades, - for their benefits to be fully realized.

In The Productivity J-Curve, a 2018 NBER paper, Erik Brynjolfsson, Daniel Rock, and Chad Syverson  explained that general purpose, transformative technologies, - such as the steam engine, electricity, and semiconductors, - “are the defining technologies of their times and can radically change the economic environment. They have great potential from the outset, but realizing that potential requires larger intangible and often unmeasured investments and a fundamental rethinking of the organization of production itself.”

The life cycle of historically transformative technologies consists of two district phases, investment and harvesting. Since the technologies are general purpose in nature, they require massive complementary investments, including business process redesign, co-invention of new products and business models, and the re-skilling of the workforce. Moreover, the more transformative the technologies, the longer it takes for them to reach the harvesting phase when they are widely embraced by individuals, companies and industries across the economy.

The Impact of Open Source on the EU Economy

In the 1990s, open source was generally viewed as experimental approach to software development mostly used by research and academic communities on emerging projects like the Internet and Linux. Open source has since evolved to become a well-accepted model of economic production across just about all private- and public-sector communities around the world. But, while widely used, what’s been the economic impact of open source on nations and firms? This question was addressed in a recent study on the impact of open source on the European economy.

“The increasing relevance of Open Source (OS) during the last two decades requires an update of an in-depth analysis of its current role, position and its potential for the European economy,” said the European Commission (EC) in its report on The impact of open source software and hardware on technological independence, competitiveness and innovation in the EU economy.

“Whereas Open Source Software (OSS) has become mainstream across all sectors of the software industry during the past 20 years, Open Source Hardware (OSH) is still in an emerging phase. However, the business ecosystem for OSH is developing.”

The EC conducted a comprehensive analysis of the commercial uses, costs, and benefits of OSS and OSH. “On the basis of this information, the study assesses the potential for the European Union (EU) to achieve its policy goals (including economic growth, greater competitiveness, innovation, and job creation) through the use, promotion and support of OSS and OSH.”

The Rise and Fall of Nation-States

Several weeks ago I attended The End of Nation-States, by technology executive and consultant Tomás Pueyo, - part of the Stanford Digital Economy Lab seminar series. In May of 2021, Pueyo launched Unchartered Territories, a newsletter he describes as aiming to explore the unchartered territories of a fast changing world “to know how we can prepare for them.”

His seminar discussed the role of information technologies in the rise of nation-states throughout history, and how information technologies are likely to lead to the end of nation-states in the coming decades. Let me summarize Pueyo’s key arguments based on his talk and two related newsletters.

The Rise of Nation-States

In Internet and Blockchain Will Kill Nation-States, published in August of 2021, Pueyo explained how the printing press led to the emergence of nation-states in the 16th century.

The feudal system was the basic structure of society between the 9th and 15th centuries in medieval Europe. Feudalism was based on the relationship between a landed-aristocracy, - e.g., kings, dukes, counts, - and the vassals under their protection who vowed them allegiance. Power in the feudal system was hyperlocal and widely distributed across different landowners. Communication was difficult across different localities, since they each generally spoke different dialects or altogether different languages.

The Catholic Church was the biggest power in medieval Europe. The root of its power was the Church's well organized hierarchy of priests, bishops, archbishops, cardinals, and the Pope, all of which were able to communicate with each other far better than everyone else, - aristocrats and vassals alike.

Getting Ready for the 100-Year Life

“In the United States, demographers predict that as many as half of today’s 5-year-olds can expect to live to the age of 100,” said The New Map of Life, a recent report from the Stanford Center on Longevity. The   cross-disciplinary Stanford Center was founded in 2007 to conduct research on the key issues associated with increased longevity, - from cognitive health to physical well-being and financial security, - with the aim to make long lives healthy and rewarding.

While the 100-year life may be here, we’re not ready. “By the middle of this century, this once unattainable milestone may become the norm for newborns, continuing a remarkable trend that saw human life expectancies double between 1900 and 2000, and still rising in this century, despite the grievous toll of the Covid-19 pandemic,” notes the report. “Longevity is one of the greatest achievements in human history, brought about by reductions in infant mortality, advances in sanitation and medicine, public education, and rising standards of living. Yet the change came about so quickly that the social institutions, economic policies, and social norms that evolved when people lived for half as long are no longer up to the task.”

According to the Stanford Center, there’s a clear distinction between aging and longevity. Aging is the biological process of getting older - the accumulation of changes in a human being over time. Longevity is “the measure of long life,” - the ways to enhance the quality of a long life “so that people experience a sense of belonging, purpose, and worth at all ages and stages.”

How Do Digital Infrastructures Increase a Firm’s Value?

“In the information age, the value of a firm rests fundamentally on how it stores, shares and processes information,” wrote Seth Benzell, Jonathan Hersh, and Marshall Van Alstyne in a recent paper, How APIs Create Growth by Inverting the Firm. “Digital infrastructure is therefore central to a firm’s success.”

But, how do digital infrastructures increase a firm’s value? One method is to make more efficient use of the firms internal capital by modularizing, reconfiguring and reusing the firms IT resources. A second method, used in platform businesses, is to leverage external capital by giving access to the firm’s resources to third parties, and capturing a share of the resulting surplus. Both methods require the implementation of Application Programming Interfaces (APIs), whether for only for internal use by the firm’s developers or exposed externally to the firm’s platform partners. Both methods also feature a modular architecture of remixable resources. “Modularity combines the advantages of standardization typically associated with high volume processes together with the advantages of customization typically associated with bespoke processes.”

“An API is a set of routines, protocols, and tools that standardizes building software applications compatible with an associated program or database. APIs fundamentally are code that control access to information. … They govern the type and format of calls or communications that any application can make of another associated program. The answering program is agnostic about the source of the call, yet can require access permission, and the calling program need not know anything about the internal workings of the answering program. … When designing an API, the architect decides how much of the computer system or data to expose to which users. Being accessible on the web, these API endpoints act as a constant conduit to business processes that the firm itself specifies.”

How Does AI Improve Human Decision-Making?

“Artificial Intelligence (AI) is the newest general-purpose technology (GPT),” wrote Sukwoong Choia, Namil Kim, Junsik Kim, and Hyo Kang in a recent paper, How Does AI Improve  Human Decision-Making? Evidence from the AI-Powered Go Program. “One remarkable characteristic of AI is its ability to provide humans with high-quality predictions at relatively low cost and to automate a wide range of predictions. AI has already outperformed human professionals in many domains - including strategic gameplay, medical diagnosis, and new drug development.” 

“Furthermore, as a GPT, the domains where AI outperforms humans are expanding at a fast pace. The rapid development and adoption of AI thus raise an interesting yet pressing question about how AI affects human tasks in these various domains. Studies of AI and human capital, for instance, have examined the performance gap between humans and AI, highlighting AI’s potential for replacing jobs.” However, we should keep in mind that new technologies have been replacing workers and transforming economies for over two centuries. But, over time, these same technologies led to the creation of whole new industries and new jobs, increasing productivity and economic output, raising earnings, and augmenting the demand for labor.

Workers can increase their productivity and performance when assisted in their jobs by AI-based tools. But beyond its assistant role, AI can play a major instructional role by training human professionals to make better decisions. Recent technology advances have significantly improved the quality and reduced the cost of AI-based predictions.

The paper raises a number of important questions about the use of AI to improve human decisions making. Can we show quantitative evidence that AI-based predictions actually improve the quality of human decisions? If so, by what mechanisms are AI-based human decisions improved? And, do the improvements vary between depending on ones attitude toward AI-based decisions?

The Promise & Peril of Human-Like Artificial Intelligence

In his 1950 seminal paper, Computing Machinery and Intelligence, Alan Turing proposed what’s famously known as the Turing test, - a test of a machine’s ability to exhibit intelligent behavior indistinguishable from that of a human. If a human at a keyboard couldn’t tell whether they were interacting with a machine or a human, the machine is considered to have passed the Turing test. “Ever since, creating intelligence that matches human intelligence has implicitly or explicitly been the goal of thousands of researchers, engineers and entrepreneurs,” wrote Erik Brynjolfsson, - Stanford professor and Director of the Stanford Digital Economy Lab, - in a recent article, The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence.

“The benefits of human-like artificial intelligence (HLAI) include soaring productivity, increased leisure, and perhaps most profoundly, a better understanding of our own minds. But not all types of AI are human-like - in fact, many of the most powerful systems are very different from humans - and an excessive focus on developing and deploying HLAI can lead us into a trap. … On the one hand, it is a path to unprecedented wealth, increased leisure, robust intelligence, and even a better understanding of ourselves. On the other hand, if HLAI leads machines to automate rather than augment human labor, it creates the risk of concentrating wealth and power. And with that concentration comes the peril of being trapped in an equilibrium where those without power have no way to improve their outcomes, a situation I call the Turing Trap.”

Over the past decade, powerful AI systems have matched or surpassed human levels of performance in a number of tasks such as image and speech recognition, applications like skin cancer classification and breast cancer detection, and complex games like Jeopardy and Go. These AI breakthroughs are generally referred to as soft, narrow or specialized AI, inspired by, but not aiming to mimic the human brain. They’ve been generally based on machine learning, that is, on the analysis of vast amounts of information using powerful computers and sophisticated algorithms, whose results exhibit qualities that we associate with human intelligence.

The Work of the Future Is Ours to Invent

The Work of the Future: Building Better Jobs in an Age of Intelligent Machines, by David Autor, David Mindell and Elisabeth Reynolds was published last week. The new book is based on the multiyear MIT Task Force on The Work of the Future that they jointly co-chaired.

The Task Force was commissioned by MIT President Rafael Reif in the spring of 2018 to address one of the most critical questions of the digital economy, - an economy that technology universities like MIT have played a major role in bringing about: as emerging technologies raise aggregate economic output and the wealth of nations, will they also enable people to attain higher living standards, better working conditions, greater economic security, and improved health and longevity? Led by Autor, Mindell and Reynolds, the task force involved over 20 faculty members from 12 departments at MIT as well as more than 20 graduate students. Its final report was released in November of 2020. In addition, the Task Force published a number of working papers and research briefs.

“Amidst a technological ecosystem delivering rising productivity, and an economy generating plenty of jobs (at least until the COVID-19 crisis), we found a labor market in which the fruits are so unequally distributed, so skewed towards the top, that the majority of workers have tasted only a tiny morsel of a vast harvest.” was the Task Force overarching conclusion. But, it argued that with better policies in place, more people could enjoy good careers even as new technologies transform the very nature of work.

Let me summarize the Task Force key findings which the book builds on:

Is It Possible to Establish Norms for Responsible State Behavior in Cyberspace?

In mid-December, the Council on Foreign Relations sponsored a virtual roundtable with Joseph Nye, - former dean of Harvard’s Kennedy School of Government, - to discuss his recent Foreign Affairs article The End of Anarchy?: How to Build a New Digital Order. Professor Nye has long been regarded as one of America’s preeminent strategic thinkers and political scientists. In the 1970s he chaired the National Security Council Group on Nonproliferation of Nuclear Weapons, and over the past decade he’s brought his expertise to the study of conflict and deterrence in cyberspace.

Cybersecurity is an increasingly important aspect of the of US national security strategy, including global trade and the protection of our critical infrastructures. In June of 2021, FBI Director Christopher Wray compared the danger of ransomware attacks on US firms by Russian criminal groups to the September 11 terrorist attacks. And, in a July editorial, the NY times said that ransomware attacks have emerged as “a formidable potential threat to national security,” given “their ability to seriously disrupt economies and to breach strategically critical enterprises or agencies,” urging governments that “It is a war that needs to be fought, and won.”

At an MIT conference in February of 2019, former US Secretary of State Henry Kissinger was asked if we need cybersecurity control agreements with Russia, China and other nations similar to the nuclear arms control agreements that he spent so much time negotiating during the Cold War. Dr. Kissinger replied that for arms control to be effective, the two sides needed to share information and agree to inspections. But such mechanisms are harder to apply in the digital world, because the transparency that was essential for arms control would be very hard to establish for cyber threats. In addition, while controls of physical arms are relatively explicable and negotiable, the variety and speed of cyber attacks make it much harder to develop adequate control agreements.

A Blockchain-based Framework for Safeguarding the Integrity of Real-World Assets

Blockchains first came to light in 2008 as the architecture underpinning bitcoin, the best known and most widely held cryptocurrency. It’s a truly brilliant architecture built on decades-old fundamental research in cryptography, distributed data, game theory and other advanced technologies. The blockchain’s original vision was limited to enabling bitcoin users to transact directly with each other with no need for a financial institution or government agency to certify the validity of the transactions. But, like the Internet and other transformative technologies, blockchain has now transcended its original objectives.

Blockchains are a kind of distributed ledger technologies (DLT), which also include non-blockchain DLTs. Over the past decade, an increasing number of people, including me, consider blockchains and DLTs as major next steps in the evolution of the Internet. In 2016 the World Economic Forum (WEF) named The Blockchain in its annual list of Top Ten Emerging Technologies citing its potential to fundamentally change the way markets and governments work. “Like the Internet, the blockchain is an open, global infrastructure upon which other technologies and applications can be built,” said the WEF. “And like the Internet, it allows people to bypass traditional intermediaries in their dealings with each other, thereby lowering or even eliminating transaction costs.”

The Internet is a general purpose network platform that unlocked huge innovations and economic value by significantly lowering the cost of connections and supporting a large variety of applications. A major reason for its ability to support so many different kinds of applications is that the Internet’s foundations, its TCP-IP layer, has stuck to its basic data-transport mission, i.e., just moving bits around.  It has no idea what the bits mean or what they’re trying to accomplish.

The design decisions that shaped the Internet back in the mid-late 1980s didn’t optimize for security and privacy, or for the ability to authenticate transactions between two or more parties. That’s all the responsibility of the applications running on top of the TCP/IP layer, and they each generally do it their own way, sometimes not at all. Not surprisingly, the lack of standards for security, privacy and transactional integrity have been the biggest challenges facing the Internet in our fast growing digital economy.

What’s the State of Our Digital Technology Revolution?

I first met Carlota Perez in the mid-2000s when she gave a seminar at IBM based on her 2002 bestseller Technological Revolutions and Financial Capital: The Dynamics of Bubbles and Golden Ages. At the time, we had been living through a series of major changes, - the explosive growth of the Internet, the advent of the digital economy, the dot-com bubble, and the bursting of the bubble. In her excellent presentation Perez explained these turbulent times by positioning them within the historical perspective she wrote about in her book.

If you look at the historical big picture, patterns begin to emerge which serve as a good guide for understanding the past and thinking about the future. Since the onset of the Industrial Revolution we’ve had 5 major technological revolutions, each one lasting roughly 40 to 60 years. First was the age of machines, factories and canals starting in 1771. This was followed by the age of steam, railways, iron and coal, starting in 1829; steel, electricity and heavy engineering in 1875; oil, automobiles, and mass production in 1908, and our present information technology and telecommunications (ICT) digital age starting in 1971.

Technology revolutions are engines of growth, ushering new paradigms for innovation, rejuvenating and transforming the economy, and re-shaping social behavior and the institutions of society. To better understand the dynamics of a technology revolution, we should split it into two different periods, each lasting 20 to 30 years.

A New Measurement Framework for the Digital Economy

Several weeks ago I heard a very interesting keynote presentation by Cambridge professor Diane Coyle at the annual workshop of the Stanford Digital Economy Lab, - What Don’t We Know About Measuring the Digital Economy? Professor Coyle is also a research associate of the UK Economics Statistics Centre of Excellence. In 2017 she was a recipient of the Indigo Prize on how to measure economic activity in the digital economy for her essay Making the Future Count, co-authored with Benjamin Mitra-Kahn.

“GDP captures only market transactions at the price of exchange, and not the welfare gains, externalities, environment, distribution of wealth or innovation which occurs in an economy,” wrote the authors. “Hence almost since its creation in the 1940s it has been criticised for its inability to capture economic welfare. Now changes in the economy, being restructured by digital technology and paying the price for unsustainable growth, make the case for a new measurement framework more pressing than ever. GDP was never an ideal measure of economic welfare and its suitability has been decreasing.”

Gross Domestic Product (GDP) became the accepted international measure of economies in the1940s. While being a good measure for the 20th century industrial economy, GDP is a flawed measure for the 21st century economy. It was suitable when the economy was dominated by the production of physical goods, but GDP doesn’t adequately capture the growing share of services and other intangible assets that now characterize advanced economies. Nor does it reflect important economic activity beyond production, such as income, consumption and living standards.

The World Ahead 2022: Adjusting to New Realities

A few weeks ago The Economist published The World  Ahead 2022, its 36th annual look at the economic, political, social and cultural trends that will likely shape the coming year. “If 2021 was the year the world turned the tide against the pandemic, 2022 will be dominated by the need to adjust to new realities, both in areas reshaped by the crisis (the new world of work, the future of travel) and as deeper trends reassert themselves (the rise of China, accelerating climate change),” wrote the issue’s editor Tom Sandage.

Here are the top ten major trends in The World Ahead 2022:

New Ways of Understanding Human Behavior

“It is often said that no person is an island and it takes a village to raise a child, but psychology has largely lacked the scientific evidence to quantify and characterize these aphorisms,” wrote MIT professor Alex (Sandy) Pentland in Contextualizing Human Psychology, - an article published in the August, 2020 issue of Technology, Mind and Behavior, a journal of the American Psychological Association. “As a result, experimental focus is usually on more easily quantifiable individual traits and behaviors.”

“In the last decade, however, digital data from online interactions, cell phones, and credit cards have allowed us to precisely quantify large-scale social behavior at a very fine level of detail. The little data breadcrumbs that we leave behind as we move around in the world are enabling new ways of understanding human behavior, giving rise to the emerging discipline of computational social science. “[T]hese new tools can help relate individual traits to the surrounding social context and thus better explain life outcomes and societal characteristics.” 

The article illustrated the advances and challenges of data-driven predictions by discussing a 2017 mass collaboration experiment. The experiment asked each of 160 academic teams to predict six life outcomes, - such as a child’s grade point average and whether a family would be evicted from their home, - by analyzing development data of over 4.200 at-risk children from the Fragile Families and Child Wellbeing Study. These data had been collected by interviewing primary caregivers over more than 15 years, as well as other assessments including early childhood education and the children’s scores on a variety of standard tests. Additional information was provided on the parents, including medical, employment, and incarceration histories, religion, and child care practices. Almost 13,000 measurements were made for each child and their family.

A Winning Strategy for the Post-Pandemic “New Normal”

“A winning digital strategy requires new twists to familiar moves,” said a recent McKinsey article, Strategy for a digital world. “Competitive differentiation, now more than ever, emerges from superior digital capabilities and technology endowment, more agile delivery, and a progressively more tech-savvy C-suite.”

According to the latest McKinsey Global Survey on digital strategy, the pandemic has sped up the adoption of digital technologies by several years. While the imperative for a strategic approach to technology is universal, the survey found that some companies are already leading the pack because they have better overall technology capabilities, talent, leadership, and resources, and their superior technology endowment is linked to better economic outcomes.

The pandemic has accelerated the pace of change of the leading technology companies as well as the industry leaders who’ve been investing heavily in new digital-enabled strategies and business models, widening the gap between these top economic performers and all other companies. At the same time, the survey showed that many of the organizations that are being left behind could be missing opportunities to catch up by investing in the areas of their business most at risk of digital advances.

Traditional legacy companies should revisit the classic strategies that may have worked well for them in decades past but that must now be updated given the accelerated pace of digital disruption. The McKinsey article offers a road map for so doing based on five major changes.

Is the Metaverse the Next Major Phase of the Internet?

“Don’t mock the metaverse,” said The Economist in a November 2021 article. “There are good reasons to take the metaverse seriously. One is historical: as computers have become more capable, the experiences which they generate have become richer. The internet began its life displaying nothing more exciting than white text on a black background. Flat images were added in the 1990s. Video came to dominate in the 2010s. On that reading, a move into three dimensions is a logical consequence of the steady growth in computing power.”

“The metaverse is already here. It’s just not evenly distributed,” the article added. “The video-game industry - the only type of entertainment fully exposed to the compounding power of Moore’s law - has been selling virtual worlds for years.” Online games like World of Warcraft, Fortnite, and Roblox have hundreds of millions of users, and their gaming companies have valuations in the tens of billions, - evidence that immersive virtual worlds can be popular and profitable. “It is hard to argue that an idea will never catch on when, for millions of people, it already has.”

3-D virtual environments have had limited success beyond the video-game industry. But this could change. Leading technology companies have announced plans to expand their use in business, education, social media, and other so-called serious applications. On October 28, Mark Zuckerberg announced his commitment to a metaverse strategy by rebranding Facebook as Meta Platforms. A week or so later, Satya Nadella shared Microsoft’s metaverse plans, starting with enabling users of Mesh for Microsoft Teams to interact and collaborate in 3-D immersive workspaces.

Technology’s Role in Society: It’s Complicated

“Welcome to the future - not 2021, as you might have been expecting, but 2025, or even 2030, depending on whom you ask,” said The Economist in a  November, 2020 article. “The adoption of new technological behaviours in response to the pandemic, from video-conferencing to online shopping, means usage has already reached levels that were not expected for many more years.”

For years, companies and governments found all kinds of reasons for not embracing work from home, virtual meetings, telemedicine, online learning, and other digital applications. But, the pandemic forced us to accelerate the digital transformations of the economy and society to help us cope with the crisis. And, not only have these digital applications worked remarkably well, but they offer a number of important benefits, like not waiting for a straightforward doctor diagnosis in a room full of sick people, and not having to travel for hours to participate in a 45 minute meeting.

Post-pandemic, how much will things snap back?, asked The Economist. “Clearly the world is not going to return to its pre-pandemic state…  some new behaviours will stick, but not all, and the result will be somewhere in the middle. Exactly where will have enormous implications: for transport patterns, property prices and the layout of cities, among other things.”

The societal implications of technological transformations are difficult to anticipate, given the rapid changes we’ve been going through in the last few decades, let alone in the last two years. This topic was directly addressed in Technology’s Role in Society: It’s Complicated, the Fall 2021 issue of Footnotes, a publication of the American Sociological Association. The issue includes nine essays on the various ways technology impacts out lives. “As technology continues to evolve at breakneck speed, we find ourselves constantly adapting and keeping up with the latest advancements,” said its Introduction article.

The Evolution of Enterprise Architecture in an Increasingly Digital World

“What does it take for traditional companies to create value with digital technology?,” asked a McKinsey article published in November of 2018. Based on its research, the article suggested that “successful digital reinventors - digital natives and digitally transformed incumbents - employ a range of approaches, such as investing boldly and adopting cutting-edge technologies at scale.” However, the article warned, such efforts can run into serious difficulties. “In our experience, a push to launch more digital applications can make a company’s technology landscape increasingly complex and difficult to manage, to the point that it impedes transformation programs.”

A few months ago, I wrote about the evolving role of the CIO, based on a survey of over 500 CIOs and related technology leaders. Almost all of the surveyed CIOs agreed that their responsibilities will become more strategic in the coming years, uniting their company’s business and technology strategies and managing increasingly complex and difficult digital transformations.

This strategic role of the CIO is in turn driving the evolution of their enterprise-architecture (EA) teams. Traditionally, enterprise architects have been responsible for translating business needs into IT requirements. A major part of their job is making sure that their company’s IT systems work together to  enable and support the company’s overall digital strategy. And increasingly, EA teams have the primary responsibility for managing the technological complexity inherent in digital transformations.

How to Effectively Manage a Company’s Digital Transformation

The adoption of new digital technologies in response to the pandemic has reached levels that weren’t expected for many year, - and those changes are likely be long lasting. A few months ago, for example, a McKinsey survey of global executives found that the pandemic has accelerated the digitization of their customer and supply-chain interactions, their internal operation, and the share of digitally-enabled products and services in their portfolios by roughly three to four years.

“Faced with the pandemic, firms did things that once seemed impossible - sometimes overnight,” noted Forrester Research in an online event that took place earlier this year. “Under the relentless pressure of new customer realities, the future came into focus: The value of your company depends on how customer-obsessed, resilient, creative, and adaptive you are in jumping to the next growth curve in your industry. … 2021 will be the year that every company - not just the 15% of firms that were already digitally savvy - doubles down on technology-fueled experiences, operations, products, and ecosystems.”

But, what should the vast majority of less digitally savvy companies do to embrace the changes they were forced to make in record time to deal with the immediate crisis? How to Speed Up Your Digital Transformation, a recent Harvard Business Review article by Benjamin Mueller and Jens Lauterbach, provides some answers to this question.

“The pandemic has given many organizations an unexpected crash course in digitalization,” wrote the authors. “While much progress has been made - from hardware and infrastructure to updated work processes and a rejuvenated corporate culture - many organizations are confronting the question of how to integrate fragmented and often makeshift digitalization efforts in a way that’s sustainable. … This is particularly pertinent for small and medium-sized organizations that need to be more targeted in their efforts and may not have the resources to engage in the ‘fail fast’ approach often heralded by the larger poster children of the digitalization movement.”

How Has Working from Home Worked Out So Far?

“COVID-19 triggered a mass social experiment in working from home (WFH),” said economists Jose Maria Barrero, Nicholas Bloom, and Stephen J. Davis in Why Working from Home Will Stick, a paper published in April of 2021 by the National Bureau of Economics Research (NBER). “Americans, for example, supplied roughly half of paid workhours from home between April and December 2020, as compared to five percent before the pandemic. This seismic shift in working arrangements has attracted no shortage of opinions about whether WFH will stick.”

Working from home (WFH) has been around for decades, modestly growing in the 1990s with the rise of the Internet. The share of WFH three or more days per week was under 1% in 1980, 2.4% in 2010, and 4.0% in 2018. Then came Covid-19, forcing tens of millions around the world to work from home and triggering a mass workplace experiment that broke through the technological and cultural barriers that had prevented its adoption in the past.

To investigate whether WFH will stick, the authors of the NBER paper devised a survey that asked questions about working arrangements and personal experiences with WFH during the pandemic, as well as worker preferences and employer plans after the pandemic ends. The survey was conducted monthly between May 2020 and March 2021, by which time it had collected 28,597 valid responses from 20-64 years old US workers, of which 43.8% were female. The typical respondent was 40 to 50 years old, with one to three years of college, who earned $40 to $50 thousand in 2019.

Let me discuss a few of the survey’s questions and findings.

Which Colleges and College Programs Give Students the Best Bang for their Buck?

“The decision not to attend college for fear that it’s a bad deal is among the most economically irrational decisions anybody could make in 2014,” wrote NY Times journalist David Leonhardt in Is College Worth It? in May of 2014. “Over the long run, college is cheaper than free,” he added, citing an article by MIT economist David Autor which pointed out that a college-educated worker can expect an additional lifetime earning of over $500,000 compared to one whose highest degree is a high school diploma. Experts and journalists questioning the value of a college education are most likely obsessing to get their toddlers into an elite nursery school, so they are on-track for the right schools over the ensuing 20 years, added Leonhardt.

In May, 2019 seminar I attended, Autor noted that over the last four decades, the US and other industrial economies have seen a remarkable rise in wage inequality by educational attainment, with the earnings of the most-educated increasing, and the earnings of the least-educated falling in real terms. Since the 1980s, the earnings of those with a four year college degree have risen by 40% to 60%, while the earnings of those with a high school education or less have fallen among men and barely changed among women.

Every year, the US Bureau of Labor Statistics publishes a set of earning projections by educational attainment. Their 2020 projections showed that the median weekly earnings for all workers is $1,029; for those with less than a high school degree it is $619; high school diploma - $781; some college, no degree - $877; associate’s degree - $938; bachelor’s degree - $1,305; master’s degree - $1,545; doctoral degree - $1,885; and professional degree - $1,893.

Beyond these aggregate numbers, which institutions of higher education give students the best economic returns, that is, the best bang for their buck. In April of 2020, Third Way, a public policy think tank, published a report that introduced a new approach for estimating the economic return of an education, - that is, the Price-to-Earnings Premium (PEP), - based on the amount of time it generally takes a student to recoup the cost of obtaining a credential at a particular school.

Impact of Covid-19 on Job Automation

“Why are there still so many jobs?,” asked MIT economist David Autor in a 2015 article on the history of workplace automation. Given that technologies have been automating human work for the past couple of centuries,“should we not be somewhat surprised that technological change hasn’t already wiped out employment for the vast majority of workers?”

As Autor explained in the article, the answer is based on an economic reality that’s frequently overlooked. “Automation does indeed substitute for labor - as it is typically intended to do. However, automation also complements labor, raises output in ways that lead to higher demand for labor, and interacts with adjustments in labor supply. … journalists and even expert commentators tend to overstate the extent of machine substitution for human labor and ignore the strong complementarities between automation and labor that increase productivity, raise earnings, and augment demand for labor.”

Professor Autor was co-chair of MIT’s Work of the Future Task Force, which was launched in the spring of 2018 to better understand the impact AI and automation on jobs. The Task Force released an interim report in September of 2019. Its overriding conclusion was that the likelihood that AI and automation would wipe out major workforce sectors in the near future was exaggerated.

However, it raised important reasons for concern, especially the rising polarization of employment and wage distribution over the past few decades, which has disproportionately benefited high-skilled professionals while reducing opportunities for mid- and low-skilled workers. The report emphasized that “at a time of historic income inequality, a critical challenge is not necessarily a lack of jobs, but the low quality of many jobs and the resulting lack of viable careers for many people, particularly workers without college degrees.”

The Covid-19 pandemic came a few months later, pretty much turning our world upside down.

The Complex Interplay Between Cybersecurity and Regulatory Compliance

Cybersecurity threats have significantly increased since March of 2020 when much of the economy was forced online to help us cope with the Covid crisis, including a number of high profile attacks by international criminal groups and adversarial governments. This past June, FBI Director Christopher Wray compared the danger of ransomware attacks on US firms by Russian criminal groups to the 9/11 terrorist attacks. When Biden and Putin met in Geneva a few weeks later, cyberweapons control was at the top of the agenda, a spot previously occupied by the control of nuclear weapons.

It’s been clear for a while that in a world increasingly governed by digital data and transactions, our existing cybersecurity methods have been far from adequate. To learn more about this very important area, earlier this year I joined  CAMS, MIT’s interdisciplinary cybersecurity initiative, and started attending its research seminars.

At a recent seminar, I heard a very interesting presentation on Compliance and Cybersecurity by CAMS research affiliate Angelica Marotta. Her seminar was based on Convergence and divergence of regulatory compliance and cybersecurity, a recent paper she co-authored with MIT professor Stuart Madnick.

Marotta’s opening slide included succinct definitions of cybersecurity and compliance that highlight their different objectives:

• Cybersecurity is responsible for the “internal procedures established by a company to improve the security of its operations.”
• Compliance is responsible for the “external regulations established by governments or industries groups that must be met.”

Today, in order to be successful, every organization needs to be both compliant and cyber secure. But, the extent to which compliance helps or hinder security for an organization continues to be a very important research question.

The Supply Chain Economy - A New Categorization of the US Economy

A few weeks ago I attended The Supply Chain Economy: Understanding Innovation in Services, a virtual seminar sponsored by the Council on Foreign Relations with economists Mercedes Delgado and Karen Mills discussing their recent paper A New Categorization of the U.S. Economy.

The debate about the drivers of innovation and job creation has long been centered on manufacturing versus services. The predominant view has been that manufacturing drives good wages, economic growth, and innovation as measured by its large share of patents, while services provide lower-wage jobs, less innovation and significantly fewer patents.

But Delgado and Mills argue that categorizing the economy in terms of manufacturing versus services is no longer meaningful. Instead, they’ve proposed an alternative framework for understanding the drivers of innovation and economic performance that’s focused on the suppliers of both goods and services: the supply chain economy.

“A long academic and policy debate has focused on the role of the manufacturing capacity of a country in its economic and innovative performance,” wrote the authors. “This question has become even more relevant as the U.S. economy has shown a large decline in manufacturing employment in recent decades, in part due to increased import competition. In this debate, the predominant view is that a country's manufacturing capacity drives innovation because of externalities associated with the production of intermediate goods (e.g., machine tools, automation equipment, and semiconductors) that improve the efficiency of the innovation process. Most prior work on innovation focused on a narrow view of suppliers as producers of intermediate goods. However, in today's economy suppliers increasingly produce services (e.g., enterprise software).”

A Pandemic Is Fundamentally an Information Problem

A few weeks ago I attended a very interesting online seminar, Economics in the Age of Covid-19, by University of Toronto professor Joshua Gans. Over the past 18 months, professor Gans has been conducting research and writing extensively on the impact of Covid-19, including a number of articles, a newsletter, and two books. His key thesis is that a pandemic is fundamentally an information problem. If you know that someone you interact with is potentially infectious, you can take actions to limit the interactions. However, if you have to guess whether a person is infectious, you’re taking a risk. Not only can you become infected, but you might also pass that infection on to others.

“The difference between perfect knowledge and no knowledge is what causes an infectious disease to have an impact on social and economic interactions,” wrote Gans in The Pandemics Information Gap, first published in April of 2020, followed by an expanded second edition in November of 2020. “With perfect knowledge, some people get sick, they are isolated, and life is (for most of us) essentially unchanged. … perfect knowledge allows you to avoid all infected people. No knowledge makes it near certain that you will encounter at least one infected person.” Furthermore, when we don’t know who is infected, we have to act as if everyone is infected, which then leads to major economic and social disruptions, including near-empty offices and city centers, decreased travel and leisure activities, and learning from home instead of in school.

In his seminar, Gans cited the 2002 SARS outbreak in China, Hong Kong, and Taiwan and the 2015 MERS outbreak in South Korea as examples of pandemics that were quickly contained. With SARS and MERS, people only became infectious when they developed a fever, cough, and other easily identifiable flu-like symptoms. Anyone suspected of being infected could thus be quickly isolated before infecting many others. This made it possible to contain the SARS and MERS viruses within a few short months, and to suppress them completely a few months later.

The 2020 COVID-19 outbreak was different. About a third of the people infected with the virus were asymptomatic carriers who didn’t develop noticeable symptoms but were still capable of infecting others. Of the people who showed symptoms, around 80% were only mild to moderate. And, there was generally a delay of several days between the time a person first became infected and the appearance of the first symptoms. In other words, the information problem was relatively straightforward with SARS and MERS, which made them easier to manage and contain, whereas managing the information problem with COVID-19 has been much, much harder.

Rethinking Digital Strategy for the Post-Pandemic Era

“One year into the COVID-19 crisis, our newest McKinsey Global Survey on digital strategy indicates that the pandemic has increased the pace of business and that technology capabilities will be critical to companies’ COVID-19 exit strategies as well as to what comes next,” said a recent McKinsey report, The new digital edge: Rethinking strategy for the postpandemic era. The survey was conducted online in January of 2021, and received responses from over 1,100 C-level executives, business unit heads and senior managers from different industries, functions, company sizes and regions.

The survey’s overriding finding is that the pandemic has sped up the adoption of digital technologies by several years. “The imperative for a strategic approach to technology is universal, yet some companies are already leading the pack; their responses show that better overall technology capabilities, talent, leadership, and resources (what we call a company’s technology endowment) are linked to better economic outcomes. At the same time, the results confirm that many organizations could be missing opportunities to invest in the areas of their business models that are most at risk of digital disruption.”

The technology endowments of the top-decile economic performers include cloud adoption and infrastructure, both public and private; a common source of data across the organization; a modern architecture for technology elements; sufficient cybersecurity to mitigate current risks and threats; prioritization of tech resources to the most strategically important efforts; increased investment in talent; filling key technology roles with high-quality individuals; increased R&D spending; and creation of new partnership.

Realizing the Economic Promise of Predictive Analytics

Wikipedia defines predictive analytics as a set of statistical techniques, - such as data mining, business analytics, and machine learning, - “that analyze current and historical facts to make predictions about future or otherwise unknown events.” Increasingly powerful and inexpensive computing technologies, new algorithms and models, and huge amounts of data on almost any subject have led to major advances in predictive analytics over the past two decades.

“Worldwide revenue for ‘big data’ and business analytics solutions is forecasted to reach $274.3 billion by 2022,” wrote economists Erik Brynjolfsson, Wang Jin, and Kristina McElheran in The Power of Prediction, a research article published earlier this year. In principle, such widespread use of predictive analytics should have a positive impact of the performance of firms. “However, these investments have yet to yield productivity gains in the aggregate,” said the authors. “At the firm level, managers struggle to close the gap between the promise of predictive analytics and its performance. These concerns have been difficult to tackle empirically due to the rate of technological change and, ironically, a dearth of data.”

To address these concerns, the authors launched a research study in collaboration with the US Census Bureau to collect information on the use of predictive analytics in a representative sample of the US manufacturing industry, - an industry that’s historically been an early adopter of leading-edge technologies.

Why Our Judgements Are Often Flawed and What to Do About It

A few weeks ago I listened to a very interesting Freakonomics podcast hosted by University of Chicago economist Steven Levitt. In the podcast, Why Our Judgment is Flawed — and What to Do About It, Levitt interviewed Daniel Kahneman about his recent book, Noise: A Flow in Human Judgement, co-authored with Olivier Sibony and Cass Sunstein. Kahneman is Professor of Psychology and Public Affairs Emeritus at Princeton University. In 2002, he was awarded the Nobel Prize in Economics “for having integrated insights from psychological research into economic science, especially concerning human judgment and decision-making under uncertainty.”

Thinking, Fast and Slow, Kahneman’s 2011 bestseller, was about the major discoveries by psychologists and cognitive scientists that have led to our current understanding of judgement and decision-making over the past several decades. Up to the 1970s, the prevailing view among social scientists was that people are generally rational and in control of the way they think and make decisions. It was thought that people only departed from rational behaviors because powerful emotions like fear, hatred or love distorted their judgement.

These assumptions were challenged by the pioneering research of Kahneman and his long time collaborator Amos Tversky, who died in 1996. In a series of experiments, they demonstrated that human behavior often deviated from the predictions of the previous rational models, and that these deviations were due to the machinery of cognition, that is, to the biases and mental shortcuts or heuristics that we use for making everyday decisions, rather than to our emotional state.

Kahneman has been studying biases and how they lead to errors in judgement for most of his career. But a few years ago, he encountered another type of error, noise, that he hadn’t thought about earlier. Noise is “the sort of ignored stepsister of bias… the complement of bias. And in terms of the standard way of measuring accuracy and measuring error, bias and noise are completely independent of each other. … bias is really the average error. And noise is the variability of error, the standard deviation of errors.

Why Do We Work So Damn Much?

A few weeks ago, I listened to a very interesting podcast, Why Do We Work So Damn Much?, where podcast host, NY Times columnist Ezra Klein, interviewed anthropologist James Suzman. Suzman has devoted almost thirty years to studying and writing about the Ju’hoansi and other bushmen from the Kalahari Basin, who are among the world’s few remaining hunter-gatherer societies. He recently published Work: A Deep History from the Stone Age to the Age of Robots, a book about his research.

Modern humans emerged in Africa between 200,000 and 300,000 years ago. Our homo sapiens ancestors were hunter-gatherers for most of those years, collecting wild plants and hunting wild animals. Starting around 12,000 years ago, the agricultural revolution introduced the domestication of plants and animals, leading many hunter-gatherer groups to establish agricultural communities and villages.

The vast majority of hunter-gatherers disappeared a long time ago, but a few groups remain in isolated sections of Africa, Australia, the Amazon rainforest and the Arctic. Anthropologists have been studying these remaining hunter-gatherers to learn how they’ve been able to survive so much longer than other human groups, as well as to understand the behaviors and cultures that modern humans may have inherited from our closest ancestors.

Revitalizing US Manufacturing

“The COVID-19 pandemic has underscored manufacturing’s role in providing products that are critical to health, safety, national security, and the continuity of multiple industries,” said McKinsey in a recent discussion paper, Building a More Competitive US Manufacturing Sector. “It has also revealed the extent to which global supply chains are exposed to shocks and disruptions. All of this has occurred at a moment when new technologies, process innovations, and demand growth are reshaping the sector worldwide. The United States can seize on these developments to make its own manufacturing sector more competitive.”

Manufacturing jobs helped build the US middle class after WWII. In the 1950s, it accounted for roughly 30% of employment and close to 30% of GDP. But manufacturing has significantly declined in the intervening decades, now comprising only 8% of the workforce and 11% of GDP. Manufacturing growth has particularly slowed down over the past 30 years, from 4.9% in the 1990s to 1.4% in each of the past two decades.

Despite its dramatic decline, manufacturing continues to have a disproportionate impact on the US economy, accounting for 35% of productivity growth, 55% of patents, 70% of R&D spending, and 60% of exports. According to McKinsey, these outsize economic contributions uniquely position manufacturing to strengthen the US recovery over the long term.

Understanding the Impact of Cybersecurity on International Trade

The explosive success of the Internet in the 1990s led to a historical transition from the industrial age of the past two centuries to an economy and society increasingly based on global, digital interactions.  This transition has continued to advance over the past two decade with the advent of billions of smartphones, hundreds of billions of IoT devices, a wide variety of online applications and mobile apps, and huge amounts of data, all connected via Internet-based broadband networks.

Then came Covid-19. A recent McKinsey survey found that the pandemic has accelerated the overall adoption of digital technologies and applications by three to seven years in just a few months.

At the same time, cybersecurity threats have been growing. Large-scale fraud, data breaches, and identity thefts have become far more common. As we moved from a world of physical interactions and paper documents, to a world primarily governed by digital data and transactions, our existing cybersecurity methods have been far from adequate.

More recently, international cyberthreats have escalated, with a growing number of high profile attacks by criminal groups and adversarial governments. Cybersecurity is now invoked by governments as a major aspect of national security, as they focus on protecting their critical infrastructures and the overall wellbeing of their nations. In early June, for example, FBI Director Christopher Wray compared the danger of ransomware attacks on US firms by Russian criminal groups to the September 11 terrorist attacks. And, in a recent editorial, the NY times editorial board argued that ransomware attacks have emerged as “a formidable potential threat to national security,” given “their ability to seriously disrupt economies and to breach strategically critical enterprises or agencies,” urging governments that “It is a war that needs to be fought, and won.”

The Evolving Role of the CIO

“CIOs and other technology leaders have led heroic work to help their companies stay in business during the pandemic,” said a recent report, Pilots, co-pilots, and engineers: Digital transformation insights from CIOs for CIOS. “The question now is where will the focus of CIOs and their organizations be in the future?” To shed light on this question, the professional services firm Genpact surveyed 500 CIOs and technology leaders in partnership with the MIT Sloan CIO Symposium and Babson College professor Tom Davenport. Their findings were presented at the 2021 MIT Digital Symposium.

“We found a surprising level of commonality in terms of the technologies on which they are focused, the infrastructure they are attempting to build, and their view of expanding responsibilities,” was the report’s overriding finding. “High proportions of CIOs, for example, are focused on artificial intelligence (AI) and advanced analytics, moving to the cloud, and architecture modernization. There is, however, a lack of consensus on a critical issue: the role of the CIO in business transformation.”

I’ve had a window into the evolution of the CIO role over the past decade through my involvement with the MIT CIO Symposium. In the past, the primary responsibility of many CIOs was operating their companies’ IT infrastructures while keeping costs down. Given their role, they often reported to the COO or the CFO. But increasingly, CIOs have been given responsibility for their companies’ overall digital strategy working closely with senior executives across the business.

“The role continues to evolve,” notes the Genpact report. “Almost all CIOs expect their roles to expand. Almost all report to or interact with the CEO regularly. And many are exploiting the cloud, advanced analytics, and automation. The big future bet that unites all CIOs is artificial intelligence (AI). And to access new talent and skill sets, many are exploiting their external ecosystem partners. All of which bodes well for the CIO’s future transformational activities. In addition to flexing their technology muscles, many CIOs are still building their transformation muscles, which must include strength in change management and business knowledge.”

The New Joint Cyber Defense Collaborative

Following World War II and the onset of the Cold War with the Soviet Union, the US undertook a series of measures to strengthen the resilience of the nation. These included a significant expansion of government support for scientific research in universities and R&D labs, leading to product innovations from the private sector and better weapons from the defense industry which contributed to making the US the most prosperous and secure nation in the world.

In the 1950s the government enacted the National Interstate and Defense Highways Act, which led to the construction of the Interstate Highway System. The Act had a dual purpose: facilitating the economic growth of the country as well as supporting the country’s defense during a conventional or nuclear war should it be necessary.

And, last but far from least, in the late 1960s the Department of Defense launched ARPANET, the digital infrastructure that eventually became the Internet. ARPANET was designed as a flexible digital network that would enable computers to continue to communicate with individuals and with each other following a military attack.

Fortunately, we never had to test the Internet’s ability to keep the US going following an attack or invasion. But, who would have thought that 50 years after the launch of ARPANET, it would be a global pandemic that’s been testing the Internet’s ability to fulfill its original objective of keeping nations and economies going during arguably the biggest shock the world has experienced since WWII.

The Evolution of Shopping in the Digital Economy

Earlier this year, The Economist published a special report on The Future of Shopping, with nine articles on the subject. In its overview article, The Economist argued that “a new species of shopper is emerging: less centered on America, more intent on ensuring that what they buy reflects what they believe, and technologically dexterous. This latest incarnation of the global consumer looks likely to change how capitalism works - for the better.”

Three major changes are transforming the world of retailing. First, Western Europe and North America are no longer the biggest retail markets; nor do they epitomize the leading edge of retail as has long been the case, with innovations like the department store, the mall, catalogue shopping, and e-commerce. Shoppers are increasingly Asian. “Last year China and America were almost neck-and-neck as the world’s biggest retail markets. China’s two biggest online marketplaces, Alibaba’s Taobao and Tmall, both do more third-party business than Amazon.” And Asia’s shoppers are now at the frontier of retail, with innovations like livestreaming e-commerce.

A second change is that, beyond low prices, younger shoppers are increasingly influenced by their social, ethical, and political values when making buying decisions. They’re selecting  which brands to engage with based on their social values like environmental credentials and workplace environment. Well managed firms work hard to establish the kind of positive reputation that attracts people to want to be associated with the brand and its products and services. This is particularly important in our Internet age, which enables a company’s actions to be instantly communicated to all. “One way that capitalism adapts to society’s changing preferences is through government regulation and laws, which voters influence, at least in democracies. But the dynamic response of companies to the signals that consumers send is a force for change, too,” and the reason firms spend considerable time, energy and funds nurturing their brands.

The final big change is the increasingly digitalization of the economy. The explosive growth of mobile devices means that a company can be engaged with its customers not only when they’re shopping online, but wherever they are, - at home, at work, or in a store. “More accurate and voluminous data about shopping patterns are breaking down the decades-long relationship between mass consumption and mass production. In its place is a more varied world in which the shopper can decide whether to buy online or in store, whether to shop via platforms or from individual brands, and whether to accept targeted ads or not.”

The Coming Era of Productivity Growth

“The last 15 years have been tough times for many Americans, but there are now encouraging signs of a turnaround,” wrote economists Erik Brynjolfsson and Georgios Petropoulos in The Coming Productivity Boom, a recent opinion article in the MIT Technology Review. “Productivity growth, a key driver for higher living standards, averaged only 1.3% since 2006, less than half the rate of the previous decade. But on June 3, the US Bureau of Labor Statistics reported that US labour productivity increased by 5.4% in the first quarter of 2021. What’s better, there’s reason to believe that this is not just a blip, but rather a harbinger of better times ahead: a productivity surge that will match or surpass the boom times of the 1990s.”

After growing at an average annual rate of around 2.8% between 1947 and 1973, US productivity has significantly slowed down, except for the Internet-driven productivity boost between 1996 and 2004. Despite the relentless advances of digital technologies over the past 15 years, - from smartphones and broadband wireless to cloud computing and machine learning, - productivity has only grown at an anemic 1.3%, between 2006 and 2019. Most OECD countries have seen similar slowdowns.

What accounts for this puzzling so-called productivity paradox and when might it finally end? Over the past several years, Brynjolfsson and his various collaborators have explored this question, first at MIT where he was faculty director of the Initiative on the Digital Economy, and since 2020 at Stanford, where he’s Director of the Stanford Digital Economy Lab. Brynjolfsson discussed alternative explanations for the paradox at a recent MIT conference.

The Post-Pandemic Future of Work: An Optimistic Outlook

“The COVID-19 pandemic-induced lockdowns and related global recession of 2020 have created a highly uncertain outlook for the labour market … millions of workers have experienced changes which have profoundly transformed their lives within and beyond work, their well-being and their productivity,” said the World Economic Forum (WEF) in The Future of Jobs Report 2020, published in October, 2020. “Comparing the impact of the Global Financial Crisis of 2008 on individuals with lower education levels to the impact of the COVID-19 crisis, the impact today is far more significant and more likely to deepen existing inequalities.”

The Economist  was considerably more optimistic in a special report on The Future of Work in its April 10 issue, which included several articles on the subject. “A jobs rebound, shifting politics and technological change could bring a golden age for labour in rich countries,” said the overview article. “It might seem premature to predict a wonderful world of work only a year on from a labour-market catastrophe. But America is showing how rapidly jobs can come back as the virus recedes. In the spring of 2020 the country’s unemployment rate was nearly 15%. Now it is already just 6% after a year containing five of the ten best months for hiring in history.”

The key reason for The Economist’s optimistic outlook is that as labor markets recovers, two deeper shifts are unfolding: a political environment which is becoming friendlier to workers than it’s been in decades; and an accelerated digital economy which promises to bring about faster productivity growth. Let me briefly summarize each of these two shifts.

The Three Types of AI: Artificial, Authentic, and Augmented Intelligence

“The history of work - particularly since the Industrial Revolution - is the history of people outsourcing their labor to machines,” notes a recent article in the Harvard Business Review, - AI Should Augment Human Intelligence, Not Replace It, - by National University of Singapore professor David De Cremer and chess grandmaster Garry Kasparov. “While that began with rote, repetitive physical tasks like weaving, machines have evolved to the point where they can now do what we might think of as complex cognitive work, such as math equations, recognizing language and speech, and writing. Machines thus seem ready to replicate the work of our minds, and not just our bodies.”

Throughout the Industrial Revolution there were periodic panics about the impact of automation on jobs, going back to the so-called Luddites, - textile workers who in the 1810s smashed the new machines that were threatening their jobs. Automation does indeed substitute for labor. However, automation also complements labor, raising economic outputs in ways that often lead to more long-run employment, not less.

Most jobs involve a number of tasks or processes. Some of these tasks are more routine in nature, while others require judgement, social skills and other human capabilities. The more routine, rules-based the task, the more amenable it is to automation. But just because some of the tasks have been automated, does not imply that the whole job has disappeared. To the contrary, automating the more routine parts of a job will often increase the productivity and quality of workers by complementing their skills with machines and computers, as well as enabling them to focus on those aspect of the job that most need their attention.