Knowledge Workers in the British Raj

Note: This is the second part of a longer series on how social media is affecting management. You can find the first post – The future of (knowledge) work – and subsequent posts – The north-south divide, Working in Hollywood, World of Warcraft in the workplace and Problems and the people who solve them – elsewhere on this blog.

Prior to the industrial revolution, most folk, apart from apprentices and other people in training, worked for themselves. Home wasn’t here and work wasn’t there: they were in the same place and tightly intertwined. For the last few decades though, we’ve all become used to working in the large bureaucracies that most modern companies use to manage their workforces. For many pundits the shift to a more social business – driven by Enterprise 2.0 and Social Business Design – is the chance to humanize these bureaucracies that we’ve created, bringing back some of the more personal experiences we used to enjoy. However, this ignores the fact that while we’ve used technology to change business, business has also evolved to the point that it’s changing how we think about and use technology.

Tomorrow’s more social companies will not simply be our existing bureaucracies humanised. They’ll be something more compact and collaborative, extremely flat organisations where the executive is responsible for steering the boat while handing responsibility for operations over to the frontline. Rather than enabling a more human bureaucracy, one where the power structures are inverted or middle management empowered, Enterprise 2.0 is returning us to an earlier time, more akin to the British Raj in India, when the world was more uncertain and communication within a bureaucracy was slow (when compared to the pace of business). We’re returning to a time when self initiative, the ability to collaborate with your peers, and a focus on bringing whatever skills and tools you can to bear on the problem in front of you, is more important than deep specialisation and formal communication and career structures.

Our companies are not what they used to be

The template for our large, vertically integrated enterprises was stamped out for us by the likes of Cornelius Vanderbilt{{1}} during through the development of the transcontinental railroads in the U.S., and perfected by the conglomerates and multinationals in the sixties and seventies. Our organisations were seen as vast machines, machines staffed and operated by an army of people.

[[1]]Born the son of an impoverished farmer and boatman, Cornelius Vanderbilt (May 27, 1794 — January 4, 1877), died the wealthiest man in the United States and probably the greatest of the nineteenth century railroad barons. Starting with money he borrowed from his parents to buy a boat which he used to ferry passengers between Staten Island and New Your City, he became a American shipping and railroad magnate who acquired a personal fortune of more than $100,000,000.[[1]]

For a long time a company’s workforce was considered just one of three factors of production{{2}}, and a fungible factor at that – homogeneous and easily interchangeable. Recently companies have taken a more humanistic approach, with many human-resources departments proclaiming “people are our organisation’s most important asset,” and driving companies to construct ever more complex career management, renumeration strategies, and recognition and reward schemes to make the most of each employee’s individual skills and foibles.

[[2]]The other factors of production are stocks (including land) and capital goods.[[2]]

A factory in the industrial revolution, where the key to scaling a business was to employ more workers, and then employ an additional layer of management to manage the workers you hired in the first place
A factory in the industrial revolution, where the key to scaling a business was to employ more workers, and then employ an additional layer of management to manage the workers you hired in the first place

Our organisations, however, have been shrinking over the last couple of decades. Initially this was from automation on the factory shop floor, where repetitive tasks were replicated in technology, man replaced with machine. Overtime we’re used technology to chipped away at increasingly complex problems, working our way from simple manual tasks such as swinging a hammer on command, through to today’s modern, automated production line marvels.

At LEGO HQ in Billund, Denmark, where raw plastic is transformed into finished bricks (including stormtrooper helmets), and packaged into sets, with very little human intervention other than to fix machines when they breakdown.
At LEGO HQ in Billund, Denmark, where raw plastic is transformed into finished bricks (including stormtrooper helmets), and packaged into sets, with very little human intervention other than to fix machines when they breakdown.

A similar journey has occurred inside the office: computers (the teams of people computing ballistics tables and payrolls by hand) have been replace by computers (the electronic gizmos prone to bugs), the typing pool was phased out in favour of management using word processors to automate the creation their own documents, and a large chunk of the customer service team has been replaced by self-service kiosks and web sites which allow customers to attend to their own needs. Most recently, the midlevel management responsible for command and control – both between teams, and between teams and the C-suite – is being replaced by software{{3}} as social media tools automate the communication and information aggregation tasks that have traditionally been the domain of middle management.

[[3]]The future of knowledge work @ PEG[[3]]

Our vast, vertically integrated enterprises have been flattened and hollowed out, creating a new generation of organisations which have a large workforce at the coal face working under the direction of a with smaller and more focused team of executives. The frontline is interacting directly with customers and suppliers or managing production, responsible for the day-to-day operation of the business. The executive is looking into the future, responsible for placing bets on where to deploy the organisation’s resources most efficiently to meets tomorrows challenges.

The provincial civil service

The emerging organisational structure we see today is of a different nature to the monolithic institutions required to run the train networks in the 1800s or multinational conglomerates of the more recent past. The impact of the latest wave of automation – the move to social business – is not to simply take the existing organisation and applying a new style of command and control, one based on bottom-up empowerment and where middle management use these new media tools to streamline motivating and managing the teams under their guidance. It’s more akin to the extremely flat structures used by organisations such as the British civil service in India during the 1800s.

As a colonial power, Britain built an administrative centre in India (initially under the monopoly of the East India Company, but later under direct government rule{{4}}), staffed with highly competent expatriate civil servants who had signed on for a tour of duty. This tour of duty was usually seen as the route to wealth and influence, as it was easy to tap-off a little of the money – the vast sums of money – which flowed past these civil servants as it made its way back to the home country. (It wasn’t uncommon for senior members of the British Raj to return to Britain at the end of their tour with suspiciously large collections of expensive trinkets and locked boxes.) A complex bureaucracy developed, constructed around the Governor-General based in Calcutta, with Mandarins gathering staff and wealth as they fed their own feeling of self importance.

[[4]]John W. Kaye (1853), The Administration of the East India Company, Richard Bentley[[4]]

Managing the provinces, however, was a completely different problem. Covering a vast, populated area, and with little incentive for senior civil servants to get directly involved, the provincial civil service had to make do with a very flat organisational structure, one where every manager was responsible for roughly one hundred direct reports. Such a high management ratio naturally precluded many of the practices we take for granted into our large matrix-managed organisations. A manager couldn’t afford to spend more than a few minutes with each of their direct reports in the course of a month, and even those few minutes might not occur as transport and communication were much more expensive than they were today. The high-touch style of management we are familiar with in recent history wouldn’t work.

The expanse of the British empire in India in 1909
The expanse of the British empire in India in 1909

From demand-side to supply-side

The strategy which enabled the provincial civil service to function – and to function very effectively – was clear objectives. Field staff were engaged for their ability and interest in taking on responsibility for a problem on behalf of the management (usually this problem was the collection of the taxes, duties and excises required by the British crown in a specific province). A set of policies and procedures were put in place to ensure that they conducted themselves in a fit and proper manner, however, generally, the field staff were provided with a great deal of discretion in how they achieved their goals, collaborating with their peers were needed.

Behind this flat organisational structure was a hiring and training process designed to find candidates who were focused on solving the right class problem, rather than candidates who specialised in a discipline or process. All candidates had to sit an extensive test covering a broad range of topics, and were then trained in the skills and processes they might need in the field. Their induction was finished off with and apprenticeship under the guidance of an experienced worker. The civil service was looking for those individuals who had the kit bag of skills and the aptitude needed to find their way to their goal on their own. Those selected were then train in the business processes and policies they needed, and provided them with the time they needed to integrate into the community of front line workers. Much like today’s emerging workplaces, the team at the front line was empowered to collaborate as they worked toward their respective objectives, rather than micromanaged.

We like to think that we’re all hired for our unique skills and paid according to the value we bring to the business. Unfortunately this is not generally true. Our large company legacy means that most managers need to think in terms of roles, cogs in a machine that they need to assemble. Measuring each employee by their contribution is a complex and laborious task which does not scale well, so companies manage large populations of employees by defining standard roles tied to specific skill sets, and then measure each employee by their ability to fulfil the role. Hiring then becomes the easier supply side challenge of finding and evaluating people with the requisite skills.

As companies flatten it is becoming less important to assemble large teams with specialised skills. Teams have shrunk as technology has replaced specialists with potent technological tools: the skilled printer replaced by the printing press, the complex task of computing ballistics tables moved from people to machines, the distributed computing specialist made redundant by an open source framework, and your procurement specialist replaced by the on-demand SaaS fulfilment solution.

Our focus has shifted from the capabilities we need to the outcomes we need to deliver. We’re swapped from the supply side problem of finding enough people who have the specialist skills we need to staff our business, to the demand side problem of finding the people who we can delegate some of our problems to. One of the organising principles behind business is changing, driven, most recently by a shift to more social businesses.

The future of our business – post Enterprise 2.0 and Social Business Design – is not in applying a new human-resources paradigm to our existing workforce. Much like the British Raj in provincial India, our businesses need to adapt to an environment where we don’t have the time or resources to micromanage every task. The workforce which staffed our bureaucracy in the past is not the same workforce we need in the future. The future of our business is with a smaller, more dynamic workforce of self-starters, built around flat organisational structures and more general skills which devolve responsibility for operational problems to the front line and empower them to work together and solve these problems under their own direction, while freeing the executive team to focus on steering the organisation through the challenging environment we operate in today.

Continued in The north-south divide.