AI and an intelligent active manager’s odyssey


In spite of Artificial Intelligence’s (AI) transformative potential, the investment management industry has been slow to invest in and use AI compared with other developed industries. This paper explores the journey of AI, a threat to active management that comes quickly behind the current shift to passive investment strategies.

Active management and the demand for hope

Much ink and some blood has been spilt over passive Exchange Traded Fund’s (ETF) supposed existential threat to the active management of securities and assets. While roughly one-third of all global equity management is now passive, the threat itself is overstated. Active’s survival, though in a much reduced form, is assured by the eternal demand for hope – hope of beating the market, hope of being above average, hope of not missing out. Supply to meet that demand flows willingly from active managers’ engaging and sometimes insightful narratives about exciting stocks, often hyped by new technologies.

That said, active is exposed to a deeper and longer-term threat, one that might just ‘sweep it away’. The Greek C P Cafavy’s poem Things Ended highlights how easily we miss more damaging threats:

Engulfed by fear and suspicion,
mind agitated, eyes alarmed
we try desperately to invent ways out,
plan how to avoid the obvious danger
that threatens us so terribly.
Yet we’re mistaken, that’s not the danger ahead:
the news was wrong
(or we didn’t hear it, or didn’t get it right).
Another disaster, one we never imagined,
suddenly, violently descends upon us,
and finding us unprepared – there’s no time now –
sweeps us away.

The opening gambit is Blackrock’s intention to replace all or many or some traditional active equity processes (of which Blackrock has $300 billion in assets under management) with quantitative active processes ostensibly because quant can generate alpha as successfully as traditional and at far lower cost. For many this is an old story. Most traditional managers rely on some form of computer-driven quant processes in portfolio construction and trading. Since 2010, the assets of quant hedge funds has doubled to nearly US$1 trillion, while according to JPMorgan, orders placed by computers now account for 60% of US trading volume, double the figure from a decade earlier. However, scale and market presence threaten to transform Blackrock’s initiative into an imperative for traditional managers.

A more substantial threat is lurking: Artificial Intelligence

But ‘going quant’ will provide only short-term solace. Lurking under the rubric ‘quant’ lies the more substantial threat of Artificial Intelligence (AI) or Deep Machine Learning.

The threat of AI to routine process-driven jobs is manifest even after discounting the considerable hype. But AI also threatens the jobs of lawyers, radiologists and others demanding advanced cognitive skills with its ability to recognise patterns and images, to learn, to improve its own algorithms.

In the investment management industry, both back and front offices are threatened. Eventually, AI will probably be capable of ‘thinking’ about, crafting, writing and even delivering engaging, insightful and empathetic narratives. Some AI programs already pass Turing’s Test in which interlocutors fail to distinguish between answers from a human and a computer.

Then AI too will sell hope.

Is this scenario, the ultimate disruptive one where machines make (almost) all investment and commercial decisions, pitch for business and report to clients? Or does it belong in the SciFi fantasy world? Doubtless some is fantasy, but less than we might hope for.

We tend to overestimate the short-term effects of new technology while underestimating the long-term effects. Campbell Harvey, a respected finance professor predicts that “in the end it will be a good thing for investors” if human judgement is usurped by machine judgement. When Amazon enters investment management that harsh reality may well emerge from picturesque fantasy. Indeed, Autonomous Learning Investment Strategies (ALIS) have been with us for some time though as yet they are not capable of crafting new insights or of selling hope.

AI’s co-existence with active managers

The history of technology suggests that some form of traditional active management will survive the rise of machines. The new often co-exists with the old rather than fully replacing it … quills and slide-rules notwithstanding. Co-existence will advance through human-machine interaction where human and machine in turn leverage off the other’s insights in a process of continual improvement. To thrive in that world active managers will need as yet unknown skills.

For a while at least, a traditional active approach should thrive. Traditional is likely to outperform machines in managing highly-concentrated portfolios and alternative assets, especially in heterogeneous domains where idiosyncratic risk is high and tacit security-specific knowledge is critical. To the extent that AI learns through data-mining, the relative scarcity of data in those domains favours humans.

Further, much alternative investing lacks robust, predictive theories which again favours human minds. However, both advantages will likely fade as AI overtakes the human ability to develop intuitive knowledge and insights without much data and without theories. When machines can formulate and test their own explanatory hypotheses traditional active management will raise the white flag. That fearful scenario lies ahead, as currently AI/Deep Machine Learning is poor at generalising specific information and can’t provide explanations or reasons to justify or explain its decisions (see ‘The dark secret at the heart of AI, MIT Technology Review, May/June 2017).

Currently it is a very black black-box and even blacker than the black-box inside active managers’ heads. The world chess champion Alpha Zero, given only the rules and aim of the game, learns to play chess by playing against itself many times, but can’t explain or justify its moves and tactics.

Investment management slow to invest in AI

In spite of AI’s transformative potential, the investment management industry has been slow to invest in the necessary R&D, and even slower to use AI compared with other developed industries. Investing fails to rate a mention in Stanford University’s AI Index. Failure is likely explained by the comfort induced by persistently high margins, by the industry’s capital-light structure which inhibits capital-intensive R&D, and by its much-vaunted essence as a human relationship-driven business. If Blackrock’s initiative drives lower margins, it may encourage the development of AI in active investment management. Further, the rules under MiFID II may cause an easy target as sell-side analysts become ‘AI’d’.).

Embracing the opportunity

Unsurprisingly, some hedge funds with their greater institutional and intellectual freedom have been early adopters of AI and not just to uncover previously hidden factors in capital markets but also to improve human insights and decisions. The CFA has taken a positive step by offering teaching modules in AI and Big Data. Perhaps that’s a straw in the wind. Perhaps the investment industry will sacrifice its long-protected comfort and embrace the opportunity and risks afforded by on-going advances in Artificial Intelligence and Deep Machine Learning.


Jack Gray is a Special Advisor and Director of Brookvine. Jack has been voted one of the Top 10 most influential academics (in his previous life as an academic) in the world for institutional investing.

Print Friendly, PDF & Email

, ,

3 Responses to AI and an intelligent active manager’s odyssey

  1. Nigel Humphreys February 15, 2018 at 11:29 PM #

    Deep Learning AI may soon be overtaken by low power very fast self learning spiking neural AI. i.e. proper artificial intelligence, not taught, data fed, processing. Check out BrainChip ASX: BRN if interested in learning more.

    • Jack Gray February 16, 2018 at 2:08 PM #

      Thanks. I’m now dangerous having read about Spiked Neural Networks on Wikipedia. A little knowledge …

  2. Graham Hand February 14, 2018 at 10:51 PM #

    Good to see the legendary Jack Gray return to the pages of Cuffelinks, not only with his unique perspective on AI, but adding such a great poem, the likes of which we have not seen since his previous gem on Poetry for Investors.

Leave a Comment:

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Register for our free weekly newsletter

New registrations receive free copies of our special investment ebooks.