Generative AI deepfake triggers a national security crisis Generative AI deepfake triggers a national security crisis Generative AI deepfake triggers a national security crisis

Generative AI deepfake triggers a national security crisis

PG
Peter Garnry

Head of Equity Strategy

Summary:  Generative AI, hailed as a productivity boon, becomes a national security threat after a daring AI deepfake heist against a high-ranking official in a developed country. Governments crack down on AI with new regulations, puncturing the AI hype as VCs flee the industry. Public distrust in AI-generated news soars and governments impose new laws, allowing only a small group of entities to disseminate public news.


While everyone from McKinsey to the corporate sector and leading economists see generative AI as a great productivity-enhancing tool that will lift growth in decades to come, others see it as a potential new weapon. In a high-stakes game, a criminal group deploys the most deceptive generative AI deepfake the world has ever seen, phishing a high-ranking government official to hand over top-secret state information from a developed country. The daring move and success triggers the biggest national security crisis since WWII, ushering in a new era of far-reaching AI regulation. 

In a historic move to deal with the catastrophic side effects of generative AI, the US and EU declare that all content produced by a generative AI should have the label ‘Made by AI’ and failure to comply will lead to a harsh penalty. In an even bigger blow to the generative AI hype, the government forces OpenAI and Google to reign in third-party access to their foundational large language models on national security grounds, meaning that only government-approved entities are allowed to use these new generative AI systems. The new regulation kills the generative AI hype, as VC investments dry up on concerns that generative AI will be more difficult to commercialise. 

The generative AI deepfake incident goes from national security crisis to full-blown public distrust in information delivered on the Internet, as AI-produced content swells to 90% of all information. In all developed countries, governments make harsh laws that only news organisations approved by the government are allowed to disseminate news to the public in a big blow to social media platforms and ‘non-compliant’ news organisations. Know-your-customers regulation, well known in the banking sector to avoid money laundering, is forced on technology companies delivering generative AI applications to avoid certain countries and entities accessing the technology. 

Market impact: Traditional media companies approved by their governments for disseminating public news soar in value, with shares in The New York Times Company doubling. Adobe shares plunge as government penalises the company, as the catastrophic deepfake was made using its software. 

Disclaimer

The Saxo Group entities each provide execution-only service and access to Analysis permitting a person to view and/or use content available on or via the website is not intended to and does not change or expand on this. Such access and use are at all times subject to (i) The Terms of Use; (ii) Full Disclaimer; (iii) The Risk Warning; (iv) the Rules of Engagement and (v) Notices applying to Saxo News & Research and/or its content in addition (where relevant) to the terms governing the use of hyperlinks on the website of a member of the Saxo Group by which access to Saxo News & Research is gained. Such content is therefore provided as no more than information. In particular no advice is intended to be provided or to be relied on as provided nor endorsed by any Saxo Group entity; nor is it to be construed as solicitation or an incentive provided to subscribe for or sell or purchase any financial instrument. All trading or investments you make must be pursuant to your own unprompted and informed self-directed decision. As such no Saxo Group entity will have or be liable for any losses that you may sustain as a result of any investment decision made in reliance on information which is available on Saxo News & Research or as a result of the use of the Saxo News & Research. Orders given and trades effected are deemed intended to be given or effected for the account of the customer with the Saxo Group entity operating in the jurisdiction in which the customer resides and/or with whom the customer opened and maintains his/her trading account. Saxo News & Research does not contain (and should not be construed as containing) financial, investment, tax or trading advice or advice of any sort offered, recommended or endorsed by Saxo Group and should not be construed as a record of our trading prices, or as an offer, incentive or solicitation for the subscription, sale or purchase in any financial instrument. To the extent that any content is construed as investment research, you must note and accept that the content was not intended to and has not been prepared in accordance with legal requirements designed to promote the independence of investment research and as such, would be considered as a marketing communication under relevant laws.

Please read our disclaimers:
- Notification on Non-Independent Investment Research (https://www.home.saxo/legal/niird/notification)
- Full disclaimer (https://www.home.saxo/en-hk/legal/disclaimer/saxo-disclaimer)

None of the information contained here constitutes an offer to purchase or sell a financial instrument, or to make any investments. Saxo does not take into account your personal investment objectives or financial situation and makes no representation and assumes no liability as to the accuracy or completeness of the information nor for any loss arising from any investment made in reliance of this presentation. Any opinions made are subject to change and may be personal to the author. These may not necessarily reflect the opinion of Saxo or its affiliates.

Saxo Capital Markets HK Limited
19th Floor
Shanghai Commercial Bank Tower
12 Queen’s Road Central
Hong Kong

Contact Saxo

Select region

Hong Kong S.A.R
Hong Kong S.A.R

Saxo Capital Markets HK Limited (“Saxo”) is a company authorised and regulated by the Securities and Futures Commission of Hong Kong. Saxo holds a Type 1 Regulated Activity (Dealing in Securities); Type 2 Regulated Activity (Dealing in Futures Contract); Type 3 Regulated Activity (Leveraged Foreign Exchange Trading); Type 4 Regulated Activity (Advising on Securities) and Type 9 Regulated Activity (Asset Management) licenses (CE No. AVD061). Registered address: 19th Floor, Shanghai Commercial Bank Tower, 12 Queen’s Road Central, Hong Kong.

Trading in financial instruments carries various risks, and is not suitable for all investors. Please seek expert advice, and always ensure that you fully understand these risks before trading. Trading in leveraged products may result in your losses exceeding your initial deposits. Saxo does not provide financial advice, any information available on this website is ‘general’ in nature and for informational purposes only. Saxo does not take into account an individual’s needs, objectives or financial situation. Please click here to view the relevant risk disclosure statements.

The Saxo trading platform has received numerous awards and recognition. For details of these awards and information on awards visit www.home.saxo/en-hk/about-us/awards.

The information or the products and services referred to on this site may be accessed worldwide, however is only intended for distribution to and use by recipients located in countries where such use does not constitute a violation of applicable legislation or regulations. Products and services offered on this website are not directed at, or intended for distribution to or use by, any person or entity residing in the United States and Japan. Please click here to view our full disclaimer.

Apple, iPad and iPhone are trademarks of Apple Inc., registered in the US and other countries. AppStore is a service mark of Apple Inc. Android is a trademark of Google Inc.