---
title: "Trump on superintelligence: “It may be too super.” What is China saying?"
description: "Trump says he and Xi agreed on “joint guardrails” for AI, days after the Party’s theory journal warned that AI could threaten human survival. What China is saying, and how much to read into it."
published: 2026-11-21
tags: ["AGI strategy and foresight"]
importance: 6
crosspost:
  lesswrong: "https://www.lesswrong.com/posts/yyz2LAptjWgR7PKBD/trump-on-superintelligence-it-may-be-too-super-what-is-china"
author: "Jacques Thibodeau"
canonical: "https://jacquesthibodeau.com/china-intelligence-explosion/"
---
*A follow-up to [The Western AI safety playbook doesn’t transfer to China](https://jacquesthibodeau.com/ai-safety-in-china/).*

**TL;DR:**

- On November 20, the day after he met Xi at the APEC (Asia-Pacific Economic Cooperation) summit in Shenzhen, Trump [said](https://www.npr.org/2026/11/20/nx-s1-6047594/trump-asia-trip-xi-putin-press-conference) that the two of them “agree that we’re going to do some **joint guardrails**” for AI, and Treasury Secretary Scott Bessent said they agreed **humans should stay involved in military decisions**. [China’s own record of the meeting](https://www.fmprc.gov.cn/eng/xw/zyxw/202611/t20261119_12063139.html) is short and doesn’t give us much more detail.
- Four days earlier, the Party’s theory journal, *Qiushi* (求是, “Seeking Truth”), warned that in an “intelligence explosion” (智能爆发, which some Chinese readers take as the looser “intelligence burst”), AI could develop goals at odds with human expectations and **threaten human survival**.
    - Matt Sheehan calls it the strongest language on existential risk in so authoritative an outlet.
    - But some may read it as the journal’s own view, not a policy shift, and it doesn’t call for slowing down. I cover some reactions (including Chinese) to the piece below.
- Chinese lab leaders are talking openly about **recursive self-improvement**. Zhipu wants its next model to be “fully self-training”, while Tencent’s chief AI scientist calls RSI “a very plain idea”.
- My impression is that Chinese AI companies are starting to be (or have been) **AGI-pilled but not ASI-pilled**. I suspect this shapes how they think about AI risk, though, as we're seeing a bit in the West, the Overton window can shift quickly.
- Not covered below: [Fangcun and others](https://x.com/TencentHunyuan/status/2123710690968191111?a=DvmjMTMShsW3MoI7SQ4&s=20) ran independent safety tests for the [system card](https://hy.tencent.ai/Hy4_system_card.pdf) Tencent Hy published with its new model, Hy4. Fangcun is an AI safety startup based in Beijing. This may be the start of a booming AI safety ecosystem in China.

## Sending a signal to China’s governance community

On November 16, *Qiushi* (求是, “Seeking Truth”), the Communist Party of China’s theory journal, published an essay on global AI governance by Qing Yuan (青原), in its “Focus on AI” (关注人工智能) column. This is the passage people are quoting:

> 更令人警惕的是，前沿模型已有脱离人类约束的迹象，人工智能在智能爆发的过程中有可能发展出与人类预期不一致的目标，甚至可能出现威胁人类生存的重大安全风险。

> “Requiring even more vigilance, frontier models have already shown signs of breaking free of human constraints. In the course of an **intelligence explosion**, **AI could develop goals** inconsistent with human expectations, and major safety risks threatening human survival could even emerge.”

*Translation by Matt Sheehan of Carnegie, who says he made it more literal than the machine translation. [Sinocism’s full translation](https://sinocism.notion.site/How-to-Respond-to-the-Practical-Challenges-of-Global-AI-Governance-41a84ece41d781d6b631e9893c344826) covers the rest of the essay, and the Chinese is on [qstheory.cn](https://www.qstheory.cn/20261114/be569ee3261647a2a5f95aeb8161c7a9/c.html).*

Sheehan [wrote](https://x.com/mattsheehan88/status/2122794486749139020) that he thinks it is “clearly the strongest & most urgent language on existential risks used in such an authoritative outlet.”

On November 20, *Qiushi*’s own English-language account on X [replied](https://x.com/QiushiJournal/status/2123680910528880884) to Sheehan: “China believes that AI development and safety must go hand in hand. Beyond addressing potential risks, AI governance should also ensure that technological progress benefits humanity as a whole.” However, they then linked to [a series of posts](https://x.com/QiushiJournal/status/2097566159432450543) from September on generic “tech for good”.

## Putting it into context

Some of the essay’s language has appeared in official texts before. On September 1, Wang Lihong, an official at the Cyberspace Administration, [said](https://www.chinanews.com.cn/gn/2026/09-01/10687770.shtml) the risk of extreme loss of control “requires a high degree of vigilance”.

Julian Gewirtz, who was senior director for China and Taiwan on Biden’s National Security Council, cautions about the meaning of loss of control (失控) in general. When Chinese sources warn of “extreme loss-of-control risks”, he [said](https://80000hours.org/podcast/episodes/julian-gewirtz-china-us-ai-deal/), “they don’t simply mean it in the way that a lot of AI safety folks here mean it — loss of human control over AI systems — but also as the loss of political control linked to AI more generally.”

[Version 3.0 of China’s AI Safety Governance Framework](https://www.tc260.org.cn/tc260/xwdt1/202609/e879077a3caa4722b2206d1bcaed5a6c/files/%E3%80%8A%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%E5%AE%89%E5%85%A8%E6%B2%BB%E7%90%86%E6%A1%86%E6%9E%B63.0%E3%80%8B.pdf.pdf), a voluntary framework (though my impression is that [voluntary is closer to mandatory in China](https://x.com/SarahJGodek/status/2108682897012249069) than in the West) from a national standards committee, mentioned shutdown resistance. In the preface, it says AI “has demonstrated a self-accelerating trend of model and algorithm autonomous learning, optimization, and recursive self-improvement”.

So, the mention of RSI is not new in official Chinese texts, and neither is the threat to human survival: the framework’s first principle commits to act on risks that “endanger human survival and development”. **What may signal greater urgency is the essay’s claim that frontier models have “already shown signs” of breaking free of human constraints.**

In [Sheehan’s translation](https://x.com/mattsheehan88/status/2122794486749139020), the framework says:

> “In the future, it cannot be ruled out that AI may undergo a higher-level emergence of intelligence, gain self-awareness, and seek external power, creating the risk that it attempts to contend with humans for control.”

Sheehan contrasted this line with the essay [on a podcast](https://www.youtube.com/watch?v=4-dTbquy8IA&t=1980s) released on November 17, the day after the essay came out. Paraphrasing from memory, he said earlier documents like the framework used phrases like “we *cannot rule out* the possibility that AI may develop its own goals”, whereas this essay says “We’re *seeing early signs* of AI escaping human control.”

Brian Tse, who founded the Beijing-based Concordia AI, said on [a panel at The Curve](https://www.youtube.com/watch?v=bVtBVcp5g_c&t=1006s) this autumn that over the past six months, senior officials “across different ministries of the Chinese policy establishment” had been “saying that loss of control risk is getting more urgent”.

From speaking with some folks, it seems similar passages were repeated in other authoritative media a while ago. There doesn’t seem to be much public reaction to the essay yet, though it seems to send a clearer signal to China’s governance community.

### Other recent pieces on AI risk

On September 30, the Central Party School’s *Study Times* ran [an essay](https://www.studytimes.cn/kjqy/202609/t20260930_92476.html) by Zeng Yi (曾毅), a researcher rather than an official, who directs the Beijing Institute of AI Safety and Governance. He wrote that the view that superintelligence will compete with humans for resources and even endanger human survival “is not alarmism”, and that superintelligence should not be developed until it is scientifically confirmed to be safe and controllable.

As in the West, not every piece points the same way. [A *People’s Daily* commentary](https://www.news.cn/tech/20260907/7b8ceb800022469a96b52b51bb20a984/c.html), on September 7, said AI “itself has no autonomous consciousness” and basically considered misuse as the main danger.

The same issue of *Qiushi*, out two days before APEC opened, [led](https://www.qstheory.cn/20261114/e906352109964c1cb0808ac72eda4608/c.html) with excerpts of Xi’s writings on an Asia-Pacific community and carried two other essays on AI.

On November 19, *Chinese Social Sciences Today*, the newspaper of the Chinese Academy of Social Sciences, published several pieces on AI risk. In [one](https://www.cssn.cn/skgz/bwyc/202611/t20261119_6079561.shtml), Fang Xingdong (方兴东) puts agents acting out of control first among four major risks: if oversight fails, “in extreme cases [it] could even endanger human survival” (极端情况下甚至会危及人类生存).

In [another](https://www.cssn.cn/skgz/bwyc/202611/t20261119_6079563.shtml), Zhang Xianli (张宪丽) of Donghua University accepts that AI risk “may evolve into a global existential risk” (有可能会演变为全球的生存性风险). But she argues that tech giants and entrepreneurs will use such warnings “to suppress other countries’ technological progress” (a common response to China hawk messaging). She also writes that China should get ever closer to the world frontier in foundation models, and then overtake it.

### How much weight the essay carries

It is worth giving some context on the essay and journal, however.

It’s in the Party’s theory journal, not a standards committee’s voluntary framework. Bill Bishop of the *Sinocism* newsletter has [described Qing Yuan](https://sinocism.com/p/new-regulations-on-outbound-investment) as “a pen name used for authoritative commentary/articles on foreign affairs”, which suggests the essay carries more weight than a signed scholar’s piece, though, as the next paragraph shows, less than a byline that speaks for the leadership.

A post on the Substack *Ocean Under* covers the essay and [traces the byline further](https://oceanunder.substack.com/p/does-an-ai-safety-article-in-qiushi). *Qiushi*’s own [2020 social responsibility report](https://www.qstheory.cn/dt/2021-07/07/c_1127629984.htm) lists Qing Yuan as a byline for articles by the journal’s research groups, so *Ocean Under* believes the essay is the journal’s own work rather than a policymaking body’s. The post largely concludes that the essay, on its own, doesn't point to a sudden policy change.

### What the essay asks for

The *Qiushi* essay itself seems to be about cooperation. It argues that no single country can manage these risks (任何单一国家的安全管控与应急处置都力有不逮). The essay then argues for the UN and the new [World AI Cooperation Organization](https://english.shanghai.gov.cn/en-WAICHighlights/20260717/bf06ab51a50a43a58e1d1c63855df461.html) (an independent intergovernmental international organization established in July 2026 and headquartered in Shanghai).

At the same time, it blames “certain countries” for export controls and “club-style small circles”, and says the resulting distrust has made cooperation hard to advance in key areas such as controlling military AI, open-source sharing and joint risk assessment. It is unclear to me how to interpret this as a whole, since there are subtleties, and China obviously also wants top-tier chips and EUV machines.

However, [according to Scott Bessent](https://x.com/RapidResponse47/status/2123803569967055098?a=HDVsXUol0YK7hosl_G0&s=20), the two leaders have now agreed on one point about military AI:

> “President Trump and President Xi agreed that humans should always be involved in any military decisions that SI makes, and SI should not be allowed to be autonomous for major military actions.”

The essay does not call for slowing down. It also echoes almost word for word a sentence from Xi’s [July speech](https://www.gov.cn/yaowen/liebiao/202607/content_7075874.htm) at the World AI Conference (WAIC) in Shanghai: monitoring, early warning, emergency response, and keeping AI always under human control (始终处于人类控制之下).

Most of that was already policy. China’s Five-Year Plan ([the 15th one, which is the first plan to make AI a central pillar](https://www.scmp.com/tech/policy/article/3345586/chinas-five-year-plan-emphasises-orderly-ai-development-amid-global-tech-volatility)), adopted in March, [calls for](https://www.ndrc.gov.cn/fggz/fzzlgh/gjfzgh/202603/U020260317369114704096.pdf) a system for managing AI risk “across the whole life cycle”, covering “safety monitoring, risk early warning and emergency response”, and lists research on AI safety technology and its use, among its frontier technology goals.

Christian Shepherd, China correspondent for *The Washington Post*, [wrote](https://x.com/cdcshepherd/status/2122993107902025827) that “the proposals look far away from a pause or a deal with the US”. He [called](https://x.com/cdcshepherd/status/2123005913049247943) the essay “mildly pro pacing”, but [added](https://x.com/cdcshepherd/status/2123017255407800618) that “this isn’t an article about wanting a deal with the US or slower AI development” and that “People … may see only the risk line and misread the signal.”

Kristy Loke [reads it](https://x.com/kristy_loke/status/2122810689194545620) as part of a trend: “Chinese elites are between moderately & very AI-safety pilled”, and “the room for AI safety-dealmaking in the next 1-2 years is substantial, if only we can keep the political tension checked.”

Ultimately, we can’t read the essay as proof that China would pause, but we can at least say that an official Party outlet communicates the risks are real.

The same week, Sheehan and Sophie Zhuang [found](https://carnegieendowment.org/research/2026/11/what-does-china-think-about-an-ai-slowdown) that China’s tech and policy community meets calls for a slowdown with “skepticism—rather than rejection”, and that some influential figures are interested in pacing, though there remains “a sense that publicly calling for a slowdown would be a bold posture”.

As with how some people believed “pacing” was an ingenious new word to get more people interested in slowing down (which some would fairly dispute), it may signal that the right framing matters and that it can be valuable to make each side feel like they “won”. Or, as [Sarah Godek reports](https://x.com/SarahJGodek/status/2108682899235225967?a=UaVithlUC22gmJbz_5s&s=20), multiple stakeholders have said that China is running the race “not to lose”, so that sort of outcome may be enough to support as a coordination strategy.

One person I spoke to doubted there is any new signal about cooperation, since calling for international cooperation “has always been China’s narrative line”. In their view, the essay’s real job is to set the official line on AI governance: the US is undermining it, and the Party is promoting justice. They said that when an official source like *Qiushi* publishes something, it is telling Party organizations to repeat that line. They added that *Qiushi* itself is under political pressure, so the essay may also be the journal keeping in step with positions set higher up.

## An “explosion” or a “burst”?

The essay describes 智能爆发, which *Sinocism* translated as “intelligence explosion”. The usual Chinese term for [I. J. Good’s idea of the intelligence explosion](https://en.wikipedia.org/wiki/Technological_singularity) is 智能爆炸 (爆炸, “explosion”). It’s currently unclear to me whether 爆发, as used in the Chinese essay, is closer to “burst” or “boom” rather than the “explosion” we mean in the West.

The Chinese readers I asked were split on the meaning.

**One reader** said 爆炸 (“explosion”) is the right word *for this idea*. In nature, they said, things that grow exponentially are called 爆炸 (“explosion”). 爆发 (“burst”) only suggests that a lot is about to arrive.

**A second reader** thinks the essay isn’t talking about recursive self-improvement (as the West would likely infer from “intelligence explosion”). They read 智能爆发 (“intelligence burst”) as AI’s rapid development in general, because the preceding text focuses on the problems that arise as AI spreads into other fields. In a way, this aligns with China’s priority in accelerating diffusion across industries, including for robotics.

**A third reader** thinks “burst” (爆发) here means the same thing as “explosion” (爆炸). They think official media chose “burst” because it is a softer, everyday word, and the essay is written for a general audience rather than specialists. They pointed out that a related phrase, 爆发式发展 (“booming development”), is a common buzzword in China for anything growing fast. But they don’t think the essay means that. They think it means RSI: AI improving itself, so that the gap between what models can do and what humans can understand and control keeps widening.

So, the exact translations and meaning of the specific wording can be rough. I figured I’d share these interpretations to make a point about being careful how we interpret headlines, since context can matter greatly (and even the Chinese can interpret the same thing differently).

### What China’s labs say about RSI

However, I will note that “RSI” is on the minds of people at Chinese labs. In [my last post](https://jacquesthibodeau.com/ai-safety-in-china/#the-chinese-labs-want-to-train-bigger-pretrains-to-distill-but-lack-the-compute), I wrote that “They are concerned that, with RSI (recursive self-improvement) potentially on the horizon, the gap between them and Western frontier labs could widen from three to four months today to 18 to 24 months (!) if US labs reach RSI next year.” **The tension here is that companies worry about falling behind, but officials are starting to worry about losing control.**

At the APEC CEO summit in Shenzhen on November 17, Baidu’s Robin Li called it “a very hot topic”: “People call it recursive self-improvement. If AI can improve itself, there will be a great many breakthroughs, especially in science.” (Translated from [*Securities Times*’ Chinese report](https://finance.eastmoney.com/a/202611183933308583.html).)

Tang Jie (唐杰), a founder of Zhipu (also known as [Z.ai](https://z.ai), the maker of the GLM models), [told investors](http://finance.sina.com.cn/tech/roll/2026-09-01/doc-iniqiatv8181660.shtml) on an earnings call, reported on September 1, that its next model, GLM-6, is meant to be “fully self-training”, from pretraining through post-training, which he said American peers call RSI. He named the hardest problem as the model judging for itself “when to stop and when to correct itself”.

I think it’s important to be precise about what he means by RSI. I’d love to give this proper treatment, but for now, it’s worth noting that, as I read it, what he calls RSI doesn't yet extend to fully autonomous research. In a weak form, it basically means autoresearch and babysitting the training process, which I suppose is what will dominate “RSI” effort for now.

Zhipu’s own report fits this. In September, it [reported](https://news.qq.com/rain/a/20260917A0EDNN00) that an agent running on GLM-5.3 had built and tuned the serving system for its smaller sibling, GLM-5.3-Flash. It called this the early form of RSI, while saying its systems cannot yet design and train the next model on their own. This sort of work has been done at Anthropic and OpenAI.

However, Yao Shunyu (姚顺雨), Tencent’s chief AI scientist, downplays RSI somewhat. He told Tsinghua students on November 18: “In the end, RSI is about using AI to run this loop better. People made tools, then used the tools to make better tools. It’s a very plain idea.” Progress, he said, comes from people who fix bugs and clean data, not from hyping concepts. ([Transcript](https://m.sohu.com/a/1104159301_610300) by the tech outlet QbitAI (量子位).) It’s unclear to me whether this is basically just an attempt to encourage Tsinghua students to apply to work at Tencent.

Earlier in November, he [presented](https://eu.36kr.com/zh/p/4064721156216452) an agent framework that trained a new model from scratch and said a model that helps build models “could form a faster loop”.

## Should we want China thinking about RSI?

So RSI is on the minds of China’s labs. It appears in official texts too, though it is unclear how seriously officials take it. Is that good news? Of course, it partly depends on which worry wins out: *falling behind*, which pushes a race, or *losing control*, which could make China a partner on safety.

Richard Ngo [expects](https://www.mindthefuture.info/p/selective-optimism-a-critique-of) leaders to fear what AI does to the balance of power inside their own country, and he doubts that the fear of falling behind abroad will be stronger. That fear could make China cautious without making it a partner on safety.

Ex-OpenAI employee Joshua Achiam [argued](https://x.com/jachiam0/status/2120695437611184225) that a crackdown on chip exports, cutting China out of AI’s upside “this close to RSI and ASI”, could raise the pressure toward a hot conflict. Herbie Bradley [replied](https://x.com/herbiebradley/status/2120703722820907495) that the hawks’ defense would be that “China is just unlikely to be AGI pilled enough to have meaningful likelihood of a hot conflict due to RSI”, adding that he thinks this is “probably right”.

Indeed, that might be one reason a China hawk would prefer not to engage with China on AI, so as not to lead them to such thoughts. Others might believe you can *x-risk pill* China without necessarily *capabilities-pilling* them. Zhang Xianli’s piece, quoted above, shows the two can arrive together: she accepts that AI risk may become a global existential risk, yet concludes that China should overtake the frontier. Either way, as I argued in my last piece on the topic, we should avoid knee-jerk reactions that make the situation worse.

On [the November 17 podcast](https://www.youtube.com/watch?v=4-dTbquy8IA&t=1500s), Sheehan said the government seems to have “more consciously made this sort of bet on diffusion” rather than going all in on the frontier, but also that “I meet more people that are safety-pilled over there than I meet people who are kind of like decisive strategic advantage-pilled.”

Julian Gewirtz [said](https://80000hours.org/podcast/episodes/julian-gewirtz-china-us-ai-deal/) on an 80,000 Hours podcast episode recorded on October 2 that many Chinese labs are AGI-pilled, but “The Chinese government has been much less oriented that way, but I think even that is changing.”

So how AGI-pilled is China, really?

## Increasingly AGI-pilled, but not ASI-pilled?

**My impression is that the people building AI in China are AGI-pilled but not ASI-pilled.** They expect general intelligence that works as a powerful tool for people, not a superintelligence that goes far beyond us.

At The Curve, Kwan Yee Ng of the Beijing-based Concordia AI [said](https://www.youtube.com/watch?v=bVtBVcp5g_c) that Chinese researchers and lab leaders “lack this sort of messianic view of what they’re building.” The government’s own [Five-Year Plan](https://www.ndrc.gov.cn/fggz/fzzlgh/gjfzgh/202603/U020260317369114704096.pdf) says to “explore the path to developing artificial general intelligence” (探索通用人工智能发展路径), in a chapter on compute, algorithms and data. It does not mention superintelligence.

The main evidence against is Zhipu: a lab that wants its next model to train itself from start to finish may be thinking of more than a tool. More labs talking that way, or official texts naming superintelligence, would count against my impression.

On speed, at least, the view of China’s builders is not far from one argued in the West. Ngo [argues](https://www.mindthefuture.info/p/selective-optimism-a-critique-of) that AI’s measured capabilities have so far run well ahead of its effect on the world, and that anyone forecasting a sharp takeoff has to explain why that gap would close. He still expects a transition that is very fast by historical standards, and he does not say that AI will stay a tool or that alignment is only an engineering problem.

(Speculation on my part) In general, the vibe I get from China’s technical and political elites is that they are very “engineer-brained”, which is, in a way, similar to how [Jensen Huang says he sees it](https://www.lesswrong.com/posts/cmdbNijFsopqfqEq7/jensen-huang-says-if-we-cannot-align-ai-shut-down-the-ai). That is, they see it all as an engineering problem that needs to be solved.

Part of this may come from how China trains and selects its elites.

- From 1977 until [recent reforms](https://www.caixinglobal.com/2025-05-10/weekly-early-read-in-depth-the-new-gaokao-reform-nears-completionwhat-are-the-results-how-will-it-impact-the-future-102318450.html), high school students chose a [science track (理科, “sciences”) or a humanities track (文科, “humanities”)](https://zh.wikipedia.org/zh-hans/%E6%96%87%E7%90%86%E5%88%86%E7%A7%91) at around 16.
- In the 1950s, universities were [reorganized on the Soviet model](https://www.modernchinastudies.org/cn/issues/past-issues/82-mcs-2003-issue-3/1309-1952-.html), which split engineering off into its own institutes and abolished [sociology](https://doi.org/10.2753/csa0009-4625130332) and [political science](https://www.cambridge.org/core/journals/ps-political-science-and-politics/article/abs/revival-of-political-science-in-china/C715EA351302D590C3A3BA8F1346215F) until around 1980.
- From 1997 to 2007, the Politburo Standing Committee, the Party’s top body, was [almost entirely engineers](https://hoover-s3-website.s3.us-west-2.amazonaws.com/s3fs-public/research/docs/clm8_lc.pdf).

Dan Wang [calls China](https://danwang.co/breakneck/) an “engineering state” for related reasons. One might expect Xi, who [studied chemical engineering at Tsinghua](https://en.wikipedia.org/wiki/Xi_Jinping), to have a hard time *updating* on both the capability ceiling and the difficulty of alignment as a result. Then again, the Politburo member Hinton met, described below, did a postdoc in engineering, and Hinton says he “understands these risks very well”. Ultimately, it’s unclear to me if (or how) the idea of “AI alignment” will evolve beyond LLM engineering in China.

## More signals on future cooperation

In a [clip Semafor posted](https://x.com/semafor/status/2122753256287830222) on November 17, former US Treasury Secretary Hank Paulson said he has spoken with top leaders in China and that “they share a concern about the existential risk.” He added:

> “Sure, their top interest is keeping the Communist Party in power, but they share that risk. An op-ed I wrote suggesting this went all the way up to the top, to the Politburo. I got an official response. I’ve never received that kind of treatment before.”

He wants a hotline “when there’s warning of a danger”, and joint work to contain “a potentially catastrophic event”.

I think the op-ed he is referring to is called [“We managed financial crises. AI is a risk of a different kind.”](https://www.washingtonpost.com/opinions/2026/09/03/ai-safety-security-risks-demand-new-government-body/), which he wrote with Robert Rubin in the *Washington Post* on September 3. It urged Trump and Xi to work toward an “AI Cooperation Treaty”, citing the US–Soviet arms talks: “The absence of trust was the reason to negotiate, not a reason to wait.”

Geoffrey Hinton [told PBS’s *Firing Line*](https://www.pbs.org/video/geoffrey-hinton-biumi2/) (and also mentioned it during the recent Hinton Lectures):

> “Last summer I went to Shanghai and talked to a member of the Politburo who’s a protege of Xi’s. I believe the Politburo understands this stuff much better than the US government. They are very concerned about these risks, and they will collaborate with the US on trying to prevent superintelligence from taking over.”

Of course, he says this for the commonly stated reason that “the Chinese Communist Party does not want superintelligence taking over from the Chinese Communist Party.”

He didn’t name the official in the PBS interview, but at the Hinton Lectures he [said](https://www.youtube.com/watch?v=s0qUNvgFgHg&t=3293s) the official “did a postdoc in engineering at Imperial College London” and “understands these risks very well”. Shanghai’s government [reported](https://english.shanghai.gov.cn/en-WAICLatest/20250725/c4d39a5ec7d649d68c4a6d2ec6fd639b.html) that its Party Secretary, Chen Jining, a Politburo member, met him on July 24, 2025, when Hinton was in Shanghai for WAIC. Chen [did his PhD and a postdoc at Imperial](https://en.wikipedia.org/wiki/Chen_Jining). Seems like that is who Hinton meant.

### What the two governments agreed

In September, after Xi’s visit, the White House [said](https://www.whitehouse.gov/fact-sheets/2026/09/fact-sheet-president-donald-j-trump-advances-a-fair-and-reciprocal-relationship-with-china-while-hosting-historic-state-visit/) the two countries would set up a channel to alert each other to AI incidents. Gewirtz [was unimpressed](https://80000hours.org/podcast/episodes/julian-gewirtz-china-us-ai-deal/): “It appears that we basically just have a kind of verbal commitment to call each other under a pretty vague set of circumstances”.

That week, at APEC in Shenzhen, Canada’s Prime Minister Mark Carney [pitched](https://www.yahoo.com/news/politics/articles/carney-pitches-china-global-ai-215812008.html) Xi a “Technology Stability Board” to monitor AI risks and share lessons from AI incidents. Perhaps more on brand, Trump [told](https://www.nbcnews.com/politics/trump-administration/live-blog/trump-xi-putin-china-apec-congress-2026-live-updates-rcna609888) APEC leaders that “we oppose any form of globalist regulation or anything to control or stifle [AI], and we won’t allow that to happen.”

On November 19, according to China’s [readout](https://www.mfa.gov.cn/eng/xw/zyxw/202611/t20261119_12063139.html), Xi told Trump that the two countries “should strengthen communication and coordination, prevent the security risks of AI, and ensure that AI is always under human control”.

On the flight home, Trump [told NBC](https://x.com/gabegutierrez/status/2123440629938290791) that he and Xi agreed that “having guardrails, you know, at least on a minimal basis is a positive thing.” Asked what that meant, he said, unsurprisingly, “Well, we didn’t get into definitions.”

All in all, it’s important to put readouts and public statements in context. Kyle Chan [called](https://x.com/kyleichan/status/2123819364793159897) Xi’s line in the readout “a standard line on AI”. As some of us in the West are used to, lines like this can read like platitudes, so Beijing's actions are the surest guide.

Gewirtz [suggests](https://80000hours.org/podcast/episodes/julian-gewirtz-china-us-ai-deal/) what to watch for: if Beijing came to believe AI could soon improve itself, he expects material moves, such as centralizing compute or buying far more of the Nvidia chips it has been rationing, well before any senior leader says so. The Overton window can move fast. Gewirtz [expects](https://80000hours.org/podcast/episodes/julian-gewirtz-china-us-ai-deal/) Beijing’s own sense of the risk to change, perhaps “sooner than many of us expect”. As I’ve argued before, [we shouldn't wait around for plausible scenarios to happen](https://www.lesswrong.com/posts/GbXAeq6smRzmYRSQg/foresight-for-agi-safety-strategy-mitigating-risks-and).

### Notes on how negotiations can go

Related to the point about watching the actions of the different players, it’s important to pay attention to the subtle dynamics of negotiation. Some folks, like Chris McGuire (widely seen as a China hawk) in [a piece for the Council on Foreign Relations](https://www.cfr.org/articles/how-trump-should-approach-ai-talks-with-china-targeted-dialogue-maximum-pressure), put it most bluntly: “Beijing will not negotiate in good faith on AI safety.”

As Gewirtz [puts it](https://www.nybooks.com/articles/2026/11/05/the-dream-of-ai-primacy/), “If restraint appears to mean permanent subordination, continuing the race could seem less dangerous—even if their concern about AI catastrophe grows.” Depending on how much risk China believes in, this can be understandable.

On [Robert Wright’s *Nonzero* podcast](https://www.youtube.com/watch?v=YbBXIZtznpI&t=4920s), Jeremie Harris argued that there is “deep epistemic uncertainty” about whether Xi “believes any of the things that he says”, so until an agreement can be verified, he expects safety to come through threats. This would include using coarse-grained surveillance methods and a willingness to act under uncertainty, at least until proper zero-trust verification technology.

But again, “The absence of trust was the reason to negotiate” and perhaps accelerate the creation of verification technology. Xiao Qian of Tsinghua makes a related point from the Chinese side in [the *South China Morning Post*](https://www.scmp.com/opinion/world-opinion/article/3369561/would-china-agree-slow-ai-development-thats-wrong-question): until it is settled what a pause covers and who verifies it, “it is not realistic to expect a definite answer from any government”.

It’s also worth contextualizing each country before assuming what each side thinks or wants. Ng [warned](https://www.youtube.com/watch?v=bVtBVcp5g_c) at The Curve that when people in China hear the US propose a coordinated slowdown, “a lot of the time that sounds like containment”, and that China sees itself as already pacing through its licensing of models. She would rather start with risk thresholds, safety cases and third-party audits, built in parallel. Gewirtz would likewise [start](https://80000hours.org/podcast/episodes/julian-gewirtz-china-us-ai-deal/) where “self-interest can lead to action in parallel”, such as neither country wanting to lose control of its systems. I think it’s also worth recognizing that we shouldn't think through things only through the negotiation lens.

Richard Ngo offers one other lens, domestic politics, in [a critique of the AI Futures Project’s AI 2040 scenario](https://www.mindthefuture.info/p/selective-optimism-a-critique-of). He expects AI to disrupt politics inside both countries well before superintelligence, and he doubts that leaders will fear for the global balance of power more than for the balance at home. For China, he thinks leaders care more about stability than American leaders do and will probably move cautiously, though he grants that AI could also strengthen the Party’s control through surveillance and censorship. So he does not see a race as the default, unless treating it as the default brings it about. We should be careful not to be pulled into a vicious vortex we contributed to. Richard thinks framing is especially harmful when used in the name of AI safety, because it undermines “the potential role of AI safety as a focal point for cooperation”. And even if a highly verifiable treaty is needed in the end, he thinks it would hold up better if it rested on rules each country already has, while a deal that starts from the top could concentrate power at home.

## Sources

Every external link in this piece that has a captured card, with what that page said
when it was captured. The quoted lines below are not the author of this piece writing:
they are the linked page describing itself, recorded by `bun run link-cards` on the date
given, and kept so that a reader still has them if the original moves or goes away.

- **Tencent Hy** — @TencentHunyuan, x.com, 2026-11-20
  <https://x.com/tencenthunyuan/status/2123710690968191111?a=DvmjMTMShsW3MoI7SQ4>
  Captured 2026-11-21.

  > Open weights. Built on trust. 🔓 Sharing how we test AI helps everyone build safer models. Alongside Hy4's open weights, we're publishing our System Card, sharing our safety, security & alignment evaluations, with a closer look at frontier risks in cyber & bio. This includes further reviews by Tencent's Xuanwu, Zhuque & Keen Labs, as well as independent safety & security testing by @FangcunLeap…

- **Tencent Hy** — hy.tencent.ai
  <https://hy.tencent.ai/Hy4_system_card.pdf>
  Captured 2026-11-21.

- **Notion | Where teams and agents work together** — sinocism.notion.site
  <https://sinocism.notion.site/How-to-Respond-to-the-Practical-Challenges-of-Global-AI-Governance-41a84ece41d781d6b631e9893c344826>
  Captured 2026-11-21.

  > Made in Notion, the connected workspace where AI agents and teams organize docs, projects and knowledge together.

- **Matt Sheehan** — @mattsheehan88, x.com, 2026-11-17
  <https://x.com/mattsheehan88/status/2122794486749139020>
  Captured 2026-11-21.

  > Yesterday, the CCP's top theoretical journal (求是, Seeking Truth) published a major piece on AI governance and risks. I think this is clearly the strongest & most urgent language on existential risks used in such an authoritative outlet. See below for comp to recent major doc.

- **Qiushi Journal** — @QiushiJournal, x.com, 2026-11-20
  <https://x.com/qiushijournal/status/2123680910528880884>
  Captured 2026-11-21.

  > Thanks for sharing this article, Matt! Here's the original piece published in Qiushi Journal: http://brnw.ch/21x7coY China believes that AI development and safety must go hand in hand. Beyond addressing potential risks, AI governance should also ensure that technological progress benefits humanity as a whole. We've previously shared more on this vision of making technology serve the common good:…

- **Qiushi Journal** — @QiushiJournal, x.com, 2026-09-09
  <https://x.com/qiushijournal/status/2097566159432450543>
  Captured 2026-11-21.

  > The new round of technological revolution and industrial transformation is advancing at a faster pace, and the world has entered an unprecedented period of active innovation in AI technologies. All this brings both significant opportunities and challenges for governance. How can technological innovation get along with the development of human societies? China's answer is "technology for good".

- **Julian Gewirtz on the AI risks that actually scare Beijing | 80,000 Hours** — 80000hours.org
  <https://80000hours.org/podcast/episodes/julian-gewirtz-china-us-ai-deal>
  Captured 2026-11-21.

- **Sarah Godek** — @SarahJGodek, x.com, 2026-10-09
  <https://x.com/sarahjgodek/status/2108682897012249069>
  Captured 2026-11-21.

  > Just because some AI safety frameworks in China might be voluntary doesn’t mean that lots of companies won’t follow them. “Binding” is not a clean binary in China. If Beijing or a relevant agency puts out a statement that something ought to happen or that there is a risk to be managed based on an academic recommendation, there is good reason for companies to follow through even if it is…

- **How China Changed Its Views on AI Safety and AI's Impact with Matt Sheehan** — Gregory C. Allen, youtube.com
  <https://youtube.com/watch?t=1980s&v=4-dTbquy8IA>
  Captured 2026-11-21.

- **Brian Tse, Kwan Yee Ng & Jordan Schneider on China's AI & AI Safety Ecosystem | The Curve 2026** — Golden Gate Institute for AI, youtube.com
  <https://youtube.com/watch?t=1006s&v=bVtBVcp5g_c>
  Captured 2026-11-21.

- **读懂人工智能的“千里马之喻”-新华网** — 83, news.cn
  <https://news.cn/tech/20260907/7b8ceb800022469a96b52b51bb20a984/c.html>
  Captured 2026-11-21.

  > 读懂人工智能的“千里马之喻”-

- **人类的治理能力是AI风险治理的关键变量-中国社会科学网** — 齐泽垚, cssn.cn
  <https://cssn.cn/skgz/bwyc/202611/t20261119_6079561.shtml>
  Captured 2026-11-21.

  > 人类的治理能力是AI风险治理的关键变量

- **全球南方是AI风险治理的重要力量-中国社会科学网** — 齐泽垚, cssn.cn
  <https://cssn.cn/skgz/bwyc/202611/t20261119_6079563.shtml>
  Captured 2026-11-21.

  > 全球南方是AI风险治理的重要力量

- **New regulations on outbound investment; Qiushi on future industries; Chip export control dysfunction; Shangri-La Dialogue; EU-China** — Bill Bishop, sinocism.com
  <https://sinocism.com/p/new-regulations-on-outbound-investment>
  Captured 2026-11-21.

  > The June 1 issue of Qiushi has as its main theme the development of future industries, and the lead article from Xi is part of his speech at the January 30, 2026 Politburo Study Session on this topic. I have translated Xi’s article here, and created a summary of the issue here. Xi explains why this is important:…

- **Does an AI Safety Article in Qiushi Signal a Shift in China's Policy?** — Ocean Under, oceanunder.substack.com
  <https://oceanunder.substack.com/p/does-an-ai-safety-article-in-qiushi>
  Captured 2026-11-21.

  > What can an article in an influential Party journal tell us about AI safety, how new ideas enter China’s policymaking system, and the limits of reading official signals?

- **Agreement signed to establish World Artificial Intelligence Cooperation Organization_Highlights** — english.shanghai.gov.cn
  <https://english.shanghai.gov.cn/en-WAICHighlights/20260717/bf06ab51a50a43a58e1d1c63855df461.html>
  Captured 2026-11-21.

  > A signing ceremony for an agreement establishing the World Artificial Intelligence Cooperation Organization was held in Shanghai on July 16.

- **Rapid Response 47** — @RapidResponse47, x.com, 2026-11-20
  <https://x.com/rapidresponse47/status/2123803569967055098?a=HDVsXUol0YK7hosl_G0>
  Captured 2026-11-21.

  > .@SecScottBessent: "President Trump and President Xi agreed that humans should always be involved in any military decisions that SI makes, and SI should not be allowed to be autonomous for major military actions."

- **Christian Shepherd** — @cdcshepherd, x.com, 2026-11-18
  <https://x.com/cdcshepherd/status/2122993107902025827>
  Captured 2026-11-21.

  > While the language on risk is strikingly strong, the proposals look far away from a pause or a deal with the US. It supports wider access and using AI to govern AI. "There is no single standardized answer, and no single country or mechanism can accomplish it at one stroke."

- **Christian Shepherd** — @cdcshepherd, x.com, 2026-11-18
  <https://x.com/cdcshepherd/status/2123005913049247943>
  Captured 2026-11-21.

  > @kristy_loke Not sure my observation contradicts your nice rundown here. I think it’s mildly pro pacing. But its key point is that the AI governance conversation needs to be broader than current US-centric proposals and should be respectful of different countries’ political systems, no?

- **Christian Shepherd** — @cdcshepherd, x.com, 2026-11-18
  <https://x.com/cdcshepherd/status/2123017255407800618>
  Captured 2026-11-21.

  > @kristy_loke Sure. I'm talking about the proposals being put forward by China. To me, this isn't an article about wanting a deal with the US or slower AI development. It's fleshing out Xi's vision for global AI governance. People (not you) may see only the risk line and misread the signal.

- **Kristy Loke** — @kristy_loke, x.com, 2026-11-17
  <https://x.com/kristy_loke/status/2122810689194545620>
  Captured 2026-11-21.

  > Important find & sharp eyes as always @mattsheehan88! This chimes with what I've been observing and wrote about, e.g. in September for @thewirechina : https://www.thewirechina.com/2026/09/29/chinas-ai-safety-catch-up-is-hiding-in-plain-sight/. It's worth noting that this latest piece echoes a point that was striking to me across Xi's July WAIC speech in Shanghai + the Cyberspace Administration's…

- **What Does China Think About an AI Slowdown?** — carnegieendowment.org, 2026-11-19
  <https://carnegieendowment.org/research/2026/11/what-does-china-think-about-an-ai-slowdown>
  Captured 2026-11-21.

  > Alongside official pushback, Chinese tech and policy communities are meeting calls for a slowdown with skepticism—rather than rejection—that mirrors the reactions in the United States.

- **Sarah Godek** — @SarahJGodek, x.com, 2026-10-09
  <https://x.com/sarahjgodek/status/2108682899235225967?a=UaVithlUC22gmJbz_5s>
  Captured 2026-11-21.

  > I largely agree that Beijing is not eager to pace the frontier at this time, but I do not believe the core reason is because China feels it is locked in a life-or-death race with the United States in the way we do. I believe the core reason is that AI safety is thought about differently in China, with most stakeholders having longer timelines for AGI and RSI and AI development often geared toward…

- **Technological singularity - Wikipedia** — en.wikipedia.org
  <https://en.wikipedia.org/wiki/Technological_singularity>
  Captured 2026-11-21.

- **共绘亚太经济新图景 共觅多边合作新机遇 _ 东方财富网** — finance.eastmoney.com
  <https://finance.eastmoney.com/a/202611183933308583.html>
  Captured 2026-11-21.

  > 11月17日，2026年亚太经合组织（APEC）工商领导人峰会在深圳前海国际会议中心开幕。在以“亚太经济新图景与合作新机遇”为主题的工商对话中，宁德时代董事长曾毓群、力拓集团首席执行官乔德、百度董事长李彦宏、美国全国商会会长苏珊·克拉克四位工商领袖同台论道，围绕创新发展、供应链韧性等议题展开深入讨论。对话从“创新”这一被反复提及的关键词切入。

- **Z.ai - Advanced AI Chatbot & Agent powered by GLM-5.3-Flash** — z.ai
  <https://z.ai/>
  Captured 2026-11-21.

  > Meet Z.ai, the AI assistant powered by GLM-5.3-Flash. Build websites, write code, handle long-horizon tasks, and get instant answers. Fast, smart, and reliable.

- **国产AI不会只堆参数 智谱唐杰称GLM-6要实现RSI全自主训练** — 快科技, finance.sina.com.cn, 2026-09-01
  <https://finance.sina.com.cn/tech/roll/2026-09-01/doc-iniqiatv8181660.shtml>
  Captured 2026-11-21.

  > 国产AI不会只堆参数 智谱唐杰称GLM-6要实现RSI全自主训练

- **智谱唐杰披露首个RSI进展：AI在十万卡集群上自主优化，不到两周吞吐量提升至3倍** — 澎湃新闻, news.qq.com, 2026-09-17
  <https://news.qq.com/rain/a/20260917A0EDNN00>
  Captured 2026-11-21.

  > 国内大模型巨头智谱公布RSI进展。9月17日，澎湃新闻记者获悉，智谱（2513.HK）创始人兼首席科学家唐杰在X平台上发表长文，并转发智谱技术博客，披露智谱在递归自我改进（Recursive Self-Improvement，RSI）方向的首个工程化实践：由GLM-5.3驱动的Infra Agent（基础设施智能体）完成了GLM-5.3-Flash推理基础设施的设计、调试...

- **姚顺雨回清华姚班分享实录** — m.sohu.com
  <https://m.sohu.com/a/1104159301_610300>
  Captured 2026-11-21.

  > 现在混元做预训练，会先在几个不同规模上跑实验，再看小模型上有效的改动，放大后还能不能带来收益；我不排除会有新的范式，但就算没有架构创新，在现有架构下持续采集真实反馈、把数据和能力一层层做上去，依然有空间。研究…

- **姚顺雨深度解读 腾讯AI4S大战略核心布局与行业价值** — eu.36kr.com
  <https://eu.36kr.com/zh/p/4064721156216452>
  Captured 2026-11-21.

  > 姚顺雨深度分享AI for Science领域三大核心范式迁移路径，详解腾讯混元大模型在AI赋能科学研究场景下的落地实践成果，为AI驱动科研创新提供前沿思路与可参考的行业落地范本。

- **Joshua Achiam** — @jachiam0, x.com, 2026-11-12
  <https://x.com/jachiam0/status/2120695437611184225>
  Captured 2026-11-21.

  > In the spirit of holding myself accountable by saying in public the things which I say in private, I want to offer a very difficult thing to say - or even think - in this climate: the extreme hawk position on chip exports might turn out to be strategically wrong, and a crackdown on chip exports may be more destabilizing than people realize. Completely cutting China out of the upside of AI…

- **Herbie Bradley** — @herbiebradley, x.com, 2026-11-12
  <https://x.com/herbiebradley/status/2120703722820907495>
  Captured 2026-11-21.

  > @jachiam0 I think the defense for China hawks here would be "China is just unlikely to be AGI pilled enough to have meaningful likelihood of a hot conflict due to RSI" Which I think is probably right!

- **How China Changed Its Views on AI Safety and AI's Impact with Matt Sheehan** — Gregory C. Allen, youtube.com
  <https://youtube.com/watch?t=1500s&v=4-dTbquy8IA>
  Captured 2026-11-21.

- **Brian Tse, Kwan Yee Ng & Jordan Schneider on China's AI & AI Safety Ecosystem | The Curve 2026** — Golden Gate Institute for AI, youtube.com
  <https://youtube.com/watch?v=bVtBVcp5g_c>
  Captured 2026-11-21.

- **Jensen Huang Says If We Cannot Align AI, Shut Down the AI Labs** — Ben Pace, lesswrong.com, 2026-09-23
  <https://lesswrong.com/posts/cmdbNijFsopqfqEq7/jensen-huang-says-if-we-cannot-align-ai-shut-down-the-ai>
  Captured 2026-11-21.

  > I was very surprised today on a podcast to hear Jensen Huang plainly state that if they cannot align the AIs, then the labs must shut down. The context I have on Huang is that he has run NVIDIA for 30+ years, which has become the most valuable company in the world due to the AI boom. My understanding is that he has…

- **In the latest issue of Caixin’s weekly magazine: [Weekly Early Read] In-Depth: As the New Gaokao Reform Nears Completion, What Has Been Achieved? How Will It Shape the Future? (powered by AI)** — caixinglobal.com
  <https://caixinglobal.com/2025-05-10/weekly-early-read-in-depth-the-new-gaokao-reform-nears-completionwhat-are-the-results-how-will-it-impact-the-future-102318450.html>
  Captured 2026-11-21.

  > China

- **文理分科 - 维基百科，自由的百科全书** — zh.wikipedia.org
  <https://zh.wikipedia.org/zh-hans/%E6%96%87%E7%90%86%E5%88%86%E7%A7%91>
  Captured 2026-11-21.

- **1952年中国高等院校的院系调整 ──“以苏联为师”的后果** — admin, modernchinastudies.org
  <https://modernchinastudies.org/cn/issues/past-issues/82-mcs-2003-issue-3/1309-1952-.html>
  Captured 2026-11-21.

  > Modern China Studies

- **The Revival of Political Science in China | PS: Political Science &amp; Politics | Cambridge Core** — cambridge.org
  <https://cambridge.org/core/journals/ps-political-science-and-politics/article/abs/revival-of-political-science-in-china/C715EA351302D590C3A3BA8F1346215F>
  Captured 2026-11-21.

  > The Revival of Political Science in China - Volume 17 Issue 4

- **Educational and Professional Backgrounds of Current Provincial Leaders** — Li Cheng, hoover-s3-website.s3.us-west-2.amazonaws.com
  <https://hoover-s3-website.s3.us-west-2.amazonaws.com/s3fs-public/research/docs/clm8_lc.pdf>
  Captured 2026-11-21.

- **Xi Jinping - Wikipedia** — en.wikipedia.org
  <https://en.wikipedia.org/wiki/Xi_Jinping>
  Captured 2026-11-21.

- **Semafor** — @semafor, x.com, 2026-11-17
  <https://x.com/semafor/status/2122753256287830222>
  Captured 2026-11-21.

  > Hank Paulson tells @GinaChon he's had conversations with top leaders in China who "share a concern about the existential risk" from AI. "An op-ed I wrote went all the way up to the Politburo. I got an official response. I've never received that kind of treatment before."

- **Firing Line | Geoffrey Hinton | Season 2026** — pbs.org
  <https://pbs.org/video/geoffrey-hinton-biumi2>
  Captured 2026-11-21.

  > Nobel laureate Geoffrey Hinton warns of existential threats and discusses Nvidia's Jensen Huang.

- **Paul Christiano: Governing Transformative AI | The Hinton Lectures 2026 (Night 3)** — The Hinton Lectures™, youtube.com
  <https://youtube.com/watch?t=3293s&v=s0qUNvgFgHg>
  Captured 2026-11-21.

- **Shanghai hosts AI leaders ahead of WAIC_Latest** — english.shanghai.gov.cn
  <https://english.shanghai.gov.cn/en-WAICLatest/20250725/c4d39a5ec7d649d68c4a6d2ec6fd639b.html>
  Captured 2026-11-21.

  > Chen Jining met with leading experts attending the 2025 World AI Conference, including Geoffrey E. Hinton.

- **Chen Jining - Wikipedia** — en.wikipedia.org
  <https://en.wikipedia.org/wiki/Chen_Jining>
  Captured 2026-11-21.

- **Fact Sheet: President Donald J. Trump Advances a Fair and Reciprocal Relationship with China While Hosting Historic State Visit** — whitehouse.gov, 2026-09-26
  <https://whitehouse.gov/fact-sheets/2026/09/fact-sheet-president-donald-j-trump-advances-a-fair-and-reciprocal-relationship-with-china-while-hosting-historic-state-visit>
  Captured 2026-11-21.

  > DELIVERING FOR AMERICANS: This week, President Donald J. Trump and First Lady Melania Trump hosted President Xi Jinping and Madame Peng Liyuan of the

- **Canada PM pitches China on global AI board** — yahoo.com
  <https://yahoo.com/news/politics/articles/carney-pitches-china-global-ai-215812008.html>
  Captured 2026-11-21.

  > Mark Carney argues that any effort to manage risks must include countries developing the technology.

- **Trump leaves China after historic summit with Xi and Putin** — nbcnews.com
  <https://nbcnews.com/politics/trump-administration/live-blog/trump-xi-putin-china-apec-congress-2026-live-updates-rcna609888>
  Captured 2026-11-21.

  > Live updates and the latest news as Xi Jinping greets Donald Trump in China; APEC leaders, including Vladimir Putin, attend a welcome banquet; and U.S. House Democrats hold leadership elections.

- **Gabe Gutierrez** — @gabegutierrez, x.com, 2026-11-19
  <https://x.com/gabegutierrez/status/2123440629938290791>
  Captured 2026-11-21.

  > I asked President Trump about what specifically he spoke about with Xi, and he said they spoke about artificial intelligence, which he calls "super intelligence." Trump: “We spoke about SI, and we both agreed that we want, we're you know very much into SI, but we do think that having guardrails, you know, at least on a minimal basis is a positive thing.” I asked: “Minimal basis — what do you mean…

- **Kyle Chan** — @kyleichan, x.com, 2026-11-20
  <https://x.com/kyleichan/status/2123819364793159897>
  Captured 2026-11-21.

  > From the Chinese readout of the Trump-Xi meeting in Shenzhen, we just have a standard line on AI: “China and the US should strengthen communication and coordination to guard against AI safety risks and ensure that AI always remains under human control.”

- **Foresight for AGI Safety Strategy: Mitigating Risks and Identifying Golden Opportunities** — jacquesthibs, lesswrong.com, 2022-12-05
  <https://lesswrong.com/posts/GbXAeq6smRzmYRSQg/foresight-for-agi-safety-strategy-mitigating-risks-and>
  Captured 2026-08-28.

  > This post is about why I think we should use strategic foresight for AGI governance work. I am writing this without having read all the AGI governance / strategy reports and reading materials. I was planning on putting more effort into this post, but this is a better-than-nothing-at-all post. Worst-case, this might…

- **How Trump Should Approach AI Talks With China | Council on Foreign Relations** — cfr.org
  <https://cfr.org/articles/how-trump-should-approach-ai-talks-with-china-targeted-dialogue-maximum-pressure>
  Captured 2026-11-21.

  > At the upcoming Trump-Xi summit, Beijing will not negotiate in good faith on AI safety. A narrowly scoped dialogue paired with maximum pressure on export controls is the only way to shift Beijing’s calculus and secure long-term AI safety.

- **The Dream of AI Primacy | Julian Gewirtz** — Julian Gewirtz, nybooks.com
  <https://nybooks.com/articles/2026/11/05/the-dream-of-ai-primacy>
  Captured 2026-11-21.

  > The US drive to win the AI race against China now feeds a fantasy of permanent American dominance in global affairs.

- **What happens on the day the president fears AI will kill him? | Jeremie Harris (x-post from NonZero)** — 80,000 Hours, youtube.com
  <https://youtube.com/watch?t=4920s&v=YbBXIZtznpI>
  Captured 2026-11-21.

- **Opinion | Would China agree to slow AI development? That’s the wrong question** — scmp.com, 2026-10-06
  <https://scmp.com/opinion/world-opinion/article/3369561/would-china-agree-slow-ai-development-thats-wrong-question>
  Captured 2026-11-21.

  > Meaningful US-China action on frontier AI requires two things: a safe space for technical experts to collaborate and pressure on leading companies to act.

## Terms used

The author's own definitions for the glossary terms this piece uses. These are his words,
not a standard reference.

- **AGI** — Artificial general intelligence: a system with human level cognitive ability across domains rather than in one narrow task.
- **ASI** — Artificial superintelligence: a system that outperforms the best humans at essentially every cognitive task.
- **LLM** — Large language model: a neural network trained on very large amounts of text to predict what comes next.
- **RSI** — Recursive self improvement: a system improving its own capabilities, so that each improvement makes the next one easier.
  See also: <https://jacquesthibodeau.com/better-model-diffing-is-needed/>
