信息通信技术与政策

信息通信技术与政策

信息通信技术与政策 ›› 2025, Vol. 51 ›› Issue (1): 10-19.doi: 10.12267/j.issn.2096-5931.2025.01.002

专题:网络安全 上一篇    下一篇

生成式人工智能大模型的安全挑战与治理路径研究

Research on security challenges and governance path of generative artificial intelligence big model

徐明   

  1. 中国电科太极计算机股份有限公司,北京 100012
  • 收稿日期:2024-12-10 出版日期:2025-01-25 发布日期:2025-02-14
  • 作者简介:
    徐明, 中国电科太极计算机股份有限公司数字政府集团业务发展事业部资深项目经理,高级工程师,主要从事数字政府以及人工智能在政府数字化转型方面的研究工作

XU Ming   

  1. CETC Taiji Computer Co., Ltd., Beijing 100012, China
  • Received:2024-12-10 Online:2025-01-25 Published:2025-02-14

摘要:

生成式人工智能(Generative Artificial Intelligence,GAI)大模型深刻地影响着信息传播、内容创作和社会互动等领域,也带来数据隐私泄露、虚假内容生成和知识产权保护等一系列安全挑战。通过探究GAI在当前阶段的安全风险和相应的治理策略,以期为该技术的持续健康发展提供借鉴。首先分析了GAI技术发展引致的各种安全挑战。其次探讨了GAI典型安全问题,包括数据安全和隐私、模型滥用、算法稳定性以及GAI技术在文本生成、图像识别等方面存在可被恶意攻击的成因。最后探讨建立多层次的GAI安全治理框架,包括技术层、组织层和社会层以及安全可控可靠的治理策略和具体的治理路径,通过政府监管部门、人工智能企业、学术界以及公众等多方协同治理,提高全社会对GAI安全的认知和应对能力。

关键词: 生成式人工智能, 数据隐私, 虚假内容监管, 技术治理路径, 安全评价体系

Abstract:

The Generative Artificial Intelligence (GAI) model profoundly affects fields such as information dissemination, content creation, and social interaction, but also brings a series of security challenges such as data privacy breaches, false content generation, and intellectual property protection. By exploring the security risks and corresponding governance strategies of GAI at the current stage, this paper hopes to provide reference for the sustainable and healthy development of this technology. Firstly, this paper analyzes various security challenges caused by the development of GAI technology. Secondly, this paper discusses typical security issues of GAI, including data security and privacy, model abuse, algorithm stability, and the reasons why GAI technology can be maliciously attacked in text generation, image recognition, and other areas. Finally, this paper explores the establishment of a multi-level GAI security governance framework, including technical, organizational, and social layers, as well as secure, controllable, and reliable governance strategies and specific governance paths. Through collaborative governance by artificial intelligence enterprises, academia, government regulatory departments, and the public, this paper aims to enhance the overall society’s awareness and response capabilities to GAI security.

Key words: generative artificial intelligence, data privacy, false content regulation, technological governance approaches, security assessment framework

中图分类号: