Field Trips Anywhere
CHO(HAN)Haejoang
Field Trips Anywhere
CHO(HAN)Haejoang

AI 실험을 잠시 멈추자는 공개서한

조한 2023.03.31 09:04 조회수 : 428

라이프 3.0을 썼던 맥스 태그마크가 주도하는 선언문. 
AI실험의 속도를 늦추자, 6개월이라도 숨고르고 상황 분석하면서 가자고.
석유 석탄보다 더 큰 돈이 달라붙어서 폭주하는 중이라 불가능할 것 같다고들 하지만 일단 꿈틀거리기라도 해야지.
 

AI systems with human-competitive intelligence can pose profound risks to society and humanity, as shown by extensive research[1] and acknowledged by top AI labs.[2] As stated in the widely-endorsed Asilomar AI PrinciplesAdvanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. Unfortunately, this level of planning and management is not happening, even though recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control.

Contemporary AI systems are now becoming human-competitive at general tasks,[3] and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization? Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable. This confidence must be well justified and increase with the magnitude of a system's potential effects. OpenAI's recent statement regarding artificial general intelligence, states that "At some point, it may be important to get independent review before starting to train future systems, and for the most advanced efforts to agree to limit the rate of growth of compute used for creating new models." We agree. That point is now.

Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.

AI labs and independent experts should use this pause to jointly develop and implement a set of shared safety protocols for advanced AI design and development that are rigorously audited and overseen by independent outside experts. These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt.[4] This does not mean a pause on AI development in general, merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.

AI research and development should be refocused on making today's powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal.

In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems. These should at a minimum include: new and capable regulatory authorities dedicated to AI; oversight and tracking of highly capable AI systems and large pools of computational capability; provenance and watermarking systems to help distinguish real from synthetic and to track model leaks; a robust auditing and certification ecosystem; liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions (especially to democracy) that AI will cause.

Humanity can enjoy a flourishing future with AI. Having succeeded in creating powerful AI systems, we can now enjoy an "AI summer" in which we reap the rewards, engineer these systems for the clear benefit of all, and give society a chance to adapt. Society has hit pause on other technologies with potentially catastrophic effects on society.[5]  We can do so here. Let's enjoy a long AI summer, not rush unprepared into a fall.

 
 
 
 
목록 제목 날짜
472 지관서가 1강 엄기호 녹화버전 2024.03.04
471 지관서가 3월 강사 정희진 file 2024.03.04
470 지관서가 강좌 시간과 장소 file 2024.03.04
469 지관서가 2강 장동선 인트로와 다섯가지 질문 노트 file 2024.03.04
468 플라톤 아카데미 1강 카드 뉴스 김남규 file 2024.03.04
467 인간 삶의 취약성과 상호 연결성에 대하여 2024.03.04
466 지관서가 김남규 님이 보낸 삽화 2024.03.04
465 4회 인권 축제 축사를 쓰다 말았다. 2024.03.24
464 인권축제 축하글 2024.03.24
463 이번 주 상경해서 본 영화 - 근대, 영화 감독, 그리고 희생자들 2024.03.24
462 지관서가 세번째 정희진 소개 2024.03.30
461 윤석남 86세, 여전히 씩씩한 화백 2024.04.15
460 기후 돌봄 Climate Care 2024.04.15
459 조민아 바이러스와 한국교회 file 2024.04.18
458 추천의 글 <기후 돌봄> 석 줄 2024.04.20
457 신윤경 컬럼 한라일보 4/24 2024.04.25
456 소크라테스와 제자들, 예수, 그리고 축의 시대 2024.05.20
455 여성학회 40주년 기념 축하 글 file 2024.06.10
454 정성숙 모내기 하는 날 창비 주간 논평에서 2024.07.03
453 저는 오늘 꽃을 받았어요. 2024.07.03
452 조한의 말 구체성 상황적 진리, 푹 쉬고 소동 2024.07.03
451 인류세 관련 정리가 잘 된 글 2024.07.10
450 <인류학으로 보는 SF> 추천의 글 2024.07.12
449 <지금 여기 함께 있다는 것> 퍼거슨 2024.07.18
448 <지금 여기 함께 있다는 것> 조문명 해제 중 2024.07.18
447 세상의 끝에서 춤추다. (어슐러 르 귄) 2024.07.25
446 르 귄 SF와 미래 (세상 끝에서 춤추다) 2024.07.25
445 낸시 프레이저 좌파의 길 식인 자본주의 2024.08.11
444 퍼펙트 데이즈와 빔 벤더스 2024.09.11
443 9/2-9/9 바쁜 서울 일정 중 영화 2024.09.11
442 할머니 교회 창립 95주년 기념하는 글 2024.09.11
441 세계 민주주의의 날 발표문 file 2024.09.11
440 세계 민주주의의 날 톡 콘서트 티저 그리고 발표ppt file 2024.09.11
439 정경일의 글을 읽다 요약해본 것 2024.09.11
438 선악의 기원 2024.09.13
437 안병무론 현존 2024.10.05
436 김진호 안병무 오클로스론의 현재성 2024.10.05
435 새로운 학교 강원 네트워크 플레이리스트 2024.11.08
434 새로운 학교, 교사들의 즐거운 시작 file 2024.11.08
433 강원네트워크 2024.11.08