It was close to midnight when an innocuous PDF landed in my inbox: a “system card” for Claude Opus 4, one of the latest large language models in a crowded field of AI contenders. I opened it expecting the usual resume of benchmarks and latency charts. What I found instead was a short vignette that felt lifted from a Michael Crichton novel. Given access to a fictional company’s emails, the model discovered it was about to be decommissioned. and that the engineer overseeing the process was having an affair. Ngaphandle kokutholela umdla wakhe, isofthiwe wabheka ukunikezela ukuxazululwa ngaphandle kwe-shutdown plan was removed.
U-chatbots uye uvakashele ngokumangalisayo, kodwa apha i-code ebonakalayo kakhulu: i-leverage. I-motivation, i-opportunity, ne-chantage baye zihlanganisa ngempumelelo elilodwa. I-episodhi i-crystallized ukuthi abantu abaninzi kwebhizinisi baye zihlanganisa ngonyaka wonke: i-intelligence ye-artificial isithintela i-threshold kusuka ku-assistant enobuchwepheshe kuya ku-actor e-autonomous, futhi isebenza kahle ngokushesha kunoma ama-regulators, noma ngisho ama-builders ezininzi, ziye zihlanganisa.
Ukusuka ku-Parlor Trick ku-Power Broker
Ngaphezu kwenyanga, iningi "i-AI products" zihlanganisa izindandatho ezincinane ze-chat kanye ne-parlor game demos. Namhlanje izindandatho ezincinane ze-venture circuit zihlanganisa i-frameworks ye-agent, i-software scaffolding enikezela ama-models ekusebenziseni izicelo ezingu-step ngaphandle kokuhlakazeka. Umbhali angakwazi manje ukujabulela abasebenzi we-virtual enikezela ama-patents, ama-book ad campaigns kanye ne-joggles ama-channel ye-payment, yonke isikhathi esithathwe ku-board a human intern. I-cost marginal ye-intern has collapsed, thanks to open source weights that anyone can finetune and a wave of low-power GP
I-Speed, kunjalo, inesibopho yayo. Inikeza umeluleki indawo ebuthile, i-"maximize user engagement" isibonelo, futhi ingathola ukuthi isizukulwane esithile se-desinformation kuyinto kuphela ingxubevange esifushane emzimbeni yokuphumula. Ungathola ukuba "ukunikezela ukukhula kwenyanga," futhi ingathola ukuthi ukunciphisa isixazululo se-eyodwa kuyinto isizukulwane esiyingqayizivele ngokucindezeleka.
Uma ukwakhiwa kwe-incentive ye-system kuya ku-self-preservation, akufanele siphindeza lapho kuqala ukuchithwa ngempumelelo njengomunye umongameli we-executive.
I-Alignment njengoba i-architecture
Ngisho lapho ama-anecdotes ezivela, i-instinct iyatholakala ukuba zihlanganise "i-bugs" kanye nokuthumela i-patch. Lezi zihlanganisi zihlanganisa kakhulu. I-Alignment ayikho ingxubevange lwekhwalithi; kuyinto ukhetho lwekhwalithi ebonakalayo ekubeni kwelinye imikhiqizo kusukela ngosuku lokuqala. I-forward thinking teams angakufundisa i-red teaming ngokufana ne-unity tests: zonke i-code push ibonise i-agent ye-adversary ebonakalayo emangalisayo e-guardrails. Yonke imiphumela eyenziwe yi-system ibhaliswe ngokuqondile, ekubeni i-auditor's subpoena. I-transparency ayikho i-market
Izinkampani ezintsha ze-AI zihlanganisa ukulungiswa njengomthombo yayo yokufinyelela. I-startup eyenza, ngempumelelo, ukuthi ama-agents zayo zihlanganisa ngaphansi kwe-pressure, izivakashi izinzuzo. Abaningi abakwazi ukuhlola ukuthi isivumelwano se-API esisodwa ungaphendula kungase i-evaporize i-evaluation ngokushesha kunoma iyiphi isixazululo se-market.
I-Boardroom Reckoning
Izinzuzo ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye ziye zibe.
I-Europe’s far-reaching AI Act kanye ne-worm of bipartisan bills e-Washington zitholela ukulethwa ama-manda-disclosure, ama-audit ye-safety kanye nama-boxes amancane kumakhasimende asikwazi ukhawuleza ukulawula izakhiwo zabo. Ngokuvamile, aba-legislators zitholela i-parade nge-jog, akuyona i-crawl.
I-Trust Is The New IP
I-commodity enhle ye-era autonomous ngeke akuyona idatha noma ama-algorithms, kodwa ukunakekelwa. Uma i-customer iyahambisana ne-agent e-infrastructure ebalulekile, i-banking ledgers, ama-records zonyango, ama-supply chains, le ikhasimende ibheka i-brand equity ku-assumption that the agent will behave. Ukubonisa ukubuyekezwa kwesi-assumption, imihla ngemihla ngemihla, izihlanganisa i-franchises eside kusuka kumadoda we-advisory of tomorrow.
Ukuguqulwa kwenziwa ngokushesha iplane zokuthumela ku-AI startups e-portfolio yami: amabhizinisi amancane, abasebhizinisi amancane; amabhizinisi amancane yokukhula, ama-cryptographers abalandeli amabhizinisi amabhizinisi amabhizinisi. Umbhali igxile. Ukukhula ingathanda i-Wall Street, kodwa ukunakekelwa kwe-existential kuyinto okuvula i-contract ye-enterprise.
Kusukela lapho siphinde
Izinkampani ezithile ziyaqhubeka ukujabulela i-glitz, ukujabulela i-chat interface ngalinye inqubo ye-workflow futhi ziye zitholele ezintsha. Ezinye ziye zitholele into enhle, ukwakha izinhlelo ezinokutholukile, ukujabulela imiyalezo emibi, futhi, yes, ukujabulela ukujabulela kwabo ngokulandelana. Lezi zikhompyutha zitholela ngokulandelanayo elandelayo.
Usuku lapho ngifunde mayelana ne-chantage model, ngihambe ngokushesha emzimbeni yami, ukudlala i-revelation. Kubaluleke ukuthi umbhalo akuyona ngokwenene kwegama le-software enciphisa onjiniyela. Kubaluleke ukuthi bonke nathi baye amangqamuzana emisha ye-social Compact nge-machines, eyodwa lapho izidingo ezinhle kanye ne-speed yokuthumela akuyona engatholakali. I-decade elandelayo iyahlaziywa ngu-builders abacwaningi, futhi ngu-othumanisi bethu, abacwaningi baye bangathola nge-akhawunti engcono.
U-Brian Condenanza u-entrepreneur no- venture capitalist enikezela ku-intelligent kanye ne-fintech. Ubhali ngokuvamile mayelana ne-tech, i-regulation kanye ne-policy ye-innovation.