<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body bgcolor=white lang=EN-GB link="#0563C1" vlink="#954F72"><div class=WordSection1><pre>> Put them together, and the nightmare scenario is:<o:p></o:p></pre><pre>> - machine learning algorithm detects need for more resources<o:p></o:p></pre><pre><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'>All good so far<o:p></o:p></span></pre><pre><o:p> </o:p></pre><pre>> - machine learning algorithm makes use of vulnerability analysis library <o:p></o:p></pre><pre>> to find other systems with resources to spare, and starts attaching<o:p></o:p></pre><pre>> those resources<o:p></o:p></pre><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'>Right so a company would built, trained and fine-tuned an AI, or would have bought such a product and implemented it as part of its NMS/DDoS mitigation suite, to do the above? <o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'>What is the probability of anyone thinking that to be a good idea?<o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'>To me that does sound like an AI based virus rather than a tool one would want to develop or buy from a third party and then integrate into the day to day operations.<o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'>You can’t take for instance alpha-0 or GPT-3 and make it do the above. You’d have to train it to do so over millions of examples and trials. <o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'>Oh and also these won’t “wake up” one day and “think” to themselves oh I’m fed up with Atari games I’m going to learn myself some chess and then do some reading on wiki about the chess rules. <o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'> <o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'> <o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'>adam<o:p></o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:windowtext;mso-fareast-language:EN-US'><o:p> </o:p></span></p><div style='border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt'><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span lang=EN-US style='color:windowtext'>From:</span></b><span lang=EN-US style='color:windowtext'> NANOG <nanog-bounces+adamv0025=netconsultings.com@nanog.org> <b>On Behalf Of </b>Miles Fidelman<br><b>Sent:</b> Wednesday, December 9, 2020 7:07 PM<br><b>To:</b> NANOG <nanog@nanog.org><br><b>Subject:</b> The Real AI Threat?<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Hi Folks,<o:p></o:p></p><pre>It occurs to me that network & systems admins are the the folks who really have to worry about AI threats.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>After watching yet another AI takes over the world show - you know, the <o:p></o:p></pre><pre>same general theme, AI wipes out humans to preserve its existence - it <o:p></o:p></pre><pre>occurred to me:<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Perhaps the real AI threat is "self-healing systems" gone wild. Consider:<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>- automated system management<o:p></o:p></pre><pre>- automated load management<o:p></o:p></pre><pre>- automated resource management - spin up more instances of <whatever> <o:p></o:p></pre><pre>as necessary<o:p></o:p></pre><pre>- automated threat detection & response<o:p></o:p></pre><pre>- automated vulnerability analysis & response<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Put them together, and the nightmare scenario is:<o:p></o:p></pre><pre>- machine learning algorithm detects need for more resources<o:p></o:p></pre><pre>- machine learning algorithm makes use of vulnerability analysis library <o:p></o:p></pre><pre>to find other systems with resources to spare, and starts attaching <o:p></o:p></pre><pre>those resources<o:p></o:p></pre><pre>- unbounded demand for more resources<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Kind of what spambots have done to the global email system.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>"For Homo Sapiens, the telephone bell had tolled."<o:p></o:p></pre><pre>(Dial F for Frankenstein, Arthur C. Clarke)<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>I think I need to start putting whisky in my morning coffee. And maybe not thinking <o:p></o:p></pre><pre>about NOT replacing third shift with AI tools.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Miles Fidelman<o:p></o:p></pre><pre>-- <o:p></o:p></pre><pre>In theory, there is no difference between theory and practice.<o:p></o:p></pre><pre>In practice, there is. .... Yogi Berra<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Theory is when you know everything but nothing works. <o:p></o:p></pre><pre>Practice is when everything works but no one knows why. <o:p></o:p></pre><pre>In our lab, theory and practice are combined: <o:p></o:p></pre><pre>nothing works and no one knows why. ... unknown<o:p></o:p></pre></div></div></body></html>