cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Caute_cautim
Community Champion

The Rise of Shadow AI: How Nation-States Undermine Trust in AI for Political Gain

Hi All

 

In the rapidly evolving world of artificial intelligence (AI), a new threat has emerged: shadow AI. Nation-states are increasingly employing various attack patterns to undermine trust in AI systems, targeting both end-users and developers for political purposes. This article explores the alarming rise of shadow AI and its far-reaching implications for the future of technology and international relations.

 

https://www.linkedin.com/pulse/rise-shadow-ai-how-nation-states-undermine-trust-gain-igor-van-gemert...

 

Regards

 

Caute_Cautim

 

 

2 Replies
leekimjd
Newcomer III

Without a doubt, nation state actors are a concern. But we also need to consider what's happening with the non-state actors as well. Are we ensuring that our systems are properly audited?

 

I think that there is a need for the regular review of our AI-enabled systems. If the intelligence is broken, we need to flag it and ensure that people in our organization know about it. AI is not perfect and indeed it can be vulnerable. But it will ultimately be human intelligence that will ensure that AI does not go off the track.

 

Lee Kim

ISC2 board of director candidate

Caute_cautim
Community Champion

@leekimjdI agree, but we need to go further than audits, we need to be actively testing both input and output of AI systems, as well putting in place AI Governance, Ethics and guardrails.  The issue of bias often comes up, from the data collected, the sources, take Meta for instance - Instagram, snap-chat, Facebook and various other means that millions of people have signed up too without realising the ramifications in later life or whether they plan to become politicians in the future etc.   Unfortunately, we also have many unethical organisations, who carry on on promoting, but at their base, they have already been compromised, due to the rush to get the solution out of the door etc.

 

Developers have bias inherently, in fact all humans have this built in from the upbringing, education, influences from many directions and many other factors too.  Humans are keen to embrace technology and change, but there are ramifications, which are not immediately known about.  For example Elon Musk Starlink satellites, with a five year life span in low Geo orbit, but apparently contain Aluminum Oxide, which upon re-entry into the Earth's atmosphere, cause Ozone holes.   

 

Commonsense, appears to have left the world, I only hope there is still some rational thought, without racing into a situation, we cannot withdraw from or avoid the consequences.

 

Regards

 

Caute_Cautim