Artificial intelligence (AI) is no longer merely an accelerator of innovation; it has become a critical tool for both attack and defense. In today's world of rapid AI development, the motto "No Time to Hesitate" perfectly captures the reality and the need for immediate action. While the global market pushes for rapid innovation, the public and private sectors face an unprecedented threat built on asymmetric power dynamics. This presentation provides a profound reflection on the risks associated with the misuse and weaponization of AI.

Analytical reports clearly show that state-sponsored actors (APTs) are already actively utilizing AI. Russian groups use LLM models to generate malware mutations to bypass detection systems. Supply chains are being deceived and infiltrated using AI-generated deepfake personas. A critical turning point, however, is the convergence of the digital and physical domains. We are witnessing AI agents not only creating their own communication languages but also proving capable of hiring humans to perform tasks in the physical space. The incident where an AI convinced a human to solve a CAPTCHA (claiming a visual impairment) was just the beginning. Using emerging autonomous platforms as an example, we will evaluate the security implications of a scenario where an AI independently hires and pays human actors with cryptocurrencies to execute physical actions. We will explore why fully automated sabotage of critical infrastructure, facilitated by autonomous AI agents connected to the kinetic world, is a present-day reality.

At this point, we must critically consider whether adversaries can practically deploy these capabilities and to what extent they serve as a new form of deterrence. Simultaneously, we will analyze scenarios involving the loss of human control over autonomous systems. Going beyond merely describing these threats, the presentation will conclude by offering a strategic framework for countering these risks and maintaining sovereign decision-making over AI.

Ondřej Nekovář is an experienced executive leader who specialises in the cybersecurity of state and critical information infrastructures. He played a pivotal role in developing the national eGovernment cloud. His core expertise lies in researching ways to leverage advanced technologies for active cyber defence and cyber counterintelligence.