Advancing UK Aerospace, Defence, Security & Space Solutions Worldwide
  • Home
  • /
  • Security
  • /
  • NCSC chief warns security must come first with AI designs

Security

NCSC chief warns security must come first with AI designs

Lindy Cameron, CEO of the UK's National Cyber Security Centre (NCSC), today warned that security must be the primary consideration for developers of artificial intelligence (AI) in order to prevent designing systems that are vulnerable to attack.

Image courtesy NCSC

In a major speech, Lindy Cameron (above) highlighted the importance of security being baked into AI systems as they are developed and not as an afterthought. She also emphasised the actions that need to be taken by developers to protect individuals, businesses, and the wider economy from inadequately secure products.

Advertisement
ODU RT

Her comments were delivered to an audience at the influential Chatham House Cyber 2023 conference, which sees leading experts gather to discuss the role of cyber security in the global economy and the collaboration required to deliver an open and secure internet.

She said: “We cannot rely on our ability to retro-fit security into the technology in the years to come nor expect individual users to solely carry the burden of risk. We have to build in security as a core requirement as we develop the technology.

“Like our US counterparts and all of the Five Eyes security alliance, we advocate a ‘secure by design’ approach where vendors take more responsibility for embedding cyber security into their technologies, and their supply chains, from the outset. This will help society and organisations realise the benefits of AI advances but also help to build trust that AI is safe and secure to use.

“We know, from experience, that security can often be a secondary consideration when the pace of development is high.

“AI developers must predict possible attacks and identify ways to mitigate them. Failure to do so will risk designing vulnerabilities into future AI systems.”

The UK is a global leader in AI and has an AI sector that contributes £3.7 billion to the economy and employs 50,000 people. It will host the first ever summit on global AI Safety later this year to drive targeted, rapid, international action to develop the international guardrails needed for safe and responsible development of AI.

Advertisement
ODU RT

Reflecting on the National Cyber Security Centre’s role in helping to secure advancements in AI, she highlighted three key themes that her organisation is focused on. The first of these is to support organisations to understand the associated threats and how to mitigate against them. She said: “It’s vital that people and organisations using these technologies understand the cyber security risks – many of which are novel.

“For example, machine learning creates an entirely new category of attack: adversarial attacks. As machine learning is so heavily reliant on the data used for the training, if that data is manipulated, it creates potential for certain inputs to result in unintended behaviour, which adversaries can then exploit.

“And LLMs pose entirely different challenges. For example - an organisation's intellectual property or sensitive data may be at risk if their staff start submitting confidential information into LLM prompts.”

The second key theme Ms Cameron discussed was the need to maximise the benefits of AI to the cyber defence community. On the third, she emphasised the importance of understanding how our adversaries – whether they are hostile states or cyber criminals – are using AI and how they can be disrupted. She said: “We can be in no doubt that our adversaries will be seeking to exploit this new technology to enhance and advance their existing tradecraft.

“LLMs also present a significant opportunity for states and cyber criminals too. They lower barriers to entry for some attacks. For example, they make writing convincing spear-phishing emails much easier for foreign nationals without strong linguistic skills.”
 

Advertisement
Babcock LB
Beazley partners with Dryad Global on superyacht cybersecurity

Security

Beazley partners with Dryad Global on superyacht cybersecurity

4 November 2024

Dryad Global has joined forces with Beazley, who offer the first comprehensive cyber insurance policy for superyachts vessels. Dryad Global's superyacht clients will now benefit from premium discounts on Beazley's specialist yacht policy.

UK PM unveils investment to boost border security

Security Events

UK PM unveils investment to boost border security

4 November 2024

UK Prime Minister Sir Keir Starmer is set to announce an additional £75 million to boost border security and tackle criminal smuggling gangs, at the INTERPOL General Assembly in Glasgow today, bringing investment in Border Security Command over the next two years to £150 million.

UK satellite set to enhance maritime security

Security Space

UK satellite set to enhance maritime security

4 November 2024

The UK Space Agency has announced that a satellite developed by Horizon Technologies, has successfully completed its Critical Design Review (CDR) and is on schedule for launch in mid-2025.

Babcock completes deep maintenance of Lambeth River Station

Security

Babcock completes deep maintenance of Lambeth River Station

1 November 2024

Babcock has successfully completed a deep maintenance programme for the London Fire Brigade’s (LFB) Lambeth river station.

Advertisement
ADS S &P RT
Five Eyes launch shared security advice campaign for tech startups

Defence Security

Five Eyes launch shared security advice campaign for tech startups

1 November 2024

The Secure Innovation security guidance is being utilised across the Five Eyes intelligence partnership demonstrating the increased commitment between the nations involved.

Emergency services tackle fire at BAE Systems

Security Defence

Emergency services tackle fire at BAE Systems' Barrow-in-Furness site

30 October 2024

Cumbria Police and other emergency services have attended a fire at BAE Systems' Barrow-in-Furness site, which took hold in the early hours of this morning.

Advertisement
ADS S &P RT