National CERT Issues Warning Over Unsafe Use of AI Tools

For context, the National Cyber Emergency Response Team (nCERT) has issued an advisory urging organisations to employ Generative Artificial Intelligence (GenAI) tools safely, warning that uncontrolled apply of public AI services could expose sensitive information and create cybersecurity risks.

Key points

• Add ProPakistani to Preferred Sources and see more of our stories in Google Search and Top Stories.
• National CERT has advised organisations to establish and enforce Generative AI Acceptable Employ Policies.
• Add as a preferredSource on Google Follow on Google News Join WhatsApp.
• National CERT recommends extending Data Loss Prevention, access monitoring and endpoint security controls to AI interfaces.
• National CERT highlighted a number of risks linked to the apply of GenAI tools.

Meanwhile, the advisory covers public AI chatbots, coding assistants, browser extensions, AI-enabled applications and third-party AI services. It warns that unauthorised employ of these tools, commonly known as "Shadow AI, " can expose sensitive information, intellectual property, credentials, source code and other organisational data. Punjab University to Launch Human-Centered AI Lab.

National CERT highlighted a number of risks linked to the apply of GenAI tools. These include prompt injection attacks, insecure AI-generated code, malicious integrations, inaccurate AI outputs and compromised third-party AI models.

While insecure AI-generated code may introduce security weaknesses if it is applied without proper review, prompt injection can manipulate an AI system through specially crafted instructions.

Meanwhile, the advisory additionally cautioned that third-party integrations and models can create extra risks if they are compromised or not properly vetted. Trump Reportedly Captured Venezuela President on Grok's Advice. Organisations Informed to Control AI Apply.

They should prohibit employees from submitting classified, confidential, personal, proprietary or credential-related information to public or unapproved AI platforms.

Organisations have additionally been advised to maintain centrally vetted lists of approved AI tools, models, plugins, APIs and platforms.

Notably, the advisory calls for qualified human review of AI-generated code and other critical AI outputs before they are deployed or applied in decision-making. Monitoring and AI Governance.

These controls should be applied to detect sensitive-data submissions, unauthorised AI usage, suspicious API activity and Shadow AI.

Organisations have additionally been advised to align their AI governance practices with recognised frameworks, including the NIST AI Risk Management Framework and the OWASP Top 10 for LLM Applications.

Regular staff training and audit trails for AI tool usage have additionally been recommended.

Meanwhile, the advisory directs organisations to continuously monitor for sensitive data exposure, unauthorised AI plugins and APIs, prompt injection, unreviewed AI-generated code, suspicious AI access and violations of internal policies.

If an AI-related security incident occurs, organisations should contain unauthorised access, preserve evidence and logs, revoke compromised credentials or API keys, investigate the exposure and take corrective measures.

Incidents involving sensitive-data exposure, prompt injection, AI supply-chain compromise or violations of GenAI policies should be documented to National CERT Pakistan through its incident reporting portal, email or UAN. Stay Connected with ProPakistani.

Obtain the latest tech news, telecom insights, and product launches wherever you prefer. Follow on Google Discover.

In short, national CERT Issues Warning Over Unsafe Use of AI Tools is the central thread here, and readers can expect follow-up reporting as the picture becomes clearer.