top of page

Understanding the Benefits and Limitations of ChatGPT in Security Analysis

As the world becomes increasingly reliant on technology, cybersecurity has become more crucial than ever before. With the rise of cybercrime, there has been a need for advanced and innovative technologies to help combat it. One such technology that has been gaining interest in the cybersecurity field is ChatGPT, the large language model developed by OpenAI.

ChatGPT is an artificial intelligence (AI) model that is designed to understand and generate human-like text. It has been trained on vast amounts of data, including books, articles, and websites, to understand the context and nuances of language. The model has demonstrated success in various areas, including incident response triage and software vulnerability discovery, making it a promising tool in the security analysis field.

However, it is essential to understand the benefits and limitations of ChatGPT when using it for security analysis. Recent experiments conducted by security researchers and hackers have revealed that while ChatGPT has significant potential, it also has its limitations.

For instance, a recent analysis by Kaspersky's incident response team lead, Victor Sergeev, found that ChatGPT was successful in identifying malicious processes running on compromised systems. The model accurately identified two malicious processes while ignoring 137 benign processes. This suggests that ChatGPT could be useful in identifying suspicious service installations and collecting metadata and indicators of compromise from a system.

Another experiment conducted by digital forensics firm Cado Security used ChatGPT to create a timeline of a compromise using JSON data from an incident, which produced a good but not entirely accurate report. Similarly, NCC Group experimented with ChatGPT to find vulnerabilities in code, which it did but not always accurately.

These experiments show that while ChatGPT has demonstrated success in various areas, it is not perfect and may produce false positives and false negatives. This means that security analysts, developers, and reverse engineers need to take care when using LLMs, especially for tasks outside the scope of their capabilities. It is essential to note that security code review is not a task we should be using ChatGPT for, and it is unfair to expect it to be perfect the first time.

Furthermore, when using ChatGPT, privacy and legal concerns must be considered. Companies need to determine whether submitting indicators of compromise or software code for analysis violates their intellectual property or exposes sensitive data. In addition, by using these scripts, you send data, including sensitive data, to OpenAI, so be careful and consult the system guidelines.

ChatGPT is a promising tool in the security analysis field, and its potential benefits are vast. However, it is crucial to understand its limitations, and analysts need to take care when using it. By exploring ChatGPT and similar models, we can gain inspiration for innovative and advanced security analysis techniques, but we should not rely on it entirely for accurate, factual results.

For more on how we can securely implement AI into your business - or for other technical solutions: Call us at (210) 538-3669, email us at, or click on the link to call us directly at

BVTech LLC Knows AI
BVTech LLC Knows AI

6 views0 comments
bottom of page