Following the advent of ChatGPT by OpenAI, the uptake rate and popularity of this technology has surged and continues to rise exponentially to this date. The resulting paradigm shifts have already been reflected in multiple facets of our lives; ranging from the ways we work to switching our default go-to source of information to answer day-to-day questions. While the masses are fawning over the convenience ChatGPT has brought about, there is also the other side of the coin which the mainstream media is seemingly under-reporting — “What happens during a power outage?”, “What if there is no internet connection at the workplace?” or “Would data privacy be compromised?” etc.

Applying this to the real-world context, this is extremely relevant since it is a known fact that workers in high-security settings such as healthcare and military defence have to carry out much of their work with little to no network access.

This is simply because the risks of any unwanted data leakage (e.g. patient health data) are risks which cannot be afforded in these high-stakes settings. In turn, this then naturally begs the question of “Is ChatGPT or other technologies alike off-limits to members of this group?”

In short, the answer is no since fortunately, the open-source community has created alternatives with comparable performance. More specifically, a category known as “Offline ChatGPT” has emerged amidst ongoing competition among commercial and open-source rivals.

Project Motivation

Running ChatGPT Offline On Local PC

Increased reliability leads to greater potential liability.

Apart from the aforementioned target audiences, it is also worth noting that similar to Google…