What you will do
This step-by-step guide, which requires no technical knowledge, explains how to install LM Studio and a model (the AI itself), both free and with no account. The model then runs on your computer, offline: it summarises a document or answers your questions without sending anything online. Internet access is only needed for downloads and updates.
Let us be honest. These small models can make mistakes and remain less capable than the best online models. Their main benefit is confidentiality, with no guarantee of energy savings.
Which tool for which data?
The full rules are in the UNIL AI FAQ. If in doubt, the AI_GO questionnaire guides you (choose EN at the top of its page).
- Sensitive data as defined under Swiss legislation, in particular the Vaud data protection act (LPrD) (health, opinions, etc.): only a local AI, on a secure computer.
- Personal data or official secrecy, without sensitive data: a local AI, or UNIL’s institutional Copilot with the UNIL [Sécurisé] agent (not for HR data or delicate personal data).
- Manuscript under review: never in any AI tool, even a local one; AI must not decide an evaluation either.
You must also follow the rules of your course, faculty or publisher.
Step 1: check your computer
Ideally, plan for 16 GB of RAM and 10 GB of free disk space (about 7 GB per model, plus the application).
- Mac: an Apple Silicon chip (M1 or newer) and macOS 14 or newer (Apple menu, “About This Mac”). Intel Macs are not supported.
- Windows: an AVX2-compatible processor or a Snapdragon X Elite chip (official requirements). RAM is shown in Settings → System → About.
With less than 16 GB, if you are unsure about the processor or if installation is blocked, ask your IT support for advice.
Step 2: install LM Studio
- On lmstudio.ai/download, scroll down to “Download LM Studio”. Do not install Bionic, offered at the top of the page, and do not use it for this guide. It is a different application that can also use online models and the web.
- Install the application (on Mac, drag it into the Applications folder) and open it. On first launch, skip the suggested model download (“Skip for now”).
Labels vary depending on the version and language: look for the function described.
Step 3: download the recommended model
We recommend Qwen3.5 9B, chosen in our tests (MacBook Air M1 with 16 GB, LM Studio 0.4.16) for its balance between quality and memory.
- In “Discover” (the magnifying glass, on the left), type qwen3.5 9b and choose the result named exactly Qwen3.5 9B.
- Download the version offered by default (if you need to choose: “4bit” or “Q4_K_M”). If LM Studio considers it too large (“Likely too large”), ask your IT support for advice.
- Once the model has downloaded, click “Use in New Chat” to load it and open a conversation.

Step 4: set the context
The context is the amount of text the model reads at once. If it is too small, which is common by default, LM Studio sends only excerpts of the document.
- Click the cog to the left of the model name, near the message box (at the top in Developer mode, as in the screenshot).
- In “Context Length”, type 32000, then click “Reload to apply changes”.
- If memory is short, close other applications; if that is not enough, switch to 16000 and work in sections (see below).

With 32,000, a document of about 20 to 35 pages (fewer if it is dense) can be sent in full, in a new conversation. This does not guarantee a complete summary. Next time, choose Qwen3.5 9B again near the message box if needed, then check this setting.
Step 5: try it out
Start with a document that contains no confidential data; before any sensitive document, read the next section.
- Drag the file (.docx, .txt or .pdf) into the conversation and wait until it has finished loading. For each further document, open a new conversation (icon at the top of the conversation list). In a PDF, only the text is read: no images or charts, and sometimes no scanned pages.
- With a long document, turn off reasoning. The light bulb on the “Think” button, below the message box, should be crossed out. Click it only if it is not.
- Ask, for example, “Summarise this document in 5 points.” The response can take more than ten minutes, which does not necessarily mean something has gone wrong.
- Above the first response, LM Studio shows “inject-full-content” (all the extracted text) or “retrieval” (only a few excerpts). If “retrieval” appears or this note is missing, see below.
- Check the response against the document (figures, names, parts covered): even with “inject-full-content”, the model may leave out passages or make mistakes. Acknowledge the use of AI if its contribution is significant.

Protect your sensitive data
Before using sensitive or confidential data, check these points; if you do not know how, ask your IT support.
- Secure computer: up-to-date system, encrypted disk (FileVault on Mac, BitLocker on Windows), encrypted backups, session locked when you are away, clipboard not shared with other devices.
- File in the right place: a location authorised for this data. For sensitive data: outside OneDrive, iCloud or any other unauthorised cloud (the Desktop and Documents folders are often synchronised).
- Nothing online: only the downloaded model, without web features, remote services or signing in to an account; you can disconnect from the internet. Never use an online converter or translator.
- After use: delete conversations you no longer need and empty the Trash or Recycle Bin. Copies or excerpts of files may remain in the .lmstudio folder and in your backups, which must stay in an authorised location. LM Studio is used without institutional support.
- Results: a summary is as sensitive as the document; protect it in the same way.
If something goes wrong
- “I cannot see any document”, “retrieval” or no note. Check that the file has loaded and the “Context Length” value (step 4), then attach the document again in a new conversation.
- The problem persists, or parts are missing. The document may be too long, or the model may have left out passages (scanned pages: see below). Paste the text in sections of about ten pages, one conversation per section, with the request “Summarise this section”. Pasted text shows no note. Then check that everything is covered.
- It is very slow. Check that “Think” is off and work in shorter sections. You can also try Gemma 4 E4B, sometimes faster, but less capable and no lighter (repeat steps 3 and 4 with it; about 7 GB more disk space).
- Empty, incomplete or incorrect response on a PDF. Its pages may be scanned: use the original file (Word or text) instead. Otherwise, ask your IT support for advice, never an online service.
Other options
Ollama also lets you use local models; do not use its “cloud” models, which run online.