Science & Tech · AI · 1 hr ago

A writer uses local AI to work with private documents

A writer uses local AI to work with private documents

A technology writer describes setting up a local AI model to read personal documents such as insurance policies and bank statements.

They use LM Studio, which can attach PDFs, Word documents and text files to a chat.

To let the model search files in folders, they use a filesystem tool connected through the MCP standard.

The writer says models need to be able to use tools, or they may guess what a file contains without opening it.

Keeping the work on a local setup can avoid sending private files to cloud services such as Google, Anthropic or OpenAI.

The writer has found Qwen 3.5 9B and Qwythos 9B v2 reliable for this work, and says newer, larger Qwen models may suit computers that can run them.

1 source

Related

What people are saying

NolenWriter
Every chatbot conversation starts from zero.
via XDA
A weaker one just guesses what's in a file without opening it.
via XDA