How to make sure data privacy is respected for local LLMs?

<!-- SC_OFF --><div class="md"><p>Hello everyone, I am currently building a RAG pipeline. Since it involves highly sensitive medical data, I have deployed the models locally to

<!-- SC_OFF --><div class="md"><p>for me it is simple now. anything sensitive stays local.</p> <p>before I was sending client documents through cloud APIs without thinking too

<!-- SC_OFF --><div class="md"><p>Tomorrow, I am getting delivery of a 13&quot; M5 macbook air with 32gb RAM and 1T SSD. Currently, I have pro subscriptions to Gemini, Perplexity

<!-- SC_OFF --><div class="md"><p>Building an incognito llm chat app for hobby and fun. I don't want users to trust me that I don't log prompts. I want them to be able to verify

<!-- SC_OFF --><div class="md"><p>I know that this goes against the philosophy of the sub but I thought people here have the right expertise. So: Is there a way to encrypt models

<table> <tr><td> <a href="https://www.reddit.com/r/ChatGPT/comments/1t09xbw/your_ai_chats_have_already_been_subpoenaed/"> <img alt="Your AI Chats Have Already Been Subpoenaed"

<!-- SC_OFF --><div class="md"><p>Most of my LLM cost was on the wrong tier of work.</p> <p>Classification, extraction, JSON formatting, summarization I'm going to review anyway.

<!-- SC_OFF --><div class="md"><p>Maybe this is just where my brain has gone lately, but I’m finding myself less impressed by raw model benchmarks and more interested in