Three LLMs, One App: Balancing Speed, Privacy, and Power
📚 Series Building a Knowledge Management App with Oracle AI Database 26ai Part 1 of 3 View all posts in this series → I spent a weekend fine-tuning a model for my knowledge management app, designed to handle notes, PDFs, and presentations with Oracle Database 23ai’s vector search (see my management AI post). It aced testing on my RTX 5090 server, but on my M2 MacBook Pro? Barely usable. A query like “Summarize last week’s customer meetings and identify risks” took over a minute, leaving me staring at a spinning wheel while my coffee got cold. ...