I ask "what is TiDB" in the demo as suggested, and it takes 2 minutes to start responding in the midst of a multi-stage workflow with several steps each of graph retrieval, vector search, generation, and response combination.
Each of these is individually cool, but it strikes me as tragic that so much effort has been put into an intricate workflow and beautifully crafted UI only to culminate in a completely useless hello-world example, which after 5+ minutes of successive querying and response-building concludes with a network error.
I could use this to build exactly what I need...after stripping out 80% of the features to make it streamlined and responsive.
It appears to be much faster on more specific questions (like the ones that are suggested after you ask it "what is TiDB"). I got a response in about 40s on the question "How does TiDB's cloud-native design enhance its scalability and reliability compared to traditional MySQL databases?"
Also, what's wrong with a nice UI? It appears to mostly be components from https://ui.shadcn.com/. Is there something wrong with good frontend craft, especially for a demo where you're trying to sell something?
It seems like something that is being offered as a self-contained tool that's easy for end users to play with, which isn't going to be the minimal version. I'm sure you could build something that suits your needs exactly, but it would be hard for someone else to predict your exact needs, and there's a decent chance everyone needs or wants a slightly different set of features, and that those things may not make for the most ideal demo.
I am personally far from the typical profile of an AI booster, but I can't help but say something about what I feel is a middlebrow dismissal.
Is this wholly self-hostable? I'd be curious to run something like this on a home server, have some small model via ollama slowly chew through my documents / conversations / receipts / .... and provide a chat-like search engine over the whole mess.
Thanks a lot, this is the first time i saw a RAG using DSPy. I wanted to know about the expected cost. A few days ago fast graphrag compared their implementation with Microsoft:
> Using The Wizard of Oz, fast-graphrag costs $0.08 vs. graphrag $0.48 — a 6x costs saving that further improves with data size and number of insertions.
Many years ago there used to be a Firefox extension (..or might have even been a Mozilla one..) that would store all the pages I visit. I recall its name was Breadcrumbs but I could be misremembering. Space is cheap, or at least affordable if one would exclude videos, which are probably technically more difficult to archive anyway, but sometimes one remembers having seen content that is never to be found again.
I think it would be useful to have just a personal basic search engine on that kind of contents, but possibly a RAG or even a fine tuned LLM would be even cooler.
Actually, e.g. Firefox could do that at least for its bookmarks and tabs, though it already does provide the function for tagging bookmarks. And I think there's probably an extension for searching tabs' contents..
Not identical but I started building a smart bookmark tool that stores the content in vectors and sqlite dB and hosts them in GitHub issues with labels managed by the ai. Check it: https://undecidability.com and code lives at https://github.com/irthomasthomas/label-maker
It's a bit rough but there is a working cli. It uses local jina embeddings model but openai logprobs to determine when to create new labels.
The original version of read it later (now Mozilla owned Pocket) had that option. but then removed that option because it went against their commercial interests.
Pocket is good. I use it across all my devices, simple and works for me but do wonder if they could or should do more with the data they collect from me which is all the things I really care about.
Hi, this link is currently for demo purposes. With the help of StackVM, we can DEBUG a RAG retrieval flow step by step and reevaluate the retrieval plan.
It looked neat but relies on a cloud db called 'TIDB', I checked its repo out and it looks like you can self host that as well but damn - it's a lot of containers. So yeah looks like self hosting is an option but likely a pain in the ass.
Each of these is individually cool, but it strikes me as tragic that so much effort has been put into an intricate workflow and beautifully crafted UI only to culminate in a completely useless hello-world example, which after 5+ minutes of successive querying and response-building concludes with a network error.
I could use this to build exactly what I need...after stripping out 80% of the features to make it streamlined and responsive.
Why isn't that minimal version the default?
reply