this post was submitted on 10 Jul 2023
28 points (100.0% liked)

Actually Useful AI

1999 readers
7 users here now

Welcome! ๐Ÿค–

Our community focuses on programming-oriented, hype-free discussion of Artificial Intelligence (AI) topics. We aim to curate content that truly contributes to the understanding and practical application of AI, making it, as the name suggests, "actually useful" for developers and enthusiasts alike.

Be an active member! ๐Ÿ””

We highly value participation in our community. Whether it's asking questions, sharing insights, or sparking new discussions, your engagement helps us all grow.

What can I post? ๐Ÿ“

In general, anything related to AI is acceptable. However, we encourage you to strive for high-quality content.

What is not allowed? ๐Ÿšซ

General Rules ๐Ÿ“œ

Members are expected to engage in on-topic discussions, and exhibit mature, respectful behavior. Those who fail to uphold these standards may find their posts or comments removed, with repeat offenders potentially facing a permanent ban.

While we appreciate focus, a little humor and off-topic banter, when tasteful and relevant, can also add flavor to our discussions.

Related Communities ๐ŸŒ

General

Chat

Image

Open Source

Please message @sisyphean@programming.dev if you would like us to add a community to this list.

Icon base by Lord Berandas under CC BY 3.0 with modifications to add a gradient

founded 1 year ago
MODERATORS
 

I'm looking for more cost-effective alternatives to Perplexity.ai that offer GPT-4 integration along with search capabilities for factual assistance, ideally around $5/month instead of the $20/month subscription fee for Perplexity.ai. I've come across Nuggt (https://github.com/Nuggt-dev/Nuggt), but it seems to rely solely on a local model without search functionality. I've also found Phind.com, a developer-focused search engine that uses GPT-4 to answer technical questions with code examples and detailed explanations. While it may not be as good as Perplexity.ai, it offers more free uses. Are there any other options that combine GPT-4 and search features at a lower price point?

top 4 comments
sorted by: hot top controversial new old
[โ€“] rikudou@lemmings.world 5 points 1 year ago (1 children)

It's doable on your own, you can use embeddings for prefiltering (searching) what you want and then provide the top results as a context for GPT. Or if you have existing search, you can skip the embeddings and just feed GPT the top results.

[โ€“] GodOfThunder@lemm.ee 19 points 1 year ago (1 children)

I don't think local models have enough context yet. I don't know how perplexity manages to use so many websites as references. As soon as there is a model like WizardCoder that has a 10k context or higher, I'll give this a try.

[โ€“] rikudou@lemmings.world 3 points 1 year ago

I didn't mean local models, but using some kind of fulltext search engine to preselect data to feed GPT-4.

[โ€“] mabcat@programming.dev 3 points 1 year ago

Maybe try kagi's FastGPT. It seems to be free to use, which is delightfully cost-effective.

This is a frontend to FastGPT API, which is pay-per-request. It probably uses Claude for synthesis, rather than GPT4. The search source is no doubt Kagi's own search, a hybrid private index+Bing+Google that I use all day long as a much better Google.

I pay for Kagi, but I checked every which way and FastGPT never seemed to want money or a Kagi account.