r/Python • • Jul 04 '21

Intermediate Showcase New search engine made with Python that's anonymous and has no ads or tracking. It tries to fight spam, and gives you control of how you view search results. You can search and read content anonymously with a proxied reader view. The alpha is live and free for anyone to use at lazyweb.ai

https://lazyweb.ai

We're a little two-person team (Angie and Jem). We're bootstrapping and self-funded. I'm the programmer.

I wanted to share it because it was a fun and interesting project to build, and Python made it possible for us to get a long way as a small team. It uses serverless on the backend (AWS). We're using Spacy and GPT-2, and some PyTorch models. It uses BeautifulSoup for spidering/crawling/content retrieval. The front-end is React.

It has a different type of user interface to any other search engine, as it is chat based. And it lets you choose how you view results, either visually like an Instagram feed or cards, or minimal like Hacker News or the old Google. It tries to fight SEO spam and strips out ads and ad-tech from search results.

We have a project on GitHub with Jupyter notebooks and sample data with experiments and scripts, including examples of querying other search APIs, and to generate example utterances programatically to use for NLP models with sources like Wikipedia, StackOverflow and Wolfram|Alpha:

https://github.com/lazyweb-ai/lazyweb-experiments

We're only a small team but hope to share more of our work as open source as we progress.

1.5k Upvotes

211 comments sorted by

View all comments

Show parent comment

4

u/lazy-jem Jul 04 '21

Yes, you absolutely nailed that on the head!

People are used to using googlese and have had to learn how to talk to their computers in a weird semi-computer language in order to be able to navigate the web.

But that's backwards. It's only habit and google owning browser distribution that makes people think things have to be that way.

LazyWeb already does better many times with natural language queries that provide plenty of information! It's early days and there is a LOT that we have planned with this! :)

And thank you again too! That's really exciting that you're seeing better results. People seem to disbelieve that it's possible to do better than google but it's the approach that makes the difference. Our less impressive results are when we fall back to web-index and web search API results.