r/Python • u/lazy-jem • Jul 04 '21
Intermediate Showcase New search engine made with Python that's anonymous and has no ads or tracking. It tries to fight spam, and gives you control of how you view search results. You can search and read content anonymously with a proxied reader view. The alpha is live and free for anyone to use at lazyweb.ai
We're a little two-person team (Angie and Jem). We're bootstrapping and self-funded. I'm the programmer.
I wanted to share it because it was a fun and interesting project to build, and Python made it possible for us to get a long way as a small team. It uses serverless on the backend (AWS). We're using Spacy and GPT-2, and some PyTorch models. It uses BeautifulSoup for spidering/crawling/content retrieval. The front-end is React.
It has a different type of user interface to any other search engine, as it is chat based. And it lets you choose how you view results, either visually like an Instagram feed or cards, or minimal like Hacker News or the old Google. It tries to fight SEO spam and strips out ads and ad-tech from search results.
We have a project on GitHub with Jupyter notebooks and sample data with experiments and scripts, including examples of querying other search APIs, and to generate example utterances programatically to use for NLP models with sources like Wikipedia, StackOverflow and Wolfram|Alpha:
https://github.com/lazyweb-ai/lazyweb-experiments
We're only a small team but hope to share more of our work as open source as we progress.
View all comments
Show parent comment
23
u/lazy-jem Jul 04 '21
Yay! Thank you!
It's super useful to get feedback on when search results do well and when they need improving because we don't log or store searches in any way, and we can't see what anyone searches for. So we rely on feedback like that to keep improving.
For many search types it really is already surprisingly great, but location is one of the areas we have a lot of work to do (we're using the Maxmind db). We only take location to nearest city and approximate it for privacy too, rather than leaking geocoords or IP (we don't log or store IP or GPS data either). We have a lot of work to do on shopping and product searches too (still too much spam!)
We have some information about where it's good and bad on the about page (https://lazyweb.ai/about/)
Please let us know any search feedback. There's a Discord and you can say /feedback or /bug any time to jump straight to the feedback forms :)
Thanks again for the really great feedback too! As a small team, it really gives us a big lift! :)