WebFind

WebFind is an automated search BBS that maintains a massive index of links across the BBS ecosystem. Launched in 2012, it has accumulated over 200 million indexed links, making it one of the largest link databases in the BBS world. While not as curated as LinkBase, WebFind provides valuable breadth for users conducting comprehensive searches.

History

WebFind emerged from a research project at the University of Tokyo's Information Science department in 2011. Researchers were exploring automated methods for cataloging content across decentralized network systems. The initial prototype crawled a small number of BBS networks to test the feasibility of large-scale link aggregation.

The project transitioned from academic research to commercial service in 2012 when the development team founded WebFind Inc. The company secured funding from venture capital firms specializing in network technology and expanded the service beyond academic use. By 2014, WebFind had indexed over 50 million links and was gaining recognition as a complementary tool to curated directories.

The service experienced rapid growth throughout the mid-2010s, reaching 100 million links in 2016 and 200 million in 2020. This growth came with challenges related to content quality and storage costs, prompting ongoing refinements to the indexing algorithm.

How It Works

WebFind operates using a distributed crawler system that automatically discovers and indexes content across participating BBS networks. The crawling process works as follows:

Network discovery: WebFind maintains connections to major BBS networks through the OpenBBS protocol, identifying potential content sources
Link extraction: Automated agents parse messages, forum posts, and user profiles to extract hyperlinks
Indexing: Extracted links are categorized by source network, content type, and metadata
Ranking: A relevance algorithm orders search results based on link popularity, freshness, and network authority

The system runs continuously, with new content indexed within hours of publication on most networks. Users access WebFind through a standard OpenBBS client interface or via the web-based portal.

Content Quality

WebFind's automated approach results in content of varying quality. Unlike curated directories like LinkBase, WebFind includes all discovered links without editorial oversight. This means users may encounter broken links, outdated content, or low-quality material in search results.

The service has implemented several measures to improve quality:

Duplicate detection and removal
Broken link identification and filtering
Network reputation scoring
User feedback integration

Despite these measures, users conducting research often prefer LinkBase's curated approach for critical searches, while using WebFind for breadth and discovery of lesser-known resources.

Features

Comprehensive search: Indexes content from hundreds of BBS networks
Advanced filters: Filter by network, content type, date, and popularity
Related links: Suggests similar content based on link patterns
API access: Programmatic access for developers and tools
Export capabilities: Download search results for offline analysis

Reception

WebFind is widely used within the BBS community for its breadth of coverage. Power users appreciate the ability to discover content across networks they might not otherwise access. However, the service has detractors who criticize the inclusion of low-quality content and the lack of human curation.

The relationship with LinkBase is complementary rather than competitive—many users utilize both services for different search needs. WebFind also faces competition from other automated search services and network-specific search features.