Data sources

Feep! Search gets data for its index from a variety of sources:

DevDocs

API documentation from many sources is loaded via devdocs.io. DevDocs is an open source, offline-capable documentation viewer, with scrapers contributed by many authors.

Hacker News

Hacker News is a discussion forum for software development-related topics (among other things). Data is loaded by scraping the HN API, and updated (hopefully) weekly.

Kiwix

Feep! Search uses Kiwix to load a subset of pages from Wikipedia, as curated by WikiProject Computing. (wikipedia_en_computer_nopic, updated monthly)

MediaWiki

The following MediaWiki instances are scraped periodically using a custom crawler:

• http://fileformats.archiveteam.org
• The ArchWiki documentation for Arch Linux.
• Chess Programming Wiki.
• NixOS Wiki.
• OSDev.org wiki.
• WikiBooks in Department:Computing.

Stack Exchange

Data for Stack Exchange sites is loaded via the Stack Exchange data dumps (hosted on the Internet Archive) and updated approximately quarterly. The following sites are currently included in the index:

• Stack Overflow
• Server Fault
• Super User
• Web Applications
• Webmasters
• Game Development
• Cross Validated
• Mathematics
• Geographic Information Systems
• TeX - LaTeX
• Ask Ubuntu
• User Experience
• Unix & Linux
• WordPress Development
• Theoretical Computer Science
• Ask Different
• Software Engineering
• Electrical Engineering
• Android Enthusiasts
• Information Security
• Graphic Design
• Database Administrators
• Code Review
• Project Management
• Drupal Answers
• SharePoint
• Software Quality Assurance & Testing
• Cryptography
• Signal Processing
• Computational Science
• Mathematica
• Computer Science
• Raspberry Pi
• Salesforce
• Robotics
• ExpressionEngine® Answers
• Magento
• Tridion
• Reverse Engineering
• Network Engineering
• Open Data
• Tor
• Ebooks
• Software Recommendations
• Arduino
• Joomla
• Data Science
• Craft CMS
• Emacs
• Vi and Vim
• CiviCRM
• Open Source
• elementary OS
• Computer Graphics
• Hardware Recommendations
• Retrocomputing
• Artificial Intelligence
• Sitecore
• Internet of Things
• DevOps
• Computer Science Educators
• Proof Assistants
• Programming Language Design and Implementation
• GenAI

Indexed but uncrawled links

The Feep! index also includes pages which have been linked to, but for which we do not have the contents of the page. These appear on results pages with the message:

This page may be related to your search, but no description is available because it has not yet been crawled.