Tell me a few websites (apart from Wikipedia) where the articles could be used to…
- User
Tell me a few websites (apart from Wikipedia) where the articles could be used to construct a public LLM evaluation benchmark. This may imply relatively loose Licensing.
Assistant
Some websites with content that could be used for LLM evaluation benchmarks due to their relatively permissive licensing include:
Stack Exchange network (including Stack Overflow) - uses CC BY-SA 4.0 licensing which allows reuse with attribution
Project Gutenberg - contains public domain books and texts
arXiv - academic preprints with various open licenses
Common Crawl - web data archive widely used in AI training
HackerNews - discussions under Creative Commons licensing
Would you like me to explain more about any of these sources or their specific licensing considerations for benchmark creation?
- User
I'd prefer options that are constantly updated with new articles. Of course arXiv and Stack Exchange are okay, but what else?
Assistant
For constantly updated sources with permissive licensing that could work for LLM benchmarks:
The Conversation - academic articles under CC BY-ND 4.0
Internet Archive blogs - frequently updated with CC licensing
GitHub README files and documentation - many under MIT or Apache licenses
Wikimedia Commons - beyond Wikipedia, includes media with various open licenses
OpenStreetMap wiki and documentation - regularly updated under open licenses
Government data portals (like data.gov) - public domain content that's frequently refreshed
These sources provide fresh content while maintaining licensing terms that could potentially allow for benchmark creation.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.