proxy.golang.org : github.com/rl404/go-malscraper : v0.8.0

Package malscraper provides methods to parse MyAnimeList web page. Malscraper will get HTML body response, parse necessary information from the elements, clean them, and convert to golang model (struct) that can be used easily by other project/package. Malscraper is using "github.com/PuerkitoBio/goquery" package for parsing the HTML body. Malscraper provides caching system. As default, malscraper is using in-memory but it is recommended to use persistent cache such as redis. That's why malscraper allows you to create your own cacher which implements this interface. Or you can choose from `https://github.com/rl404/mal-plugin/tree/master/cache`. And use it when initiating malscraper. Logging is also interface so you can use your own logging. And use it when initiating malscraper. Some methods require specific value for the parameter. So, it is recommended to fill the parameter with provided constant to prevent unwanted errors. Errors returned by methods are guaranteed from malscraper errors package. You should be able to handle the errors easier. The original errors (from the dependency package) can still be viewed through printed log (if you turn on error log level). All methods also return HTTP response code to help you distinguish the error. All methods are requesting and accessing MyAnimeList web page so use them responsibly and don't spam too much or your ip will get banned or blacklisted. Recommended 1 request per 3 seconds and use caching. Or for more safety, 1 request per 5 seconds.

Registry - Documentation - Download - JSON
purl: pkg:golang/github.com/rl404/go-malscraper@v0.8.0
Published: over 5 years ago
Indexed: over 3 years ago