wiki.ziemers.de

ziemer's informatik Wiki

Benutzer-Werkzeuge

Webseiten-Werkzeuge

Zuletzt angesehen:
wiki:software:beuthbot:webscraper

Unterschiede

Hier werden die Unterschiede zwischen zwei Versionen angezeigt.

Link zu dieser Vergleichsansicht

Beide Seiten der vorigen Revision Vorhergehende Überarbeitung
Nächste Überarbeitung 		Vorhergehende Überarbeitung
wiki:software:beuthbot:webscraper [12.12.2019 13:33]
Timo Bruns [Structure] 		wiki:software:beuthbot:webscraper [24.01.2020 14:26] (aktuell)
Timo Bruns [Authors]
Zeile 26: Zeile 26:
  
 You will need a current version of [[https://nodejs.org/en/|node & npm]]. You will need a current version of [[https://nodejs.org/en/|node & npm]].
 +
 +
  
 === Installing === === Installing ===
Zeile 43: Zeile 45:
 ==== Overview ==== ==== Overview ====
  
-The bot is basically a _Node_-_Express_-Backend. Incoming requests are checked and specifically handled.+The bot is basically a //Node//-//Express//-Backend. Incoming requests are checked and specifically handled.
  
 ==== Structure ==== ==== Structure ====
  
-The bot is separated into two files. ''index.js'' contains the fundamental logic. At the moment there is only one ressource but we expect to expand this with more ressources. A ressource is represented by a _route_. If the user request the lists of study rooms at our university, the script notices the request at the specified route and prepares a _JSON_ response.+The bot is separated into two files. ''index.js'' contains the fundamental logic. At the moment there is only one ressource but we expect to expand this with more ressources. A ressource is represented by a //route//. If the user request the lists of study rooms at our university, the script notices the request at the specified route and prepares a //JSON// response.
  
-The second script, ''scrape.js'', takes care of the actual web scraping. The given URL is requested with _axios_ and then parsed with _cheerio_.+The second script, ''scrape.js'', takes care of the actual web scraping. The given URL is requested with //axios// and then parsed with //cheerio//.
  
 ==== Functionalities ==== ==== Functionalities ====
Zeile 59: Zeile 61:
 ==== Further Development ==== ==== Further Development ====
  
-Add a new route for every ressource in 'index.js' and prepare functions in 'scrape.js' to scrape the requested data from given Websites.+Add a new route for every ressource in ''index.js'' and prepare functions in ''scrape.js'' to scrape the requested data from given Websites.
  
 ====  Built With ==== ====  Built With ====
  
-- [Node.js](https://nodejs.org/en/) \\  +- [[https://nodejs.org/en/|Node.js]]\\ 
-- [Express.js](https://expressjs.com/) \\  +- [[https://expressjs.com/|Express.js]]\\ 
-- [Axios](https://github.com/axios/axios) \\  +- [[https://github.com/axios/axios|Axios]]\\ 
-- [Cheerio](https://github.com/cheeriojs/cheerio)\\ +- [[https://github.com/cheeriojs/cheerio|Cheerio]]\\ 
  
 ==== Versioning ==== ==== Versioning ====
  
-We use [SemVer](http://semver.org/) for versioning. For the versions available, see the [tags on this repository](https://github.com/T0biWan/scrape-js/tags).+We use [[http://semver.org/|SemVer]] for versioning. For the versions available, see the [[https://github.com/beuthbot/scraper/tags|tags on this repository]].
  
 ==== Authors ==== ==== Authors ====
  
-- **Tobias Klatt** - _Initial work_ - [GitHub](https://github.com/T0biWan/) +- **Tobias Klatt** - //Initial work// - [[https://github.com/T0biWan/|GitHub]]
- +
-See also the list of [contributors](https://github.com/T0biWan/scrape-js/graphs/contributors) who participated in this project.+
  
 +See also the list of [[https://github.com/beuthbot/scraper/graphs/contributors|contributors]] who participated in this project.
 +<WRAP pagebreak></WRAP>
wiki/software/beuthbot/webscraper.1576153985.txt.gz · Zuletzt geändert: 12.12.2019 13:33 von Timo Bruns

Seiten-Werkzeuge