Commit Graph

17 Commits

Author SHA1 Message Date
cee0af6c3c
fix: only select images that have non-data src
Previously, when the image url contained data, it tried to parse an url
and failed, instead of keeping data.

It have been fixed so that images where url is starting by 'data' are
not modified.
2021-05-22 04:41:08 +02:00
970f510cd1
feat: add retrieval from le monde diplomatique
Add retrieval from le monde diplomatique

Previously, 404 pages were injected in the document when downloading
styles
Now, the downloader returns None when documents are not found
2021-05-22 04:41:01 +02:00
koalp
8afd74995b Merge pull request 'feature/several_rooms' () from feature/several_rooms into development
Reviewed-on: 
2021-05-08 01:34:08 +00:00
dd26be54b5
chore: format according to cargo fmt 2021-05-08 03:24:42 +02:00
ac5ef59dfa
feat: add support for multiple rooms 2021-05-08 03:08:37 +02:00
koalp
a64096fa87 Merge pull request 'feat: move ArticleLocation to defined errors' () from feature/article_location_defined_errors into development
Reviewed-on: 
2021-04-30 18:10:50 +00:00
b1d025a23c
feat: move ArticleLocation to defined errors
Previously, the functions in article_location.rs where returning generic
anyhow::Result.

In order to ease error handling when using the library, it have been
moved to specific errors.
2021-04-30 19:55:52 +02:00
koalp
2e6aed97ef Merge pull request 'feat: add a containerfile to build a chatbot image' () from feature/container_image into development
Reviewed-on: 
2021-04-30 00:22:27 +00:00
48485c3097
feat: add a containerfile to build a chatbot image
An image to run crieur-chatbot have been added.
The crieur-chatbot matrix-sdk dependency have been edited in order to
use rustls instead of native tsl library.
2021-04-30 02:14:18 +02:00
koalp
9655b086f0 Merge pull request 'feat: add basic chatbot' () from feature/minimal-chatbot into development
Reviewed-on: 
2021-04-29 00:24:20 +00:00
9dd501418e
chore(ci): add cmake to the test stage 2021-04-29 02:14:30 +02:00
865b949b5f
feat: add builder for mediapart, document chatbot
A builder for mediapart have been added. No generic builder have been
created as there is no usecase yet.

Some documentation have been added, roadmap and scope have been
clarified and chatbot have been lightly documented.
2021-04-29 02:11:32 +02:00
a16dbbc790
feat: add basic chatbot
A basic chabot application that downloads article from one newspaper
have been added.

It can download html pages and is called with !hmtl

ArticleLocation have been refactored to own it's internal data.
2021-04-27 04:32:37 +02:00
9aa2b5f07b
Merge branch 'feature/mediapart_poc' into development 2021-04-24 03:48:39 +02:00
756b1592b7
feat: allows to remove elements of html pages
A feature to remove elements of html pages based on css selectors have
been added.

The removal of link element that load external js have been added.
2021-04-24 03:45:13 +02:00
c4ab210c4d
feat: add retrieval application and one newspaper
A first example as well as some documentation have been added

The first example builds an article location and download the article as
an html String.

The documentation explains how it has been designed and what is the goal
of the application as well as it's intended architecture
2021-04-23 22:12:02 +02:00
7fec40e9e4
chore: initial commit 2021-04-02 23:27:15 +02:00