a-text/atextcrawler
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

Make minimum text length configurable and actually remove elasticsearch documents

Browse source
This commit is contained in:
ibu 2021-12-26 18:21:15 +00:00
parent 08ca7fee56
commit f8debcff87
3 changed files with 17 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
doc/source/config_template/main.yaml
View file

@ -70,6 +70,12 @@ crawl:
# Allowed values: positive number
#feed_crawl_interval: 86400
# Minimum length of the text (in characters) extracted from
# a resource; resources with shorter texts are not stored.
# Default value: 300
# Allowed values: positive number
#min_text_length: 300
# Parameters for access to the ElasticSearch service
# No default values; must be set.
elasticsearch: