Firepup650/bitbot-3.11-fork
2
0
Fork 0
Code Issues Pull requests Activity Actions

use lxml for parsing fedi Notes. html.parse is bad and unpredictable

Browse source
This commit is contained in:
jesopo 2019-10-31 15:17:39 +00:00
parent 8188aeb9b8
commit 5d08a496a4
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
modules/fediverse/ap_utils.py
View file

@ -61,7 +61,7 @@ def find_actor(username, instance):
KNOWN_TAGS = ["p", "br"]
def _normalise_note(content):
soup = bs4.BeautifulSoup(content, "html.parser")
soup = bs4.BeautifulSoup(content, "lxml").body
lines = []
for element in soup.find_all():
if element.text.strip() == "":