myned/modufur
1
0
Fork 0
mirror of https://github.com/myned/modufur.git synced 2024-12-23 22:27:27 +00:00
Code Issues Activity

Lowered rate for iqdb requests to reduce possibility of ip ban

Browse source
This commit is contained in:
Myned 2017-10-27 21:31:57 -04:00
parent 21fc7d40fb
commit 18bae80a1d
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
src/main/utils/scraper.py
View file

@ -1,3 +1,4 @@
import asyncio
import re
from bs4 import BeautifulSoup
@ -8,6 +9,8 @@ from utils import utils as u
async def get_post(url):
await asyncio.sleep(u.RATE_LIMIT)
content = await u.fetch('http://iqdb.harry.lu', params={'url': url})
try: