counterweight/drogon
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Cambios notables. Creadas interfaces para la tabla de capturing task

Browse source 
y la tabla de capturas.

Traslado todo lo relacionado a Geocoding a un servicio independiente
del capturer.

Replanteo totalmente el parseo del html, creando un objeto nuevo.
This commit is contained in:
pablomartincalvo 2018-10-06 19:09:44 +02:00
parent 3bd8de0e02
commit 240a61649c
7 changed files with 474 additions and 262 deletions
Download patch file Download diff file Expand all files Collapse all files

4
explorer/explorer.py
View file

@ -10,7 +10,7 @@ from random import randint
from core.mysql_wrapper import get_anunciosdb, get_tasksdb
from core.scrapping_utils import UrlAttack
from core.alerts import alert_master
from capturer.capturer import create_capturing_task
from mysql.capturing_tasks_interface import capturing_interface
class Explorer():
@ -51,7 +51,7 @@ class Explorer():
if current_task.status == 'Referencias ready':
referencias = current_task.get_referencias()
for referencia in referencias:
create_capturing_task(referencia, self.tasksdb)
capturing_interface.create_capturing_task(referencia)
current_task._update_status("Sent to queue")