another python crawler framework

high performace, accept multi project running paralleling (different processing procedures.)
accept add task from other process

framework

multiple threads prototype

one thread listen ,one thread create multiple coroutine to do tasks.
crawler1

one thread prototype

one coroutine listen update tasks event(would execute task_loader to add tasks into queue) ,other multiple coroutine to do tasks. proper high io query ,low compute
crawler2