7 task in paralell

[luciano fain]

Dear all, any of you knows why when you run 7 / 8 task in paralell each one with one host, the gsad intrface stucks?
I can see the key problem in tasks.db access, do you have any suggestion to execute 7 or more tasks in paralell with good response of tasks.db?
I know the same sqlite db is used by scanner and gsad gr.interface.
Any tip will be appreciated.Regards.

[Brandon Perry]

TBH it would actually be awesome if SQLite were supported out of the box,
but you could configure OpenVAS to use PostgreSQL. Would resolve this
issue, and would allow you to reduce IO during scans on the engine, and put
it on a dedicated database.

Post by luciano fain
Dear all, any of you knows why when you run 7 / 8 task in paralell each
one with one host, the gsad intrface stucks?
I can see the key problem in tasks.db access, do you have any suggestion
to execute 7 or more tasks in paralell with good response of tasks.db?
I know the same sqlite db is used by scanner and gsad gr.interface.
Any tip will be appreciated.
Regards.
_______________________________________________
Openvas-discuss mailing list
https://lists.wald.intevation.org/cgi-bin/mailman/listinfo/openvas-discuss

[Jan-Oliver Wagner]

Post by Brandon Perry
TBH it would actually be awesome if SQLite were supported out of the box,

to my understanding it is supported out of the box ... ?

Post by Brandon Perry
but you could configure OpenVAS to use PostgreSQL. Would resolve this
issue, and would allow you to reduce IO during scans on the engine, and put
it on a dedicated database.

The PostgreSQL backend will be supported from OpenVAS-8 on. Current
trunk version is not yet fully functional.

[Brandon Perry]

Yes, I didn't mean it SQLite wasn't supported out of the box, I meant it
would be awesome if it were supported out of the box, with an option to use
pgsql. :)


On Fri, Aug 15, 2014 at 2:17 AM, Jan-Oliver Wagner <

Post by Jan-Oliver Wagner

Post by Brandon Perry
TBH it would actually be awesome if SQLite were supported out of the box,

to my understanding it is supported out of the box ... ?

Post by Brandon Perry
but you could configure OpenVAS to use PostgreSQL. Would resolve this
issue, and would allow you to reduce IO during scans on the engine, and

put

Post by Brandon Perry
it on a dedicated database.

The PostgreSQL backend will be supported from OpenVAS-8 on. Current
trunk version is not yet fully functional.
--
Dr. Jan-Oliver Wagner | [phone] | http://www.greenbone.net/
Greenbone Networks GmbH, Neuer Graben 17, 49074 OsnabrÃŒck | AG OsnabrÃŒck,
HR B 202460
GeschÀftsfÌhrer: Lukas Grunwald, Dr. Jan-Oliver Wagner
_______________________________________________
Openvas-discuss mailing list
https://lists.wald.intevation.org/cgi-bin/mailman/listinfo/openvas-discuss

[Ryan Schulze]

I remember a short discussion of that topic a few months ago (IIRC the
subject was "SQL_giveup error") where simultaneous scans on multiple
slaves were causing the same problem (multiple instances of the manager
fighting for tasks.db locks).
I wanted look into the topic but never found the time. Putting the
tasks.db on a ramdisk will somewhat lessen the IO problem (by tempting
fate, don't do this on a system where losing tasks.db will hurt). But
that doesn't solve the main problem at hand, just does its best to
mitigate it. I have yet to dig deeper into the sourcecode, but my best
guess is that this will always be a bottleneck caused by how sqlite does
it's database locking.
Using a database like PostgreSQL with table or row locking would
probably go a good way to solving the problem in environments that are
prone to this problem (I saw that it is being worked on, but to my
knowledge it isn't finished yet).

Post by luciano fain
Dear all, any of you knows why when you run 7 / 8 task in paralell
each one with one host, the gsad intrface stucks?
I can see the key problem in tasks.db access, do you have any
suggestion to execute 7 or more tasks in paralell with good response
of tasks.db?
I know the same sqlite db is used by scanner and gsad gr.interface.
Any tip will be appreciated.
Regards.
_______________________________________________
Openvas-discuss mailing list
https://lists.wald.intevation.org/cgi-bin/mailman/listinfo/openvas-discuss

[Jan-Oliver Wagner]

Post by luciano fain
Dear all, any of you knows why when you run 7 / 8 task in paralell each one with one host, the gsad intrface stucks?
I can see the key problem in tasks.db access, do you have any suggestion to execute 7 or more tasks in paralell with good response of tasks.db?
I know the same sqlite db is used by scanner and gsad gr.interface.

Only OpenVAS Manager accesses the sqlite database, not the gsad.

Are you sure it stucks? Or did it just slow down?

[luciano fain]

Just very slow down Jan.

I will try to make a fifo in a second database launching 4 task max in paralell. My problem is that im using a new gui to auto launch tasks using omp interface. I think it is only my problem because I need to use one task for each target as we developed the interface.

Thanks all for the tips.

Enviado desde Samsung Mobile.

<div>-------- Mensaje original --------</div><div>De: Jan-Oliver Wagner <Jan-***@greenbone.net> </div><div>Fecha:15/08/2014 04:15 (GMT-03:00) </div><div>A: openvas-***@wald.intevation.org </div><div>CC: luciano fain <***@hotmail.com> </div><div>Asunto: Re: [Openvas-discuss] 7 task in paralell </div><div>
</div>

Post by luciano fain
Dear all, any of you knows why when you run 7 / 8 task in paralell each one with one host, the gsad intrface stucks?
I can see the key problem in tasks.db access, do you have any suggestion to execute 7 or more tasks in paralell with good response of tasks.db?
I know the same sqlite db is used by scanner and gsad gr.interface.

Only OpenVAS Manager accesses the sqlite database, not the gsad.

Are you sure it stucks? Or did it just slow down?



--
Dr. Jan-Oliver Wagner | [phone] | http://www.greenbone.net/
Greenbone Networks GmbH, Neuer Graben 17, 49074 OsnabrÃŒck | AG OsnabrÃŒck, HR B 202460
GeschÀftsfÌhrer: Lukas Grunwald, Dr. Jan-Oliver Wagner