Trace number 3283103

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24UNSAT 2665.36 668.407

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_L150_coli.sat.cnf
MD5SUMba6884aaa746378e56c38fd8b3d0255e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark52.912
Satisfiable
(Un)Satisfiability was proved
Number of variables486992
Number of clauses2456708
Sum of the clauses size7147094
Maximum clause length11
Minimum clause length1
Number of clauses of size 145577
Number of clauses of size 2599727
Number of clauses of size 31431108
Number of clauses of size 4295435
Number of clauses of size 584412
Number of clauses of size over 5449

Solver Data 

2665.07/668.36	
2665.07/668.36	s UNSATISFIABLE
2665.07/668.36	c Conflict at level 0

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3283103-1304047643/watcher-3283103-1304047643 -o /tmp/evaluation-result-3283103-1304047643/solver-3283103-1304047643 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3283103-1304047643.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.09 8.03 5/180 19724
/proc/meminfo: memFree=15087184/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=26192 CPUtime=0 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 1540 0 0 0 0 0 0 0 24 0 1 0 516362470 26820608 1478 33554432000 4194304 4623224 140736376049056 18446744073709551615 4315013 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19724/statm: 6548 1480 290 105 0 2052 0

[startup+0.0983801 s]
/proc/loadavg: 8.12 8.09 8.03 5/180 19724
/proc/meminfo: memFree=15087184/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=123696 CPUtime=0.09 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 13155 0 0 0 8 1 0 0 24 0 1 0 516362470 126664704 11194 33554432000 4194304 4623224 140736376049056 18446744073709551615 4388779 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19724/statm: 30924 11195 301 105 0 26428 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 123696

[startup+0.100376 s]
/proc/loadavg: 8.12 8.09 8.03 5/180 19724
/proc/meminfo: memFree=15087184/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=124584 CPUtime=0.09 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 13656 0 0 0 8 1 0 0 24 0 1 0 516362470 127574016 11258 33554432000 4194304 4623224 140736376049056 18446744073709551615 4583937 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19724/statm: 31146 11264 301 105 0 26650 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 124584

[startup+0.300376 s]
/proc/loadavg: 8.12 8.09 8.03 5/180 19724
/proc/meminfo: memFree=15087184/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=148744 CPUtime=0.29 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 26497 0 0 0 26 3 0 0 25 0 1 0 516362470 152313856 17610 33554432000 4194304 4623224 140736376049056 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19724/statm: 37186 17610 301 105 0 32690 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 148744

[startup+0.70027 s]
/proc/loadavg: 8.12 8.09 8.03 5/180 19724
/proc/meminfo: memFree=15087184/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=201268 CPUtime=0.69 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 51475 0 0 0 63 6 0 0 25 0 1 0 516362470 206098432 31772 33554432000 4194304 4623224 140736376049056 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19724/statm: 50317 31772 301 105 0 45821 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 201268

[startup+1.50109 s]
/proc/loadavg: 8.12 8.09 8.03 6/181 19725
/proc/meminfo: memFree=14911972/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=838412 CPUtime=1.56 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 186534 0 0 0 133 23 0 0 25 0 4 0 516362470 858533888 142138 33554432000 4194304 4623224 140736376049056 18446744073709551615 4367376 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 209603 142160 347 105 0 205107 0
Current children cumulated CPU time (s) 1.56
Current children cumulated vsize (KiB) 838412

[startup+3.1008 s]
/proc/loadavg: 8.11 8.08 8.03 9/184 19728
/proc/meminfo: memFree=14412596/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=971020 CPUtime=7.95 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 218241 0 0 0 767 28 0 0 25 0 4 0 516362470 994324480 172542 33554432000 4194304 4623224 140736376049056 18446744073709551615 4388116 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 242755 172542 337 105 0 238259 0
[pid=19724/tid=19726] ppid=19722 vsize=971020 CPUtime=1.6 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 12345 0 0 0 159 1 0 0 25 0 4 0 516362618 994324480 172542 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289804 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=971020 CPUtime=1.61 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 12795 0 0 0 159 2 0 0 25 0 4 0 516362618 994324480 172542 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=971020 CPUtime=1.61 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 6533 0 0 0 161 0 0 0 25 0 4 0 516362618 994324480 172542 33554432000 4194304 4623224 140736376049056 18446744073709551615 4467877 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7.95
Current children cumulated vsize (KiB) 971020

[startup+6.30022 s]
/proc/loadavg: 8.11 8.08 8.03 9/184 19728
/proc/meminfo: memFree=14386176/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=971020 CPUtime=20.71 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 218673 0 0 0 2043 28 0 0 25 0 4 0 516362470 994324480 170386 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507114 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 242755 170386 346 105 0 238259 0
[pid=19724/tid=19726] ppid=19722 vsize=971020 CPUtime=4.78 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 12429 0 0 0 477 1 0 0 25 0 4 0 516362618 994324480 170386 33554432000 4194304 4623224 140736376049056 18446744073709551615 4377457 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=971020 CPUtime=4.81 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 12797 0 0 0 479 2 0 0 25 0 4 0 516362618 994324480 170386 33554432000 4194304 4623224 140736376049056 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=971020 CPUtime=4.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 6727 0 0 0 481 0 0 0 25 0 4 0 516362618 994324480 170386 33554432000 4194304 4623224 140736376049056 18446744073709551615 4545903 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20.71
Current children cumulated vsize (KiB) 971020

[startup+12.7011 s]
/proc/loadavg: 8.10 8.08 8.02 9/184 19729
/proc/meminfo: memFree=14370468/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=971020 CPUtime=46.28 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 220443 0 0 0 4599 29 0 0 25 0 4 0 516362470 994324480 171970 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507171 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 242755 171970 346 105 0 238259 0
[pid=19724/tid=19726] ppid=19722 vsize=971020 CPUtime=11.15 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 12710 0 0 0 1113 2 0 0 25 0 4 0 516362618 994324480 171970 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=971020 CPUtime=11.21 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 13269 0 0 0 1119 2 0 0 25 0 4 0 516362618 994324480 171970 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317214 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=971020 CPUtime=11.21 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 7009 0 0 0 1121 0 0 0 25 0 4 0 516362618 994324480 171970 33554432000 4194304 4623224 140736376049056 18446744073709551615 4330746 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 46.28
Current children cumulated vsize (KiB) 971020

[startup+25.5008 s]
/proc/loadavg: 8.15 8.10 8.03 9/184 19729
/proc/meminfo: memFree=14349468/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=971020 CPUtime=97.41 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 243820 0 0 0 9706 35 0 0 25 0 4 0 516362470 994324480 172924 33554432000 4194304 4623224 140736376049056 18446744073709551615 4412473 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 242755 172924 346 105 0 238259 0
[pid=19724/tid=19726] ppid=19722 vsize=971020 CPUtime=23.88 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 12975 0 0 0 2386 2 0 0 25 0 4 0 516362618 994324480 172924 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289785 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=971020 CPUtime=24.01 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 35932 0 0 0 2394 7 0 0 25 0 4 0 516362618 994324480 172926 33554432000 4194304 4623224 140736376049056 18446744073709551615 4367598 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=971020 CPUtime=24.01 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 7210 0 0 0 2401 0 0 0 25 0 4 0 516362618 994324480 172926 33554432000 4194304 4623224 140736376049056 18446744073709551615 4545353 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 97.41
Current children cumulated vsize (KiB) 971020

[startup+51.1012 s]
/proc/loadavg: 8.17 8.10 8.03 9/184 19730
/proc/meminfo: memFree=14266432/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=971020 CPUtime=199.67 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 395309 0 0 0 19902 65 0 0 25 0 4 0 516362470 994324480 178013 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507356 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 242755 178013 346 105 0 238259 0
[pid=19724/tid=19726] ppid=19722 vsize=971020 CPUtime=49.34 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 13201 0 0 0 4932 2 0 0 25 0 4 0 516362618 994324480 178013 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=971020 CPUtime=49.61 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 182588 0 0 0 4925 36 0 0 25 0 4 0 516362618 994324480 178013 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=971020 CPUtime=49.61 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 7464 0 0 0 4961 0 0 0 25 0 4 0 516362618 994324480 178013 33554432000 4194304 4623224 140736376049056 18446744073709551615 228122369980 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 199.67
Current children cumulated vsize (KiB) 971020

[startup+102.307 s]
/proc/loadavg: 8.12 8.10 8.03 9/184 19731
/proc/meminfo: memFree=13964940/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1102092 CPUtime=404.19 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 638508 0 0 0 40306 113 0 0 25 0 4 0 516362470 1128542208 197174 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507171 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 275523 197174 384 105 0 271027 0
[pid=19724/tid=19726] ppid=19722 vsize=1102092 CPUtime=100.25 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 24577 0 0 0 10021 4 0 0 25 0 4 0 516362618 1128542208 197174 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289875 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1102092 CPUtime=100.82 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 216326 0 0 0 10034 48 0 0 25 0 4 0 516362618 1128542208 197174 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1102092 CPUtime=100.82 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 204886 0 0 0 10048 34 0 0 25 0 4 0 516362618 1128542208 197174 33554432000 4194304 4623224 140736376049056 18446744073709551615 4364414 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 404.19
Current children cumulated vsize (KiB) 1102092

[startup+162.301 s]
/proc/loadavg: 8.08 8.09 8.03 9/184 19733
/proc/meminfo: memFree=13855008/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1036556 CPUtime=643.85 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 906437 0 0 0 64228 157 0 0 25 0 4 0 516362470 1061433344 205082 33554432000 4194304 4623224 140736376049056 18446744073709551615 4510896 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 259139 205082 384 105 0 254643 0
[pid=19724/tid=19726] ppid=19722 vsize=1036556 CPUtime=159.92 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 31195 0 0 0 15986 6 0 0 25 0 4 0 516362618 1061433344 205083 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289785 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1036556 CPUtime=160.82 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 216647 0 0 0 16034 48 0 0 25 0 4 0 516362618 1061433344 205083 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317197 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1036556 CPUtime=160.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 465434 0 0 0 16006 75 0 0 25 0 4 0 516362618 1061433344 205083 33554432000 4194304 4623224 140736376049056 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 643.85
Current children cumulated vsize (KiB) 1036556

[startup+222.3 s]
/proc/loadavg: 8.14 8.10 8.04 9/184 19734
/proc/meminfo: memFree=13748844/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1125120 CPUtime=883.52 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 1104162 0 0 0 88162 190 0 0 25 0 4 0 516362470 1152122880 207367 33554432000 4194304 4623224 140736376049056 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 281280 207367 384 105 0 276784 0
[pid=19724/tid=19726] ppid=19722 vsize=1125120 CPUtime=219.58 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 50254 0 0 0 21949 9 0 0 25 0 4 0 516362618 1152122880 207367 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289735 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1125120 CPUtime=220.82 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 216869 0 0 0 22034 48 0 0 25 0 4 0 516362618 1152122880 207367 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1125120 CPUtime=220.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 643556 0 0 0 21976 105 0 0 25 0 4 0 516362618 1152122880 207367 33554432000 4194304 4623224 140736376049056 18446744073709551615 4330665 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 883.52
Current children cumulated vsize (KiB) 1125120

[startup+282.301 s]
/proc/loadavg: 8.17 8.11 8.04 9/184 19767
/proc/meminfo: memFree=17516928/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1125120 CPUtime=1123.18 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 1341706 0 0 0 112087 231 0 0 25 0 4 0 516362470 1152122880 211282 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507444 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 281280 211282 373 105 0 276784 0
[pid=19724/tid=19726] ppid=19722 vsize=1125120 CPUtime=279.26 cores=0,2,4,6

################
# More data... #
################

/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 54858 0 0 0 45816 10 0 0 25 0 4 0 516362618 1189171200 216013 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1161300 CPUtime=460.82 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 236388 0 0 0 46030 52 0 0 25 0 4 0 516362618 1189171200 216013 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1161300 CPUtime=460.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 872918 0 0 0 45937 144 0 0 25 0 4 0 516362618 1189171200 216013 33554432000 4194304 4623224 140736376049056 18446744073709551615 4467877 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1842.19
Current children cumulated vsize (KiB) 1161300

[startup+522.3 s]
/proc/loadavg: 8.13 8.12 8.06 9/184 19773
/proc/meminfo: memFree=16801248/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1177080 CPUtime=2081.87 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 1448521 0 0 0 207937 250 0 0 25 0 4 0 516362470 1205329920 225514 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507171 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 294270 225514 348 105 0 289774 0
[pid=19724/tid=19726] ppid=19722 vsize=1177080 CPUtime=517.93 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 56429 0 0 0 51782 11 0 0 25 0 4 0 516362618 1205329920 225514 33554432000 4194304 4623224 140736376049056 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1177080 CPUtime=520.82 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238501 0 0 0 52029 53 0 0 25 0 4 0 516362618 1205329920 225514 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317194 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1177080 CPUtime=520.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 958385 0 0 0 51924 157 0 0 25 0 4 0 516362618 1205329920 225514 33554432000 4194304 4623224 140736376049056 18446744073709551615 4364992 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2081.87
Current children cumulated vsize (KiB) 1177080

[startup+582.301 s]
/proc/loadavg: 8.12 8.11 8.06 9/184 19775
/proc/meminfo: memFree=16736260/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1177080 CPUtime=2321.54 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 1754288 0 0 0 231853 301 0 0 25 0 4 0 516362470 1205329920 229918 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 294270 229918 347 105 0 289774 0
[pid=19724/tid=19726] ppid=19722 vsize=1177080 CPUtime=577.6 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 57303 0 0 0 57749 11 0 0 25 0 4 0 516362618 1205329920 229918 33554432000 4194304 4623224 140736376049056 18446744073709551615 4376057 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1177080 CPUtime=580.82 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238512 0 0 0 58029 53 0 0 25 0 4 0 516362618 1205329920 229919 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1177080 CPUtime=580.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1263146 0 0 0 57873 208 0 0 25 0 4 0 516362618 1205329920 229919 33554432000 4194304 4623224 140736376049056 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2321.54
Current children cumulated vsize (KiB) 1177080

[startup+642.301 s]
/proc/loadavg: 8.11 8.10 8.05 9/184 19776
/proc/meminfo: memFree=16653664/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1242616 CPUtime=2561.22 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2056963 0 0 0 255774 348 0 0 25 0 4 0 516362470 1272438784 234535 33554432000 4194304 4623224 140736376049056 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 310654 234535 347 105 0 306158 0
[pid=19724/tid=19726] ppid=19722 vsize=1242616 CPUtime=637.27 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 72941 0 0 0 63711 16 0 0 25 0 4 0 516362618 1272438784 234535 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289691 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1242616 CPUtime=640.83 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238512 0 0 0 64030 53 0 0 25 0 4 0 516362618 1272438784 234535 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317201 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1242616 CPUtime=640.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1550037 0 0 0 63830 251 0 0 25 0 4 0 516362618 1272438784 234535 33554432000 4194304 4623224 140736376049056 18446744073709551615 4552841 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2561.22
Current children cumulated vsize (KiB) 1242616

Solver just ended. Dumping a history of the last processes samples

[startup+652.701 s]
/proc/loadavg: 8.09 8.10 8.05 9/184 19777
/proc/meminfo: memFree=16632088/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1242616 CPUtime=2602.75 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2112383 0 0 0 259917 358 0 0 25 0 4 0 516362470 1272438784 234734 33554432000 4194304 4623224 140736376049056 18446744073709551615 4507406 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 310654 234734 347 105 0 306158 0
[pid=19724/tid=19726] ppid=19722 vsize=1242616 CPUtime=647.61 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 75730 0 0 0 64745 16 0 0 25 0 4 0 516362618 1272438784 234734 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289788 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1242616 CPUtime=651.23 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238512 0 0 0 65070 53 0 0 25 0 4 0 516362618 1272438784 234734 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317194 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1242616 CPUtime=651.21 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1602661 0 0 0 64861 260 0 0 25 0 4 0 516362618 1272438784 234734 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289772 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2602.75
Current children cumulated vsize (KiB) 1242616

[startup+659.101 s]
/proc/loadavg: 8.08 8.10 8.05 9/184 19777
/proc/meminfo: memFree=16617704/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1265632 CPUtime=2628.32 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2169485 0 0 0 262465 367 0 0 25 0 4 0 516362470 1296007168 238923 33554432000 4194304 4623224 140736376049056 18446744073709551615 4517833 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 316408 238923 351 105 0 311912 0
[pid=19724/tid=19726] ppid=19722 vsize=1265632 CPUtime=653.97 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 76414 0 0 0 65381 16 0 0 25 0 4 0 516362618 1296007168 238923 33554432000 4194304 4623224 140736376049056 18446744073709551615 4377034 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1265632 CPUtime=657.63 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238512 0 0 0 65710 53 0 0 25 0 4 0 516362618 1296007168 238923 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317264 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1265632 CPUtime=657.61 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1647516 0 0 0 65494 267 0 0 25 0 4 0 516362618 1296007168 238923 33554432000 4194304 4623224 140736376049056 18446744073709551615 4376579 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2628.32
Current children cumulated vsize (KiB) 1265632

[startup+662.3 s]
/proc/loadavg: 8.08 8.10 8.05 9/184 19777
/proc/meminfo: memFree=16597740/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1265632 CPUtime=2641.09 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2184333 0 0 0 263740 369 0 0 25 0 4 0 516362470 1296007168 236673 33554432000 4194304 4623224 140736376049056 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 316408 236673 344 105 0 311912 0
[pid=19724/tid=19726] ppid=19722 vsize=1265632 CPUtime=657.15 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 76564 0 0 0 65699 16 0 0 25 0 4 0 516362618 1296007168 236673 33554432000 4194304 4623224 140736376049056 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1265632 CPUtime=660.83 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238512 0 0 0 66030 53 0 0 25 0 4 0 516362618 1296007168 236673 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1265632 CPUtime=660.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1662007 0 0 0 65811 270 0 0 25 0 4 0 516362618 1296007168 236673 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289711 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2641.09
Current children cumulated vsize (KiB) 1265632

[startup+665.507 s]
/proc/loadavg: 8.08 8.10 8.05 9/184 19777
/proc/meminfo: memFree=16466424/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1265632 CPUtime=2653.9 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2199721 0 0 0 265018 372 0 0 25 0 4 0 516362470 1296007168 237021 33554432000 4194304 4623224 140736376049056 18446744073709551615 4412446 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 316408 237022 344 105 0 311912 0
[pid=19724/tid=19726] ppid=19722 vsize=1265632 CPUtime=660.34 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 77131 0 0 0 66018 16 0 0 25 0 4 0 516362618 1296007168 237022 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1265632 CPUtime=664.03 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238605 0 0 0 66350 53 0 0 25 0 4 0 516362618 1296007168 237022 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1265632 CPUtime=664.01 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1676727 0 0 0 66128 273 0 0 25 0 4 0 516362618 1296007168 237023 33554432000 4194304 4623224 140736376049056 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2653.9
Current children cumulated vsize (KiB) 1265632

[startup+667.1 s]
/proc/loadavg: 8.07 8.09 8.05 10/184 19777
/proc/meminfo: memFree=16464192/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1265632 CPUtime=2660.27 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2209191 0 0 0 265653 374 0 0 25 0 4 0 516362470 1296007168 240069 33554432000 4194304 4623224 140736376049056 18446744073709551615 4412513 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 316408 240069 344 105 0 311912 0
[pid=19724/tid=19726] ppid=19722 vsize=1265632 CPUtime=661.93 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 77575 0 0 0 66177 16 0 0 25 0 4 0 516362618 1296007168 240069 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317180 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1265632 CPUtime=665.63 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238605 0 0 0 66510 53 0 0 25 0 4 0 516362618 1296007168 240069 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1265632 CPUtime=665.61 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1685747 0 0 0 66287 274 0 0 25 0 4 0 516362618 1296007168 240069 33554432000 4194304 4623224 140736376049056 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2660.27
Current children cumulated vsize (KiB) 1265632

[startup+667.9 s]
/proc/loadavg: 8.07 8.09 8.05 10/184 19777
/proc/meminfo: memFree=16471880/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1265632 CPUtime=2663.47 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2209198 0 0 0 265973 374 0 0 25 0 4 0 516362470 1296007168 236955 33554432000 4194304 4623224 140736376049056 18446744073709551615 4412473 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 316408 236955 344 105 0 311912 0
[pid=19724/tid=19726] ppid=19722 vsize=1265632 CPUtime=662.72 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 77575 0 0 0 66256 16 0 0 25 0 4 0 516362618 1296007168 236955 33554432000 4194304 4623224 140736376049056 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1265632 CPUtime=666.43 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238605 0 0 0 66590 53 0 0 25 0 4 0 516362618 1296007168 236955 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317145 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1265632 CPUtime=666.41 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1685752 0 0 0 66367 274 0 0 25 0 4 0 516362618 1296007168 236955 33554432000 4194304 4623224 140736376049056 18446744073709551615 4364999 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2663.47
Current children cumulated vsize (KiB) 1265632

[startup+668.3 s]
/proc/loadavg: 8.07 8.09 8.05 10/184 19777
/proc/meminfo: memFree=16471880/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=1265632 CPUtime=2665.07 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) R 19722 19724 19389 0 -1 4202496 2209202 0 0 0 266133 374 0 0 25 0 4 0 516362470 1296007168 236959 33554432000 4194304 4623224 140736376049056 18446744073709551615 4412446 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 316408 236959 344 105 0 311912 0
[pid=19724/tid=19726] ppid=19722 vsize=1265632 CPUtime=663.12 cores=0,2,4,6
/proc/19724/task/19726/stat : 19726 (SArTagnan) R 19722 19724 19389 0 -1 4202560 77575 0 0 0 66296 16 0 0 25 0 4 0 516362618 1296007168 236959 33554432000 4194304 4623224 140736376049056 18446744073709551615 4364891 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19724/tid=19727] ppid=19722 vsize=1265632 CPUtime=666.83 cores=0,2,4,6
/proc/19724/task/19727/stat : 19727 (SArTagnan) R 19722 19724 19389 0 -1 4202560 238605 0 0 0 66630 53 0 0 25 0 4 0 516362618 1296007168 236959 33554432000 4194304 4623224 140736376049056 18446744073709551615 4317199 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=1265632 CPUtime=666.81 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4202560 1685752 0 0 0 66407 274 0 0 25 0 4 0 516362618 1296007168 236959 33554432000 4194304 4623224 140736376049056 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2665.07
Current children cumulated vsize (KiB) 1265632

[startup+668.4 s]
/proc/loadavg: 8.07 8.09 8.05 10/184 19777
/proc/meminfo: memFree=16471880/32951124 swapFree=67111528/67111528
[pid=19724] ppid=19722 vsize=0 CPUtime=2665.35 cores=0,2,4,6
/proc/19724/stat : 19724 (SArTagnan) Z 19722 19724 19389 0 -1 4203548 2209215 0 0 0 266157 378 0 0 25 0 2 0 516362470 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19724/statm: 0 0 0 0 0 0 0
[pid=19724/tid=19728] ppid=19722 vsize=0 CPUtime=666.91 cores=0,2,4,6
/proc/19724/task/19728/stat : 19728 (SArTagnan) R 19722 19724 19389 0 -1 4203588 1685752 0 0 0 66413 278 0 0 25 0 2 0 516362618 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2665.35
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 668.407
CPU time (s): 2665.36
CPU user time (s): 2661.58
CPU system time (s): 3.78642
CPU usage (%): 398.763
Max. virtual memory (cumulated for all children) (KiB): 1265632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2661.58
system time used= 3.78642
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2209215
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 141
involuntary context switches= 12279

runsolver used 1.00985 second user time and 2.6376 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 05:27:25
IDJOB=3283103
IDBENCH=70961
IDSOLVER=1656
FILE ID=node138/3283103-1304047643
RUNJOBID= node138-1304045043-19407
PBS_JOBID= 13170394
Free space on /tmp= 71764 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_L150_coli.sat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3283103-1304047643/watcher-3283103-1304047643 -o /tmp/evaluation-result-3283103-1304047643/solver-3283103-1304047643 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3283103-1304047643.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ba6884aaa746378e56c38fd8b3d0255e
RANDOM SEED=1728714742

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15087472 kB
Buffers:       2040200 kB
Cached:       11518936 kB
SwapCached:          0 kB
Active:        6931884 kB
Inactive:     10361208 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15087472 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           49840 kB
Writeback:           0 kB
AnonPages:     3733384 kB
Mapped:          15524 kB
Slab:           500588 kB
PageTables:      12268 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  4301208 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71748 MiB
End job on node138 at 2011-04-29 05:38:33