Trace number 3290417

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.32 1201.75

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
32/aes_32_3_keyfind_1.cnf
MD5SUM278d646386a62d4f28f7fc390c5eab3e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark151.988
Satisfiable
(Un)Satisfiability was proved
Number of variables708
Number of clauses2664
Sum of the clauses size8392
Maximum clause length5
Minimum clause length1
Number of clauses of size 176
Number of clauses of size 2120
Number of clauses of size 31856
Number of clauses of size 4552
Number of clauses of size 560
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3290417-1304097479/watcher-3290417-1304097479 -o /tmp/evaluation-result-3290417-1304097479/solver-3290417-1304097479 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3290417-1304097479.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.61 7.77 7.89 4/176 1178
/proc/meminfo: memFree=30876296/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=19112 CPUtime=0 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 595 0 0 0 0 0 0 0 19 0 1 0 599978572 19570688 531 33554432000 4194304 4623224 140736971852832 18446744073709551615 218880262352 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1178/statm: 4815 544 303 105 0 319 0
[pid=1178/tid=1180] ppid=1176 vsize=181064 CPUtime=0 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 9 0 0 0 0 0 0 0 21 0 4 0 599978572 185409536 619 33554432000 4194304 4623224 140736971852832 18446744073709551615 218880261899 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=181064 CPUtime=0 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 9 0 0 0 0 0 0 0 21 0 4 0 599978572 185409536 619 33554432000 4194304 4623224 140736971852832 18446744073709551615 4304144 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=181064 CPUtime=0 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 22 0 0 0 0 0 0 0 21 0 4 0 599978572 185409536 620 33554432000 4194304 4623224 140736971852832 18446744073709551615 4559668 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.045801 s]
/proc/loadavg: 6.61 7.77 7.89 4/176 1178
/proc/meminfo: memFree=30876296/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=248420 CPUtime=0.16 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 1754 0 0 0 16 0 0 0 21 0 4 0 599978572 254382080 1315 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510358 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 62105 1315 343 105 0 57609 0
[pid=1178/tid=1180] ppid=1176 vsize=248420 CPUtime=0.04 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 225 0 0 0 4 0 0 0 21 0 4 0 599978572 254382080 1315 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=248420 CPUtime=0.04 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 192 0 0 0 4 0 0 0 21 0 4 0 599978572 254382080 1315 33554432000 4194304 4623224 140736971852832 18446744073709551615 4377457 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=248420 CPUtime=0.03 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 285 0 0 0 3 0 0 0 22 0 4 0 599978572 254382080 1315 33554432000 4194304 4623224 140736971852832 18446744073709551615 4545418 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 248420

[startup+0.100791 s]
/proc/loadavg: 6.61 7.77 7.89 4/176 1178
/proc/meminfo: memFree=30876296/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=249028 CPUtime=0.38 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 2257 0 0 0 38 0 0 0 21 0 4 0 599978572 255004672 1446 33554432000 4194304 4623224 140736971852832 18446744073709551615 4517548 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 62257 1446 343 105 0 57761 0
[pid=1178/tid=1180] ppid=1176 vsize=249028 CPUtime=0.09 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 346 0 0 0 9 0 0 0 21 0 4 0 599978572 255004672 1446 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=249028 CPUtime=0.09 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 289 0 0 0 9 0 0 0 21 0 4 0 599978572 255004672 1446 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=249028 CPUtime=0.09 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 485 0 0 0 9 0 0 0 22 0 4 0 599978572 255004672 1446 33554432000 4194304 4623224 140736971852832 18446744073709551615 4377153 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 249028

[startup+0.300756 s]
/proc/loadavg: 6.61 7.77 7.89 4/176 1178
/proc/meminfo: memFree=30876296/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=249956 CPUtime=1.17 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 3762 0 0 0 117 0 0 0 21 0 4 0 599978572 255954944 2090 33554432000 4194304 4623224 140736971852832 18446744073709551615 4360016 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 62489 2090 344 105 0 57993 0
[pid=1178/tid=1180] ppid=1176 vsize=249956 CPUtime=0.29 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 598 0 0 0 29 0 0 0 21 0 4 0 599978572 255954944 2090 33554432000 4194304 4623224 140736971852832 18446744073709551615 4467803 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=249956 CPUtime=0.29 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 735 0 0 0 29 0 0 0 21 0 4 0 599978572 255954944 2090 33554432000 4194304 4623224 140736971852832 18446744073709551615 4465922 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=249956 CPUtime=0.29 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 1180 0 0 0 29 0 0 0 22 0 4 0 599978572 255954944 2090 33554432000 4194304 4623224 140736971852832 18446744073709551615 4467976 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 249956

[startup+0.700688 s]
/proc/loadavg: 6.61 7.77 7.89 4/176 1178
/proc/meminfo: memFree=30876296/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=251968 CPUtime=2.77 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 6960 0 0 0 277 0 0 0 22 0 4 0 599978572 258015232 3280 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 62992 3280 344 105 0 58496 0
[pid=1178/tid=1180] ppid=1176 vsize=251968 CPUtime=0.69 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 1333 0 0 0 69 0 0 0 22 0 4 0 599978572 258015232 3280 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=251968 CPUtime=0.69 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 1315 0 0 0 69 0 0 0 22 0 4 0 599978572 258015232 3280 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=251968 CPUtime=0.69 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 2729 0 0 0 69 0 0 0 25 0 4 0 599978572 258015232 3280 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 251968

[startup+1.50055 s]
/proc/loadavg: 6.61 7.77 7.89 10/184 1186
/proc/meminfo: memFree=30835092/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=257304 CPUtime=5.97 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 11988 0 0 0 596 1 0 0 25 0 4 0 599978572 263479296 4824 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 64326 4824 344 105 0 59830 0
[pid=1178/tid=1180] ppid=1176 vsize=257304 CPUtime=1.48 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 1977 0 0 0 148 0 0 0 25 0 4 0 599978572 263479296 4824 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=257304 CPUtime=1.49 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 1935 0 0 0 149 0 0 0 25 0 4 0 599978572 263479296 4824 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=257304 CPUtime=1.48 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 5982 0 0 0 148 0 0 0 25 0 4 0 599978572 263479296 4824 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 257304

[startup+3.10027 s]
/proc/loadavg: 6.72 7.78 7.89 10/184 1186
/proc/meminfo: memFree=30819468/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=261992 CPUtime=12.36 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 16458 0 0 0 1235 1 0 0 25 0 4 0 599978572 268279808 7553 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510020 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 65498 7553 345 105 0 61002 0
[pid=1178/tid=1180] ppid=1176 vsize=261992 CPUtime=3.07 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 3344 0 0 0 307 0 0 0 25 0 4 0 599978572 268279808 7553 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=261992 CPUtime=3.09 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 3212 0 0 0 309 0 0 0 25 0 4 0 599978572 268279808 7553 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=261992 CPUtime=3.08 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 7091 0 0 0 308 0 0 0 25 0 4 0 599978572 268279808 7553 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376692 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 261992

[startup+6.30071 s]
/proc/loadavg: 6.72 7.78 7.89 10/184 1186
/proc/meminfo: memFree=30791208/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=271168 CPUtime=25.14 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 25886 0 0 0 2510 4 0 0 25 0 4 0 599978572 277676032 11642 33554432000 4194304 4623224 140736971852832 18446744073709551615 4517554 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 67792 11642 357 105 0 63296 0
[pid=1178/tid=1180] ppid=1176 vsize=271168 CPUtime=6.25 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 5353 0 0 0 624 1 0 0 25 0 4 0 599978572 277676032 11642 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=271168 CPUtime=6.28 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 5017 0 0 0 628 0 0 0 25 0 4 0 599978572 277676032 11642 33554432000 4194304 4623224 140736971852832 18446744073709551615 4366369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=271168 CPUtime=6.29 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 11591 0 0 0 628 1 0 0 25 0 4 0 599978572 277676032 11642 33554432000 4194304 4623224 140736971852832 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 271168

[startup+12.7006 s]
/proc/loadavg: 6.82 7.78 7.89 10/184 1186
/proc/meminfo: memFree=30759216/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=283696 CPUtime=50.71 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 61634 0 0 0 5061 10 0 0 25 0 4 0 599978572 290504704 15787 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 70924 15787 382 105 0 66428 0
[pid=1178/tid=1180] ppid=1176 vsize=283696 CPUtime=12.62 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 7711 0 0 0 1260 2 0 0 25 0 4 0 599978572 290504704 15787 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=283696 CPUtime=12.69 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 8074 0 0 0 1268 1 0 0 25 0 4 0 599978572 290504704 15787 33554432000 4194304 4623224 140736971852832 18446744073709551615 4377368 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=283696 CPUtime=12.68 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 40192 0 0 0 1263 5 0 0 25 0 4 0 599978572 290504704 15787 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 283696

[startup+25.5004 s]
/proc/loadavg: 7.15 7.81 7.90 11/184 1187
/proc/meminfo: memFree=30696600/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=298596 CPUtime=101.84 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 139470 0 0 0 10159 25 0 0 25 0 4 0 599978572 305762304 23190 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 74649 23190 347 105 0 70153 0
[pid=1178/tid=1180] ppid=1176 vsize=298596 CPUtime=25.35 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 12101 0 0 0 2532 3 0 0 25 0 4 0 599978572 305762304 23190 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=298596 CPUtime=25.49 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 11788 0 0 0 2547 2 0 0 25 0 4 0 599978572 305762304 23190 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=298596 CPUtime=25.49 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 108332 0 0 0 2531 18 0 0 25 0 4 0 599978572 305762304 23190 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 298596

[startup+51.1009 s]
/proc/loadavg: 7.24 7.77 7.89 9/184 1217
/proc/meminfo: memFree=30461988/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=325612 CPUtime=204.1 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 316185 0 0 0 20354 56 0 0 25 0 4 0 599978572 333426688 34241 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 81403 34241 417 105 0 76907 0
[pid=1178/tid=1180] ppid=1176 vsize=325612 CPUtime=50.81 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 17249 0 0 0 5076 5 0 0 25 0 4 0 599978572 333426688 34241 33554432000 4194304 4623224 140736971852832 18446744073709551615 4377475 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=325612 CPUtime=51.09 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 16833 0 0 0 5107 2 0 0 25 0 4 0 599978572 333426688 34241 33554432000 4194304 4623224 140736971852832 18446744073709551615 4377624 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=325612 CPUtime=51.09 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 271200 0 0 0 5063 46 0 0 25 0 4 0 599978572 333426688 34241 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.1
Current children cumulated vsize (KiB) 325612

[startup+102.307 s]
/proc/loadavg: 7.78 7.84 7.90 9/184 1249
/proc/meminfo: memFree=30558620/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=410468 CPUtime=408.65 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 479632 0 0 0 40778 87 0 0 25 0 4 0 599978572 420319232 56104 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 102617 56104 907 105 0 98121 0
[pid=1178/tid=1180] ppid=1176 vsize=410468 CPUtime=101.74 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 24680 0 0 0 10167 7 0 0 25 0 4 0 599978572 420319232 56104 33554432000 4194304 4623224 140736971852832 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=410468 CPUtime=102.29 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 25276 0 0 0 10224 5 0 0 25 0 4 0 599978572 420319232 56104 33554432000 4194304 4623224 140736971852832 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=410468 CPUtime=102.29 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 404618 0 0 0 10159 70 0 0 25 0 4 0 599978572 420319232 56104 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.65
Current children cumulated vsize (KiB) 410468

[startup+162.3 s]

################
# More data... #
################

[pid=1178] ppid=1176 vsize=892492 CPUtime=2805.38 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 3537210 0 0 0 279903 635 0 0 25 0 4 0 599978572 913911808 167033 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 223123 167034 429 105 0 218627 0
[pid=1178/tid=1180] ppid=1176 vsize=892492 CPUtime=698.47 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 62238 0 0 0 69825 22 0 0 25 0 4 0 599978572 913911808 167034 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=892492 CPUtime=702.31 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 79866 0 0 0 70216 15 0 0 25 0 4 0 599978572 913911808 167034 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=892492 CPUtime=702.27 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 3265588 0 0 0 69650 577 0 0 25 0 4 0 599978572 913911808 167035 33554432000 4194304 4623224 140736971852832 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2805.38
Current children cumulated vsize (KiB) 892492

[startup+762.307 s]
/proc/loadavg: 8.18 8.05 7.95 9/184 1386
/proc/meminfo: memFree=28844048/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=893412 CPUtime=3045.08 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 3870994 0 0 0 303814 694 0 0 25 0 4 0 599978572 914853888 175676 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510327 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 223353 175676 429 105 0 218857 0
[pid=1178/tid=1180] ppid=1176 vsize=893412 CPUtime=758.15 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 64312 0 0 0 75791 24 0 0 25 0 4 0 599978572 914853888 175676 33554432000 4194304 4623224 140736971852832 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=893412 CPUtime=762.31 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 80067 0 0 0 76216 15 0 0 25 0 4 0 599978572 914853888 175676 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=893412 CPUtime=762.27 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 3593742 0 0 0 75595 632 0 0 25 0 4 0 599978572 914853888 175676 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3045.08
Current children cumulated vsize (KiB) 893412

[startup+822.3 s]
/proc/loadavg: 8.12 8.06 7.96 10/184 1388
/proc/meminfo: memFree=28730032/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=960344 CPUtime=3284.73 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 4185464 0 0 0 327722 751 0 0 25 0 4 0 599978572 983392256 182809 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 240086 182809 415 105 0 235590 0
[pid=1178/tid=1180] ppid=1176 vsize=960344 CPUtime=817.82 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 64791 0 0 0 81758 24 0 0 25 0 4 0 599978572 983392256 182809 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=960344 CPUtime=822.31 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 80229 0 0 0 82216 15 0 0 25 0 4 0 599978572 983392256 182809 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=960344 CPUtime=822.27 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 3904344 0 0 0 81538 689 0 0 25 0 4 0 599978572 983392256 182809 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.73
Current children cumulated vsize (KiB) 960344

[startup+882.301 s]
/proc/loadavg: 8.04 8.05 7.96 9/184 1389
/proc/meminfo: memFree=28551532/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1124108 CPUtime=3524.4 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 4571240 0 0 0 351624 816 0 0 25 0 4 0 599978572 1151086592 199193 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 281027 199193 421 105 0 276531 0
[pid=1178/tid=1180] ppid=1176 vsize=1124108 CPUtime=877.5 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 88945 0 0 0 87723 27 0 0 25 0 4 0 599978572 1151086592 199193 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1124108 CPUtime=882.31 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 81585 0 0 0 88216 15 0 0 25 0 4 0 599978572 1151086592 199193 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1124108 CPUtime=882.26 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4215116 0 0 0 87482 744 0 0 25 0 4 0 599978572 1151086592 199193 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.4
Current children cumulated vsize (KiB) 1124108

[startup+942.3 s]
/proc/loadavg: 8.08 8.05 7.96 9/184 1391
/proc/meminfo: memFree=28444584/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1126792 CPUtime=3764.08 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 4890018 0 0 0 375535 873 0 0 25 0 4 0 599978572 1153835008 204813 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 281698 204813 407 105 0 277202 0
[pid=1178/tid=1180] ppid=1176 vsize=1126792 CPUtime=937.17 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 89510 0 0 0 93690 27 0 0 25 0 4 0 599978572 1153835008 204813 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1126792 CPUtime=942.31 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 81819 0 0 0 94216 15 0 0 25 0 4 0 599978572 1153835008 204813 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1126792 CPUtime=942.26 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4531083 0 0 0 93426 800 0 0 25 0 4 0 599978572 1153835008 204813 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3764.08
Current children cumulated vsize (KiB) 1126792

[startup+1002.3 s]
/proc/loadavg: 8.08 8.05 7.97 9/184 1393
/proc/meminfo: memFree=28302780/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1165972 CPUtime=4003.76 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 5203405 0 0 0 399449 927 0 0 25 0 4 0 599978572 1193955328 215358 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 291493 215358 412 105 0 286997 0
[pid=1178/tid=1180] ppid=1176 vsize=1165972 CPUtime=996.84 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 89952 0 0 0 99657 27 0 0 25 0 4 0 599978572 1193955328 215358 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1165972 CPUtime=1002.31 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 87100 0 0 0 100215 16 0 0 25 0 4 0 599978572 1193955328 215358 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1165972 CPUtime=1002.27 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4837011 0 0 0 99375 852 0 0 25 0 4 0 599978572 1193955328 215358 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.76
Current children cumulated vsize (KiB) 1165972

[startup+1062.3 s]
/proc/loadavg: 8.13 8.07 7.98 9/184 1394
/proc/meminfo: memFree=28210580/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1165972 CPUtime=4243.42 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 5241301 0 0 0 423409 933 0 0 25 0 4 0 599978572 1193955328 218134 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510896 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 291493 218134 407 105 0 286997 0
[pid=1178/tid=1180] ppid=1176 vsize=1165972 CPUtime=1056.52 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 90281 0 0 0 105625 27 0 0 25 0 4 0 599978572 1193955328 218134 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1165972 CPUtime=1062.29 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 87188 0 0 0 106213 16 0 0 25 0 4 0 599978572 1193955328 218134 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1165972 CPUtime=1062.26 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4871700 0 0 0 105369 857 0 0 25 0 4 0 599978572 1193955328 218134 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.42
Current children cumulated vsize (KiB) 1165972

[startup+1122.3 s]
/proc/loadavg: 8.13 8.09 7.99 9/184 1396
/proc/meminfo: memFree=28142192/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1165972 CPUtime=4483.09 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 5327643 0 0 0 447358 951 0 0 25 0 4 0 599978572 1193955328 222485 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510133 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 291493 222485 380 105 0 286997 0
[pid=1178/tid=1180] ppid=1176 vsize=1165972 CPUtime=1116.19 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 92671 0 0 0 111591 28 0 0 25 0 4 0 599978572 1193955328 222485 33554432000 4194304 4623224 140736971852832 18446744073709551615 4485971 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1165972 CPUtime=1122.28 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 88152 0 0 0 112212 16 0 0 25 0 4 0 599978572 1193955328 222485 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1165972 CPUtime=1122.27 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4953651 0 0 0 111353 874 0 0 25 0 4 0 599978572 1193955328 222485 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4483.09
Current children cumulated vsize (KiB) 1165972

[startup+1182.3 s]
/proc/loadavg: 8.14 8.10 8.00 9/184 1397
/proc/meminfo: memFree=28064248/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1165972 CPUtime=4722.75 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 5330418 0 0 0 471323 952 0 0 25 0 4 0 599978572 1193955328 223269 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 291493 223269 380 105 0 286997 0
[pid=1178/tid=1180] ppid=1176 vsize=1165972 CPUtime=1175.87 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 92892 0 0 0 117559 28 0 0 25 0 4 0 599978572 1193955328 223269 33554432000 4194304 4623224 140736971852832 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1165972 CPUtime=1182.27 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 88337 0 0 0 118211 16 0 0 25 0 4 0 599978572 1193955328 223269 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1165972 CPUtime=1182.27 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4955383 0 0 0 117352 875 0 0 25 0 4 0 599978572 1193955328 223269 33554432000 4194304 4623224 140736971852832 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.75
Current children cumulated vsize (KiB) 1165972



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.16 8.11 8.00 9/184 1398
/proc/meminfo: memFree=28043508/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1165972 CPUtime=4800.24 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 5343193 0 0 0 479069 955 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 291493 223769 344 105 0 286997 0
[pid=1178/tid=1180] ppid=1176 vsize=1165972 CPUtime=1195.16 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 92958 0 0 0 119488 28 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1165972 CPUtime=1201.67 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 88514 0 0 0 120150 17 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376649 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1165972 CPUtime=1201.67 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4967694 0 0 0 119290 877 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4550521 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1165972

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.16 8.11 8.00 9/184 1398
/proc/meminfo: memFree=28043508/32950928 swapFree=67111524/67111528
[pid=1178] ppid=1176 vsize=1165972 CPUtime=4800.24 cores=1,3,5,7
/proc/1178/stat : 1178 (SArTagnan) R 1176 1178 1141 0 -1 4202496 5343193 0 0 0 479069 955 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1178/statm: 291493 223769 344 105 0 286997 0
[pid=1178/tid=1180] ppid=1176 vsize=1165972 CPUtime=1195.16 cores=1,3,5,7
/proc/1178/task/1180/stat : 1180 (SArTagnan) R 1176 1178 1141 0 -1 4202560 92958 0 0 0 119488 28 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1178/tid=1181] ppid=1176 vsize=1165972 CPUtime=1201.67 cores=1,3,5,7
/proc/1178/task/1181/stat : 1181 (SArTagnan) R 1176 1178 1141 0 -1 4202560 88514 0 0 0 120150 17 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4376649 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1178/tid=1182] ppid=1176 vsize=1165972 CPUtime=1201.67 cores=1,3,5,7
/proc/1178/task/1182/stat : 1182 (SArTagnan) R 1176 1178 1141 0 -1 4202560 4967694 0 0 0 119290 877 0 0 25 0 4 0 599978572 1193955328 223769 33554432000 4194304 4623224 140736971852832 18446744073709551615 4550521 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1165972

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.75
CPU time (s): 4800.32
CPU user time (s): 4790.73
CPU system time (s): 9.59654
CPU usage (%): 399.443
Max. virtual memory (cumulated for all children) (KiB): 1180812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4790.73
system time used= 9.59654
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5343193
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 658
involuntary context switches= 29988

runsolver used 1.79473 second user time and 4.76828 second system time

The end

Launcher Data 

Begin job on node112 at 2011-04-29 19:17:59
IDJOB=3290417
IDBENCH=83432
IDSOLVER=1656
FILE ID=node112/3290417-1304097479
RUNJOBID= node112-1304097479-1160
PBS_JOBID= 13170614
Free space on /tmp= 72564 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/32/aes_32_3_keyfind_1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3290417-1304097479/watcher-3290417-1304097479 -o /tmp/evaluation-result-3290417-1304097479/solver-3290417-1304097479 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3290417-1304097479.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 278d646386a62d4f28f7fc390c5eab3e
RANDOM SEED=754895898

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5261.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30876692 kB
Buffers:        441848 kB
Cached:        1165508 kB
SwapCached:          4 kB
Active:         135072 kB
Inactive:      1537444 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30876692 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            2020 kB
Writeback:           0 kB
AnonPages:       65668 kB
Mapped:          15208 kB
Slab:           334696 kB
PageTables:       4516 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   209120 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72560 MiB
End job on node112 at 2011-04-29 19:38:03