Trace number 3266404

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.4 1201.76

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/f600.shuffled.cnf
MD5SUMd42133fd7674f41611be43d1b8ca7db6
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.011997
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2550
Sum of the clauses size7650
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32550
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3266404-1304111653/watcher-3266404-1304111653 -o /tmp/evaluation-result-3266404-1304111653/solver-3266404-1304111653 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3266404-1304111653.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.01 8.05 8.00 6/180 31148
/proc/meminfo: memFree=24375628/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=39700 CPUtime=0 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 610 0 0 0 0 0 0 0 25 0 3 0 601396061 40652800 546 33554432000 4194304 4623224 140736563634736 18446744073709551615 215988648945 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 9925 546 302 105 0 5429 0
[pid=31148/tid=31149] ppid=31146 vsize=39700 CPUtime=0 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 3 0 601396061 40652800 546 33554432000 4194304 4623224 140736563634736 18446744073709551615 47367834064818 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=39700 CPUtime=0 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 3 0 601396061 40652800 546 33554432000 4194304 4623224 140736563634736 18446744073709551615 216000390198 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.106714 s]
/proc/loadavg: 8.01 8.05 8.00 6/180 31148
/proc/meminfo: memFree=24375628/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=248744 CPUtime=0.39 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 2113 0 0 0 39 0 0 0 25 0 4 0 601396061 254713856 1537 33554432000 4194304 4623224 140736563634736 18446744073709551615 4517577 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 62186 1537 342 105 0 57690 0
[pid=31148/tid=31149] ppid=31146 vsize=248744 CPUtime=0.1 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 383 0 0 0 10 0 0 0 25 0 4 0 601396061 254713856 1537 33554432000 4194304 4623224 140736563634736 18446744073709551615 4330845 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=248744 CPUtime=0.09 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 286 0 0 0 9 0 0 0 25 0 4 0 601396061 254713856 1537 33554432000 4194304 4623224 140736563634736 18446744073709551615 4291637 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 248744

[startup+0.200699 s]
/proc/loadavg: 8.01 8.05 8.00 6/180 31148
/proc/meminfo: memFree=24375628/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=249732 CPUtime=0.77 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 2859 0 0 0 77 0 0 0 25 0 4 0 601396061 255725568 1876 33554432000 4194304 4623224 140736563634736 18446744073709551615 4384347 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 62433 1876 342 105 0 57937 0
[pid=31148/tid=31149] ppid=31146 vsize=249732 CPUtime=0.19 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 637 0 0 0 19 0 0 0 25 0 4 0 601396061 255725568 1876 33554432000 4194304 4623224 140736563634736 18446744073709551615 4466451 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=249732 CPUtime=0.19 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 519 0 0 0 19 0 0 0 25 0 4 0 601396061 255725568 1876 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376862 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 249732

[startup+0.300681 s]
/proc/loadavg: 8.01 8.05 8.00 6/180 31148
/proc/meminfo: memFree=24375628/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=251012 CPUtime=1.17 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 3574 0 0 0 117 0 0 0 25 0 4 0 601396061 257036288 2265 33554432000 4194304 4623224 140736563634736 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 62753 2265 342 105 0 58257 0
[pid=31148/tid=31149] ppid=31146 vsize=251012 CPUtime=0.29 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 903 0 0 0 29 0 0 0 25 0 4 0 601396061 257036288 2265 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=251012 CPUtime=0.29 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 792 0 0 0 29 0 0 0 25 0 4 0 601396061 257036288 2265 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 251012

[startup+0.700611 s]
/proc/loadavg: 8.01 8.05 8.00 6/180 31148
/proc/meminfo: memFree=24375628/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=253040 CPUtime=2.76 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 5563 0 0 0 276 0 0 0 25 0 4 0 601396061 259112960 3379 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510896 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 63260 3379 342 105 0 58764 0
[pid=31148/tid=31149] ppid=31146 vsize=253040 CPUtime=0.69 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 1503 0 0 0 69 0 0 0 25 0 4 0 601396061 259112960 3379 33554432000 4194304 4623224 140736563634736 18446744073709551615 4330912 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=253040 CPUtime=0.68 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 1423 0 0 0 68 0 0 0 25 0 4 0 601396061 259112960 3379 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 253040

[startup+1.50048 s]
/proc/loadavg: 8.01 8.05 8.00 9/184 31152
/proc/meminfo: memFree=24359172/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=257516 CPUtime=5.96 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 8762 0 0 0 595 1 0 0 25 0 4 0 601396061 263696384 5192 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 64379 5192 342 105 0 59883 0
[pid=31148/tid=31149] ppid=31146 vsize=257516 CPUtime=1.48 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 2293 0 0 0 148 0 0 0 25 0 4 0 601396061 263696384 5192 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=257516 CPUtime=1.48 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 2317 0 0 0 148 0 0 0 25 0 4 0 601396061 263696384 5192 33554432000 4194304 4623224 140736563634736 18446744073709551615 4461028 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=257516 CPUtime=1.49 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 2320 0 0 0 149 0 0 0 25 0 4 0 601396061 263696384 5192 33554432000 4194304 4623224 140736563634736 18446744073709551615 4364681 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 257516

[startup+3.1012 s]
/proc/loadavg: 8.01 8.05 8.00 9/184 31152
/proc/meminfo: memFree=24337720/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=262192 CPUtime=12.36 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 13571 0 0 0 1234 2 0 0 25 0 4 0 601396061 268484608 8156 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510086 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 65548 8156 343 105 0 61052 0
[pid=31148/tid=31149] ppid=31146 vsize=262192 CPUtime=3.07 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 3755 0 0 0 307 0 0 0 25 0 4 0 601396061 268484608 8156 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=262192 CPUtime=3.08 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 3747 0 0 0 308 0 0 0 25 0 4 0 601396061 268484608 8156 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=262192 CPUtime=3.09 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 3610 0 0 0 309 0 0 0 25 0 4 0 601396061 268484608 8156 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 262192

[startup+6.30064 s]
/proc/loadavg: 8.01 8.05 8.00 9/184 31152
/proc/meminfo: memFree=24315012/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=275552 CPUtime=25.14 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 23362 0 0 0 2510 4 0 0 25 0 4 0 601396061 282165248 12679 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 68888 12679 343 105 0 64392 0
[pid=31148/tid=31149] ppid=31146 vsize=275552 CPUtime=6.25 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 6935 0 0 0 624 1 0 0 25 0 4 0 601396061 282165248 12679 33554432000 4194304 4623224 140736563634736 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=275552 CPUtime=6.28 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 7209 0 0 0 627 1 0 0 25 0 4 0 601396061 282165248 12679 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=275552 CPUtime=6.28 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 5721 0 0 0 628 0 0 0 25 0 4 0 601396061 282165248 12679 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 275552

[startup+12.7005 s]
/proc/loadavg: 8.01 8.05 8.00 9/184 31152
/proc/meminfo: memFree=24285516/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=291712 CPUtime=50.7 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 73657 0 0 0 5057 13 0 0 25 0 4 0 601396061 298713088 18049 33554432000 4194304 4623224 140736563634736 18446744073709551615 4384648 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 72928 18049 343 105 0 68432 0
[pid=31148/tid=31149] ppid=31146 vsize=291712 CPUtime=12.61 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 9935 0 0 0 1260 1 0 0 25 0 4 0 601396061 298713088 18049 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=291712 CPUtime=12.69 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 11123 0 0 0 1265 4 0 0 25 0 4 0 601396061 298713088 18049 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=291712 CPUtime=12.68 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 47860 0 0 0 1262 6 0 0 25 0 4 0 601396061 298713088 18049 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376719 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 291712

[startup+25.5003 s]
/proc/loadavg: 8.00 8.05 8.00 9/184 31152
/proc/meminfo: memFree=24224392/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=316556 CPUtime=101.83 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 163317 0 0 0 10154 29 0 0 25 0 4 0 601396061 324153344 26915 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510978 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 79139 26915 379 105 0 74643 0
[pid=31148/tid=31149] ppid=31146 vsize=316556 CPUtime=25.35 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 15703 0 0 0 2531 4 0 0 25 0 4 0 601396061 324153344 26915 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=316556 CPUtime=25.48 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 16417 0 0 0 2544 4 0 0 25 0 4 0 601396061 324153344 26915 33554432000 4194304 4623224 140736563634736 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=316556 CPUtime=25.48 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 124477 0 0 0 2530 18 0 0 25 0 4 0 601396061 324153344 26915 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 316556

[startup+51.1008 s]
/proc/loadavg: 8.00 8.04 8.00 9/184 31153
/proc/meminfo: memFree=24165092/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=341396 CPUtime=204.09 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 347755 0 0 0 20344 65 0 0 25 0 4 0 601396061 349589504 37779 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510086 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 85349 37779 413 105 0 80853 0
[pid=31148/tid=31149] ppid=31146 vsize=341396 CPUtime=50.81 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 22304 0 0 0 5075 6 0 0 25 0 4 0 601396061 349589504 37779 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=341396 CPUtime=51.09 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 22819 0 0 0 5103 6 0 0 25 0 4 0 601396061 349589504 37779 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=341396 CPUtime=51.09 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 292310 0 0 0 5059 50 0 0 25 0 4 0 601396061 349589504 37779 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 204.09
Current children cumulated vsize (KiB) 341396

[startup+102.301 s]
/proc/loadavg: 8.03 8.05 8.00 9/184 31155
/proc/meminfo: memFree=24013176/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=475312 CPUtime=408.64 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 684355 0 0 0 40742 122 0 0 25 0 4 0 601396061 486719488 62068 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510978 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 118828 62068 796 105 0 114332 0
[pid=31148/tid=31149] ppid=31146 vsize=475312 CPUtime=101.74 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 33384 0 0 0 10165 9 0 0 25 0 4 0 601396061 486719488 62068 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376853 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=475312 CPUtime=102.29 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 27596 0 0 0 10222 7 0 0 25 0 4 0 601396061 486719488 62068 33554432000 4194304 4623224 140736563634736 18446744073709551615 215988253729 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=475312 CPUtime=102.29 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 602101 0 0 0 10129 100 0 0 25 0 4 0 601396061 486719488 62068 33554432000 4194304 4623224 140736563634736 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.64
Current children cumulated vsize (KiB) 475312

[startup+162.3 s]
/proc/loadavg: 8.12 8.07 8.01 9/184 31156
/proc/meminfo: memFree=23899052/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=507580 CPUtime=648.29 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 1058835 0 0 0 64640 189 0 0 25 0 4 0 601396061 519761920 76086 33554432000 4194304 4623224 140736563634736 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 126895 76086 807 105 0 122399 0
[pid=31148/tid=31149] ppid=31146 vsize=507580 CPUtime=161.41 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 35564 0 0 0 16131 10 0 0 25 0 4 0 601396061 519761920 76086 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=507580 CPUtime=162.29 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 38137 0 0 0 16217 12 0 0 25 0 4 0 601396061 519761920 76086 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=507580 CPUtime=162.28 cores=1,3,5,7

################
# More data... #
################

[pid=31148] ppid=31146 vsize=865624 CPUtime=2565.71 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 3896486 0 0 0 255861 710 0 0 25 0 4 0 601396061 886398976 159812 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 216406 159812 1125 105 0 211910 0
[pid=31148/tid=31149] ppid=31146 vsize=865624 CPUtime=638.8 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 89570 0 0 0 63842 38 0 0 25 0 4 0 601396061 886398976 159812 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366416 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=865624 CPUtime=642.29 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 84102 0 0 0 64203 26 0 0 25 0 4 0 601396061 886398976 159812 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=865624 CPUtime=642.3 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 3667413 0 0 0 63594 636 0 0 25 0 4 0 601396061 886398976 159812 33554432000 4194304 4623224 140736563634736 18446744073709551615 4550432 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2565.71
Current children cumulated vsize (KiB) 865624

[startup+702.301 s]
/proc/loadavg: 8.00 8.04 8.00 9/184 31171
/proc/meminfo: memFree=23249996/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=865624 CPUtime=2805.39 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 4253281 0 0 0 279767 772 0 0 25 0 4 0 601396061 886398976 164685 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 216406 164685 1088 105 0 211910 0
[pid=31148/tid=31149] ppid=31146 vsize=865624 CPUtime=698.47 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 91412 0 0 0 69805 42 0 0 25 0 4 0 601396061 886398976 164685 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=865624 CPUtime=702.29 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 85691 0 0 0 70201 28 0 0 25 0 4 0 601396061 886398976 164685 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376895 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=865624 CPUtime=702.29 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 4020383 0 0 0 69538 691 0 0 25 0 4 0 601396061 886398976 164685 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2805.39
Current children cumulated vsize (KiB) 865624

[startup+762.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/184 31172
/proc/meminfo: memFree=23194648/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=931160 CPUtime=3045.09 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 4598865 0 0 0 303676 833 0 0 25 0 4 0 601396061 953507840 170984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510918 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 232790 170984 829 105 0 228294 0
[pid=31148/tid=31149] ppid=31146 vsize=931160 CPUtime=758.15 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 93400 0 0 0 75771 44 0 0 25 0 4 0 601396061 953507840 170984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=931160 CPUtime=762.3 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 87201 0 0 0 76200 30 0 0 25 0 4 0 601396061 953507840 170984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=931160 CPUtime=762.3 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 4361733 0 0 0 75481 749 0 0 25 0 4 0 601396061 953507840 170984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3045.09
Current children cumulated vsize (KiB) 931160

[startup+822.301 s]
/proc/loadavg: 8.04 8.04 8.00 9/184 31174
/proc/meminfo: memFree=23116628/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=990352 CPUtime=3284.75 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 4932562 0 0 0 327581 894 0 0 25 0 4 0 601396061 1014120448 186256 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 247588 186256 795 105 0 243092 0
[pid=31148/tid=31149] ppid=31146 vsize=990352 CPUtime=817.82 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 95565 0 0 0 81737 45 0 0 25 0 4 0 601396061 1014120448 186256 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376875 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=990352 CPUtime=822.3 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 88808 0 0 0 82198 32 0 0 25 0 4 0 601396061 1014120448 186256 33554432000 4194304 4623224 140736563634736 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=990352 CPUtime=822.29 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 4681385 0 0 0 81425 804 0 0 25 0 4 0 601396061 1014120448 186256 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376855 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.75
Current children cumulated vsize (KiB) 990352

[startup+882.306 s]
/proc/loadavg: 8.09 8.06 8.01 9/184 31175
/proc/meminfo: memFree=23055084/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=924816 CPUtime=3524.45 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 5274431 0 0 0 351492 953 0 0 25 0 4 0 601396061 947011584 188553 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510142 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 231204 188553 785 105 0 226708 0
[pid=31148/tid=31149] ppid=31146 vsize=924816 CPUtime=877.5 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 96223 0 0 0 87704 46 0 0 25 0 4 0 601396061 947011584 188553 33554432000 4194304 4623224 140736563634736 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=924816 CPUtime=882.31 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 89942 0 0 0 88197 34 0 0 25 0 4 0 601396061 947011584 188553 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=924816 CPUtime=882.31 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 5020280 0 0 0 87370 861 0 0 25 0 4 0 601396061 947011584 188553 33554432000 4194304 4623224 140736563634736 18446744073709551615 4577687 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3524.45
Current children cumulated vsize (KiB) 924816

[startup+942.301 s]
/proc/loadavg: 8.18 8.09 8.02 9/184 31177
/proc/meminfo: memFree=23010780/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=1055888 CPUtime=3764.1 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 5625103 0 0 0 375396 1014 0 0 25 0 4 0 601396061 1081229312 195695 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510017 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 263972 195695 799 105 0 259476 0
[pid=31148/tid=31149] ppid=31146 vsize=1055888 CPUtime=937.17 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 98158 0 0 0 93668 49 0 0 25 0 4 0 601396061 1081229312 195695 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=1055888 CPUtime=942.3 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 91269 0 0 0 94195 35 0 0 25 0 4 0 601396061 1081229312 195695 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=1055888 CPUtime=942.3 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 5366802 0 0 0 93313 917 0 0 25 0 4 0 601396061 1081229312 195695 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3764.1
Current children cumulated vsize (KiB) 1055888

[startup+1002.3 s]
/proc/loadavg: 8.18 8.10 8.02 9/184 31179
/proc/meminfo: memFree=22940208/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=1084872 CPUtime=4003.77 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 5972704 0 0 0 399299 1078 0 0 25 0 4 0 601396061 1110908928 201765 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 271218 201765 797 105 0 266722 0
[pid=31148/tid=31149] ppid=31146 vsize=1084872 CPUtime=996.84 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 100099 0 0 0 99632 52 0 0 25 0 4 0 601396061 1110908928 201765 33554432000 4194304 4623224 140736563634736 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=1084872 CPUtime=1002.3 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 93312 0 0 0 100193 37 0 0 25 0 4 0 601396061 1110908928 201765 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=1084872 CPUtime=1002.3 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 5709590 0 0 0 99254 976 0 0 25 0 4 0 601396061 1110908928 201765 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.77
Current children cumulated vsize (KiB) 1084872

[startup+1062.3 s]
/proc/loadavg: 8.14 8.10 8.02 9/184 31180
/proc/meminfo: memFree=22874076/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=1180452 CPUtime=4243.45 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 6340221 0 0 0 423203 1142 0 0 25 0 4 0 601396061 1208782848 214188 33554432000 4194304 4623224 140736563634736 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 295113 214188 795 105 0 290617 0
[pid=31148/tid=31149] ppid=31146 vsize=1180452 CPUtime=1056.52 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 106603 0 0 0 105597 55 0 0 25 0 4 0 601396061 1208782848 214188 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=1180452 CPUtime=1062.3 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 121318 0 0 0 106189 41 0 0 25 0 4 0 601396061 1208782848 214188 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=1180452 CPUtime=1062.3 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 6041699 0 0 0 105198 1032 0 0 25 0 4 0 601396061 1208782848 214188 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.45
Current children cumulated vsize (KiB) 1180452

[startup+1122.3 s]
/proc/loadavg: 5.72 7.42 7.79 5/175 31200
/proc/meminfo: memFree=23771228/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=1299424 CPUtime=4483.13 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 6670451 0 0 0 447114 1199 0 0 25 0 4 0 601396061 1330610176 228984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 324856 228984 785 105 0 320360 0
[pid=31148/tid=31149] ppid=31146 vsize=1299424 CPUtime=1116.19 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 136994 0 0 0 111556 63 0 0 25 0 4 0 601396061 1330610176 228984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4377034 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=1299424 CPUtime=1122.3 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 126587 0 0 0 112188 42 0 0 25 0 4 0 601396061 1330610176 228984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=1299424 CPUtime=1122.3 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 6318913 0 0 0 111152 1078 0 0 25 0 4 0 601396061 1330610176 228984 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 1299424

[startup+1182.3 s]
/proc/loadavg: 4.70 6.81 7.56 5/175 31201
/proc/meminfo: memFree=23755052/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=1299424 CPUtime=4722.82 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 6674622 0 0 0 471076 1206 0 0 25 0 4 0 601396061 1330610176 233141 33554432000 4194304 4623224 140736563634736 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 324856 233141 785 105 0 320360 0
[pid=31148/tid=31149] ppid=31146 vsize=1299424 CPUtime=1175.87 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 139162 0 0 0 117519 68 0 0 25 0 4 0 601396061 1330610176 233141 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=1299424 CPUtime=1182.3 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 128064 0 0 0 118187 43 0 0 25 0 4 0 601396061 1330610176 233141 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=1299424 CPUtime=1182.31 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 6319118 0 0 0 117152 1079 0 0 25 0 4 0 601396061 1330610176 233141 33554432000 4194304 4623224 140736563634736 18446744073709551615 4366446 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.82
Current children cumulated vsize (KiB) 1299424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 4.50 6.63 7.48 5/175 31202
/proc/meminfo: memFree=23751308/32950940 swapFree=67111364/67111528
[pid=31148] ppid=31146 vsize=1299424 CPUtime=4800.33 cores=1,3,5,7
/proc/31148/stat : 31148 (SArTagnan) R 31146 31148 30624 0 -1 4202496 6675493 0 0 0 478825 1208 0 0 25 0 4 0 601396061 1330610176 234007 33554432000 4194304 4623224 140736563634736 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31148/statm: 324856 234007 785 105 0 320360 0
[pid=31148/tid=31149] ppid=31146 vsize=1299424 CPUtime=1195.16 cores=1,3,5,7
/proc/31148/task/31149/stat : 31149 (SArTagnan) R 31146 31148 30624 0 -1 4202560 139604 0 0 0 119446 70 0 0 25 0 4 0 601396061 1330610176 234007 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31148/tid=31150] ppid=31146 vsize=1299424 CPUtime=1201.71 cores=1,3,5,7
/proc/31148/task/31150/stat : 31150 (SArTagnan) R 31146 31148 30624 0 -1 4202560 128211 0 0 0 120128 43 0 0 25 0 4 0 601396061 1330610176 234007 33554432000 4194304 4623224 140736563634736 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31148/tid=31152] ppid=31146 vsize=1299424 CPUtime=1201.71 cores=1,3,5,7
/proc/31148/task/31152/stat : 31152 (SArTagnan) R 31146 31148 30624 0 -1 4202560 6319182 0 0 0 119092 1079 0 0 25 0 4 0 601396061 1330610176 234007 33554432000 4194304 4623224 140736563634736 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 1299424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.76
CPU time (s): 4800.4
CPU user time (s): 4788.27
CPU system time (s): 12.1262
CPU usage (%): 399.449
Max. virtual memory (cumulated for all children) (KiB): 1397272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4788.27
system time used= 12.1262
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6675493
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1004
involuntary context switches= 33831

runsolver used 1.84872 second user time and 4.71328 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-29 23:14:13
IDJOB=3266404
IDBENCH=87732
IDSOLVER=1656
FILE ID=node117/3266404-1304111653
RUNJOBID= node117-1304109104-30742
PBS_JOBID= 13170668
Free space on /tmp= 71680 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT02/handmade/simon/satex-challenges/f600.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3266404-1304111653/watcher-3266404-1304111653 -o /tmp/evaluation-result-3266404-1304111653/solver-3266404-1304111653 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3266404-1304111653.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d42133fd7674f41611be43d1b8ca7db6
RANDOM SEED=1073315261

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      24375784 kB
Buffers:       1862480 kB
Cached:        5779764 kB
SwapCached:        160 kB
Active:         953016 kB
Inactive:      7063032 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      24375784 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             416 kB
Writeback:           0 kB
AnonPages:      373360 kB
Mapped:          15456 kB
Slab:           495496 kB
PageTables:       4976 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   603540 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71680 MiB
End job on node117 at 2011-04-29 23:34:17