Trace number 3729116

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 1695.94 1691.97

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/
prestwich/armies/normalized-army12.21ls.opb
MD5SUM3d28f31cd61cfb39466f429c599fdb4f
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark10.7814
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables428
Total number of constraints644
Number of constraints which are clauses354
Number of constraints which are cardinality constraints (but not clauses)2
Number of constraints which are nor clauses,nor cardinality constraints288
Minimum length of a constraint2
Maximum length of a constraint144
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 21
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 165
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.38/1.41	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.38/1.41	c INFO: solving HOME/instance-3729116-1338713783.opb
0.38/1.42	c INFO: parsing took 0.01 s
0.38/1.43	c INFO: features took 0.01 CPU seconds
0.38/1.46	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.59)
48.75/49.70	c INFO: running scip-2.0.1-clp@0 for 45 with 1752 remaining (b = 0.10)
96.60/97.57	c INFO: running clasp-1.3.7@0 for 45 with 1705 remaining (b = 0.04)
143.84/144.72	c INFO: running clasp-1.3.7@47 for 45 with 1658 remaining (b = 0.01)
191.99/192.86	c INFO: running pbct-0.1.2-linear@0 for 45 with 1610 remaining (b = 0.01)
243.24/244.03	c INFO: running scip-2.0.1-clp@47 for 45 with 1563 remaining (b = 0.01)
288.26/288.98	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1518 remaining (b = 0.01)
337.80/336.62	c INFO: running clasp-1.3.7@95 for 136 with 1469 remaining (b = 0.02)
471.38/470.01	c INFO: running scip-2.0.1-spx@47 for 45 with 1336 remaining (b = 0.01)
520.30/518.88	c INFO: running bsolo_pb10-l3@0 for 45 with 1288 remaining (b = 0.02)
567.55/566.06	c INFO: running scip-2.0.1-spx@94 for 410 with 1241 remaining (b = 0.06)
986.49/984.08	c INFO: running bsolo_pb10-l1@0 for 91 with 834 remaining (b = 0.01)
1081.94/1079.38	c INFO: running bsolo_pb10-l2@0 for 45 with 739 remaining (b = 0.00)
1129.20/1126.55	c INFO: running scip-2.0.1-spx@502 for 547 with 692 remaining (b = 0.05)
1695.23/1691.27	c INFO: running wbo1.4a@0 for 45 with 141 remaining (b = 0.00)
1695.94/1691.96	c INFO: running scip-2.0.1-clp@91 for 45 with 141 remaining (b = 0.00)
1695.94/1691.96	Traceback (most recent call last):
1695.94/1691.96	  File "HOME/solve", line 33, in <module>
1695.94/1691.96	    plac.call(main)
1695.94/1691.96	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3729116-1338713783/watcher-3729116-1338713783 -o /tmp/evaluation-result-3729116-1338713783/solver-3729116-1338713783 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3729116-1338713783.opb -seed 1836371932 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.03 1.88 1.86 3/191 4321
/proc/meminfo: memFree=29813212/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=15276 CPUtime=0 cores=0,2,4,6
/proc/4321/stat : 4321 (python) D 4319 4321 3958 0 -1 4202496 671 0 0 0 0 0 0 0 20 0 1 0 337504400 15642624 559 33554432000 4194304 5683644 140735408705376 140735408673320 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 0 0 0 0 0 0
/proc/4321/statm: 3819 559 324 364 0 261 0

[startup+0.0529241 s]
/proc/loadavg: 2.03 1.88 1.86 3/191 4321
/proc/meminfo: memFree=29813212/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=16592 CPUtime=0.01 cores=0,2,4,6
/proc/4321/stat : 4321 (python) D 4319 4321 3958 0 -1 4202496 1150 0 0 0 1 0 0 0 20 0 1 0 337504400 16990208 962 33554432000 4194304 5683644 140735408705376 140735408689624 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 0 0 0 0 0 0
/proc/4321/statm: 4148 962 394 364 0 590 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16592

[startup+0.10026 s]
/proc/loadavg: 2.03 1.88 1.86 3/191 4321
/proc/meminfo: memFree=29813212/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=19084 CPUtime=0.02 cores=0,2,4,6
/proc/4321/stat : 4321 (python) D 4319 4321 3958 0 -1 4202496 1398 0 0 0 2 0 0 0 20 0 1 0 337504400 19542016 1153 33554432000 4194304 5683644 140735408705376 140735408645368 217401355559 0 0 16781312 2 18446744072100588836 0 0 17 0 0 0 0 0 0
/proc/4321/statm: 4771 1153 430 364 0 695 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 19084

[startup+0.300162 s]
/proc/loadavg: 2.03 1.88 1.86 3/191 4321
/proc/meminfo: memFree=29813212/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=83948 CPUtime=0.05 cores=0,2,4,6
/proc/4321/stat : 4321 (python) D 4319 4321 3958 0 -1 4202496 2916 0 0 0 4 1 0 0 20 0 1 0 337504400 85962752 2442 33554432000 4194304 5683644 140735408705376 140735408673000 217410525031 0 0 16781312 2 18446744071580543392 0 0 17 0 0 0 0 0 0
/proc/4321/statm: 20987 2442 744 364 0 1615 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 83948

[startup+0.700222 s]
/proc/loadavg: 2.03 1.88 1.86 3/191 4321
/proc/meminfo: memFree=29813212/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=121780 CPUtime=0.14 cores=0,2,4,6
/proc/4321/stat : 4321 (python) D 4319 4321 3958 0 -1 4202496 5753 1011 1 0 12 2 0 0 20 0 1 0 337504400 124702720 3713 33554432000 4194304 5683644 140735408705376 140735408641240 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 0 0 0 23 0 0
/proc/4321/statm: 30445 3713 998 364 0 2688 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 121780

[startup+1.50015 s]
/proc/loadavg: 2.26 1.93 1.87 3/192 4326
/proc/meminfo: memFree=29789404/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=357440 CPUtime=0.43 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 10564 1011 1 0 36 7 0 0 20 0 2 0 337504400 366018560 7247 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 23 0 0
/proc/4321/statm: 89360 7247 1900 364 0 24583 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 357440

[startup+3.10028 s]
/proc/loadavg: 2.26 1.93 1.87 3/195 4329
/proc/meminfo: memFree=29757008/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=357440 CPUtime=0.43 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 10564 1011 1 0 36 7 0 0 20 0 2 0 337504400 366018560 7247 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 23 0 0
/proc/4321/statm: 89360 7247 1900 364 0 24583 0
[pid=4327] ppid=4321 vsize=281660 CPUtime=0 cores=0,2,4,6
/proc/4327/stat : 4327 (python) S 4321 4321 3958 0 -1 4202560 767 0 0 0 0 0 0 0 20 0 1 0 337504547 288419840 5682 33554432000 4194304 5683644 140735408705376 140735408696464 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/4327/statm: 70415 5682 341 364 0 5638 0
[pid=4329] ppid=4327 vsize=47520 CPUtime=1.62 cores=0,2,4,6
/proc/4329/stat : 4329 (scip-2.0.1.linu) R 4327 4329 4329 0 -1 4202496 11099 0 0 0 158 4 0 0 20 0 1 0 337504547 48660480 9696 33554432000 4194304 13684479 140733642263696 140733642257448 7419341 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/4329/statm: 11880 9696 814 2317 0 9558 0
[pid=4321/tid=4328] ppid=4319 vsize=357440 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4328/stat : 4328 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 2 0 337504547 366018560 7247 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 2.05
Current children cumulated vsize (KiB) 686620
heavy processes:

[startup+6.30028 s]
/proc/loadavg: 2.26 1.93 1.87 3/195 4329
/proc/meminfo: memFree=29737664/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=357440 CPUtime=0.43 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 10564 1011 1 0 36 7 0 0 20 0 2 0 337504400 366018560 7247 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 23 0 0
/proc/4321/statm: 89360 7247 1900 364 0 24583 0
[pid=4327] ppid=4321 vsize=281660 CPUtime=0 cores=0,2,4,6
/proc/4327/stat : 4327 (python) S 4321 4321 3958 0 -1 4202560 879 0 0 0 0 0 0 0 20 0 1 0 337504547 288419840 5705 33554432000 4194304 5683644 140735408705376 140735408696464 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/4327/statm: 70415 5705 364 364 0 5638 0
[pid=4329] ppid=4327 vsize=47520 CPUtime=4.82 cores=0,2,4,6
/proc/4329/stat : 4329 (scip-2.0.1.linu) R 4327 4329 4329 0 -1 4202496 11103 0 0 0 473 9 0 0 20 0 1 0 337504547 48660480 9700 33554432000 4194304 13684479 140733642263696 140733642257960 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/4329/statm: 11880 9700 818 2317 0 9558 0
[pid=4321/tid=4328] ppid=4319 vsize=357440 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4328/stat : 4328 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 2 0 337504547 366018560 7247 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 5.25
Current children cumulated vsize (KiB) 686620

[startup+12.7002 s]
/proc/loadavg: 2.22 1.94 1.88 3/195 4329
/proc/meminfo: memFree=29725012/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=357440 CPUtime=0.43 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 10564 1011 1 0 36 7 0 0 20 0 2 0 337504400 366018560 7247 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 23 0 0
/proc/4321/statm: 89360 7247 1900 364 0 24583 0
[pid=4327] ppid=4321 vsize=281660 CPUtime=0.01 cores=0,2,4,6
/proc/4327/stat : 4327 (python) S 4321 4321 3958 0 -1 4202560 988 0 0 0 1 0 0 0 20 0 1 0 337504547 288419840 5710 33554432000 4194304 5683644 140735408705376 140735408696464 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/4327/statm: 70415 5710 369 364 0 5638 0
[pid=4329] ppid=4327 vsize=47520 CPUtime=11.22 cores=0,2,4,6
/proc/4329/stat : 4329 (scip-2.0.1.linu) R 4327 4329 4329 0 -1 4202496 11107 0 0 0 1098 24 0 0 20 0 1 0 337504547 48660480 9703 33554432000 4194304 13684479 140733642263696 140733642260472 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/4329/statm: 11880 9703 818 2317 0 9558 0
[pid=4321/tid=4328] ppid=4319 vsize=357440 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4328/stat : 4328 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 2 0 337504547 366018560 7247 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 11.66
Current children cumulated vsize (KiB) 686620

[startup+25.5066 s]
/proc/loadavg: 2.19 1.94 1.88 3/196 4330
/proc/meminfo: memFree=29696360/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=357440 CPUtime=0.43 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 10564 1011 1 0 36 7 0 0 20 0 2 0 337504400 366018560 7247 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 23 0 0
/proc/4321/statm: 89360 7247 1900 364 0 24583 0
[pid=4327] ppid=4321 vsize=281660 CPUtime=0.04 cores=0,2,4,6
/proc/4327/stat : 4327 (python) S 4321 4321 3958 0 -1 4202560 1023 0 0 0 2 2 0 0 20 0 1 0 337504547 288419840 5714 33554432000 4194304 5683644 140735408705376 140735408696464 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/4327/statm: 70415 5714 369 364 0 5638 0
[pid=4329] ppid=4327 vsize=47708 CPUtime=24.02 cores=0,2,4,6
/proc/4329/stat : 4329 (scip-2.0.1.linu) R 4327 4329 4329 0 -1 4202496 11149 0 0 0 2345 57 0 0 20 0 1 0 337504547 48852992 9745 33554432000 4194304 13684479 140733642263696 140733642260840 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/4329/statm: 11927 9745 818 2317 0 9605 0
[pid=4321/tid=4328] ppid=4319 vsize=357440 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4328/stat : 4328 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 2 0 337504547 366018560 7247 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 24.49
Current children cumulated vsize (KiB) 686808

[startup+51.1004 s]
/proc/loadavg: 2.12 1.94 1.88 3/200 4334
/proc/meminfo: memFree=29661260/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=433732 CPUtime=0.46 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 11441 1011 1 0 38 8 0 0 20 0 3 0 337504400 444141568 7371 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 23 0 0
/proc/4321/statm: 108433 7371 1903 364 0 43653 0
[pid=4327] ppid=4321 vsize=357572 CPUtime=0.1 cores=0,2,4,6
/proc/4327/stat : 4327 (python) S 4321 4321 3958 0 -1 4202560 1185 0 0 0 7 3 0 0 20 0 2 0 337504547 366153728 5770 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4327/statm: 89393 5770 399 364 0 24616 0
[pid=4329] ppid=4327 vsize=47840 CPUtime=48.19 cores=0,2,4,6
/proc/4329/stat : 4329 (scip-2.0.1.linu) T 4327 4329 4329 0 -1 4202496 11201 0 0 0 4704 115 0 0 20 0 1 0 337504547 48988160 9797 33554432000 4194304 13684479 140733642263696 140733642257624 11876362 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/4329/statm: 11960 9797 818 2317 0 9638 0
[pid=4327/tid=4331] ppid=4321 vsize=357572 CPUtime=0 cores=0,2,4,6
/proc/4327/task/4331/stat : 4331 (python) S 4321 4321 3958 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 2 0 337509369 366153728 5770 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4332] ppid=4321 vsize=357952 CPUtime=0 cores=0,2,4,6
/proc/4332/stat : 4332 (python) S 4321 4321 3958 0 -1 4202560 776 0 0 0 0 0 0 0 20 0 1 0 337509371 366542848 5798 33554432000 4194304 5683644 140735408705376 140735408696464 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/4332/statm: 89488 5798 336 364 0 24708 0
[pid=4334] ppid=4332 vsize=50916 CPUtime=1.38 cores=0,2,4,6
/proc/4334/stat : 4334 (scip-2.0.1.linu) R 4332 4334 4334 0 -1 4202496 12549 0 0 0 135 3 0 0 20 0 1 0 337509371 52137984 9211 33554432000 4194304 15243407 140736317723888 140736317719032 13354455 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/4334/statm: 12729 9211 946 2698 0 10024 0
[pid=4321/tid=4328] ppid=4319 vsize=433732 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4328/stat : 4328 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 3 0 337504547 444141568 7371 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4321/tid=4333] ppid=4319 vsize=433732 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4333/stat : 4333 (python) S 4319 4321 3958 0 -1 4202560 21 1011 0 0 0 0 0 0 20 0 3 0 337509371 444141568 7371 33554432000 4194304 5683644 140735408705376 139749351346736 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.13
Current children cumulated vsize (KiB) 1248012

[startup+102.3 s]
/proc/loadavg: 2.05 1.95 1.88 3/204 4338
/proc/meminfo: memFree=29650480/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=509416 CPUtime=0.49 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 12384 1011 1 0 41 8 0 0 20 0 4 0 337504400 521641984 7336 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 23 0 0
/proc/4321/statm: 127354 7336 1905 364 0 62571 0
[pid=4327] ppid=4321 vsize=357572 CPUtime=0.1 cores=0,2,4,6
/proc/4327/stat : 4327 (python) S 4321 4321 3958 0 -1 4202560 1185 0 0 0 7 3 0 0 20 0 2 0 337504547 366153728 5770 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4327/statm: 89393 5770 399 364 0 24616 0
[pid=4329] ppid=4327 vsize=47840 CPUtime=48.19 cores=0,2,4,6
/proc/4329/stat : 4329 (scip-2.0.1.linu) T 4327 4329 4329 0 -1 4202496 11201 0 0 0 4704 115 0 0 20 0 1 0 337504547 48988160 9797 33554432000 4194304 13684479 140733642263696 140733642257624 11876362 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/4329/statm: 11960 9797 818 2317 0 9638 0
[pid=4327/tid=4331] ppid=4321 vsize=357572 CPUtime=0 cores=0,2,4,6
/proc/4327/task/4331/stat : 4331 (python) S 4321 4321 3958 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 2 0 337509369 366153728 5770 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4332] ppid=4321 vsize=357952 CPUtime=0.08 cores=0,2,4,6
/proc/4332/stat : 4332 (python) S 4321 4321 3958 0 -1 4202560 1104 0 0 0 5 3 0 0 20 0 2 0 337509371 366542848 5847 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/4332/statm: 89488 5847 384 364 0 24708 0
[pid=4334] ppid=4332 vsize=50944 CPUtime=47.82 cores=0,2,4,6
/proc/4334/stat : 4334 (scip-2.0.1.linu) T 4332 4334 4334 0 -1 4202496 17166 0 0 0 4714 68 0 0 20 0 1 0 337509371 52166656 9585 33554432000 4194304 15243407 140736317723888 140736317718600 8113506 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/4334/statm: 12736 9585 949 2698 0 10031 0
[pid=4332/tid=4335] ppid=4321 vsize=357952 CPUtime=0 cores=0,2,4,6
/proc/4332/task/4335/stat : 4335 (python) S 4321 4321 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337514155 366542848 5847 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4336] ppid=4321 vsize=433636 CPUtime=0 cores=0,2,4,6
/proc/4336/stat : 4336 (python) S 4321 4321 3958 0 -1 4202560 899 0 0 0 0 0 0 0 20 0 1 0 337514158 444043264 5783 33554432000 4194304 5683644 140735408705376 140735408696464 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/4336/statm: 108409 5783 358 364 0 43626 0
[pid=4338] ppid=4336 vsize=2768 CPUtime=4.71 cores=0,2,4,6
/proc/4338/stat : 4338 (clasp-1.3.7-x86) R 4336 4338 4338 0 -1 4202496 688 0 0 0 471 0 0 0 20 0 1 0 337514158 2834432 432 33554432000 134512640 136139019 4289832480 4289831312 134832319 0 0 16781312 16386 0 0 0 17 0 0 0 0 0 0
/proc/4338/statm: 692 432 182 398 0 292 0
[pid=4321/tid=4328] ppid=4319 vsize=509416 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4328/stat : 4328 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 4 0 337504547 521641984 7336 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4321/tid=4333] ppid=4319 vsize=509416 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=4321/tid=4333] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4333/stat : 4333 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 10 0 337509371 987820032 8017 33554432000 4194304 5683644 140735408705376 139749351346736 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4337] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4337/stat : 4337 (python) S 4319 4321 3958 0 -1 4202560 25 1011 0 0 0 0 0 0 20 0 10 0 337514158 987820032 8017 33554432000 4194304 5683644 140735408705376 139749340856880 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4321/tid=4341] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4341/stat : 4341 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337523687 987820032 8017 33554432000 4194304 5683644 140735408705376 139749330367024 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4376] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4376/stat : 4376 (python) S 4319 4321 3958 0 -1 4202560 19 1011 0 0 0 0 0 0 20 0 10 0 337533299 987820032 8017 33554432000 4194304 5683644 140735408705376 139749108998704 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4321/tid=4399] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4399/stat : 4399 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337556289 987820032 8017 33554432000 4194304 5683644 140735408705376 139749098508848 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4433] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4433/stat : 4433 (python) S 4319 4321 3958 0 -1 4202560 23 1011 0 0 0 0 0 0 20 0 10 0 337602809 987820032 8017 33554432000 4194304 5683644 140735408705376 139749088018992 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4437] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4437/stat : 4437 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337612339 987820032 8017 33554432000 4194304 5683644 140735408705376 139749077529136 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4696] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4696/stat : 4696 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337673528 987820032 8017 33554432000 4194304 5683644 140735408705376 139749067039280 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1695.94
Current children cumulated vsize (KiB) 16242516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1691.9 s]
/proc/loadavg: 2.14 2.07 1.97 3/230 4697
/proc/meminfo: memFree=27304336/32873648 swapFree=7628/7628
[pid=4321] ppid=4319 vsize=964668 CPUtime=0.73 cores=0,2,4,6
/proc/4321/stat : 4321 (python) S 4319 4321 3958 0 -1 4202496 18123 1011 1 0 63 10 0 0 20 0 10 0 337504400 987820032 8017 33554432000 4194304 5683644 140735408705376 140735408700208 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 23 0 0
/proc/4321/statm: 241167 8017 1917 364 0 176366 0
[pid=4327] ppid=4321 vsize=359156 CPUtime=2.66 cores=0,2,4,6
/proc/4327/stat : 4327 (python) S 4321 4321 3958 0 -1 4202560 1891 0 0 0 176 90 0 0 20 0 2 0 337504547 367775744 6184 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/4327/statm: 89789 6184 401 364 0 25012 0
[pid=4329] ppid=4327 vsize=51540 CPUtime=1079.6 cores=0,2,4,6
/proc/4329/stat : 4329 (scip-2.0.1.linu) T 4327 4329 4329 0 -1 4202496 12108 0 0 0 105289 2671 0 0 20 0 1 0 337504547 52776960 10971 33554432000 4194304 13684479 140733642263696 140733642257448 11876362 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/4329/statm: 12885 10971 818 2317 0 10563 0
[pid=4327/tid=4331] ppid=4321 vsize=359156 CPUtime=0 cores=0,2,4,6
/proc/4327/task/4331/stat : 4331 (python) S 4321 4321 3958 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 2 0 337509369 367775744 6184 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4332] ppid=4321 vsize=357952 CPUtime=0.2 cores=0,2,4,6
/proc/4332/stat : 4332 (python) S 4321 4321 3958 0 -1 4202560 1190 0 0 0 11 9 0 0 20 0 2 0 337509371 366542848 5847 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/4332/statm: 89488 5847 384 364 0 24708 0
[pid=4334] ppid=4332 vsize=50816 CPUtime=92.74 cores=0,2,4,6
/proc/4334/stat : 4334 (scip-2.0.1.linu) T 4332 4334 4334 0 -1 4202496 37610 0 0 0 9137 137 0 0 20 0 1 0 337509371 52035584 9766 33554432000 4194304 15243407 140736317723888 140736317718600 7436005 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/4334/statm: 12704 9766 949 2698 0 9999 0
[pid=4332/tid=4335] ppid=4321 vsize=357952 CPUtime=0 cores=0,2,4,6
/proc/4332/task/4335/stat : 4335 (python) S 4321 4321 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337514155 366542848 5847 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4336] ppid=4321 vsize=433636 CPUtime=0.36 cores=0,2,4,6
/proc/4336/stat : 4336 (python) S 4321 4321 3958 0 -1 4202560 1139 0 0 0 19 17 0 0 20 0 2 0 337514158 444043264 5810 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/4336/statm: 108409 5810 384 364 0 43626 0
[pid=4338] ppid=4336 vsize=4272 CPUtime=228.54 cores=0,2,4,6
/proc/4338/stat : 4338 (clasp-1.3.7-x86) T 4336 4338 4338 0 -1 4202496 1074 0 0 0 22854 0 0 0 20 0 1 0 337514158 4374528 818 33554432000 134512640 136139019 4289832480 4289831088 134831165 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/4338/statm: 1068 818 182 398 0 668 0
[pid=4336/tid=4339] ppid=4321 vsize=433636 CPUtime=0 cores=0,2,4,6
/proc/4336/task/4339/stat : 4339 (python) S 4321 4321 3958 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 2 0 337518870 444043264 5810 33554432000 4194304 5683644 140735408705376 139749351346736 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4340] ppid=4321 vsize=509812 CPUtime=0.08 cores=0,2,4,6
/proc/4340/stat : 4340 (python) S 4321 4321 3958 0 -1 4202560 1087 0 0 0 5 3 0 0 20 0 2 0 337523687 522047488 5912 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/4340/statm: 127453 5912 384 364 0 62667 0
[pid=4342] ppid=4340 vsize=21688 CPUtime=51.11 cores=0,2,4,6
/proc/4342/stat : 4342 (pbct-0.1.2-linu) T 4340 4342 4342 0 -1 4202496 5241 0 0 0 4703 408 0 0 20 0 1 0 337523687 22208512 5016 33554432000 134512640 136422188 4289724176 4289721500 135874785 0 0 16781312 16387 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/4342/statm: 5422 5016 214 467 0 4953 0
[pid=4340/tid=4350] ppid=4321 vsize=509812 CPUtime=0 cores=0,2,4,6
/proc/4340/task/4350/stat : 4350 (python) S 4321 4321 3958 0 -1 4202560 44 0 0 0 0 0 0 0 20 0 2 0 337528801 522047488 5912 33554432000 4194304 5683644 140735408705376 139749340856880 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4375] ppid=4321 vsize=585584 CPUtime=0.07 cores=0,2,4,6
/proc/4375/stat : 4375 (python) S 4321 4321 3958 0 -1 4202560 1128 0 0 0 4 3 0 0 20 0 2 0 337533299 599638016 5913 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/4375/statm: 146396 5913 384 364 0 81607 0
[pid=4377] ppid=4375 vsize=9624972 CPUtime=49.38 cores=0,2,4,6
/proc/4377/stat : 4377 (java) T 4375 4377 4377 0 -1 4202496 23200 0 32 0 4897 41 0 0 20 0 19 0 337533299 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 140737179788224 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 8 0 0
/proc/4377/statm: 2406243 428385 2257 9 0 2396937 0
[pid=4377/tid=4378] ppid=4375 vsize=9624972 CPUtime=47.08 cores=0,2,4,6
/proc/4377/task/4378/stat : 4378 (java) T 4375 4377 4377 0 -1 4202560 3553 0 7 0 4683 25 0 0 20 0 19 0 337533310 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814661582064 139814490368767 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 15 0 0
[pid=4377/tid=4379] ppid=4375 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/4377/task/4379/stat : 4379 (java) T 4375 4377 4377 0 -1 4202560 41 0 0 0 7 2 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814623075240 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=4377/tid=4380] ppid=4375 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/4377/task/4380/stat : 4380 (java) T 4375 4377 4377 0 -1 4202560 28 0 0 0 7 2 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814622022696 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4377/tid=4381] ppid=4375 vsize=9624972 CPUtime=0.07 cores=0,2,4,6
/proc/4377/task/4381/stat : 4381 (java) T 4375 4377 4377 0 -1 4202560 34 0 0 0 5 2 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814620969640 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=4377/tid=4382] ppid=4375 vsize=9624972 CPUtime=0.1 cores=0,2,4,6
/proc/4377/task/4382/stat : 4382 (java) T 4375 4377 4377 0 -1 4202560 96 0 0 0 8 2 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814619917096 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=4377/tid=4383] ppid=4375 vsize=9624972 CPUtime=0.05 cores=0,2,4,6
/proc/4377/task/4383/stat : 4383 (java) T 4375 4377 4377 0 -1 4202560 60 0 0 0 5 0 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814618864040 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=4377/tid=4384] ppid=4375 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/4377/task/4384/stat : 4384 (java) T 4375 4377 4377 0 -1 4202560 31 0 0 0 7 2 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814617811496 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=4377/tid=4385] ppid=4375 vsize=9624972 CPUtime=0.07 cores=0,2,4,6
/proc/4377/task/4385/stat : 4385 (java) T 4375 4377 4377 0 -1 4202560 72 0 0 0 5 2 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814616758440 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=4377/tid=4386] ppid=4375 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/4377/task/4386/stat : 4386 (java) T 4375 4377 4377 0 -1 4202560 81 0 0 0 7 2 0 0 20 0 19 0 337533316 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814615705896 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=4377/tid=4387] ppid=4375 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/4377/task/4387/stat : 4387 (java) T 4375 4377 4377 0 -1 4202560 742 0 0 0 0 0 0 0 20 0 19 0 337533319 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814485601128 217413892009 0 0 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=4377/tid=4388] ppid=4375 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/4377/task/4388/stat : 4388 (java) T 4375 4377 4377 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 337533320 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814484547448 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4377/tid=4389] ppid=4375 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/4377/task/4389/stat : 4389 (java) T 4375 4377 4377 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 337533321 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814483494280 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4377/tid=4390] ppid=4375 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/4377/task/4390/stat : 4390 (java) T 4375 4377 4377 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337533328 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814482443024 217413900064 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4377/tid=4391] ppid=4375 vsize=9624972 CPUtime=0.59 cores=0,2,4,6
/proc/4377/task/4391/stat : 4391 (java) T 4375 4377 4377 0 -1 4202560 6826 0 1 0 57 2 0 0 20 0 19 0 337533328 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814481389880 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4377/tid=4392] ppid=4375 vsize=9624972 CPUtime=0.92 cores=0,2,4,6
/proc/4377/task/4392/stat : 4392 (java) T 4375 4377 4377 0 -1 4202560 10239 0 1 0 90 2 0 0 20 0 19 0 337533328 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814480337336 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4377/tid=4393] ppid=4375 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/4377/task/4393/stat : 4393 (java) T 4375 4377 4377 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337533328 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814479284472 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4377/tid=4394] ppid=4375 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/4377/task/4394/stat : 4394 (java) T 4375 4377 4377 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 337533328 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814478232136 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=4377/tid=4395] ppid=4375 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/4377/task/4395/stat : 4395 (java) T 4375 4377 4377 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 337533348 9855971328 428385 33554432000 1073741824 1073778376 140737179797088 139814477178408 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=4375/tid=4396] ppid=4321 vsize=585584 CPUtime=0 cores=0,2,4,6
/proc/4375/task/4396/stat : 4396 (python) S 4321 4321 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337538061 599638016 5913 33554432000 4194304 5683644 140735408705376 139749330367024 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4398] ppid=4321 vsize=661376 CPUtime=0.08 cores=0,2,4,6
/proc/4398/stat : 4398 (python) S 4321 4321 3958 0 -1 4202560 1121 0 0 0 4 4 0 0 20 0 2 0 337556289 677249024 6446 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4398/statm: 165344 6446 384 364 0 100552 0
[pid=4400] ppid=4398 vsize=52568 CPUtime=47.13 cores=0,2,4,6
/proc/4400/stat : 4400 (bsolo_pb10) T 4398 4400 4400 0 -1 4202496 10970 0 0 0 4710 3 0 0 20 0 1 0 337556289 53829632 10698 33554432000 134512640 137138936 4293851072 4293850000 134542484 0 0 16781312 16384 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/4400/statm: 13142 10698 192 642 0 12498 0
[pid=4398/tid=4401] ppid=4321 vsize=661376 CPUtime=0 cores=0,2,4,6
/proc/4398/task/4401/stat : 4401 (python) S 4321 4321 3958 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 2 0 337561004 677249024 6446 33554432000 4194304 5683644 140735408705376 139749108998704 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4432] ppid=4321 vsize=737168 CPUtime=0.16 cores=0,2,4,6
/proc/4432/stat : 4432 (python) S 4321 4321 3958 0 -1 4202560 1166 0 0 0 8 8 0 0 20 0 2 0 337602809 754860032 6453 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4432/statm: 184292 6453 384 364 0 119497 0
[pid=4434] ppid=4432 vsize=62528 CPUtime=95.26 cores=0,2,4,6
/proc/4434/stat : 4434 (bsolo_pb10) T 4432 4434 4434 0 -1 4202496 13471 0 0 0 9504 22 0 0 20 0 1 0 337602810 64028672 13197 33554432000 134512640 137138936 4286668928 4286667968 134540747 0 0 16781312 16384 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/4434/statm: 15632 13197 191 642 0 14988 0
[pid=4432/tid=4435] ppid=4321 vsize=737168 CPUtime=0 cores=0,2,4,6
/proc/4432/task/4435/stat : 4435 (python) S 4321 4321 3958 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 2 0 337612338 754860032 6453 33554432000 4194304 5683644 140735408705376 139749098508848 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4436] ppid=4321 vsize=812960 CPUtime=0.08 cores=0,2,4,6
/proc/4436/stat : 4436 (python) S 4321 4321 3958 0 -1 4202560 1195 0 0 0 4 4 0 0 20 0 2 0 337612339 832471040 6477 33554432000 4194304 5683644 140735408705376 140735408697024 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4436/statm: 203240 6477 390 364 0 138442 0
[pid=4438] ppid=4436 vsize=56592 CPUtime=47.14 cores=0,2,4,6
/proc/4438/stat : 4438 (bsolo_pb10) T 4436 4438 4438 0 -1 4202496 11983 0 0 0 4701 13 0 0 20 0 1 0 337612340 57950208 11710 33554432000 134512640 137138936 4288623264 4288622184 135984592 0 0 16781312 16384 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/4438/statm: 14148 11710 192 642 0 13504 0
[pid=4436/tid=4440] ppid=4321 vsize=812960 CPUtime=0 cores=0,2,4,6
/proc/4436/task/4440/stat : 4440 (python) S 4321 4321 3958 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 337617055 832471040 6477 33554432000 4194304 5683644 140735408705376 139749088018992 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4695] ppid=4321 vsize=888888 CPUtime=0 cores=0,2,4,6
/proc/4695/stat : 4695 (python) S 4321 4321 3958 0 -1 4202560 887 0 0 0 0 0 0 0 20 0 1 0 337673528 910221312 6437 33554432000 4194304 5683644 140735408705376 140735408696464 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/4695/statm: 222222 6437 343 364 0 157421 0
[pid=4697] ppid=4695 vsize=6340 CPUtime=0.62 cores=0,2,4,6
/proc/4697/stat : 4697 (wbo1.4a) R 4695 4697 4697 0 -1 4202496 1429 0 0 0 61 1 0 0 20 0 1 0 337673528 6492160 1152 33554432000 134512640 135751879 4293672720 4293670972 135270609 0 0 16781312 3 0 0 0 17 4 0 0 0 0 0
/proc/4697/statm: 1585 1152 143 303 0 1280 0
[pid=4321/tid=4328] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4328/stat : 4328 (python) S 4319 4321 3958 0 -1 4202560 42 1011 0 0 0 0 0 0 20 0 10 0 337504547 987820032 8017 33554432000 4194304 5683644 140735408705376 139749361836592 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4321/tid=4333] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4333/stat : 4333 (python) S 4319 4321 3958 0 -1 4202560 27 1011 0 0 0 0 0 0 20 0 10 0 337509371 987820032 8017 33554432000 4194304 5683644 140735408705376 139749351346736 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4337] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4337/stat : 4337 (python) S 4319 4321 3958 0 -1 4202560 25 1011 0 0 0 0 0 0 20 0 10 0 337514158 987820032 8017 33554432000 4194304 5683644 140735408705376 139749340856880 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4321/tid=4341] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4341/stat : 4341 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337523687 987820032 8017 33554432000 4194304 5683644 140735408705376 139749330367024 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4376] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4376/stat : 4376 (python) S 4319 4321 3958 0 -1 4202560 19 1011 0 0 0 0 0 0 20 0 10 0 337533299 987820032 8017 33554432000 4194304 5683644 140735408705376 139749108998704 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4321/tid=4399] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4399/stat : 4399 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337556289 987820032 8017 33554432000 4194304 5683644 140735408705376 139749098508848 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4433] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4433/stat : 4433 (python) S 4319 4321 3958 0 -1 4202560 23 1011 0 0 0 0 0 0 20 0 10 0 337602809 987820032 8017 33554432000 4194304 5683644 140735408705376 139749088018992 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4437] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4437/stat : 4437 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337612339 987820032 8017 33554432000 4194304 5683644 140735408705376 139749077529136 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4321/tid=4696] ppid=4319 vsize=964668 CPUtime=0 cores=0,2,4,6
/proc/4321/task/4696/stat : 4696 (python) S 4319 4321 3958 0 -1 4202560 22 1011 0 0 0 0 0 0 20 0 10 0 337673528 987820032 8017 33554432000 4194304 5683644 140735408705376 139749067039280 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1695.94
Current children cumulated vsize (KiB) 16242516

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4321 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=757884
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=193970
# CPU time returned by wait4() is 0.951854
# while last known CPU time is 1695.94
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1691.97
CPU time (s): 1695.94
CPU user time (s): 1661.5
CPU system time (s): 34.44
CPU usage (%): 100.234
Max. virtual memory (cumulated for all children) (KiB): 16242516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.757884
system time used= 0.19397
maximum resident set size= 32180
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20980
page faults= 1
swaps= 0
block input operations= 32
block output operations= 448
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2824
involuntary context switches= 14

runsolver used 9.05962 second user time and 21.1328 second system time

The end

Launcher Data 

Begin job on node122 at 2012-06-03 10:56:23
IDJOB=3729116
IDBENCH=1168
IDSOLVER=2327
FILE ID=node122/3729116-1338713783
RUNJOBID= node122-1338713392-3974
PBS_JOBID= 14636732
Free space on /tmp= 71088 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/prestwich/armies/normalized-army12.21ls.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3729116-1338713783/watcher-3729116-1338713783 -o /tmp/evaluation-result-3729116-1338713783/solver-3729116-1338713783 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3729116-1338713783.opb -seed 1836371932 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3d28f31cd61cfb39466f429c599fdb4f
RANDOM SEED=1836371932

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29813740 kB
Buffers:          194872 kB
Cached:          1863804 kB
SwapCached:         1800 kB
Active:           886348 kB
Inactive:        1378368 kB
Active(anon):     206484 kB
Inactive(anon):     2040 kB
Active(file):     679864 kB
Inactive(file):  1376328 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67100160 kB
Dirty:            101852 kB
Writeback:             0 kB
AnonPages:        212256 kB
Mapped:            23560 kB
Shmem:                60 kB
Slab:             654728 kB
SReclaimable:      97804 kB
SUnreclaim:       556924 kB
KernelStack:        1560 kB
PageTables:         7284 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     529536 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     90112 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70860 MiB
End job on node122 at 2012-06-03 11:24:38