From 694949b0a1ce209ddf54316988e8336727f18987 Mon Sep 17 00:00:00 2001 From: Luke Conibear Date: Tue, 3 May 2022 16:03:52 +0100 Subject: [PATCH] main.bash uses whole nodes, not scattered cores Changing from: (256 GB memory overall) To: On ARC4, this is 80 cores and 384 GB (40 cores and 192 GB per node). Tests find large performance benefits (up to 40% speed up) from reduced node communication, memory and network latency. This approach is more efficient, general, and reproducible. If the user requires specific domain decompositions then they can request node/core/memory allocations using: However, this approach can be wasteful (e.g., 16 idle cores). The downside to using whole nodes is the queue times can be longer, though this shouldn't be too much of an issue for 1/2 nodes. --- blueprints/leeds/machine_specific/arc4/batch_preambles/main | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/blueprints/leeds/machine_specific/arc4/batch_preambles/main b/blueprints/leeds/machine_specific/arc4/batch_preambles/main index 4bb6f47..558ca2e 100644 --- a/blueprints/leeds/machine_specific/arc4/batch_preambles/main +++ b/blueprints/leeds/machine_specific/arc4/batch_preambles/main @@ -1,6 +1,5 @@ #!/bin/bash -l #$ -cwd -V #$ -l h_rt=48:00:00 -#$ -pe ib 128 -#$ -l h_vmem=2G +#$ -l nodes=2 -- GitLab