History

coccinelle: fix parallel build with CHECK=scripts/coccicheck

The command "make -j8 C=1 CHECK=scripts/coccicheck" produces lots of "coccicheck failed" error messages. Julia Lawall explained the Coccinelle behavior as follows: "The problem on the Coccinelle side is that it uses a subdirectory with the name of the semantic patch to store standard output and standard error for the different threads. I didn't want to use a name with the pid, so that one could easily find this information while Coccinelle is running. Normally the subdirectory is cleaned up when Coccinelle completes, so there is only one of them at a time. Maybe it is best to just add the pid. There is the risk that these subdirectories will accumulate if Coccinelle crashes in a way such that they don't get cleaned up, but Coccinelle could print a warning if it detects this case, rather than failing." When scripts/coccicheck is used as CHECK tool and -j option is given to Make, the whole of build process runs in parallel. So, multiple processes try to get access to the same subdirectory. I notice spatch creates the subdirectory only when it runs in parallel (i.e. --jobs <N> is given and <N> is greater than 1). Setting NPROC=1 is a reasonable solution; spatch does not create the subdirectory. Besides, ONLINE=1 mode takes a single file input for each spatch invocation, so there is no reason to parallelize it in the first place.

Masahiro Yamada committed 9 years ago

Commit d7059ca1 parent 88127da1 file · +9 −6Browse files

Unified · Split

scripts/coccicheck+9−6
@@ -30,12 +30,6 @@ else · 29 unmodified lines
3030 VERBOSE=0
3131 fi
3232
33−if [ -z "$J" ]; then
34− NPROC=$(getconf _NPROCESSORS_ONLN)
35−else
36− NPROC="$J"
37−fi
38−
3933 FLAGS="--very-quiet"
4034
4135 # You can use SPFLAGS to append extra arguments to coccicheck or override any
@@ -70,6 +64,9 @@ if [ "$C" = "1" -o "$C" = "2" ]; then · 28 unmodified lines
7064 # Take only the last argument, which is the C file to test
7165 shift $(( $# - 1 ))
7266 OPTIONS="$COCCIINCLUDE $1"
67+
68+ # No need to parallelize Coccinelle since this mode takes one input file.
69+ NPROC=1
7370 else
7471 ONLINE=0
7572 if [ "$KBUILD_EXTMOD" = "" ] ; then
@@ -77,6 +74,12 @@ else · 1 unmodified line
7774 else
7875 OPTIONS="--dir $KBUILD_EXTMOD $COCCIINCLUDE"
7976 fi
77+
78+ if [ -z "$J" ]; then
79+ NPROC=$(getconf _NPROCESSORS_ONLN)
80+ else
81+ NPROC="$J"
82+ fi
8083 fi
8184
8285 if [ "$KBUILD_EXTMOD" != "" ] ; then

Keyboard shortcuts

General

Show keyboard shortcuts
?
Focus the current search
/

Issues and pull requests

Open filters
f

Issues, pull requests and Inbox

Select next item
j↓
Select previous item
k↑
Open selected item
Enter
Dismiss filters or clear selection
Esc

Repository code

Go to file
t