m3ulcb only matches sstate-cache ~49% match
Description
Environment
Activity
ronan Le Martret November 26, 2019 at 8:31 AM
Can't reproduce anymore.
ronan Le Martret November 26, 2019 at 8:30 AM
Test to reproduce this issue:
DIST_MACHINE="m3ulcb-nofx"
DIST_FEATURES="agl-ci-change-features-nogfx"
build (1):
# rm -fr tmp bitbake-cookerdaemon.log
bitbake -k agl-image-ivi-crosssdk
# grep -rn "Sstate summary: Wanted"tmp/log/cooker/m3ulcb/*.log:38:Sstate summary: Wanted 2714 Found 661 Missed 2053 Current 0 (24% match, 0% complete)
build (2):
# rm -fr tmp bitbake-cookerdaemon.log
bitbake -k agl-image-ivi-crosssdk
# grep -rn "Sstate summary: Wanted"tmp/log/cooker/m3ulcb/*.log:37:Sstate summary: Wanted 2714 Found 2702 Missed 12 Current 0 (99% match, 0% complete)
build (3):
# rm -fr tmp bitbake-cookerdaemon.log
bitbake -k agl-image-ivi-crosssdk
# grep -rn "Sstate summary: Wanted"tmp/log/cooker/m3ulcb/*.log:37:Sstate summary: Wanted 2714 Found 2702 Missed 12 Current 0 (99% match, 0% complete)
ronan Le Martret November 25, 2019 at 11:23 AM
Test to reproduce this issue:
DIST_MACHINE="m3ulcb"
IMAGE = "agl-demo-platform"
# rm -fr tmp bitbake-cookerdaemon.log
# bitbake agl-demo-platform -k
# grep -rn "Sstate summary: Wanted" tmp/log/
tmp/log/cooker/m3ulcb/20191125092345.log:41:Sstate summary: Wanted 3071 Found 3054 Missed 17 Current 0 (99% match, 0% complete)
# rm -fr tmp bitbake-cookerdaemon.log
# bitbake agl-demo-platform -k
# grep -rn "Sstate summary: Wanted" ../build/build-m3/tmp/log/
tmp/log/cooker/m3ulcb/20191125103826.log:41:Sstate summary: Wanted 3071 Found 3059 Missed 12 Current 0 (99% match, 0% complete)
Harunobu Kurokawa June 10, 2019 at 11:31 AM
We'll investigate
Jan-Simon Moeller June 7, 2019 at 2:27 PM
I see better results when I use linux-libc-headers from thud (aka not linux-libc-headers_4.14). We reach
Sstate summary: Wanted 3026 Found 2611 Missed 415 Current 0 (86% match, 0% complete)This speeds-up the CI builds by ~40% already.
This points-out that we need to take a closer look at not changing the linux-libc-headers in meta-renesas-rcar-gen3.
Looking into this, I found this comment by Richard Purdie:
Let's take another look at this.
As it is related to the m3 bsp, assigning to @Harunobu Kurokawa-san
CC: @Stephane Desneux
Details
Details
Assignee
Reporter
Labels
Contract ID
Priority
Major
Sstate summary: Wanted 2793 Found 1370 Missed 2846 Current 42 (49% match, 49% complete)
vs ~90% match rate on qemux86-64
reproduce (if not own sstate-mirror, build host is ubuntu 16.04 for native packages):
#export DLHOST="http://download.automotivelinux.org/" export DLHOST="https://download.automotivelinux.org/" cat << EOF >> conf/auto.conf PREMIRRORS = "\ git://.*/.* ${DLHOST}/AGL/mirror/ \n \ ftp://.*/.* ${DLHOST}/AGL/mirror/ \n \ http://.*/.* ${DLHOST}/AGL/mirror/ \n \ https://.*/.* ${DLHOST}/AGL/mirror/ \n \ SSTATE_MIRRORS = " \ file://.* ${DLHOST}/sstate-mirror/${DISTROBRANCH}/\${DEFAULTTUNE}/PATH \n \ " # DISTROBRANCH e.g. master # DEFAULTTUNE for m3ulcb is aarch64 (resolved in bitbake) SSTATE_DIR = "\${TOPDIR}/sstate-cache/\${MACHINE}/" EOFFor sstate-cache fill and ci-jobs:
m3 builds aglsetup with:
export TARGETFEATURESnogfx="agl-ci-change-features-nogfx"
all other builds do aglsetup with:
export TARGETFEATURES="agl-ci-change-features"
To see the difference, take a look at
https://build.automotivelinux.org/job/ci-platform-meta-agl-verify/2644/
with the job for qemux86:
https://build.automotivelinux.org/job/ci-platform-meta-agl-verify-CIB-qemux86-64/3278/consoleFull
grep for "Sstate summary", it is the 2nd match
Sstate summary: Wanted 2521 Found 2422 Missed 198 Current 300 (96% match, 96% complete)with the job for m3ulcb-nogfx (less packages!)
https://build.automotivelinux.org/job/ci-platform-meta-agl-verify-CIB-m3ulcb-nogfx/2390/console
grep for "Sstate summary" it is the 2nd match
Sstate summary: Wanted 2793 Found 1370 Missed 2846 Current 42 (49% match, 49% complete)
NOTE: Executing RunQueue Tasks NOTE: Running task 124 of 7645 (/w/workspace/ci-platform-meta-agl-verify-CIB-m3ulcb-nogfx/repoclone/poky/meta/recipes-devtools/gcc/gcc-source_8.2.bb:do_fetch) NOTE: Running task 174 of 7645 (/w/workspace/ci-platform-meta-agl-verify-CIB-m3ulcb-nogfx/repoclone/meta-renesas-rcar-gen3/meta-rcar-gen3/recipes-kernel/linux-libc-headers/linux-libc-headers_4.14.bb:do_fetch)EEk . There is likely a recipe bug. At least head for improvement !!!