patch ptest-runner package in AGL to use Tim Orling's patch

Fixed

Activity

Show:

Jan-Simon Moeller 
November 30, 2018 at 10:36 PM

We take the current way first and then see where things develop into upstream.
The ptest-runner variant looks to me better than the wrapper approach atm.

Kevin Hilman 
November 30, 2018 at 9:42 PM

replying to myself... I'll assume that is ok with Tim's approach since he merged the patches into qa-testdefinitions, so will close this issue.

If we want to rethink this and switch to the Linaro way later, we'll track that as a separate issue.

 

Kevin Hilman 
November 30, 2018 at 12:22 AM

Here's an AGL job for rpi3 using the Linaro ptest wrapper: http://lava.baylibre.com:10080/scheduler/job/59419

 

Kevin Hilman 
November 30, 2018 at 12:06 AM

There's been some off-list discussion that Tim's approach of building LAVA support into ptest-runner itself is not the right way to go.  Rather, we should consider using the Linaro way of running all the ptests first, and then post-processing the output and sending to LAVA: https://git.linaro.org/qa/test-definitions.git/tree/automated/linux/ptest/ptest.yaml

Note that this has the benefit of being more like what users would do at their desktop, but has the downside of being all or nothing, since if the the ptest wrapper fails, the results will never be parsed by LAVA.

However, there does seem to be work in progress to have the ptest.py tool capture/send LAVA signals during the run, so we may be able to upgrade that when available.

what do you think?

Kevin Hilman 
November 27, 2018 at 12:52 AM

Posted a series of patches to qa-testdefinitions that switch the ptest-wrapper from the custom wrapper to using the new LAVA mode: https://gerrit.automotivelinux.org/gerrit/#/c/18313/

Tested on an rpi3 in BayLibre lab.

Tested a local build of master branch on rpi3 in BayLibre lab.

minmal set: http://lava.baylibre.com:10080/scheduler/job/56313

full set: http://lava.baylibre.com:10080/scheduler/job/56314

 

Details

Assignee

Reporter

Labels

Contract ID

Components

Priority

Created October 29, 2018 at 5:16 PM
Updated December 7, 2018 at 8:56 PM
Resolved November 30, 2018 at 9:42 PM

Flag notifications