summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2019-03-10Merge #364210 from ↵PMR
~sylvain-pineau/plainbox-provider-checkbox:fix-nm_connection_backup_ids
2019-03-10units:wireless: Fix nm_connection_save/restore ids (category->interface)Sylvain Pineau
Using category in identifiers can generate duplicated job ids if more than one wifi device is available on the system: File "/snap/checkbox-foo/z/lib/python3.x/site-packages/plainbox/impl/session/state.py", line 1106, in _add_job_unit raise DependencyDuplicateError(existing_job, new_job) plainbox.impl.depmgr.DependencyDuplicateError: duplicate job id: 'com.canonical.certification::wireless/nm_connection_save_WIRELESS'
2019-03-07Merge #362689 from ~jocave/plainbox-provider-checkbox:led-cert-test-planPMR
2019-03-07Merge #364056 from ↵PMR
~bladernr/plainbox-provider-checkbox:1818898-disk_stats-nvdimms
2019-03-06Modified disk_stats_test to exit with success and a notice if we run on an ↵Jeff Lane
NVDIMM as NVDIMMs disable iostats by default. LP: #1818898
2019-03-05Merge #363952 from ~pieq/plainbox-provider-checkbox:fix-1816809-NA-timesPMR
2019-03-05providers:checkbox: better handle unexpected times in sleep_time_checkPierre Equoy
Sometimes, the time to sleep or resume cannot be computed accurately by FWTS. Instead of returning a numeric value, FWTS then returns "N/A". This commit handles this kind of case better. The job will fail (because it cannot calculate average time), but will provide clearer information instead of a scary stack trace. LP: #1816809
2019-03-01Merge #363443 from ~jocave/plainbox-provider-checkbox:ethernet-detect-testingPMR
2019-02-22Merge #363500 from ~jocave/plainbox-provider-checkbox:filter-out-loop-devicesPMR
2019-02-21removable_storage_test: ignore loop devicesJonathan Cave
2019-02-20ethernet: network_device_info detect/info changesJonathan Cave
The network_device_info script was being used by the ethernet/detect and info/network_devices jobs. This clarifies the two roles and removes the unrequired udev/NM matching code.
2019-02-20Merge #363417 from ~jocave/plainbox-provider-checkbox:wifi-test-rescan-failPMR
2019-02-20wireless: sleep on failure to request rescanJonathan Cave
In wifi_nmcli_test on recent nmcli versions a rescan is requested to ensure an up-to-date list of APs is available. However this request can fail if NM has already started a scan, but we immediately attempt the connection. This should let the background scan complete.
2019-02-19Merge #363364 from ↵PMR
~sylvain-pineau/plainbox-provider-checkbox:fix-oob-inline-comments
2019-02-19units:oob: Fix comments syntaxSylvain Pineau
When using a snapped validation tool, the simple '# comment' was producing the following error: error: [...] field 'requires', expression did not reference any resources
2019-02-14Merge #362097 from ↵PMR
~ray.chen/plainbox-provider-checkbox:automated-switch-gpu-job-into-nested-plan modified: units/graphics/test-plan.pxu and units/suspend/suspend-graphics.pxu
2019-02-14Merge #363164 from ↵PMR
~bladernr/plainbox-provider-checkbox:1815621-add-gpgpu-tests-checkbox Added new GPGPU tests to checkbox
2019-02-13Added new GPGPU tests for cert. LP: #1815621Jeff Lane
2019-02-13modify indentation to consistent with the restray.chen
2019-02-12Merge #362872 from ~jocave/plainbox-provider-checkbox:wireless-nm-conn-backupPMR
2019-02-12Merge #362858 from ~pieq/plainbox-provider-checkbox:suspend-with-coldbootsPMR
2019-02-08stress: add summaries for the 30 suspend cycles jobsPierre Equoy
2019-02-07stress: Add "30 suspend cycles and 1 poweroff, 3 times" jobsPierre Equoy
'suspend_30_cycles_with_reboots' job was originally created because it was found that suspend (S3) may fail after reboots. Adding 'suspend_30_cycles_with_coldboots' to ensure suspend also work properly after cold boots (i.e. poweroff). A new test plan (stress-suspend-30-cycles-with-coldboots-automated) is available.
2019-02-07stress: Use automated suspend job for 'suspend_30_cycles_with_reboots' jobPierre Equoy
The 'power-management/suspend_30_cycles_with_reboots' job is used in 'stress-suspend-30-cycles-with-reboots-automated' test plan, yet depends on 'suspend/suspend_advanced' which is manual. Switching to 'suspend/suspend_advanced_auto' instead.
2019-02-07wireless: bracket nested tp with save/restore jobsJonathan Cave
2019-02-07wireless: new NM connection save/restore jobsJonathan Cave
2019-02-05Merge #362669 from ~jocave/plainbox-provider-checkbox:disk-variable-namePMR
2019-02-04led: update cert test plan to 18.04 coverage guideJonathan Cave
2019-02-04storage_test: bad variable name in partition checkJonathan Cave
2019-01-24Merge #362167 from plainbox-provider-checkbox:releasePMR
Release_2019_Week4
2019-01-24increment version to v0.48.0.dev0Sylvain Pineau
2019-01-24Bump to v0.47.0Sylvain Pineau
2019-01-22Changes to be committed:ray.chen
modified: units/graphics/test-plan.pxu Replace {index}_switch_card_{product_slug}_xenial with {index}_auto_switch_card_{product_slug}. Rename test id “_xenial” with “_auto”. modified: units/suspend/suspend-graphics.pxu Rename test id form “_xenial” to “ _auto” accordingly. Modified test cases dependency from “after: graphics/{index}_switch_card_{product_slug}_xenial” to “after: graphics/{index}_auto_switch_card_{product_slug}”
2019-01-18Merge #361929 from ↵PMR
~bladernr/plainbox-provider-checkbox:1812262-stress-ng-exit-code-catch
2019-01-17improved output on stress-ng tests to better catch and explain timeout ↵Jeff Lane
return codes. LP: #1812262
2019-01-17Bump to v0.47.0rc2Sylvain Pineau
2019-01-17Merge branch 'master' into releaseSylvain Pineau
2019-01-16Merge #361818 from ~sylvain-pineau/plainbox-provider-checkbox:fix-1415358PMR
2019-01-16units:touchpad: Remove singletouch-automated and multitouch-automatedSylvain Pineau
All modern touchpads are multitouch and those two jobs sometimes return false alarms. touchpad/detected-as-mouse is a better test to identify issues. Fixes: lp:1415358
2019-01-16units:touchpad: Remove obsolete touchpad/singletouch-cornerSylvain Pineau
2019-01-10Merge #361627 from ~kissiel/plainbox-provider-checkbox:media-info-as-buildstampPMR
add /etc/media-info as an alternative to buildstamp On some project (*cough* Chelmsford) buildstamp is present in this media-info file. I created Chelmsford-specific buildstamp job to make it work, but Checkbox looks for a hardcoded buildstamp job from com.canonical.certification namespace when creating the report.
2019-01-10add /etc/media-info as an alternative to buildstampMaciej Kisielewski
On some project (*cough* Chelmsford) buildstamp is present in this media-info file. I created Chelmsford-specific buildstamp job to make it work, but Checkbox looks for a hardcoded buildstamp job from com.canonical.certification namespace when creating the report. Signed-off-by: Maciej Kisielewski <maciej.kisielewski@canonical.com>
2019-01-10Merge #361499 from ↵PMR
~taihsiangho/plainbox-provider-checkbox:mr-update-xorg-process-testcase
2019-01-09Merge #361576 from ~jocave/plainbox-provider-checkbox:bluez-controller-detectPMR
2019-01-09bluetooth: add bluez controller detect jobJonathan Cave
2019-01-08Merge #361202 from ~jocave/plainbox-provider-checkbox:bluetooth-detect-jobPMR
2019-01-08units:graphics: update xorg-process detection methodTaihsiang Ho (tai271828)
2019-01-08Merge #361486 from ↵PMR
~sylvain-pineau/plainbox-provider-checkbox:non-udisk2-mediacard-tests
2019-01-08units:mediacard: leverage the checkbox-support utilities to run non-udisks2 ↵Sylvain Pineau
tests on UC
2019-01-07Merge #361244 from ↵PMR
~rodsmith/plainbox-provider-checkbox:fix-timeout-memory-stress-ng Increase timeout in memory_stress_ng from 150% to 200% of expected run time