summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2020-11-26make snap tests not require a particular system stateMaciej Kisielewski
For instance the snap-remove test doesn't require test snap to be installed. It'll install it first before trying to remove it.
2020-11-26Merge #394493 from ~jocave/plainbox-provider-checkbox:fix-exit-codePMR
2020-11-25snap_tests.py: fix exit code, add core20Jonathan Cave
Ensure that the return value of each subcommand actually impacts the test result. Add core20 to the list of core snaps.
2020-11-25Merge #393798 from ~meribold/plainbox-provider-checkbox:camera-qrcode-tty-detectPMR
2020-11-25Merge #393800 from ~meribold/plainbox-provider-checkbox:tty0PMR
2020-11-25camera/roundtrip-qrcode_*: reduce the size of QR codesLukas Waymann
Reduce the size of QR codes that camera/roundtrip-qrcode_* tests display to make them fit on the relatively small screens we have in the certification lab.
2020-11-25Just use tty0 for camera/roundtrip-qrcode_* testsLukas Waymann
tty0 always points to the current virtual console, so we don't need any code for detecting which virtual console (tty1, tty2, ...) is selected.
2020-11-13Merge #393725 from ~jocave/plainbox-provider-checkbox:camera-qrcode-tty-detectPMR
2020-11-13roundtrip_qr.py: detect the active ttyJonathan Cave
UC20 seems to deviate from the norm of tty1 being the active tty after install. Update the script to detect which is active.
2020-11-04Merge #393020 from ↵PMR
~meribold/plainbox-provider-checkbox:usb_storage_preinserted_after_suspend-requires-has_usb_storage
2020-11-04Add `imports` fields so that `manifest.has_usb_storage` can be usedLukas Waymann
2020-11-02Merge #392462 from ↵PMR
~bladernr/plainbox-provider-checkbox:1900448-improve-jitter-test-output
2020-10-30Skip after-suspend-usb*/storage-preinserted when DUT lacks USB driveLukas Waymann
2020-10-30Remove suspend/usb*_storage_preinserted_after_suspend jobsLukas Waymann
These jobs are functionally equivalent to after-suspend-usb/storage-preinserted and after-suspend-usb3/storage-preinserted.
2020-10-29Delete units/suspend/manifest.pxuLukas Waymann
I'm told that there's no need to copy the `has_usb_storage` block from `units/usb/manifest.pxu` to `units/suspend/manifest.pxu`.
2020-10-29Skip suspend/usb_storage_preinserted_after_suspend when DUT lacks USB driveLukas Waymann
Employ the same mechanism that usb/storage-detect uses for skipping the test when the DUT doesn't have a USB drive in suspend/usb_storage_preinserted_after_suspend. This way we can skip both tests rather than letting usb_storage_preinserted_after_suspend fail.
2020-10-28Merge #392898 from ~jocave/plainbox-provider-checkbox:wwan-remove-core-reqPMR
2020-10-27wwan/jobs: remove requirement for core snapJonathan Cave
There should no longer be a requirement for the core snap to be present when running the wwan tests, for exmaple on UC18 or UC20 images
2020-10-26Merge branch 'palm-detect-support'Kai-Chuan Hsieh
2020-10-26Merge branch 'power-button-shutdown'Kai-Chuan Hsieh
2020-10-23unit: Add test job to validate power button event filtering (LP: #1877084)Kai-Chuan Hsieh
Current WinOS requires ODM vendor to report press and release events with one power button press, the power button release can be filtered if 5-button-array is supported. There is a timing issue that two consecutive and close power button event might trigger the system goes to shutdown directly wihtout endSessionDialog pop-up, which is not the expected behaviour. Create a job for knowing if the system will hit the issue.
2020-10-22Merge #392528 from ~sylvain-pineau/plainbox-provider-checkbox:fix-1854862PMR
submission: Add a new boot mode property to the existing BIOS dict in the raw_devices_dmi_json job. This info is extracted from inxi output and can take the following values: BIOS, UEFI, or UEFI [Legacy].
2020-10-22submission:raw_devices_dmi_json: Add the boot mode info to the BIOS dictSylvain Pineau
This new property comes from inxi which can take the following values: - BIOS - UEFI - UEFI [Legacy] The last one is legacy BIOS boot mode in a system using UEFI but booted as BIOS/Legacy. It is added to the existing json directly into the BIOS dict. Fixes: lp:1854862
2020-10-20Merge #392119 from ↵snap-2020-10-20T1735PMR
~iamerin-c/plainbox-provider-checkbox/+git/plainbox-provider-checkbox:fix-1893161 fix lp:1893161 xrandr_screens_after_suspend.tar.gz_auto
2020-10-19src/clocktest.c: output is a little more informative now lp: #1900448Jeff Lane
2020-10-19Add touchpad EV_ABS ABS_MT_TOOL capability check (LP: #1899879)Kai-Chuan Hsieh
The firmware/labeling palm detection is general for mordern touchpad. And libinput requires ABS_MT_TOOL_TYPE event for supporting firmware/lebeling palm detection https://wayland.freedesktop.org/libinput/doc/latest/palm-detection.html#palm-tool Add a test job to check if the touchpad can report the event type. The 55 bit offset is obtained from kernel code ABS_MT_TOOL_TYPE 0x37 https://elixir.bootlin.com/linux/latest/source/include/uapi/linux/input-event-codes.h#L857
2020-10-12fix lp:1893161 xrandr_screens_after_suspend.tar.gz_autoErin Chen
2020-10-12Merge #387916 from ↵PMR
~lihow731/plainbox-provider-checkbox/+git/plainbox-provider-checkbox:master Fix the "Unable to control recording volume..." bug
2020-10-12bin/audio_test.py: Fix the "Unable to control recording volume..." bugLi-Hao Liao (Leon Liao)
Fix: 1. Remove the method parameter from PAVolumeController.__init__(): Assum PAVolumeController class only be used in this audio_test.py. 2. Don't check the return value of self.method(command): In PAVolumeController._pactl_output(), when failed to execute the pactl command the exception will be thrown. 3. When pactl command fail (after retry 3 times), let audio_test stop. Original issue: In PAVolumeController class: In set_volume() and mute(), the self.method(command) returns a zero-length string. So, the set_volume() and mute() always return False. Then, in get_volume(), the self._volume always won't be set. This is the root cause of the "Unable to control recording volume..." issue. More detail: 1. There is no ouptu from the `pactl set-souerce-volume ...` command. 2. The PAVolumeController._pactl_output fucntion will return subprocess.check_output(). The subprocess.check_output function return the output of "command". LP: #1890526
2020-10-08Merge #391931 from ~sylvain-pineau/plainbox-provider-checkbox:fix-1815867PMR
stress-ng: Run cpu and memory tests using systemd-inhibit
2020-10-07stress: Run stress-ng cpu and memory tests using systemd-inhibitSylvain Pineau
This runs stress-ng and inhibits system sleeping, shutdown and idle while doing so. Fixes lp:1815867
2020-10-07Merge #391917 from ↵PMR
~sylvain-pineau/plainbox-provider-checkbox:stress_s3_arm_rtcwake
2020-10-07stress:s3s4: Fallback to rtcwake if fwts s3 is not supported (e.g on arm)Sylvain Pineau
2020-10-06Merge #391804 from ↵PMR
~jocave/plainbox-provider-checkbox:reapply-wireless-net-if-mgmt
2020-10-06wireless/*: depend on net_if_mgmt resource againJonathan Cave
Re-apply the requires field on wireless job to use the net_if_managment resource to select which wireless jobs to run on a device. This should now correctly select either network-manager or networkd and allow for a single set of test plans.
2020-10-01Merge #391685 from ↵PMR
~jocave/plainbox-provider-checkbox:kernel-matches-current-uc20
2020-10-01bin/booted_kernel_tests: kernel name for uc20Jonathan Cave
In UC20 images the kernel image is packed and distributed in a different format and location. Handle this for the booted kernel check test.
2020-09-30Merge #391604 from ↵snap-2020-10-01T0725PMR
~sylvain-pineau/plainbox-provider-checkbox:has_camera_manifest units:camera: Use a new manifest to trigger the camera/detect job, has_camera
2020-09-30units:camera: Use camera/detect{,-rpi} as depends jobs for ↵Sylvain Pineau
camera/roundtrip-qrcode
2020-09-30units:camera: Use a new manifest to trigger the camera/detect job, has_cameraSylvain Pineau
2020-09-30Merge #391600 from ↵PMR
~sylvain-pineau/plainbox-provider-checkbox:disk_read_performance_mtd bin:disk_read_performance_test.sh: Add support for MTD (Flash) devices
2020-09-30bin:disk_read_performance_test.sh: Add support for MTD (Flash) devicesSylvain Pineau
2020-09-24Merge #391282 from plainbox-provider-checkbox:releasePMR
Release_2020_Week39
2020-09-24increment version to v0.56.0.dev0PMR
2020-09-24Bump to v0.55.0v0.55.0PMR
2020-09-22Bump to v0.55.0rc2v0.55.0rc2PMR
2020-09-22Merge branch 'master' into releasePMR
2020-09-22Merge #391102 from ↵snap-2020-09-24T0652PMR
~bettyl/plainbox-provider-checkbox:update_depends_to_suspend_advanced_auto To let the test plan 'after-suspend-reference-cert-automated' and 'after-suspend-reference-cert-blockers' can run fully auto.
2020-09-22Merge #391107 from ↵PMR
~bettyl/plainbox-provider-checkbox:graphic_auto_depends_to_suspend_advanced_auto
2020-09-22Modify graphic auto test depends to suspend_advanced_autoBetty Lin
To let the graphic auto test to be fully automatic, change the depends from suspend/suspend_advanced to suspend/suspend_advanced_auto