Merge somerville jobs from bzr 215

1 files changed, 389 insertions, 9 deletions

diff --git a/jobs/somerville/somerville.txt.in b/jobs/somerville/somerville.txt.in
index f616032..2eb9501 100644
--- a/jobs/somerville/somerville.txt.in
+++ b/jobs/somerville/somerville.txt.in
@@ -208,21 +208,401 @@ _description:
 1.Need to base on the PM/Engineer define for default settings to verify this test case with Yes or No result.
 2.Please also list the current graphics mode into Further information.
 
-id: somerville/platform-meta-test
+id: somerville/dock-monitor-dual-head
 category_id: somerville
-plugin: shell
+estimated_duration: 120.0
+_summary: somerville/Dock Dual monitors test while docked
+plugin: manual
+_purpose:
+ This test verifies that dual-monitor output works using the dock. You will need two external monitors to perform this test.
+_steps:
+ Skip this test if your video card or the dock do not support multiple monitors. Use 4K monitors to run this test if the video card and dock both support.
+ Dell Trinity Docking spec - IE: 2 x FHD 1920x1080 @60Hz
+ Dell Trinity Docking spec - BME: 2 x 4kx2k @60Hz by DP + Type-C
+ 1. If your dock provides more than one monitor outputs, connect two monitors
+ 2. Open the "Displays" tool (open the dash and search for "Displays")
+ 3. Configure your output to provide one desktop across all the monitors
+ 4. Open any application and drag its window from one monitor to the next.
+_verification:
+ Was the stretched desktop displayed correctly across all the screens?
+
+id: somerville/dock-monitor-triple-head
+category_id: somerville
+estimated_duration: 120.0
+_summary: somerville/Dock Triple monitors test while docked
+plugin: manual
+_purpose:
+ This test verifies that triple-monitor output works using the dock. You will need three external monitors to perform this test.
+_steps:
+ Skip this test if your video card or the dock do not support multiple monitors.
+ Dell Trinity Docking spec - IE: 3 x SXGAA 1280x1200 @60Hz (AMD and Nvidia only)
+ Dell Trinity Docking spec - BME: 3 x 4kx2k @30Hz by DP + mDP + Type-C
+ 1. If your dock provides more than one monitor outputs, connect three monitors
+ 2. Open the "Displays" tool (open the dash and search for "Displays")
+ 3. Turn off internal monitor
+ 4. Configure your output to provide one desktop across all the monitors
+ 5. Open any application and drag its window from one monitor to the next.
+_verification:
+ Was the stretched desktop displayed correctly across all the screens?
+
+id: somerville/dock-monitor-dual-head-after-suspend
+category_id: somerville
+estimated_duration: 120.0
+_summary: somerville/Dock Dual monitors test while docked after suspend
+plugin: manual
+_purpose:
+ This test verifies that dual-monitor output works using the dock. You will need two external monitors to perform this test.
+_steps:
+ Skip this test if your video card or the dock do not support multiple monitors. Use 4K monitors to run this test if the video card and dock both support.
+ Dell Trinity Docking spec - IE: 2 x FHD 1920x1080 @60Hz
+ Dell Trinity Docking spec - BME: 2 x 4kx2k @60Hz by DP + Type-C
+ 1. If your dock provides more than one monitor outputs, connect two monitors
+ 2. Open the "Displays" tool (open the dash and search for "Displays")
+ 3. Configure your output to provide one desktop across all the monitors
+ 4. Open any application and drag its window from one monitor to the next.
+_verification:
+ Was the stretched desktop displayed correctly across all the screens?
+
+id: somerville/dock-monitor-triple-head-after-suspend
+category_id: somerville
+estimated_duration: 120.0
+_summary: somerville/Dock Triple monitors test while docked after suspend
+plugin: manual
+_purpose:
+ This test verifies that triple-monitor output works using the dock. You will need three external monitors to perform this test.
+_steps:
+ Skip this test if your video card or the dock do not support multiple monitors.
+ Dell Trinity Docking spec - IE: 3 x SXGAA 1280x1200 @60Hz (AMD and Nvidia only)
+ Dell Trinity Docking spec - BME: 3 x 4kx2k @30Hz by DP + mDP + Type-C
+ 1. If your dock provides more than one monitor outputs, connect three monitors
+ 2. Open the "Displays" tool (open the dash and search for "Displays")
+ 3. Turn off internal monitor
+ 4. Configure your output to provide one desktop across all the monitors
+ 5. Open any application and drag its window from one monitor to the next.
+_verification:
+ Was the stretched desktop displayed correctly across all the screens?
+
+id: somerville/dock_playback_type-c_displayport
+category_id: somerville
+_summary: somerville/Dock Type-C DisplayPort audio test
+plugin: user-interact-verify
+estimated_duration: 30.0
+command:
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings store --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings set --verbose --device=hdmi --volume=50
+ /usr/lib/plainbox-provider-checkbox/bin/gst_pipeline_test -t 2 --device hdmi 'audiotestsrc wave=sine freq=512 ! audioconvert ! audioresample ! autoaudiosink'
+ EXIT_CODE=$?
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings restore --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ exit $EXIT_CODE
+_purpose:
+ Dock DisplayPort audio via USB Type-C port interface verification
+_steps:
+ 1. Plug an external DisplayPort device with sound on a USB Type-C port using a "USB Typce-C to DisplayPort" adapter on Dock (Use only one HDMI/DisplayPort/Thunderbolt interface at a time for this test)
+ 2. Commence the test
+_verification:
+ Did you hear the sound from the DisplayPort device?
+
+id: somerville/dock_playback_type-c_hdmi
+category_id: somerville
+_summary: somerville/Dock Type-C HDMI audio test
+plugin: user-interact-verify
+estimated_duration: 30.0
 command:
- platform_meta_test
-_description: Check if the platform metapackage is installed.
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings store --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings set --verbose --device=hdmi --volume=50
+ /usr/lib/plainbox-provider-checkbox/bin/gst_pipeline_test -t 2 --device hdmi 'audiotestsrc wave=sine freq=512 ! audioconvert ! audioresample ! autoaudiosink'
+ EXIT_CODE=$?
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings restore --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ exit $EXIT_CODE
+_purpose:
+ Dock HDMI audio interface verification
+_steps:
+ 1. Plug an external HDMI device with sound on Dock (Use only one HDMI/DisplayPort/Thunderbolt interface at a time for this test)
+ 2. Commence the test
+_verification:
+ Did you hear the sound from the HDMI device?
 
-id: somerville/dkms-build-exclusive-test
+id: somerville/dock-hotplug_playback_type-c_displayport
 category_id: somerville
+_summary: somerville/Dock hotplug Type-C DisplayPort audio test
 plugin: user-interact-verify
+estimated_duration: 30.0
 command:
- dkms_build_exclusive_test
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings store --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings set --verbose --device=hdmi --volume=50
+ /usr/lib/plainbox-provider-checkbox/bin/gst_pipeline_test -t 2 --device hdmi 'audiotestsrc wave=sine freq=512 ! audioconvert ! audioresample ! autoaudiosink'
+ EXIT_CODE=$?
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings restore --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ exit $EXIT_CODE
+_purpose:
+ Dock DisplayPort audio via USB Type-C port interface verification
+_steps:
+ 1. Plug an external DisplayPort device with sound on a USB Type-C port using a "USB Typce-C to DisplayPort" adapter on Dock (Use only one HDMI/DisplayPort/Thunderbolt interface at a time for this test)
+ 2. Commence the test
+_verification:
+ Did you hear the sound from the DisplayPort device?
+
+id: somerville/dock-hotplug_playback_type-c_hdmi
+category_id: somerville
+_summary: somerville/Dock Type-C hotplug HDMI audio test
+plugin: user-interact-verify
+estimated_duration: 30.0
+command:
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings store --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings set --verbose --device=hdmi --volume=50
+ /usr/lib/plainbox-provider-checkbox/bin/gst_pipeline_test -t 2 --device hdmi 'audiotestsrc wave=sine freq=512 ! audioconvert ! audioresample ! autoaudiosink'
+ EXIT_CODE=$?
+ /usr/lib/plainbox-provider-checkbox/bin/audio_settings restore --verbose --file=$PLAINBOX_SESSION_SHARE/pulseaudio_settings
+ exit $EXIT_CODE
+_purpose:
+ Dock HDMI audio interface verification
+_steps:
+ 1. Plug an external HDMI device with sound on Dock (Use only one HDMI/DisplayPort/Thunderbolt interface at a time for this test)
+ 2. Commence the test
+_verification:
+ Did you hear the sound from the HDMI device?
+
+plugin: user-interact
+id: somerville/hotplug-usb-insert
+category_id: somerville
+estimated_duration: 10.0
+_summary: USB drive insertion test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher insert usb
+_purpose:
+ This test will check that the system correctly detects the insertion of
+ a USB storage device after dock hot plugged in
+_steps:
+ 1. Click "Test" and insert a USB storage device, preferably a HDD,
+ in one of the dock's port.
+ Although a USB pen drive may be used it might cause performance
+ related tests to fail. (Note: this test will time-out after 20
+ seconds.)
+ 2. Do not unplug the device after the test.
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.
+
+plugin: shell
+id: somerville/hotplug-usb-storage-automated
+category_id: somerville
+depends: somerville/hotplug-usb-insert
+user: root
+estimated_duration: 45.0
+_summary: USB drive storage test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_test -s 268400000 usb
 _description:
- Check if DKMS has BUILD_EXCLUSIVE_KERNEL clause.
+ This test is automated and executes after the dock/usb_insert test is run.
+
+plugin: user-interact
+id: somerville/hotplug-usb-remove
+category_id: somerville
+depends: somerville/hotplug-usb-insert
+estimated_duration: 10.0
+_summary: USB drive removal test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher remove usb
+_purpose:
+ This test will check that the system correctly detects the removal of
+ a USB storage device after dock hot plugged in
+_steps:
+ 1. Click "Test" and remove the USB device from the dock.
+ (Note: this test will time-out after 20 seconds.)
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.
+
+id: somerville/hot-plug-after-suspend
+category_id: somerville
+plugin: manual
+estimated_duration: 30.00
+_summary: Docking test
+_purpose:
+ This test will check the device can be used after docking after suspend.
+_steps:
+ 1. Unplug docking station.
+ 2. Replug in docking station.
+_verification:
+ Is the system working with problem (e.g. system hang) after docking station hot plugged in?
+
+plugin: user-interact-verify
+category_id: somerville
+id: somerville/hotplug-ethernet-after-suspend
+command: /usr/lib/plainbox-provider-checkbox/bin/network_check
+estimated_duration: 10
+_description:
+ PURPOSE:
+ This test will check wired connection after hotplug fom suspend
 STEPS:
- 1. Verify and check the output.
+ 1. Disable WiFi connection
+ 2. Click "Test" to verify that it's possible to establish a HTTP connection
 VERIFICATION:
- No ERROR messages.
+ Did a notification show and was the connection correctly established?
+
+plugin: user-interact
+id: somerville/hotplug-usb-insert-after-suspend
+category_id: somerville
+estimated_duration: 10.0
+_summary: USB drive insertion test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher insert usb
+_purpose:
+ This test will check that the system correctly detects the insertion of
+ a USB storage device after dock hot plugged in after suspend
+_steps:
+ 1. Click "Test" and insert a USB storage device, preferably a HDD,
+ in one of the dock's port.
+ Although a USB pen drive may be used it might cause performance
+ related tests to fail. (Note: this test will time-out after 20
+ seconds.)
+ 2. Do not unplug the device after the test.
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.
+
+plugin: shell
+id: somerville/hotplug-usb-storage-automated-after-suspend
+category_id: somerville
+depends: somerville/hotplug-usb-insert-after-suspend
+user: root
+estimated_duration: 45.0
+_summary: USB drive storage test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_test -s 268400000 usb
+_description:
+ This test is automated and executes after the dock/usb_insert test is run.
+
+plugin: user-interact
+id: somerville/hotplug-usb-remove-after-suspend
+category_id: somerville
+depends: somerville/hotplug-usb-insert-after-suspend
+estimated_duration: 10.0
+_summary: USB drive removal test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher remove usb
+_purpose:
+ This test will check that the system correctly detects the removal of
+ a USB storage device after dock hot plugged in after suspend
+_steps:
+ 1. Click "Test" and remove the USB device from the dock.
+ (Note: this test will time-out after 20 seconds.)
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.
+
+plugin: user-interact
+id: somerville/hotplug-usb3-insert-after-suspend
+category_id: somerville
+estimated_duration: 10.0
+_summary: USB3 drive insertion test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher -m 500000000 insert usb
+_purpose:
+ This test will check that the system correctly detects the insertion of
+ a USB 3.0 storage device after dock hot plugged in after suspend
+_steps:
+ 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD,
+ in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may
+ be used it might cause performance related tests to fail.
+ (Note: this test will time-out after 20 seconds.)
+ 2. Do not unplug the device after the test.
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.
+
+plugin: shell
+id: somerville/hotplug-usb3-storage-automated-after-suspend
+category_id: somerville
+depends: somerville/hotplug-usb3-insert-after-suspend
+user: root
+estimated_duration: 45.0
+_summary: USB3 drive storage test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
+_description:
+ This test is automated and executes after the dock/usb3_insert test is run.
+
+plugin: user-interact
+id: somerville/hotplug-usb3-remove-after-suspend
+category_id: somerville
+depends: somerville/hotplug-usb3-insert-after-suspend
+estimated_duration: 10.0
+_summary: USB3 drive removal test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher -m 500000000 remove usb
+_purpose:
+ This test will check that the system correctly detects the removal of
+ a USB 3.0 storage device after dock hot plugged in after suspend
+_steps:
+ 1. Click "Test" and remove the USB 3.0 device from the dock.
+ (Note: this test will time-out after 20 seconds.)
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.
+
+id: somerville/hotplug-monitor-displayport-after-suspend
+category_id: somerville
+estimated_duration: 120.0
+_summary: DisplayPort test on the dock
+plugin: manual
+_purpose:
+ This test will check the DisplayPort(s) on the dock after hot plugged in after suspend.
+_steps:
+ Skip this test if the dock does not have a DisplayPort.
+ 1. Connect a display (if not already connected) to the DisplayPort on the dock
+ 2. Repeat step 1 for each additional DisplayPorts, if any
+_verification:
+ Was the desktop displayed correctly on both screens?
+
+id: somerville/hotplug-monitor-hdmi-after-suspend
+category_id: somerville
+estimated_duration: 120.0
+_summary: HDMI port test on the dock
+plugin: manual
+_purpose:
+ This test will check the HDMI port(s) on the dock after hot plugged in after suspend.
+_steps:
+ Skip this test if the dock does not have a HDMI port.
+ 1. Connect a display (if not already connected) to the HDMI port on the dock
+ 2. Repeat step 1 for each additional HDMI port, if any
+_verification:
+ Was the desktop displayed correctly on both screens?
+
+plugin: user-interact
+id: somerville/usb-insert-after-suspend-dock-resume
+category_id: somerville
+estimated_duration: 10.0
+_summary: USB drive insertion test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher -m 500000000 insert usb
+_purpose:
+ This test will check that the system correctly detects the insertion of
+ a USB storage device after suspend, undocked, docked, resume.
+_steps:
+ 1. Click "Test" and insert a USB storage device, preferably a HDD,
+ in one of the dock's USB port. Although a USB pen drive may
+ be used it might cause performance related tests to fail.
+ (Note: this test will time-out after 20 seconds.)
+ 2. Do not unplug the device after the test.
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.
+
+plugin: shell
+id: somerville/usb-storage-automated-after-suspend-dock-resume
+category_id: somerville
+depends: somerville/usb-insert-after-suspend-dock-resume
+user: root
+estimated_duration: 45.0
+_summary: USB drive storage test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
+_description:
+ This test is automated and executes after the dock/usb_insert test is run.
+
+plugin: user-interact
+id: somerville/usb-remove-after-suspend-dock-resume
+category_id: somerville
+depends: somerville/usb-insert-after-suspend-dock-resume
+estimated_duration: 10.0
+_summary: USB drive removal test
+command: /usr/lib/plainbox-provider-checkbox/bin/removable_storage_watcher -m 500000000 remove usb
+_purpose:
+ This test will check that the system correctly detects the removal of
+ a USB storage device after suspend, undocked, docked, resume.
+_steps:
+ 1. Click "Test" and remove the USB 3.0 device from the dock.
+ (Note: this test will time-out after 20 seconds.)
+_verification:
+ The verification of this test is automated. Do not change the
+ automatically selected result.