Skip to content

mgood7123/AndroidUI-Test-Framework

BranchesTags

Repository files navigation

AndroidUI Test Framework

a C# unit testing framework, based loosely off of GoogleTest

Table Of Contents

Color output

Main Method

you can run test via AndroidUITestFramework.Main.Run

AndroidUITestFramework.Main.Run can be called as many times as you wish without affecting previous or future runs

  • AndroidUITestFramework.Main.Run() runs all found tests
  • AndroidUITestFramework.Main.Run(nameof(a_namespace)) runs all found tests inside the namespace a_namespace
  • AndroidUITestFramework.Main.Run(typeof(test)) runs the specified Test or TestGroup
  • AndroidUITestFramework.Main.Run(typeof(test), nameof(a_namespace)) runs the specified Test if it is found inside of the specified namespace a_namespace

Exception Handling

AndroidUI Test Framework provides a RETHROW_EXCEPTION_IF_NEEDED(Exception e) method to rethrow an exception if it is used internally by AndroidUI Test Framework

if you are catching Exception you should call this method first

try { throwableMethod(); } catch (Exception e) { RETHROW_EXCEPTION_IF_NEEDED(e); handle_exception(e); }

if a Test or TestGroup throws an uncaught exception AndroidUI Test Framework will catch this and fail the current test or group

 [Running ] Test: UNHANDLED_TEST_EXCEPTION UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_TEST_EXCEPTION.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:239 [Running FAILED] Test: UNHANDLED_TEST_EXCEPTION

Assertions and Expectations

all Assertions and Expectations operate via throwing an exception internally used by AndroidUI Test Framework

these are located at AndroidUITestFramework.Tools

  • SKIP()

  • skips the current Test or TestGroup, equivilant to a silent FAIL()

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • Skip("Not supported by this platform")

  • FAIL()

  • fails the current Test or TestGroup

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • Fail("We should never get here!")

  • ExpectTrue(bool expression)

  • fails the current Test or TestGroup if the given expression is not true

  • Continues execution of the current Test or TestGroup

  • can provide an optional message:

  • ExpectTrue(i == 5-4, "Index has become corrupted")

  • AssertTrue(bool expression)

  • fails the current Test or TestGroup if the given expression is not true

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • AssertTrue(i == 5-4, "Index has become corrupted")

  • ExpectFalse(bool expression)

  • fails the current Test or TestGroup if the given expression is not false

  • Continues execution of the current Test or TestGroup

  • can provide an optional message:

  • ExpectFalse(str.Equals(INTERNAL), "the given string cannot have the same name as an INTERNAL string")

  • AssertFalse(bool expression)

  • fails the current Test or TestGroup if the given expression is not false

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • AssertFalse(str.Equals(INTERNAL), "the given string cannot have the same name as an INTERNAL string")

  • ExpectEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect.Equals(value) returns false

  • Continues execution of the current Test or TestGroup

  • Does automatic type promotion of (s)byte, (u)short, (u)int, (u)long, float, double

  • Does value-wise comparison of float and double (0.432 and 0.432f will be equal even though the actual representations are not due to precision differences)

  • Does automatic conversion of char to string

  • can provide an optional message:

  • ExpectEqual(str, str2, "the given strings do not match")

  • AssertEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect.Equals(value) returns false

  • Stops execution of the current Test or TestGroup

  • Does automatic type promotion of (s)byte, (u)short, (u)int, (u)long, float, double

  • Does value-wise comparison of float and double (0.432 and 0.432f will be equal even though the actual representations are not due to precision differences)

  • Does automatic conversion of char to string

  • can provide an optional message:

  • AssertEqual(str, str2, "the given strings do not match")

  • ExpectNotEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect.Equals(value) returns true

  • Continues execution of the current Test or TestGroup

  • Does automatic type promotion of (s)byte, (u)short, (u)int, (u)long, float, double

  • Does value-wise comparison of float and double (0.432 and 0.432f will be equal even though the actual representations are not due to precision differences)

  • Does automatic conversion of char to string

  • can provide an optional message:

  • ExpectNotEqual(str, INTERNAL, "the given string cannot have the same name as an INTERNAL string")

  • AssertNotEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect.Equals(value) returns true

  • Stops execution of the current Test or TestGroup

  • Does automatic type promotion of (s)byte, (u)short, (u)int, (u)long, float, double

  • Does value-wise comparison of float and double (0.432 and 0.432f will be equal even though the actual representations are not due to precision differences)

  • Does automatic conversion of char to string

  • can provide an optional message:

  • AssertNotEqual(str, INTERNAL, "the given string cannot have the same name as an INTERNAL string")

  • ExpectInstanceEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect != value returns true

  • Continues execution of the current Test or TestGroup

  • can provide an optional message:

  • ExpectInstanceEqual(str, str2, "the given strings are not the same")

  • AssertInstanceEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect != value returns true

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • AssertInstanceEqual(str, str2, "the given strings are not the same")

  • ExpectInstanceEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect == value returns true

  • Continues execution of the current Test or TestGroup

  • can provide an optional message:

  • ExpectInstanceNotEqual(value, INTERNAL, "somehow managed to obtain an instance of an INTERNAL string")

  • AssertInstanceNotEqual(object value, object expect)

  • fails the current Test or TestGroup if the result of expect == value returns true

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • AssertInstanceNotEqual(value, INTERNAL, "somehow managed to obtain an instance of an INTERNAL string")

  • ExpectException<EXCEPTION>(Action method)

  • fails the current Test or TestGroup if the Exception of type EXCEPTION was not thrown or a different Exception was caught

  • Continues execution of the current Test or TestGroup

  • can provide an optional message:

  • ExpectException<FATAL_EXCEPTION>(() => my_method() }, "expected my_method to throw FATAL_EXCEPTION")

  • AssertException<EXCEPTION>(Action method)

  • fails the current Test or TestGroup if the Exception of type EXCEPTION was not thrown or a different Exception was caught

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • AssertException<FATAL_EXCEPTION>(() => my_method() }, "expected my_method to throw FATAL_EXCEPTION")

  • ExpectNoException(Action method)

  • fails the current Test or TestGroup if any Exception was thrown

  • Continues execution of the current Test or TestGroup

  • can provide an optional message:

  • ExpectNoException(() => my_method() }, "my_method thrown an exception")

  • AssertNoException(Action method)

  • fails the current Test or TestGroup if any Exception was thrown

  • Stops execution of the current Test or TestGroup

  • can provide an optional message:

  • AssertNoException(() => my_method() }, "my_method thrown an exception")

Tests and TestGroups

a Test is a class extending from AndroidUITestFramework.Test

class a_test : Test { public override void Run(TestGroup nullableInstance) { Console.WriteLine("I AM A TEST"); } }

a TestGroup is a class extending from AndroidUITestFramework.TestGroup

public class a_test_group : TestGroup { public override void OnCreate() { // called before a test is ran } public override void OnDestroy() { // called after a test is ran } // tests for this group here class a_test : Test { public override void Run(TestGroup nullableInstance) { Console.WriteLine("I AM A TEST INSIDE OF A TEST GROUP"); } } }

a Tests nullableInstance will be set to the instance of the TestGroup it belongs to

Nesting

AndroidUI Test Framework tries very hard to find all your tests where ever they may be

a Tests and TestGroups can be nested inside of any TestGroup either directly or indirectly

public class a_test_group : TestGroup { public override void OnCreate() { // called before a test is ran } public override void OnDestroy() { // called after a test is ran } class foo { class a_test : Test { public override void Run(TestGroup nullableInstance) { Console.WriteLine("I AM A TEST INSIDE OF A TEST GROUP AND I AM STILL FOUND"); } } } class sub { class group { class we_are_nested { public class a_test_group : TestGroup { public override void OnCreate() { // called before a test is ran Console.WriteLine("I AM A TEST GROUP INSIDE OF A TEST GROUP AND I AM STILL FOUND"); } public override void OnDestroy() { // called after a test is ran } class foo { class a_test : Test { public override void Run(TestGroup nullableInstance) { Console.WriteLine("I AM A TEST INSIDE OF A TEST GROUP INSIDE OF ANOTHER TEST GROUP AND I AM STILL FOUND"); } } } } } } } }

the above produces the following output:

produces the following output: Printing Tests Heirarchy +Top Level No Tests Have Been Declared By 'Top Level' +a_test_group a_test +a_test_group a_test No Test Groups Have Been Declared By 'a_test_group' Printed Tests Heirarchy Running Tests in Alphaberical Order... [Running ] Group: Top Level [Running ] Group: a_test_group [Running ] Test: a_test I AM A TEST INSIDE OF A TEST GROUP AND I AM STILL FOUND [Running OK] Test: a_test [Running ] Group: a_test_group.a_test_group I AM A TEST GROUP INSIDE OF A TEST GROUP AND I AM STILL FOUND [Running ] Test: a_test I AM A TEST INSIDE OF A TEST GROUP INSIDE OF ANOTHER TEST GROUP AND I AM STILL FOUND [Running OK] Test: a_test [Running OK] Group: a_test_group.a_test_group [Running OK] Group: a_test_group [Running OK] Group: Top Level Ran Tests in Alphaberical Order

Test inheritence

a Test can inherit another Test

class BASE_TEST : AndroidUITestFramework.Test { public override void Run(AndroidUITestFramework.TestGroup nullableInstance) { Console.WriteLine("TEST! 1"); } } class inherited_test : BASE_TEST { public override void Run(AndroidUITestFramework.TestGroup nullableInstance) { base.Run(nullableInstance); Console.WriteLine("TEST! INHERITED"); } }

output:

 [Running ] Test: BASE_TEST TEST! 1 [Running OK] Test: BASE_TEST [Running ] Test: inherited_test TEST! 1 TEST! INHERITED [Running OK] Test: inherited_test

likewise a TestGroup can also inherit a TestGroup

in most cases it will work fine, as documented by the following example

example

class g : TestGroup { int data; class s : g { internal class Data : Test { internal g data; public override void Run(TestGroup nullableInstance) { // set our instance of data to our parent `g` // this will work as long `nullableInstance` is // an instance of a TestGroup that inherits `g` // or is `g` itself // // we may also be able to set `g.data` directly // eg, data = ((g)nullableInstance).data // but this will COPY if `g.data` is a VALUE TYPE // which it currently is `int data` // `int` is a VALUE TYPE data = (g)nullableInstance; } } } class n { class test : s.Data { public override void Run(TestGroup nullableInstance) { // this works because we recieve `g` itself // due to nested test finding // `Data` expects to recieve an instance of `g` base.Run(nullableInstance); // we can quickly access `data` which is of type `g` data.data = 5; } } } }

benchmarking

AndroidUI Test Framework now includes a Benchmarking library MeasureMap https://github.com/WickedFlame/MeasureMap

as well as Spectre.Console https://github.com/spectreconsole/spectre.console

Spectre.Console is used to output the benchmark data in a clean formatted table

BenchmarkDotNet is unsuitible for our use since it is not known how to get it to avoid compiling a temporary project and attempting to replace the currently running executable (which is us!)

MeasureMap was our previous benchmarking library, however it was very slow when combined with a progress bar

therefore XMarkTest was created as the fast benchmark library for integrated benchmark unit testing

XMarkTest is simple a wrapper over Test that manages the execution of the XSession and XManager benchmarking classes

(NOTE: the contents of MeasureMap are kept as a reference but will be removed in a future build)

since the XMarkTest runs as a Test, it is isolated in the same way a normal Test is

a simple benchmark might look like this

class native_benchmark : XMarkTest { protected override void prepareBenchmark(XManager runner) { var m = Int32.MaxValue / 4; runner.AddSession( new XSession( m + " Nothings", () => { for (var i = m - m; i < m; i++) { } } ) ); runner.AddSession(new XSession(m + " iterations of Nothing", () => { }, m)); void al() { var sk2f = AndroidUI.Native.Sk2f.Load(new float[] { 1, 2 }); Tools.ExpectEqual(sk2f[0], 1); Tools.ExpectEqual(sk2f[1], 2); sk2f *= sk2f; Tools.ExpectEqual(sk2f[0], 1); Tools.ExpectEqual(sk2f[1], 4); } runner.AddSession(new XSession("Native allocation", al, 80)); runner.AddSession(new XSession( "Native allocation MT", al, TimeSpan.FromSeconds(30).Ticks / 100 / 2 / 2 / 2/2, 10 )); } }

the above example does not do much but is sufficent for demonstration

here, you prepare your benchmark inside of prepareBenchmark using the provided runner

XManager contains integrated logging (powered by Spectre.Console) to provide information about currently running benchmark sessions

upon running the above benchmark example, you will get the following output

the above progress bars and table are drawn using the powerful Spectre.Console library

the output of the XMarkTest is subject to change if it can better reflect benchmark data

why this framework?

have a look at https://www.lambdatest.com/blog/nunit-vs-xunit-vs-mstest/

Description NUnit MSTest xUnit AndroidUI Test Framework
Marks a test method/individual test [Test] [TestMethod] [Fact] class t : Test
Indicates that a class has a group of unit tests [TestFixture] [TestClass] N.A class g : TestGroup
Contains the initialization code, which is triggered before every test case [SetUp] [TestInitialize] Constructor OnCreate
Contains the cleanup code, which is triggered after every test case [TearDown] [TestCleanup] IDisposable.Dispose OnDestroy
Contains method that is triggered once before test cases start [OneTimeSetUp] [ClassInitialize] IClassFixture N.A
Contains method that is triggered once before test cases end [OneTimeTearDown] [ClassCleanup] IClassFixture N.A
Contains per-collection fixture setup and teardown N.A N.A ICollectionFixture N.A
Ignores a test case [Ignore(“reason”)] [Ignore] [Fact(Skip=”reason”)] SKIP()
Categorize test cases or classes [Category()] [TestCategory(“)] [Trait(“Category”, “”) N.A
Identifies a method that needs to be called before executing any test in test class/test fixture [TestFixtureSetup] [ClassInitialize] N.A N.A
Identifies a method that needs to be called after executing any test in test class/test fixture [TestFixtureTearDown] [ClassCleanUp] N.A N.A
Identifies a method that needs to be called before the execution of any tests in Test Assembly N.A [AssemblyInitialize] N.A N.A
Identifies a method that needs to be called after execution of tests in Test Assembly N.A [AssemblyCleanUp] N.A N.A





AndroidUI Test Framework is much simpler than NUnit, XUnit, and MSTest

however AndroidUI Test Framework makes up for this with easy-to-use tests, and detailed output

for comparison, we will use tests in all frameworks 4 frameworks

NUnit

TEST:

using NUnit.Framework; using System; using System.Collections.Generic; using System.Linq; using System.Text; using System.Threading; namespace NUnit_Test { class NUnit_Demo { [SetUp] public void Initialize() { Console.WriteLine("Inside SetUp"); } [TearDown] public void DeInitialize() { Console.WriteLine("Inside TearDown"); } public class TestClass1 { [OneTimeSetUp] public static void ClassInitialize() { Console.WriteLine("Inside OneTimeSetUp"); } [OneTimeTearDown] public static void ClassCleanup() { Console.WriteLine("Inside OneTimeTearDown"); } } [Test, Order(1)] public void Test_1() { Console.WriteLine("Inside TestMethod Test_1"); } [Test, Order(2)] public void Test_2() { Console.WriteLine("Inside TestMethod Test_2"); } } }

OUTPUT:

Inside SetUp Inside TestMethod Test_1 Inside TearDown Inside SetUp Inside TestMethod Test_2 Inside TearDown

MSTest

TEST:

using Microsoft.VisualStudio.TestTools.UnitTesting; using System; using System.Collections.Generic; using System.Linq; using System.Text; using System.Threading; namespace MsTest { [TestClass] public class Initialize { [AssemblyInitialize] public static void AssemblyInitialize(TestContext context) { Console.WriteLine("Inside AssemblyInitialize"); } } public class DeInitialize { [AssemblyCleanup] public static void AssemblyCleanup() { Console.WriteLine("Inside AssemblyCleanup"); } } [TestClass] public class TestClass1 { [ClassInitialize] public static void ClassInitialize(TestContext context) { Console.WriteLine("Inside ClassInitialize"); } [ClassCleanup] public static void ClassCleanup() { Console.WriteLine("Inside ClassCleanup"); } [TestMethod] public void Test_1() { Console.WriteLine("Inside TestMethod Test_1"); } } [TestClass] public class TestClass2 { [TestInitialize] public void TestInitialize() { Console.WriteLine("Inside TestInitialize"); } [TestMethod] public void Test_2() { Console.WriteLine("Inside TestMethod Test_2"); } [TestCleanup] public void TestCleanup() { Console.WriteLine("Inside TestCleanup"); } } }

OUTPUT:

Inside ClassInitialize Inside TestMethod Test_1 Inside AssemblyInitialize Inside TestInitialize Inside TestMethod Test_2 Inside TestCleanup

XUnit

TEST:

using System; using Xunit; namespace xUnit_Test { public class xUnit_Tests : IDisposable { public xUnit_Tests() { Console.WriteLine("Inside SetUp Constructor"); } public void Dispose() { Console.WriteLine("Inside CleanUp or Dispose method"); } } public class UnitTest_1 : IClassFixture<xUnit_Tests> { [Fact] public void Test_1() { Console.WriteLine("Inside Test_1"); } } public class UnitTest_2 : IClassFixture<xUnit_Tests> { [Fact] public void Test_2() { Console.WriteLine("Inside Test_2"); } } }

OUTPUT:

Inside SetUp Constructor Inside Test_1 Inside Test_2 Inside CleanUp or Dispose method

AndroidUI Test Framework

TEST:

using AndroidUITestFramework; namespace AndroidUITestFramework_Test { public class AndroidUITestFramework_Tests : TestGroup { public override void OnCreate() { Console.WriteLine("Inside OnCreate"); } public override void OnDestroy() { Console.WriteLine("Inside OnDestroy"); } public class UnitTest_1 : Test { public override void Run(TestGroup nullableInstance) { Console.WriteLine("Inside Test_1"); } } public class UnitTest_2 : Test { public override void Run(TestGroup nullableInstance) { Console.WriteLine("Inside Test_2"); } } } }

OUTPUT:

Starting AndroidUI Test Framework... Started AndroidUI Test Framework Discovering Tests... Discovered Tests Printing Tests Heirarchy +Top Level No Tests Have Been Declared By 'Top Level' +AndroidUITestFramework_Tests UnitTest_1 UnitTest_2 No Test Groups Have Been Declared By 'AndroidUITestFramework_Tests' Printed Tests Heirarchy Running Tests in Alphaberical Order... [Running ] Group: Top Level [Running ] Group: AndroidUITestFramework_Tests Inside OnCreate [Running ] Test: UnitTest_1 Inside Test_1 [Running OK] Test: UnitTest_1 Inside OnDestroy Inside OnCreate [Running ] Test: UnitTest_2 Inside Test_2 [Running OK] Test: UnitTest_2 Inside OnDestroy [Running OK] Group: AndroidUITestFramework_Tests [Running OK] Group: Top Level Ran Tests in Alphaberical Order D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\bin\Debug\net6.0\AndroidUITest.exe (process 22372) exited with code 0. Press any key to close this window . . .



as you can see above, AndroidUI Test Framework prints detail info about the test heirarchy and tests being run and their status

below is a sample of our capabilities

Starting AndroidUI Test Framework... Started AndroidUI Test Framework Discovering Tests... Discovered Tests Printing Tests Heirarchy +Top Level BASE_TEST inherited_test EXPECTATIONS B_TEST UNHANDLED_TEST_EXCEPTION B_TEST +Group ASSERTION TEST_INSIDE_ANOTHER_CLASS +GROUP_INSIDE_ANOTHER_CLASS HOTDOG No Test Groups Have Been Declared By 'GROUP_INSIDE_ANOTHER_CLASS' +PrintGroup PrintTest SkipTest No Test Groups Have Been Declared By 'PrintGroup' +SkipGroup SkipTest No Test Groups Have Been Declared By 'SkipGroup' +FailGroup Test No Test Groups Have Been Declared By 'FailGroup' +FailGroup2 Test No Test Groups Have Been Declared By 'FailGroup2' +UNHANDLED_GROUP_EXCEPTION_CREATE UNHANDLED_TEST_EXCEPTION No Test Groups Have Been Declared By 'UNHANDLED_GROUP_EXCEPTION_CREATE' +UNHANDLED_GROUP_EXCEPTION_DESTROY UNHANDLED_TEST_EXCEPTION No Test Groups Have Been Declared By 'UNHANDLED_GROUP_EXCEPTION_DESTROY' +UNHANDLED_GROUP_EXCEPTION_DESTROY2 UNHANDLED_TEST_EXCEPTION No Test Groups Have Been Declared By 'UNHANDLED_GROUP_EXCEPTION_DESTROY2' +UNHANDLED_GROUP_EXCEPTION_2 UNHANDLED_TEST_EXCEPTION_1 UNHANDLED_TEST_EXCEPTION_2 No Test Groups Have Been Declared By 'UNHANDLED_GROUP_EXCEPTION_2' +a_test_group a_test +a_test_group a_test No Test Groups Have Been Declared By 'a_test_group' +AndroidUITestFramework_Tests UnitTest_1 UnitTest_2 No Test Groups Have Been Declared By 'AndroidUITestFramework_Tests' Printed Tests Heirarchy Running Tests in Alphaberical Order... [Running ] Group: Top Level [Running ] Test: B_TEST TEST! [Running OK] Test: B_TEST [Running ] Test: B_TEST TEST! INSIDE NAMESPACE [Running OK] Test: B_TEST [Running ] Test: BASE_TEST TEST! 1 [Running OK] Test: BASE_TEST [Running ] Test: EXPECTATIONS EXPECTATIONS! Test Failed Reason: Expected the expression to be false, it was true Message: <No Message Given> Location: at Method: EXPECTATIONS.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:60 Test Failed Reason: Expected the expression to be true, it was false Message: <No Message Given> Location: at Method: EXPECTATIONS.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:61 Test Failed Reason: Expected the following instances to be equal Actual: EXPECTATIONS Expected: <null> Message: <No Message Given> Location: at Method: EXPECTATIONS.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:62 [Running FAILED] Test: EXPECTATIONS [Running ] Test: inherited_test TEST! 1 TEST! INHERITED [Running OK] Test: inherited_test [Running ] Test: UNHANDLED_TEST_EXCEPTION UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_TEST_EXCEPTION.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:240 [Running FAILED] Test: UNHANDLED_TEST_EXCEPTION [Running ] Group: Group [Running ] Test: ASSERTION ASSERTION! Test Failed Reason: Expected the expression to be false, it was true Message: <No Message Given> Location: at Method: Group.ASSERTION.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:10 [Running FAILED] Test: ASSERTION [Running ] Test: TEST_INSIDE_ANOTHER_CLASS TEST! 3 [Running OK] Test: TEST_INSIDE_ANOTHER_CLASS [Running ] Group: Group.GROUP_INSIDE_ANOTHER_CLASS [Running ] Test: HOTDOG TEST! 4 [Running OK] Test: HOTDOG [Running OK] Group: Group.GROUP_INSIDE_ANOTHER_CLASS [Running FAILED] Group: Group [Running ] Group: PrintGroup TEST GROUP CREATE [Running ] Test: PrintTest TEST [Running OK] Test: PrintTest TEST GROUP DESTROY TEST GROUP CREATE [Running ] Test: SkipTest [Running SKIPPED] Test: SkipTest TEST GROUP DESTROY [Running OK] Group: PrintGroup [Running ] Group: SkipGroup [Running SKIPPED] Group: SkipGroup [Running ] Group: FailGroup TEST GROUP CREATE Test Failed Reason: <No Reason Given> Message: <No Message Given> Location: at Method: FailGroup.OnCreate() in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:142 [Running FAILED] Group: FailGroup [Running ] Group: FailGroup2 TEST GROUP CREATE [Running ] Test: Test TEST [Running OK] Test: Test TEST GROUP DESTROY Test Failed Reason: <No Reason Given> Message: <No Message Given> Location: at Method: FailGroup2.OnDestroy() in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:169 [Running FAILED] Group: FailGroup2 [Running ] Group: UNHANDLED_GROUP_EXCEPTION_CREATE UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_GROUP_EXCEPTION_CREATE.OnCreate() in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:187 [Running FAILED] Group: UNHANDLED_GROUP_EXCEPTION_CREATE [Running ] Group: UNHANDLED_GROUP_EXCEPTION_DESTROY [Running ] Test: UNHANDLED_TEST_EXCEPTION [Running OK] Test: UNHANDLED_TEST_EXCEPTION UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_GROUP_EXCEPTION_DESTROY.OnDestroy() in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:205 [Running FAILED] Group: UNHANDLED_GROUP_EXCEPTION_DESTROY [Running ] Group: UNHANDLED_GROUP_EXCEPTION_DESTROY2 [Running ] Test: UNHANDLED_TEST_EXCEPTION UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_GROUP_EXCEPTION_DESTROY2.UNHANDLED_TEST_EXCEPTION.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:230 [Running FAILED] Test: UNHANDLED_TEST_EXCEPTION UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_GROUP_EXCEPTION_DESTROY2.OnDestroy() in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:222 [Running FAILED] Group: UNHANDLED_GROUP_EXCEPTION_DESTROY2 [Running ] Group: UNHANDLED_GROUP_EXCEPTION_2 [Running ] Test: UNHANDLED_TEST_EXCEPTION_1 UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_GROUP_EXCEPTION_2.UNHANDLED_TEST_EXCEPTION_1.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:251 [Running FAILED] Test: UNHANDLED_TEST_EXCEPTION_1 [Running ] Test: UNHANDLED_TEST_EXCEPTION_2 UNHANDLED EXCEPTION Exception Type: NullReferenceException Reason: Object reference not set to an instance of an object. Location: at Method: UNHANDLED_GROUP_EXCEPTION_2.UNHANDLED_TEST_EXCEPTION_2.Run(TestGroup nullableInstance) in Location: D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\A_TEST.cs:260 [Running FAILED] Test: UNHANDLED_TEST_EXCEPTION_2 [Running FAILED] Group: UNHANDLED_GROUP_EXCEPTION_2 [Running ] Group: a_test_group [Running ] Test: a_test I AM A TEST INSIDE OF A TEST GROUP AND I AM STILL FOUND [Running OK] Test: a_test [Running ] Group: a_test_group.a_test_group I AM A TEST GROUP INSIDE OF A TEST GROUP AND I AM STILL FOUND [Running ] Test: a_test I AM A TEST INSIDE OF A TEST GROUP INSIDE OF ANOTHER TEST GROUP AND I AM STILL FOUND [Running OK] Test: a_test [Running OK] Group: a_test_group.a_test_group [Running OK] Group: a_test_group [Running ] Group: AndroidUITestFramework_Tests Inside OnCreate [Running ] Test: UnitTest_1 Inside Test_1 [Running OK] Test: UnitTest_1 Inside OnDestroy Inside OnCreate [Running ] Test: UnitTest_2 Inside Test_2 [Running OK] Test: UnitTest_2 Inside OnDestroy [Running OK] Group: AndroidUITestFramework_Tests [Running FAILED] Group: Top Level Ran Tests in Alphaberical Order D:\IMPORTANT\source\repos\WindowsProject1\AndroidUITest\bin\Debug\net6.0\AndroidUITest.exe (process 27852) exited with code 0. Press any key to close this window . . .

About

a C# Unit Testing Framework, used by AndroidUI, NOT RELATED TO ANDROID

Topics

unittesting unittesting-library unittest-framework unittest-library

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages