Async GlobalSetup does not work with InProcess toolchain #1738
Description
#521 added support for async GlobalSetup, but it appears that InProcess toolchain does not wait for the async setup method to finish. Simple reproducer:
using BenchmarkDotNet.Attributes; using BenchmarkDotNet.Running; using System.Threading.Tasks; namespace AsyncGlobalSetupRepro { [InProcess] public class MyBenchmarkClass { private string _foo; [GlobalSetup] public async Task MyAsyncSetup() { await Task.Delay(1000); _foo = "hello"; } [Benchmark] public int MyBenchmark() => _foo.Length; // NullReferenceException! } public class Program { public static void Main(string[] args) { BenchmarkRunner.Run(typeof(MyBenchmarkClass)); } } }It looks like MyAsyncSetup gets invoked as a regular method here, and then JITting starts immediately without waiting for it to finish: