Bye-bye, EOF.

Removed

• The implementation of the EVM Object Format version 1 (EOFv1) has been completely removed. #1321
  • implementation of EOF validation and execution,
  • implementation of DUPN, SWAPN and EXCHANGE instructions,
  • "initcodes" transaction type,
  • additional testing tools: eofparse, eoftest and eofparsefuzz,
  • unit tests, integration tests, benchmarks and test helpers.

This release provides full Osaka compatibility by implementing 3 remaining EIPs.

Added

• Implementation of the p256verify (EIP-7951) precompile for the secp256r1/P256 signature verification. #1321 #1328
• Unit tests and benchmarks for the p256verify precompile. #1326 #1333
• Support for EIP-7934—MAX_RLP_BLOCK_SIZE in testing infrastructure. #1329
• Support for EIP-7892—Blob Parameter Only (BPO) forks in testing infrastructure. #1330

Changed

• Testing infrastructure improvements:
  • State and blockchain test runners now discover tests by individual test cases. #1331
  • Block header validation fixes. #1244
  • Fix deposit log and system contract validations in t8n. #1339
• Cryptography optimizations:
  • Optimize bit test of scalars in ECC multiplication. #1336
  • Add ECC doubling formula for curves with A coefficient of -3. #1321
  • Use g1_mul and g2_mul for single-input multiplication in BLS precompiles. #1340
• Code quality and coverage improvements:
  • Refactor MPT implementation for more precise code coverage. #1341
  • Filter relevant functionality in call_impl template. #1348
  • Remove deprecated methods in TestState. #1352
  • Remove dead code: ethash_keccak256_32, secp256k1 affine point multiplication, and RLP encode(array). #1345 #1346 #1342
  • Degrade always-true condition to assert in the Host code. #1344
  • Remove potentially dead code in ExecutionState. #1338
  • Move BlobSchedule from state library to test utilities. #1349
• Build and dependencies:
  • Upgrade minimum CMake version to 3.19. #1350
  • Disable -Werror by default. #1351
  • Upgrade minimum Xcode to 16.2.0. #1334
• External test suites:
  • [Execution Spec Tests] upgraded to [v5.3.0][Execution Spec Tests 5.3.0]. #1334 #1327
  • Adjust coverage report for EEST tests. #1318

Fixed

• Fix handling of the input point-at-infinity in secp256r1 signature verification. #1328

Added

• Partial [Osaka] support:
  • Add CLZ opcode (EIP-7939). #1264
  • Implement blob count limit per transaction (EIP-7594). #1279
  • Modify blob base fee calculation (EIP-7918). #1281 #1322
  • Enforce max transaction gas limit (EIP-7825). #1285
  • Add the modexp precompile changes from EIP-7823 and EIP-7883. #1242 #1268 #1294
  • Add p256verify (EIP-7951) precompile ID/address (no implementation yet). #1309

Changed

• EVM Object Format (EOF):
  • New address hashing scheme for EOFCREATE. #1140
  • TXCREATE and InitcodeTransaction type (EIP-7873). #1139 #1192
  • Align EOFCREATE args with EXT*CALL. #1147
  • Change container sections size to 4 bytes. #1171
  • Caching of TXCREATE validation results. #1193
  • Move EOF to EVMC_EXPERIMENTAL. #1243
• Improvements to Elliptic Curve Cryptography code:
  • Add mixed-add formula. #1170
  • Better API for ECC. #1288 #1298 #1299
  • Improve bn254 point "on curve". #1300
  • Remove special case checks from point multiplication. #1301
  • Avoid conversion to/from Montgomery form of y in secp256k1. #1303
  • Reduce EC multiplication scalar by the order. #1305
  • Switch to Jacobian coordinates in ECC. #1312
• Optimization to the Merkle Patricia Trie (MPT) implementation: "Extension node is a lie!" #703
• Better EVM stack memory alignment and implementation:
  • Mark stack pointer as 32-byte aligned. #1233
  • Track stack "end" instead of "top". #895
  • Use alignas to specify EVM stack space alignment. #1304

Changed

• EOF:
  The is the final version compatible with EOF devnet-0.
  • Rename RETURNCONTRACT to RETURNCODE #1153
  • Optimize allocations when validating the header #1160
• EVMMAX:
  • evmmax: Add inversion method #1142
  • evmmax: Use inv() instead of generated addchains #1143
• Precompiles:
  • Handle trivial inputs to the expmod precompile #1163
  • Use classic EC point add formula for BN precompiles #1165
  • Optimize EC point multiplication for BN precompiles #1166
  • Refactor the BN254 ecpairing precompile #1175
• EIP-7702: Remove the check for empty in-state accounts #1141
• Add prestate validation checks to the state test loader #1134
• Upgrade the silkpre dependency #1173

Fixed

• Fix incorrect output size in the BN254 ecpairing precompile #1174

Fixed

• Fixes and improvements to BLS precompiles (EIP-2537). #1155 #1154 #1150 #1151 #1148
• Check for topic when parsing deposit contract logs (EIP-6110). #1152

Changed

• Improvements to EOF validation. #1137 #1144 #1145

Added

• Support for all remaining Prague EIPs:
  • EIP-6110: Supply validator deposits on chain. #1079
  • EIP-7002 and EIP-7251: Withdrawal and consolidation requests. #1084
  • EIP-7623: Increase calldata cost. #1095 #1108
  • EIP-7685: General purpose execution layer requests. #1083
  • EIP-7691: Blob throughput increase. #1118
  • EIP-7702: Set EOA account code. #961
• EVMMAX-based BN254 pairing check precompile. #852
• New API for transaction execution: StateView & StateDiff. #802
• Introduce BlockHashes interface. #1059
• Add option -k to filter tests by name in evmone-statetest. #1111
• Add support for EIP-4844 in blockchain tests. #1077
• Add GDB pretty printers for common bytes and uint256 types. #1024

Changed

• Improvements to EOF validation and execution:
  • Move EOF to Osaka. #1060
  • Optimized EOF validation using std::move. #1036
  • Return constant hash of EXTCODEHASH of EOF. #1035
  • Optimized EOF by reading types on demand. #1034
  • Move EOF type validation outside of header validation. #1052
  • Improve has_full_data() helper. #1097
• Updates to BLS precompiles (EIP-2537). #1089
• State and transaction execution improvements:
  • Split transaction and block related types. #1031
  • Avoid returning bytes_view in system contracts. #1048
  • Implement CREATE address scheme without RLP lib. #1055
  • Separate transaction validation from transition. #1069
  • Introduce TransactionProperties. #1098
  • Simplify code modification indicator in StateDiff. #1117
• Requirements and dependencies updates:
  • EVMC 12.1.0 with EIP-7702 support. #1125
  • intx 0.12.1 #1131
  • ethash 1.1.0 #1131

This release adds BLS precompiles and a system contract for Prague and improves the interpreter API.

Added

• Implementation of all EIP-2537 BLS precompiles, enabled in Prague: #984
  • uses blst v0.3.13 library, #972 #986
  • bls12_g1add (0x0b) #982
  • bls12_g1mul (0x0c) #994
  • bls12_g1msm (0x0d) #1010
  • bls12_g2add (0x0e) #995
  • bls12_g2mul (0x0f) #999
  • bls12_g2msm (0x10) #1010
  • bls12_pairing_check (0x11) #1016
  • bls12_map_fp_to_g1 (0x12) #1012
  • bls12_map_fp2_to_g2 (0x13) #1012
• Implementation of KZG proof verification (aka "point evaluation") precompile from EIP-4844. #979
• Implementation of EIP-2935 "Serve historical block hashes from state". #953

Changed

• Refactor system_call() in preparation for more Pectra system contracts. #976
• Improved Baseline code analysis API. #941
• Provide execution states at VM object level and hide them from public API. #1005
• Requirements and dependencies updates:
  • Support for 32-bit MSVC compiler has been dropped. #973
  • intx v0.12.0 #985
• External test suites:
  • EEST EOF tests upgraded to eip7692@v1.1.0. #1025
  • Added EEST tests for Pectra pectra-devnet-3@v1.5.0 #997
  • ethereum/tests upgraded to v14.1. #980

Fixed

• Fixed EOF parsing bug allowing multiple subcontainer kinds in the header. #978
• Ensure mandatory fields are included in the exported state tests. #993
• Properly handle EOF additions in ExecutionState::reset(). #1004

Removed

• The implementation of EOF's TXCREATE has been removed. It will be back when scheduled for a network upgrade. #992

This release is focused on the Prague upgrade and EOF.

Added

• Added evmone-precompiles-bench tool to benchmark precompiles. #765
• Added native implementations of the precompiled hash functions:
  • RIPEMD160 #846
  • BLAKE2bf #857
  • SHA256 #924
• Added validate_eof EVMC option to validate EOF before execution. This option is enabled by default in evmc run. #768 #960
• Implemented EIP-7610 "Revert creation in case of non-empty storage" in the testing infrastructure. #816
• Added --version option to testing tools. #902
• Introduce TestState and TestAccount to testing infrastructure. #811
• Added support for validating "initcode" containers in eofparse and eoftest. #934 #943

Changed

• EVM Object Format (EOF)

  Completed implementation of the EIP-7692: EVM Object Format (EOFv1) Meta.

  • Added EOFCREATE and RETURNCONTRACT instructions. #553
  • Added TXCREATE instruction, later moved to the future EOF version (Osaka). #702 #889
  • Make EXT*CALL instructions Address Space Expansion ready. #915
  • Added EOF validation of sub-container kinds. #876
  • Limit validated container size to MAX_INITCODE_SIZE. #930
  • Added RETURNDATALOAD instruction. #786
  • Implementation of "less restricted" stack validation. #676
  • Added implementation of EXCHANGE from EIP-663. #839
  • Disallow unreachable code sections in EOF containers. #721 #866
  • Restrict DUPN and SWAPN to EOF only in EOF only. #788
  • Change DATA* opcodes. #797
  • Disable EOF ↔ legacy cross-creation. #825
  • Deprecate and reject code/gas-observability in EOF. #834
  • Make EOF opaque for EXTCODE* instructions. #587
  • Implement EOF creation transactions. #878
  • Modify EOF RETURNDATA* to allow out-of-bounds reads (instead of failing execution). #909
  • Tune EOF validation: disallow truncated data in top-level EOF containers. #921
  • Disallow unreferenced sub-containers and sub-containers of conflicting kinds. #916

• Testing

  There are a lot of improvements to the testing tools and test formats. In particular, big portion of evmone's unit tests has been re-shaped to have a structure of State Tests or EOF Validation Tests.

  Moreover, we added the option to export these tests to JSON and the archive of the exported tests ("fixture") is the artifact of this release.

  Upgraded external test suites:

  • ethereum/tests: 14.0
  • Execution Spec Tests: 3.0.0

  Other details:

  • Add some missing State Test export features. #807
  • Check for unexpected EF prefix in test code. #809
  • EOF Validation Test fixture. #810
  • Export EOF validation unit tests to JSON EOF Validation Tests. #818
  • Output failed test case index in EOF Validation Tests. #820
  • Add ExportableFixture for JSON tests exporting. #821
  • Recognize all official fork/revision names. #830
  • Export State Tests with invalid transactions. #858
  • Allow "to": null in JSON transactions. #927
  • EOF Validation Tests runner: support "initcode" flag. #936
  • evmone-blockchaintest: Simplify genesis handling. #954
  • Optimization: only empty accounts are marked "touched". #785
  • Adjust ethash difficulty if below minimum 0x20000. #803

• Requirements and dependencies updates:

  • CMake 3.18 #840
  • Xcode 15.0 #847
  • EVMC 12.0.0 #966
  • intx 0.11.0 #967

• Use 32-byte aligned allocation for Baseline stack space. #907

• Split Baseline analysis and execution into separate files. #946

• Convert EVMMAX to header-only library with full constexpr capabilities. #864 #964

• Return number of errors from eofparse. #873

Fixed

• Implement Frontier behavior of failing code deployment (testing infrastructure). #824
• Fix error messages for compatibility with external testing tools. #828 #886
• Fix initcode handling before EOF is enabled: an initcode staring with EF00 should not be validated as EOF unconditionally. #893
• Fix EOF header parsing bug (introduced by code refactoring). #957 #958
• Fix eoftest to run all tests from a JSON file. #935
• Improve output buffer handling for precompiles in testing infrastructure. This fixes out-of-bound access for some fuzzing-generated state tests. #951

This release is focused on Cancun and EOF.

Added

• Cancun Network Upgrade fully supported
  • EIP-1153: Transient storage opcodes
    • transient storage & TLOAD and TSTORE instructions #669
    • clearing of transient storage between transactions #715
  • EIP-4788: Beacon block root in the EVM
    • don't assume the transaction sender exists #731
    • system call to the Beacon Roots contract #709
  • EIP-4844: Shard Blob Transactions
    • BLOBHASH instruction #668
    • blob transactions #713
    • stub of the point_evaluation precompile #730
  • EIP-5656: MCOPY - Memory copying instruction #629 #648
  • EIP-6780: SELFDESTRUCT only in same transaction #735
  • EIP-7516: BLOBBASEFEE opcode #708
• EVM Modular Arithmetic Extensions ([EVMMAX])
  • Added basic EVMMAX support in form of C++ API. #673
  • Implementation of secp256k1 ECDSA recovery (ecrecovery precompile) using EVMMAX #688
  • Implementation of ecadd and ecmul BN254 precompiles using EVMMAX #716
• Initial support for [Blockchain Tests]
  • block execution #681 #679 #685 #701
  • test format support & results encoding #680 #690 #694 #711 #736
  • PoW difficulty calculation #682 #718
• Optionally use [Silkworm] as the precompiles implementation. #660
• Support for executing JSON EOF Tests (thanks @gzanitti) #678
• EVM tracing option --trace in evmone-t8n #616
• Support for compiling for riscv32 architecture #700
• Ability to export evmone's unit tests to the JSON State Test format #743

Changed

• EVM Object Format (EOF):
  EOF implementation follows the [EOF spec] (aka Mega EOF Endgame) and is tentatively enabled in the Prague EVM revision.
  • Tests have been migrated to ipsilon/tests/eof #651
  • Implementation of four new instructions for accessing data sections: DATALOAD, DATALOADN, DATASIZE, DATACOPY #586 #663 #717 #741
  • Forbid DELEGATECALL from EOF to legacy contracts during execution #588
  • The data section kind has been changed to 0x04 #632
  • The RJUMPV immediate argument meaning has been changed to "max index" #640
  • Implementation of the JUMPF instruction and the non-returning functions #644
• Opcodes of new instructions have been assigned following the execution-spec opcodes list #665
• State changes are now reverted with the journal #689
• Compatibility of evmone-statetest with [goevmlab] has been improved #658 #757
• Minimal tested/supported compilers versions: #675
  • GCC 11
  • Clang 13
  • XCode 14.3.1 (bumped from 13.4)
  • Visual Studio 2022
  • CMake 3.16...3.27
• EVMC has been upgraded to version 11.0.1. #754 #738 #707 #669
• intx has been upgraded to version 0.10.1. #674
• [Ethereum Execution Tests] has been upgraded to version [13][tests 13] and [Execution Spec Tests] version [1.0.6][Execution Spec Tests 1.0.6] has been added. #737

Fixed

• EOF: Fix CALLF runtime stack overflow check #677
• EOF: Fix missing CALLF stack overflow validation #619
• Fixed processing of withdrawals with 0 amount (testing infrastructure) #630
• Fixed handling of short nodes in Merkle Patricia Trie (testing infrastructure) #686

...

The highlights of this release are support for Shanghai execution specification upgrade and implementation of EOF "v1.0". There are also big enhancements to the EVM testing tools and infrastructure. In particular, we added the t8n command-line utility.

As it is tradition, the EVM performance has been improved as well. Comparing with the previous release using the "main" benchmark suite, the Baseline interpreter is now:

• 10–45% (mean 25%) faster for GCC builds,
• 0–19% (mean 11%) faster for Clang builds.

Added

• Shanghai support:
  • EIP-3651: Warm COINBASE (testing infrastructure only). #560
  • EIP-3860: Limit and meter initcode. #545
  • EIP-4895: Beacon chain push withdrawals as operations (testing infrastructure only). #614
• EVM Object Format "EOF v1.0":
  • The implementation of the revisions of EIP-3540, EIP-3670, EIP-4200, EIP-4750 and EIP-5450 originally proposed for Shanghai. #563 #572 #594 #508
  • EOF is currently enabled in the Cancun revision but likely to be moved to Prague in the future. #561
  • Added evmone-eofparse and evmone-eofparsefuzz tools for testing EOF validation. #568
• Implemented EIP-663: Unlimited SWAP and DUP instructions (enabled in EOF). #529
• Added implementation of evmc::Host, state transition and block finalization for testing purposes. #484 #519 #575 #608 #609
• Added t8n tool evmone-t8n — a command line utility for transaction execution and state transition testing. It allows executing and generating tests with cooperation of retesteth or execution-spec-tests. #552 #555 #558 #569 #583 #590 #591 #604 #606 #607 #612
• Added partial support for EVM Precompiles — gas cost computation and execution via JSON stub file. #524
• Declarative state transition unit test suite. #589
• CMake option EVMONE_X86_64_ARCH_LEVEL to set the x86-64 microarchitecture level. On Linux and Windows this is set to x86-64-v2 by default. #548

Changed

• C++20 is now required to build evmone. #502
• Minimal tested/supported compilers versions: #535
  • GCC 11
  • Clang 13
  • XCode 13.4
  • Visual Studio 2022
  • CMake 3.16
• EVMC has been upgraded to version 10.1.0. #623
• intx has been upgraded to version 0.10.0. #622
• ethash has been upgraded to version 1.0.0. #540
• Ethereum Execution Tests has been upgraded to version 12.2. #625
• Baseline interpreter optimizations:
  • Better stack overflow/underflow checks. #518
  • SWAP instructions optimization for Clang. #527
  • Pass gas counter to memory grow/check helpers by value. #598
  • Pass gas counter to instructions by value. #600
• Changes to EVM tracing:
  • Instruction trace prints "gas" and "gasUsed" as hex numbers to match geth. #592
  • C++ tracing API has separated the gas parameter. #599
• Improvements to the JSON State Test execution tool evmone-statetest:
  • Ability to load tests from multiple dirs/files. #512
  • Validate deployed EOF code before state test execution. #593 #601
  • Added --trace command-line flag to enable EVM execution tracing. #543
  • Other improvements. #556 #603
• Benchmarks (invocable by evmone-bench) have been migrated to external evm-benchmarks which use JSON State Test format. #513 #530
• Removed dependency on evmc::instructions. #533 #534 #537

Fixed

• Fixed calling Tracer.notify_execution_start. #531
• Fixed instruction tracing of EOF code. #536

New Contributors

• JSzymanskiJS #512
• miles170 #513
• rodiazet #531