Skip to content

Latest commit

 

History

History
386 lines (311 loc) · 18 KB

CHANGELOG.md

File metadata and controls

386 lines (311 loc) · 18 KB

CHANGELOG

[2.4.4] - 2021-07-19

  • Annotating tags during releases

[2.4.3] - 2021-05-20

  • added new 64-bit K crypto tests as per the test-plan presented by the scalar crypto task group here
  • added new 32-bit K crypto tests as per the above mentioned test-plan.
  • added coverage and data propagation reports for the above tests.
  • updated README in riscv-test-suite
  • added missing semi-colon in example target Makefile.include files

[2.4.2] - 2021-04-20

  • changed all occurances of SPTBR to the new name SATP

[2.4.1] - 2021-04-01

  • updated issue number in TestFormatSpec to be consistent with doc history
  • adding a contribution guideline
  • updated comment on usage of RISCV_DEVICE in Makefile.include
  • updated licenses that are currently used by tests
  • renamed K tests to K_unratified
  • updated ci to build and upload pdf for testformatspec

[2.4.0] - 2021-03-26

2021-03-26 Duncan Graham [email protected] - Added new K Crypto (scalar) (0.8.1) tests from Imperas

[2.3.1] - 2021-03-20

Changed

  • Compliance Task Group changed to Architecture Test SIG in all docs and comments
  • replacing old riscv-compliance link with new riscv-arch-test links
  • fixed ci for release

Removed

  • spec/TestFormatSpec.pdf is removed since its old. Keeping only adoc file
  • removing obsolete and commented out portions from doc/README

[2.3] - 2021-03-11

Added

- updated maintainers list in root-level readme
- updated the links to riscof, isac and ctg repos and docs in root-level readme
- adding CI to update versions automatically

Removed

- replaced spike target with a REAMDE pointing to riscv-isa-sim/arch_test_target/README.md

[2.2] - 2021-01-28

2021-01-22 Tobias Wölfel <[email protected]>
	* Add missing base ISA check in riscv-test-suite

2021-01-20 Xiretza <[email protected]>
	* Deduplicate makefiles in riscv-test-suite
	* Makefile: Fix ordering of simulate and verify targets to allow multi-job runs (make -j)
	* Makefile.include: Document RISCV_TEST
	* Makefile: use $(TARGETDIR) variable for postverify target instead of hard-coded path

2021-01-16 S Pawan Kumar <[email protected]>
  	* Fixed NARGS macro defintion to work correctly. 

2021-01-15 Xiretza <[email protected]>
	* style: Add a missing space to the "OK" message in verify.sh

2020-12-17 Neel Gala <[email protected]>
  * remove env folder symlinks from all riscv-test-suite src folders 
	* fixed assertion macros for ovpsim
	* renamed RVTEST_ASSERT to RVMODEL_ASSERT in the Makefile and ovpsim macros
	* tests updated with right set of "correctvals"

2020-11-24 Neel Gala <[email protected]>
	* added MIGRATION.adoc in doc directory to indicate how old framework targets can work with
	  changes made as part of this PR
	* updated doc/README.adoc to avoid the word "compliance" and updated the section on porting a new
	  target to the framework.
	* Added an example_target directory to host dummy files which can be used as a starting point for
	  porting targets. This was provided by MarcKarasek.
	* migrated/ported existing targets (except codasip and sifive-formal) to the new framework
	  changes.
	* in riscv-test-env/p/riscv_test.h changed names of RVTEST_[CODE/DATA]_[BEGIN/END] to
	  RVTEST_[CODE/DATA]_[BEGIN/END]_OLD respectively to avoid conflicts with the new framework macros.
	* in riscv-test-env/p/riscv_test.h re-strutucture RVTEST_DATA_BEGIN_OLD/END to ensure that all
	  target specific data contents are introduced in RVTEST_DATA_END after the signature.
	* added new file riscv-test-suite/env/arch_test.h which contains the macros used by the new set of 
	  tests. A symlink to this in the riscv-test-env directory is also created. The arch_test also 
	  includes aliases for the old macros. 
	* encoding.h moved to riscv-test-suite/env and a symlink to this file exists in riscv-test-env.
	  This was done to ensure that the arch_test.h and encoding.h are not to be modified by the
	  targets
	* Added riscv-test-stats which includes coverage and data propagation reports for the tests
	  available in the riscv-test-suite directory.
	* upddted the directory structure of the riscv-test-suite as per definition found in the
	  TestFormatSpec document.
	* new set of tests with better coverage for rv[32/64][I,M,C, Zifencei] added. Almost all tests 
		were generated using the open source riscv_ctg tool. A few tests like fence, fencei, ebreak, 
		ecall, etc were handwritten/modified to follow the new macro conventions.
	* Updated TestFormatSpec to avoid the word compliance and also updated the definitions of macros
	  and signatures
	* created a root-level Makefile.include to decouple the Makefile and target specific settings. 
	* Added riscv-target and Makefile.include to the .gitignore file to stop tracking target specific
	  changes.
	* Added special targets for compile(build), simulate(run) and verify in the Makefiles of each
	  test-suite.
	* the existing riscv-targets have been either updated for the new framework or migrated to the
		framework.

2020-10-15 Simon Davidmann <[email protected]>
    * riscvOVPsim enhanced and moved to its own respository: github.com/riscv-ovpsim

2020-04-24 Allen Baum <[email protected]>
	* fixed the I-SB-01.S and I-SH-01.S tests and associated reference signatures to account
	of tests with negative offsets (which causes stores outside the signature area)
  
2020-03-19 Neel Gala <[email protected]>
    * restructuring the riscv-test-suite to indicate clearly what is deprecated, wip and usable
      tests.
    * based on the above fixed the directory structure for riscv-targets where-ever applicable. Only
      tested riscvOVPsim and spike.
    * fixed script bugs for spike as well
    * renamed rv32i/I-IO.S to rv32i/I-IO-01.S along with necessary changes to the reference files
      and Makefrag
    * renamed mbadaddr csr to mtval as raised in issue #31
    * C.SWSP-01.S test updated to fix issue #37

2020-03-18 Neel Gala <[email protected]>
    * fixed doc/README.adoc with correct version to pass the sanity-check in the doc/Makefile

2020-02-07 Prashanth Mundkur <[email protected]>
    * Support F extension on RV32 sail-riscv-c.

2019-12-01 Allen Baum <[email protected]>
        * modified macro names to conformn to riscof naming convention of model specific vs. pre-defined
	* add more complete list of macros, their uses, parameters, and whether they are required or optional
	* minor structural changes (moving sentences, renumbering) and typo fixes
	* clarified impact of debug macros
	* clarified how SIGUPD and BASEUPD must be used
        * remove section about test taxonomy, binary tests, emulated ops
        * clarify/fix  boundary between test target and framework responsibilities
	   (split test target into test target and test shell)
        * remove To Be discussed items that have been discussed
	* remove default case condition; if conditions are unchanged, part of same case
        *  minor grammatical changes related to the above

2019-10-16 Allen Baum <[email protected]>
	* spec/TestFormatSpec.adoc: changed the format of the signature to fixed physical address size, fixed 32b data size extracted from COMPLIANCE_DATA_BEGIN/END range.

	* more gramatical fixes, clarifications added
	* added To Be Discussed items regarding emulated instruction and binary tests

2019-09-11 Allen Baum <[email protected]>
	* spec/TestFormatSpec.adoc:   more grammar and typo corrections and changes
	  clarified and added To Be Discussed issues

2019-09-11 Allen Baum <[email protected]>
    * spec/TestFormatSpec.adoc:   many grammar and typo corrections and changes
	removed many "to Be Discussed items and made them official
	Added wording to clarify spec intent (work in progress/goal rather than final)
	Added macros to ease test authoring: RVTEST_SIGBASE, RVTEST_SIGUPDATE, RVTEST_CASE
	Added detail on proposals for connection to framework (how framework selects tests).
	Expanded definition of signature format
	Changed the (proposed) directory structure and naming convention to eliminate ambiguities, add consistancy and slightly better match existing structure
	Added many "future work" items related to the above
	Added examples and comments to code examples to indicate how proposed macros would be used
   * .gitignore: added condition to ignore Mac file system artifacts


2019-11-05 Lee Moore <[email protected]>
    * Restructured RV32I to move Zicsr and Zifencei into their own suites

2019-10-14 Lee Moore <[email protected]>
    * Added Ability to run a single test by using the Make Variable RISCV_TEST
    for example, to only run the test I-ADD-01 from the rv32i suite
        make RISCV_ISA=rv32i RISCV_TEST=I-ADD-01
    * Added Top Level Variable to Makefile RISCV_TARGET_FLAGS, 
    in the case of the RISCV_TARGET this can be passed and appended to the invocation
    commandline configuration, for example to pass a command line flag to the RISCV_TARGET
    to perform tracing. The value of this flag will be target specific
        make RISCV_ISA=rv32i RISCV_TEST=I-ADD-01 RISCV_TARGET_FLAGS="--trace"
    This is has also been added to all other targets to allow target configuration from
    the commandline

2019-10-07 Philipp Wagner <[email protected]>
    * When executing the test suite, Ibex always writes an instruction
      log. Update the Makefile to write it to a test-specific location
      (next to all other log files).
    * On Ibex, provide an additional .objdump-noalias disassembly file
      with no aliases and numeric register names (instead of ABI names).
      This file matches the Ibex trace and can be used to debug the test
      runs.

2019-08-29 Robert Balas <[email protected]>
    * Added support for using RI5CY as a target.
    * Added subdirectory riscv-target/ri5cy

2019-08-08 Lee Moore <[email protected]>
    * Added support for lowRISC/ibex RTL as a target using Verilator.
      In conjunction with Philipp Wagner of lowRISC [email protected]

2019-07-18 Paul Donahue <[email protected]>
    * Fix typos/grammar and use correct architectural terms.

2019-06-21 Ben Selfridge <[email protected]>
    * Added support for using the the GRIFT simulator as a target.
    * Added subdirectory riscv-target/grift
    * updated README.md and doc/README.adoc

2019-05-23 Prashanth Mundkur <[email protected]>
    * Added support and instructions for using the C and OCaml simulators from the Sail RISC-V formal model as targets.
	* added subdirectories riscv-target/sail-riscv-c and riscv-target/sail-riscv-ocaml
	* updated README.md and doc/README.adoc

2019-04-05 Allen Baum <[email protected]>
    * spec/TestFormatSpec.adoc:  Adding details, minor corrections, ToBeDiscussed
      items and clarifications to the specification of the future compliance test
      suite. Also removing restrictions on having absolate addresses in signature

2019-02-21 Lee Moore <[email protected]>
    * Fixed     bug in RVTEST_IO_ASSERT_GPR_EQ which was not preserving register t0
    * Corrected commit I-LUI-01.S, register target changed but missed assertion

2019-02-21 Deborah Soung <[email protected]>
    * added RiscvFormalSpec as a target with its own unique environment

2019-02-15 Radek Hajek <[email protected]>
    * updated rv32i tests to support all registers (x31) with assertions
    * updated spec/TestFormatSpec.adoc example ISA test with new assertions

2019-02-05 Deborah Soung <[email protected]>
    * [Issue #33] fixing rv32si/ma_fetch.S test
    * [Issue #32] fixing breakpoint test

2019-02-01 Lee Moore <[email protected]>
    * updated Infrastructure macros to support non-volatile registers
    * updated riscvOVPsim

2019-01-29 Deborah Soung <[email protected]>
    * Added Rocket Chip generated cores as a target
        * riscv-target/rocket/compliance_io.h created
	* riscv-target/rocket/compliance_test.h created
	* riscv-target/rocket/*/Makefile.include created for existing test suites
	* README.adoc updated with instructions for using Rocket cores as targets
	
2019-01-22 Premysl Vaclavik  <[email protected]>
    * feature: initial version of Compliance Test Format Specification
        * This new document outlines how we should like the compliance
          system to work going forward. By contrast the doc/README.adoc file
          describes the current system as it is.
        * Approved at Compliance TG meeting of 9 Jan 2019.

2019-01-02 Radek Hajek <[email protected]>
    * unified macros in all compliance tests

2018-12-20 Lee Moore <[email protected]>
    * fixed riscvOVPsim 

2018-11-22 Simon Davidmann <[email protected]>
    * added information on test suite status
    
2018-11-21 Olof Kindgren <[email protected]>
    * Added support for using external target directories with $TARGETDIR

2018-11-21 Neel Gala <[email protected]>
   	* riscv-test-suite/rv_/references/_.reference_output: changed signature 
	  format for all tests to include only 4-bytes per line starting with the
  	  most significant byte on the left.
    	* riscv-target/spike/device/rv_/Makefile.include: Added a patch for 
	  spike-device Makefiles where the old-signature format is post-processed 
      	  to generate a signature in the new format at the end of each test.
	* riscv-target/riscvOVPsim/device/rv_/Makefile.include: same patch as above.
    	* Makefile: default target for Makefile is now to run all tests supported by 
	  the target mentioned defined by RISCV_TARGET variable.

2018-10-11 Simon Davidmann <[email protected]>
    * Ported github riscv/riscv-tests for RV32 processors to this compliance env
    * rv32ua rv32uc rv32ud rv32uf rv32ud rv32ui

2018-09-10  Lee Moore  <[email protected]>
	* Added tests to RV32I to improve coverage, usage of Imperas Mutating Fault Simulator to 
	  identify untested usage cases
	* Macro renames to support GPR, (S)FPR, (D)FPR
	* Added test suite RV32IM to test 32 bit Multiply and Divide instructions 
	* Added test suite RV32IMC to test 32 bit Compressed instructions
	* Added test suite RV64I to test 64 bit Integer instructions
	* Added test suite RV64IM to test 64 bit Multiply and Divide instructions 
	
	
2018-06-15  Radek Hajek  <[email protected]>

	Modifications to support Codasip simulator.

	The simulator is renamed as Codasip-simulator (was
	Codasip-IA-simulator), compliance_test.h has been moved to target
	directories and a COMPILE_TARGET has been added to Makefile to
	allow use of LLVM.

	* Makefile: Include Codasip simulator target.
	* riscv-target/codasip-IA-simulator/compliance_io.h: Renamed as
	riscv-target/Codasip-simulator/compliance_io.h.
	* riscv-target/Codasip-simulator/compliance_io.h: Renamed from
	riscv-target/codasip-IA-simulator/compliance_io.
	* riscv-target/Codasip-simulator/compliance_test.h: Created.
	* riscv-target/codasip-IA-simulator/device/rv32i/Makefile.include:
	Renamed as
	riscv-target/Codasip-simulator/device/rv32i/Makefile.include
	* riscv-target/Codasip-simulator/device/rv32i/Makefile.include:
	Renamed from
	riscv-target/codasip-IA-simulator/device/rv32i/Makefile.include.
	* riscv-test-env/compliance_test.h: Renamed as
	riscv-target/riscvOVPsim/compliance_test.h.
	* riscv-target/riscvOVPsim/compliance_test.h: Renamed from
	riscv-test-env/compliance_test.h.
	* riscv-target/riscvOVPsim/device/rv32i/Makefile.include: Updated
	for new environment.
	* riscv-target/spike/compliance_test.h: Created.
	* riscv-target/spike/device/rv32i/Makefile.include: Updated for
	new environment.
	* riscv-test-suite/rv32i/Makefile: Likewise.

2018-06-10  Jeremy Bennett  <[email protected]>

	Put placeholders in empty directories to make sure they show in
	the GitHub hierarchy.

	* riscv-test-suite/rv32i/.gitignore: Created.
	* riscv-test-suite/rv32m/.gitignore: Created.

2018-06-10  Jeremy Bennett  <[email protected]>

	* README.md: Make references to files in the repo into links.

2018-06-09  Jeremy Bennett  <[email protected]>

	* .gitignore: Ignore editor backup files.

2018-06-09  Jeremy Bennett  <[email protected]>

	* README.md: Add better link to documentation README.md.

2018-06-08  Jeremy Bennett  <[email protected]>

	* README.md: Move AsciiDoc details into new README.md in the doc
	directory.

2018-06-08  Jeremy Bennett  <[email protected]>

	* README.md: Fix typo in link to AsciiDoc cheat sheet

2018-06-08  Jeremy Bennett  <[email protected]>

	* COPYING.BSD: Created.
	* COPYING.CC: Created.
	* README.md: Add git process, licensing and engineering process.

2018-06-08  Jeremy Bennett  <[email protected]>

	* README.md: Correct details for running the compliance tests and
	directory for OVPsim.

2018-06-08  Jeremy Bennett  <[email protected]>

	Clean restructuring to just the work of interest.

	* thought-experiments: Directory removed.
	* .gitignore: Merged with TestStructure/.gitignore
	* Makefile: Renamed from TestStructure/Makefile.
	* TestStructure/Makefile: Renamed as Makefile.
	* README.md: Merged with TestStructure/README.md.
	* TestStructure/.gitignore: Deleted and contents moved into
	.gitignore.
	* TestStructure/README.md: Deleted and contents moved into
	README.md.
	* TestStructure/doc: Directory deleted.
	* TestStructure/riscv-target: Directory moved to riscv-target.
	* riscv-target: Directory moved from TestStructure/riscv-target
	* TestStructure/riscv-test-env: Directory moved to riscv-test-env.
	* riscv-test-env: Directory moved from
	TestStructure/riscv-test-env.
	* TestStructure/riscv-test-suite: Directory moved to
	riscv-test-suite.
	* riscv-test-suite: Directory moved from
	TestStructure/riscv-test-suite.
	* thought-experiments: Directory deleted.

2018-05-21  Jeremy Bennett  <[email protected]>

	Initial commit to populate the repository.

	* ChangeLog: Created.
	* README.md: Created.