Skip to content

Latest commit

 

History

History
593 lines (407 loc) · 40.2 KB

CHANGELOG.md

File metadata and controls

593 lines (407 loc) · 40.2 KB
Raw

v0.56.2 - 2023-01-22

  • Bump up version of getkin/kin-openapi by @k2tzumi in k1LoW#379

v0.56.1 - 2023-01-22

  • Fixing Frame not found for the given storage id by @k2tzumi in k1LoW#380

v0.56.0 - 2023-01-08

  • [BREAKING] Fix default interval for loop by @k1LoW in k1LoW#376

v0.55.0 - 2023-01-05

  • Bonsai by @k1LoW in k1LoW#372
  • Add --threshold option for checking result of loadt by @k1LoW in k1LoW#375

v0.54.5 - 2022-12-29

  • Prefer step desc if exist in debug printing by @nobuyo in k1LoW#369
  • Add --cache-dir and --retain-cache-dir option by @k1LoW in k1LoW#371

v0.54.4 - 2022-12-25

  • Fix handling usage of flags by @k1LoW in k1LoW#366
  • Support fetch files when using external vars with http:// or github:// by @k1LoW in k1LoW#368

v0.54.3 - 2022-12-25

  • Fix panic when --concurrent > 1 by @k1LoW in k1LoW#362
  • Fix loadt result by @k1LoW in k1LoW#364

v0.54.2 - 2022-12-24

v0.54.1 - 2022-12-23

  • Support fetch files when using http:// or github:// by @k1LoW in k1LoW#357

v0.54.0 - 2022-12-23

  • Support fetching runbooks via https:// or github:// by @k1LoW in k1LoW#355

v0.53.4 - 2022-12-20

  • runn examples by @atsushi-ishibashi in k1LoW#351
  • Fix to be able to get trailers in Bidirectional streaming by @k1LoW in k1LoW#353
  • Fix sshd_keep_session.yml by @k1LoW in k1LoW#354

v0.53.3 - 2022-12-09

  • openapi3filter.RegisterBodyDecoder only needs once. by @k1LoW in k1LoW#349

v0.53.2 - 2022-12-05

  • Fix duplicate drainBody by @k1LoW in k1LoW#347

v0.53.1 - 2022-12-05

  • Fix capture/runbook.go reading out request body when multipart/form-data by @k1LoW in k1LoW#345

v0.53.0 - 2022-12-02

  • [BREAKING] Support for loop run of runbook by @k1LoW in k1LoW#340

v0.52.3 - 2022-11-30

  • Fix handling result by @k1LoW in k1LoW#337
  • Add path resolution for setUploadFile.path by @k1LoW in k1LoW#339

v0.52.2 - 2022-11-30

  • Support array for multipart body by @atsushi-ishibashi in k1LoW#332
  • Fix sshOutTimeout by @k1LoW in k1LoW#333
  • Add Stdout Stderr opiton by @k1LoW in k1LoW#335
  • Support capturing multiple files (capture.runbook) by @k1LoW in k1LoW#336

v0.52.1 - 2022-11-29

  • Show index of CDP actions when error by @k1LoW in k1LoW#327
  • Fix Dump runner output by @k1LoW in k1LoW#329
  • Reset headers as well by @atsushi-ishibashi in k1LoW#331

v0.52.0 - 2022-11-29

  • Support SSH runner with detailed by @k1LoW in k1LoW#322
  • Add SSHRunnerWithOptions by @k1LoW in k1LoW#324
  • [BREAKING] Add KeepSession Option / Set keepSession to default false by @k1LoW in k1LoW#325

v0.51.1 - 2022-11-28

  • Bump up k1LoW/sshc version by @k1LoW in k1LoW#320

v0.51.0 - 2022-11-28

  • Update .octocov.yml ( report to GitHub Actions Summary ) by @k1LoW in k1LoW#311
  • Add pronunciation by @k1LoW in k1LoW#313
  • [BREAKING] Change function signature of BeforeFunc args by @k1LoW in k1LoW#314
  • Support SSH by @k1LoW in k1LoW#315
  • [BREAKING] Support capturing SSH command stdout and stderr by @k1LoW in k1LoW#316
  • Add doc about SSH Runner by @k1LoW in k1LoW#317
  • Fix handling stdout/stderr of operator and runners by @k1LoW in k1LoW#318
  • Update pkgs by @k1LoW in k1LoW#319

v0.50.0 - 2022-11-25

  • Support built-in func on Dump runner by @k1LoW in k1LoW#303
  • Bonsai dummy images by @k1LoW in k1LoW#305
  • Export eval* functions for afterFuncs by @k1LoW in k1LoW#306
  • Fix handling store keys by @k1LoW in k1LoW#308
  • Add AfterFuncIf Option by @k1LoW in k1LoW#309
  • Add localStorage sessionStorage to cdpfn by @atsushi-ishibashi in k1LoW#307

v0.49.3 - 2022-11-21

  • Bump up k1LoW/expand version by @k1LoW in k1LoW#300
  • Handle expand error by @k1LoW in k1LoW#302

v0.49.2 - 2022-11-20

  • Add input secret select to built-in function for interactive input by @k1LoW in k1LoW#297

v0.49.1 - 2022-11-19

  • Bonsai by @k1LoW in k1LoW#292
  • Support marshal runbook with mapped steps by @k1LoW in k1LoW#294
  • Support for mapped step runbook on runn new. by @k1LoW in k1LoW#295

v0.49.0 - 2022-11-18

  • [BREAKING] Rename CaptureFailed to CaptureFailure by @k1LoW in k1LoW#280
  • [BREAKING] Support JSON output of RunN result by @k1LoW in k1LoW#279
  • Rename userAgent to setUserAgent by @k1LoW in k1LoW#282
  • Set timeout to CDP Runner for each step by @k1LoW in k1LoW#284
  • Aggregate runbook parsing process by @k1LoW in k1LoW#285
  • Support multipart/form-data via http by @atsushi-ishibashi in k1LoW#283
  • Tiny fix test for multipart/form-data by @k1LoW in k1LoW#288
  • Support relative file path by @k1LoW in k1LoW#289
  • base64encode & decode as built-in func by @atsushi-ishibashi in k1LoW#290
  • Support parsing body of multipart/form-data by @k1LoW in k1LoW#291

v0.48.0 - 2022-11-14

  • [BREAKING] AfterFuncs will run even if the scenario fails by @k1LoW in k1LoW#273
  • [BREAKING] Make AfterFuncs receive runbook run error by @k1LoW in k1LoW#275
  • Make AfterFuncs receive runbook run result ( contains error ) by @k1LoW in k1LoW#276
  • Bump up k1LoW/expand version by @k1LoW in k1LoW#277
  • Add userAgent for setting User-Agent header by @k1LoW in k1LoW#278

v0.47.3 - 2022-11-10

  • Add git for using actions/checkout@v3 on container: workflow by @k1LoW in k1LoW#271

v0.47.2 - 2022-11-09

  • Fix panic: reflect: Call using zero Value argument by @k1LoW in k1LoW#269

v0.47.1 - 2022-11-08

  • Add fullHTML for getting full HTML of current page. by @k1LoW in k1LoW#262
  • Fix timing of record step value on Dump runner and Bind runner. by @k1LoW in k1LoW#264
  • Support current and previous key on Dump runner by @k1LoW in k1LoW#265
  • Fix Dump runner ( support file output ) by @k1LoW in k1LoW#266
  • Add screenshot for take screenshot of page. by @k1LoW in k1LoW#267
  • Add scroll for scroll window by @k1LoW in k1LoW#268

v0.47.0 - 2022-11-08

  • Enable gosec by @k1LoW in k1LoW#258
  • Support Chrome DevTools Protocol (CDP) by @k1LoW in k1LoW#257
  • Add setUploadFile for uploading file via browser. by @k1LoW in k1LoW#260
  • Add Chrominium to Docker image for supporting CDP by @k1LoW in k1LoW#261

v0.46.0 - 2022-11-02

  • [BREAKING] Support --random option for CLI and RunRandom option for test helper by @k1LoW in k1LoW#253
  • Add number of runbooks to loadt result by @k1LoW in k1LoW#255
  • Re fix loadt result by @k1LoW in k1LoW#256

v0.45.1 - 2022-11-01

v0.45.0 - 2022-10-31

  • [BREAKING] Add ID for record id and context by @k1LoW in k1LoW#248
  • Add runn rprof command for reading runn profile file by @k1LoW in k1LoW#250

v0.44.1 - 2022-10-31

  • Add --profile/--profile-out option for CLI by @k1LoW in k1LoW#245
  • Copy ca-certificates.crt from builder image by @k1LoW in k1LoW#247

v0.44.0 - 2022-10-28

  • Fix test by @k1LoW in k1LoW#239
  • Support --var foo.bar.key:value option for CLI by @k1LoW in k1LoW#241
  • Fix runn new when no --and-run by @k1LoW in k1LoW#242
  • Support --runner req:https://example.com/api/v1 option for CLI by @k1LoW in k1LoW#243
  • Add runn loadt for load test using runbooks by @k1LoW in k1LoW#244

v0.43.0 - 2022-10-24

  • [BREAKING] Support *sql.Tx with DBRunner by @k1LoW in k1LoW#237

v0.42.1 - 2022-10-23

  • Fix docker image build pipeline by @k1LoW in k1LoW#234
  • Set steps.*.run to true when step is run by @k1LoW in k1LoW#236

v0.42.0 - 2022-10-23

  • Append runn new using access log to "Quickstart" section by @k1LoW in k1LoW#227
  • Add comment for vars by @k1LoW in k1LoW#229
  • Support for appending steps via runn new by @k1LoW in k1LoW#230
  • Bump up go and pkgs version by @k1LoW in k1LoW#231
  • Fix typo by @k1LoW in k1LoW#232
  • Support previous variable by @k1LoW in k1LoW#233

v0.41.0 - 2022-10-22

  • Add "Quickstart" section by @k1LoW in k1LoW#221
  • Support runn new via STDIN by @k1LoW in k1LoW#224
  • Support create runbook from access log by @k1LoW in k1LoW#225
  • Fix host handling by @k1LoW in k1LoW#226

v0.40.0 - 2022-10-20

  • Add command runn new to create new runbook by @k1LoW in k1LoW#216
  • Support gRPCurl command by @k1LoW in k1LoW#218
  • [BREAKING] gRPC runner use TLS by default by @k1LoW in k1LoW#219
  • Support --grpc-no-tls option for CLI and GRPCNoTLS option for test helper by @k1LoW in k1LoW#220

v0.39.0 - 2022-10-16

  • Update grpcstub to v0.6.1 by @k1LoW in k1LoW#200
  • Append capture points by @k1LoW in k1LoW#205
  • Make it possible to get counts of run results by @k1LoW in k1LoW#206
  • [BREAKING] Change the custom operation of runn run command to operators.RunN() by @k1LoW in k1LoW#207
  • Fix logic of listing in runn list by @k1LoW in k1LoW#208
  • Support --shuffle option for CLI and Shuffle option for test helper by @k1LoW in k1LoW#209
  • Support --parallel option for CLI and Parallel option for test helper by @k1LoW in k1LoW#211
  • Fix handling of Option by @k1LoW in k1LoW#212
  • [BREAKING] Support --skip-included option for CLI by @k1LoW in k1LoW#213
  • Support --shuffle --overlay --underlay for runn list by @k1LoW in k1LoW#214
  • Support --sample option for CLI by @k1LoW in k1LoW#215

v0.38.0 - 2022-10-06

  • Add notFollowRedirect option for HTTP Runner by @k1LoW in k1LoW#198

v0.37.4 - 2022-10-05

  • Wrap expr.Eval() with eval() by @k1LoW in k1LoW#190
  • Move functions related to function eval() to eval.go by @k1LoW in k1LoW#192
  • Fix timing of trimming comments of string to eval() by @k1LoW in k1LoW#193
  • Fix installing Go by @k1LoW in k1LoW#194
  • Move logic form o.expand() to evalExpand() by @k1LoW in k1LoW#195
  • [BREAKING] Update k1LoW/expand to v0.5.2 by @k1LoW in k1LoW#196

v0.37.3 - 2022-10-01

  • Support for comment statements within the test syntax by @k2tzumi in k1LoW#188

v0.37.2 - 2022-10-01

  • migrate builtin functions to package by @k2tzumi in k1LoW#185
  • Append diff function by @k2tzumi in k1LoW#186

v0.37.1 - 2022-10-01

  • Fixed compare function always returning true by @k2tzumi in k1LoW#183

v0.37.0 - 2022-10-01

  • Support solo-single-line comment by @k1LoW in k1LoW#176
  • Support single-line comment by @k1LoW in k1LoW#179
  • Add doc about structure of request and response by @k1LoW in k1LoW#181
  • Show number of loop times when an error occurs during loop. by @k1LoW in k1LoW#180
  • Fix buildTree() by @k1LoW in k1LoW#182

v0.36.2 - 2022-09-28

  • Re-fix release pipeline by @k1LoW in k1LoW#174

v0.36.1 - 2022-09-28

  • Fix release pipeline by @k1LoW in k1LoW#172

v0.35.3 - 2022-09-28

  • Use tagpr by @k1LoW in k1LoW#166
  • [README]The *sql.DB used by the test target and the *sql.DB used by runn should be separated. by @k1LoW in k1LoW#169
  • Improve post-processing of YAML parsed results by @k1LoW in k1LoW#168
  • Add badge by @k1LoW in k1LoW#171
  • Support --overlay/--underlay option for CLI and Overlay/Underlay option for test helper by @k1LoW in k1LoW#170

v0.35.2 (2022-09-26)

v0.35.1 (2022-09-26)

  • Use gopkg.in/yaml.v2 only for the first YAML parsing to keep the parsing stable #159 (k1LoW)
  • Fix error handling #162 (k1LoW)
  • Decimal point was not considered in the parsing of duration. #163 (k1LoW)
  • Change loop index variable name #160 (k1LoW)
  • Fix bind reserved key #158 (k2tzumi)
  • Allow time units in the *interval: section #157 (k1LoW)
  • Move the parsing operation of runbook(YAML) from operator{} to book{} to clarify responsibilities #156 (k1LoW)
  • Rename Array to List #154 (k1LoW)

v0.35.0 (2022-09-19)

v0.34.0 (2022-09-12)

  • Revert 'Allow strings "true" and "false" as true/false' #142 (k1LoW)
  • Expand vars of Include while preserving type information #140 (k2tzumi)
  • Fix debugger output of DB Runner #138 (k1LoW)
  • Add CaptureStart() CaptureEnd() to type Capturer interface #137 (k1LoW)

v0.33.0 (2022-09-07)

  • Introduce type Capturer interface #136 (k1LoW)
  • Build vars parameters with templates #132 (k2tzumi)
  • Improve column type determination using MySQL integration testing environment #134 (k1LoW)
  • Setup integration test using Docker #133 (k1LoW)
  • Support for DATETIME columns in DBRunner #129 (k2tzumi)
  • Add badges #130 (k1LoW)

v0.32.2 (2022-08-31)

v0.32.1 (2022-08-30)

  • Should be able to access values using current in the until: section. #122 (k1LoW)

v0.32.0 (2022-08-28)

  • Use parser.Parse() instead of own parser #120 (k1LoW)
  • Support current variable #119 (k1LoW)
  • Change type of store.stepMap #118 (k1LoW)
  • Improved logic for determining steps: syntax #115 (k1LoW)

v0.31.0 (2022-08-25)

v0.30.3 (2022-08-23)

  • Stop creating anonymous structures in functions #110 (k1LoW)

v0.30.2 (2022-08-22)

  • Add functions to cast as built-in functions #107 (k1LoW)
  • Error if duplicate step keys are found in the runbook in Map syntax. #109 (k1LoW)

v0.30.1 (2022-08-22)

v0.30.0 (2022-08-21)

  • Bump stopw version to 0.7.0 #105 (k1LoW)
  • Use go.uber.org/multierr instead of github.com/hashicorp/go-multierror #104 (k1LoW)
  • Create extension points for built-in functions #102 (k2tzumi)

v0.29.0 (2022-08-20)

  • Support reading json in the vars section of includes #101 (k2tzumi)
  • [BREAKING] Create a new loop: section and integrate it with the features of the retry: section. #97 (k1LoW)

v0.28.0 (2022-08-18)

  • [BREAKING] Allow strings "true" and "false" as true/false values when evaluating conditions such as if: sections. #99 (k1LoW)
  • Add playbook path to sub test name #98 (k1LoW)
  • Measure elapsed time as profile #96 (k1LoW)

v0.27.1 (2022-08-15)

  • Convert number var to json compatible type #95 (k2tzumi)

v0.27.0 (2022-08-12)

  • Support json object expand #94 (k2tzumi)
  • Support for read json in var section #93 (k2tzumi)
  • Fix race condition on bidirectional streaming #92 (k1LoW)

v0.26.2 (2022-08-01)

  • Improvement of unstable operation during OAS Spec verification #91 (k2tzumi)

v0.26.1 (2022-07-27)

v0.26.0 (2022-07-15)

v0.25.0 (2022-07-11)

v0.24.0 (2022-07-09)

  • Support gRPC #78 (k1LoW)
  • Support gRPC (Step 3: Bidirectional streaming RPC) #77 (k1LoW)
  • Support gRPC (Step 2: Client streaming RPC) #76 (k1LoW)
  • Support gRPC (Step 1: Server streaming RPC) #75 (k1LoW)
  • Support gRPC (Step 0: Unary RPC) #74 (k1LoW)

v0.23.1 (2022-07-08)

  • Fix the order of applying options when running RunN #79 (k1LoW)

v0.23.0 (2022-07-03)

  • Support OpenAPI3 validation at authentication request #73 (k2tzumi)
  • Rename option RunShard() to RunPart() and set alias. #72 (k1LoW)

v0.22.3 (2022-07-03)

v0.22.2 (2022-06-22)

  • The functions added with Func() do not work in the included runbook. #70 (k1LoW)

v0.22.1 (2022-06-21)

v0.22.0 (2022-06-20)

  • Add option RunPart #68 (k1LoW)
  • Add option RunSample #67 (k1LoW)
  • Add option RunMatch #66 (k1LoW)
  • Filter runbooks to be executed by the environment variable RUNN_RUN #65 (k1LoW)

v0.21.0 (2022-06-17)

  • [BREAKING] Fix binding of parent vars #64 (k1LoW)

v0.20.2 (2022-06-17)

  • include.vars should be variable expanded #63 (k1LoW)

v0.20.1 (2022-06-03)

  • Fix handling recording when skip test #62 (k1LoW)

v0.20.0 (2022-06-03)

  • Add option BeforeFunc and AfterFunc #61 (k1LoW)
  • Support skipTest: #60 (k1LoW)
  • Support overriding vars: of included runbook. #59 (k1LoW)
  • Fix tokenize #58 (k1LoW)

v0.19.1 (2022-06-02)

v0.19.0 (2022-05-31)

v0.18.1 (2022-05-30)

  • Fix layout of func to be set in store #55 (k1LoW)

v0.18.0 (2022-05-30)

  • Add Func(k,v) for custom function #54 (k1LoW)

v0.17.2 (2022-05-25)

  • Run multiple queries in a single transaction. #53 (k1LoW)

v0.17.1 (2022-05-24)

  • Improve tokenize of conditional statements #52 (k1LoW)
  • Skip validate response for unsupported format #51 (k1LoW)

v0.17.0 (2022-05-23)

  • Support retry step #50 (k1LoW)
  • Fix validation error message of http runner #49 (k1LoW)

v0.16.2 (2022-05-09)

  • Fix hundling runner result #48 (k1LoW)

v0.16.1 (2022-05-09)

  • Fix handling for bind runner #47 (k1LoW)

v0.16.0 (2022-05-09)

  • Support steps[*].desc: steps.<key>.desc: #46 (k1LoW)
  • Support steps[*].if: steps.<key>.if: #45 (k1LoW)

v0.15.0 (2022-05-06)

  • Reserve if: and desc: #44 (k1LoW)
  • Allow test/dump/bind runner to run in the same step as other runners #43 (k1LoW)

v0.14.0 (2022-04-06)

  • Introduce if: section to skip steps #42 (k1LoW)
  • Trim delimiter of []interface{} #41 (k1LoW)

v0.13.2 (2022-04-02)

v0.13.1 (2022-03-31)

  • Support runner override settings by delaying runner setting fixes as long as possible. #39 (k1LoW)

v0.13.0 (2022-03-28)

  • Fix option #38 (k1LoW)
  • Skip scheme://host:port validation #37 (k1LoW)
  • Validate HTTP request and HTTP response using OpenAPI Spec(v3) #36 (k1LoW)

v0.12.2 (2022-03-23)

v0.12.1 (2022-03-20)

v0.12.0 (2022-03-18)

  • Support application/x-www-form-urlencoded #33 (k1LoW)
  • Support text/plain #32 (k1LoW)

v0.11.1 (2022-03-17)

  • Fix hundling nested variables #31 (k1LoW)

v0.11.0 (2022-03-17)

  • Add bind runner for binding variables #30 (k1LoW)

v0.10.1 (2022-03-17)

  • Add option --fail-fast to runn run #29 (k1LoW)
  • Add option FailFast(bool) to disable running additional tests after any test fails ( for RunN(ctx) ) #28 (k1LoW)

v0.10.0 (2022-03-16)

  • Fix behavior when runn acts as a test helper #27 (k1LoW)
  • Fix casting numeric #26 (k1LoW)
  • Enabling debug prevents override #25 (k1LoW)

v0.9.0 (2022-03-16)

  • Introduce interval: section to configure the running interval between steps. #24 (k1LoW)
  • Fix debug message #23 (k1LoW)

v0.8.2 (2022-03-15)

v0.8.1 (2022-03-15)

v0.8.0 (2022-03-15)

  • Support named ( ordered map ) steps #20 (k1LoW)
  • Fix test runner out #19 (k1LoW)

v0.7.0 (2022-03-14)

v0.6.0 (2022-03-12)

  • Add HTTPRunnerWithHandler for using http.Handler instead of http.Client #17 (k1LoW)
  • Detect duplicate runner names #16 (k1LoW)

v0.5.2 (2022-03-11)

  • Trim string as a workaround #15 (k1LoW)

v0.5.1 (2022-03-11)

  • Make RunN() also behave as a test helper #14 (k1LoW)

v0.5.0 (2022-03-11)

  • Dump runner also increments steps #13 (k1LoW)
  • Support include: in steps #12 (k1LoW)
  • DB Runner support multiple queries #11 (k1LoW)

v0.4.0 (2022-03-09)

v0.3.0 (2022-03-08)

  • Add debug: for printing debug output #7 (k1LoW)

v0.2.0 (2022-03-08)

v0.1.0 (2022-03-08)

  • Improve error handling for parsing #5 (k1LoW)
  • Fix: panic: assignment to entry in nil map #4 (k1LoW)

v0.0.1 (2022-03-07)

  • Support for running as test helper #3 (k1LoW)
  • Add command runn run #2 (k1LoW)
  • Add command runn list #1 (k1LoW)