{"@context":"https://w3id.org/codemeta/3.0","@type":"SoftwareSourceCode","identifier":"pkg:golang/github.com/j178/benchdiff","name":"github.com/j178/benchdiff","description":"Benchstat computes and compares statistics about benchmarks.\n\nUsage:\n\nEach input file should contain the concatenated output of a number\nof runs of “go test -bench.” For each different benchmark listed in an input file,\nbenchstat computes the mean, minimum, and maximum run time,\nafter removing outliers using the interquartile range rule.\n\nIf invoked on a single input file, benchstat prints the per-benchmark statistics\nfor that file.\n\nIf invoked on a pair of input files, benchstat adds to the output a column\nshowing the statistics from the second file and a column showing the\npercent change in mean from the first to the second file.\nNext to the percent change, benchstat shows the p-value and sample\nsizes from a test of the two distributions of benchmark times.\nSmall p-values indicate that the two distributions are significantly different.\nIf the test indicates that there was no significant change between the two\nbenchmarks (defined as p \u003e 0.05), benchstat displays a single ~ instead of\nthe percent change.\n\nThe -delta-test option controls which significance test is applied:\nutest (Mann-Whitney U-test), ttest (two-sample Welch t-test), or none.\nThe default is the U-test, sometimes also referred to as the Wilcoxon rank\nsum test.\n\nIf invoked on more than two input files, benchstat prints the per-benchmark\nstatistics for all the files, showing one column of statistics for each file,\nwith no column for percent change or statistical significance.\n\nThe -html option causes benchstat to print the results as an HTML table.\n\nThe -sort option specifies an order in which to list the results:\nnone (input order), delta (percent improvement), or name (benchmark name).\nA leading “-” prefix, as in “-delta”, reverses the order.\n\nSuppose we collect results from running a set of benchmarks twenty times\nbefore a particular change:\n\nAnd the same benchmarks twenty times after:\n\nThe file old.txt contains:\n\nThe file new.txt contains:\n\nThe order of the lines in the file does not matter, except that the\noutput lists benchmarks in order of appearance.\n\nIf run with just one input file, benchstat summarizes that file:\n\nIf run with two input files, benchstat summarizes and compares:\n\nNote that the JSONEncode result is reported as\nstatistically insignificant instead of a -0.93% delta.","version":"v0.0.0-20221030061827-27ece05f0b8d","softwareVersion":"v0.0.0-20221030061827-27ece05f0b8d","license":"https://spdx.org/licenses/BSD-3-Clause","codeRepository":"https://github.com/j178/benchdiff","issueTracker":"https://github.com/j178/benchdiff/issues","url":"https://github.com/j178/benchdiff","programmingLanguage":{"@type":"ComputerLanguage","name":"Go"},"dateCreated":"2022-10-30","dateModified":"2022-10-30","datePublished":"2022-10-30","copyrightYear":2022,"downloadUrl":"https://proxy.golang.org/github.com/j178/benchdiff/@v/v0.0.0-20221030061827-27ece05f0b8d.zip","softwareHelp":{"@type":"WebSite","url":"https://pkg.go.dev/github.com/j178/benchdiff#section-documentation"},"applicationCategory":"go","runtimePlatform":"go","developmentStatus":"active","sameAs":["https://pkg.go.dev/github.com/j178/benchdiff"],"funder":[{"@type":"Organization","url":"https://github.com/sponsors/j178"}],"https://www.w3.org/ns/activitystreams#likes":2}