Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
855 commits
Select commit Hold shift + click to select a range
f620315
#545 cnf_manager now has a check_service option
Feb 19, 2021
ba5ecc4
Merge branch 'master' into feature/#545_services
wvwatson Feb 19, 2021
5fac8c0
Merge pull request #618 from cncf/feature/#545_services
agentpoyo Feb 19, 2021
41d6962
added recommendations from #577 and #606
agentpoyo Feb 22, 2021
ab33ec4
Added private registry docs
agentpoyo Feb 22, 2021
aaf5a67
updated link to conformance usage for private registry
agentpoyo Feb 22, 2021
bbcca51
Created quick install guide with update to links
agentpoyo Feb 22, 2021
758755f
Update QUICK-INSTALL.md
wvwatson Feb 23, 2021
a165ad7
Merge pull request #625 from cncf/wavell-patch-1
agentpoyo Feb 23, 2021
950d892
grammar fixes
agentpoyo Feb 23, 2021
2c90119
Update README.md
taylor Feb 23, 2021
18266c2
updated recommended changes
agentpoyo Feb 23, 2021
53fe78d
Merge branch 'master' into docs/private_docker_registry_#577_#606
agentpoyo Feb 23, 2021
f1ae8ea
Merge pull request #624 from cncf/docs/private_docker_registry_#577_#606
taylor Feb 23, 2021
ef0bfaf
#619 microservices now test against a local registry with a port
Feb 25, 2021
2f0b9f0
Merge branch 'master' into feature/#619_registry_port
Feb 25, 2021
620310a
#619 Update spec test for non-standard ports to install deps
denverwilliams Feb 25, 2021
5342e44
#619 Add patch so Kind supports using a private registry
denverwilliams Feb 25, 2021
c1caa53
#619 moved configmap rollback cnf to version 1.8.0
Feb 26, 2021
2d828cf
Merge pull request #627 from cncf/feature/#619_registry_port
agentpoyo Feb 26, 2021
806ca73
#608 sample-minimal-cnf now used to test minimal cnf-conformance.yml
Mar 1, 2021
d812078
#608 whitelist now not required
Mar 1, 2021
c5c2973
#608 container_names now errors gracefully
Mar 1, 2021
2a00809
Merge pull request #628 from cncf/feature/#608-minimal-cnf-yml
agentpoyo Mar 1, 2021
120db43
patch for converting YAML to JSON error
agentpoyo Mar 1, 2021
96b22f1
#601 kubectl apply now used in kubectl client
Mar 2, 2021
6f14af2
Revert "#545 cnf_manager now uses empty array for looping over resour…
Mar 2, 2021
23761a6
#601 nodeport_not_used now has check_service set to true (regression)
Mar 2, 2021
c33c216
Merge pull request #629 from cncf/dbentley_#508_patch
denverwilliams Mar 2, 2021
09b04c4
Merge branch 'master' into feature/#601-kubectl-apply
wvwatson Mar 2, 2021
1dce882
Merge pull request #630 from cncf/feature/#601-kubectl-apply
nupejosh Mar 2, 2021
8a8fc5c
When looking for resource yamls, reject resources that contain the 'h…
sishbi Mar 4, 2021
39d2b75
Ignore .idea, build.sh, shards.sh
sishbi Mar 4, 2021
8e4f98b
Contributing docs now have acceptance process #614
wvwatson Mar 4, 2021
16385fd
Fix bug causing the Litmus Network Latency test to fail cncf/cnf-conf…
denverwilliams Mar 4, 2021
cce478e
Merge pull request #639 from cncf/bug/litmus_network#636
wvwatson Mar 4, 2021
250b4fa
Merge remote-tracking branch 'upstream/master'
sishbi Mar 5, 2021
3030507
ignore all shell scripts
sishbi Mar 5, 2021
c42d25b
support local registry with port
sishbi Mar 5, 2021
bfe6ba0
support local registry with port
sishbi Mar 5, 2021
e1b8dcb
#619 registry port now uses the full k8s container image. node port …
Mar 8, 2021
2ff9577
Merge pull request #641 from cncf/feature/#619_registry_port
agentpoyo Mar 8, 2021
24f87e4
Merge branch 'master' into accepting-pr-doc
agentpoyo Mar 8, 2021
91d7de1
Merge branch 'master' into bug/#614_cnf_setup_tests
wvwatson Mar 9, 2021
c5eed47
Support image names that include a port for local registry
sishbi Mar 9, 2021
4b9f8f7
Merge remote-tracking branch 'upstream/master' into bug/#635_rollback…
sishbi Mar 9, 2021
b77e023
#614 helm test check now uses dig
Mar 9, 2021
e665093
Merge pull request #643 from cncf/bug/#614_cnf_setup_tests
denverwilliams Mar 9, 2021
9f49b33
Update CONTRIBUTING.md
wvwatson Mar 9, 2021
215ad17
Merge branch 'master' of github.com:cncf/cnf-conformance into bug/#63…
Mar 9, 2021
71bf118
Merge remote-tracking branch 'upstream/master' into bug/#635_rollback…
sishbi Mar 10, 2021
10d9309
Ignore .log files
sishbi Mar 10, 2021
312f3ba
Do not pass test if cnf-conformance.yml is invalid (missing _test_tag…
sishbi Mar 10, 2021
a3f68a5
Report cnf_setup success to stdout
sishbi Mar 10, 2021
1246144
Check if pod is NOT found and exit early
sishbi Mar 10, 2021
50b8a05
Update PULL_REQUEST_TEMPLATE.md
lixuna Mar 10, 2021
1c7b58a
#635 rollback tests now have specs that test for registries with a port
Mar 10, 2021
1a955ab
#635 The return of rollback tests is now a boolean
Mar 10, 2021
8d9ed35
#635 merge
Mar 10, 2021
0d04e00
Merge pull request #648 from cncf/bug/#635_rollback_port
agentpoyo Mar 10, 2021
fa420ce
Merge branch 'master' into accepting-pr-doc
wvwatson Mar 10, 2021
57aad66
Merge pull request #638 from cncf/accepting-pr-doc
agentpoyo Mar 10, 2021
39cec7c
Merge branch 'master' into lixuna-pr-template
taylor Mar 11, 2021
1ccf6e3
Merge pull request #646 from cncf/lixuna-pr-template
taylor Mar 11, 2021
0cd8311
#603 task_points can now be used with a skipped parameter
Mar 11, 2021
9d151f0
#603 task_points can now be used with a skipped parameter
Mar 11, 2021
8b4fd3d
#603 removed ambiguous calls to task_points
Mar 11, 2021
b07993b
#603 Spec now present for upsert_skipped_task
Mar 11, 2021
41db8d7
Merge branch 'master' into feature/#603-skipped
agentpoyo Mar 11, 2021
0d2f8dd
Merge pull request #651 from cncf/feature/#603-skipped
agentpoyo Mar 11, 2021
982e87a
Add extra debug to identify why points are not calculated correctly
sishbi Mar 12, 2021
cb00891
Add volume_hostpath_not_found to statelessness suite in points_v1.yml
sishbi Mar 12, 2021
305356b
Example images
wvwatson Mar 12, 2021
0355788
Update EXAMPLE-CNFS.md
wvwatson Mar 12, 2021
f39ada9
Update EXAMPLE-CNFS.md
wvwatson Mar 12, 2021
d3f83d8
Update EXAMPLE-CNFS.md
wvwatson Mar 12, 2021
8543f15
Update EXAMPLE-CNFS.md
wvwatson Mar 12, 2021
1c47156
#645 reasonable image size now skips if dockerd not installed
Mar 12, 2021
369fd1c
#645 reasonable reasonable startup time now always in results file, e…
Mar 12, 2021
630d52c
Merge pull request #654 from cncf/wavell-examles
denverwilliams Mar 12, 2021
68f1a83
Merge branch 'master' into feature/#645-dockerd-skip
wvwatson Mar 12, 2021
791d84e
Merge pull request #656 from cncf/feature/#645-dockerd-skip
agentpoyo Mar 12, 2021
de90a4e
Add missing resilience tasks to points_v1.yml
sishbi Mar 15, 2021
100b8cd
Add missing configuration_lifecycle tasks to points_v1.yml
sishbi Mar 15, 2021
1790875
Merge remote-tracking branch 'upstream/master' into bug/#652_stateles…
sishbi Mar 15, 2021
75f5b50
#603 Skipped now in points_v1.yml
wvwatson Mar 15, 2021
3571905
Correct points_v1.yml so that all tests mentioned in points-all.yml a…
sishbi Mar 15, 2021
e75a67a
Change 'Skipped' message to include test that was skipped, more work …
sishbi Mar 15, 2021
c47c7f7
Split configuration lifecycle spec into separate files to speed up sp…
denverwilliams Mar 15, 2021
89f3baa
Remove original config_lifecycle spec
denverwilliams Mar 15, 2021
58e6ab0
#297 calling cnf-conformance with no arguments now shows the help
Mar 15, 2021
adcfd97
Trigger CI
denverwilliams Mar 15, 2021
edbd83c
#645 docker skip now has a test
Mar 16, 2021
cf35664
Merge pull request #659 from cncf/feature/#297-help
agentpoyo Mar 16, 2021
5b147b0
#645 docker skip now has debugging information
Mar 16, 2021
1e9e878
#645 dockerd manifest file now uses ./
Mar 16, 2021
9f32c23
#645 docker skip spec now installs dockerd after completion
Mar 16, 2021
2a2ff1b
#645 docker skip uninstall dockerd now sleeps
Mar 16, 2021
12fc1ce
fix: FAILURE to FAILED in test results
iamayushdas Mar 17, 2021
273787f
#645 docker skip spec now commented
Mar 17, 2021
2495006
#645 docker skip spec now with more logging
Mar 17, 2021
8d9314d
#645 docker skip spec now with more logging
Mar 17, 2021
99a2285
Merge pull request #661 from iamayushdas/master
wvwatson Mar 17, 2021
75addcc
#645 install dockerd now uses kubectl create
Mar 17, 2021
8971c13
#645 install dockerd now uses kubectl create
Mar 17, 2021
2e4b743
#645 install dockerd now uses kubectl create
Mar 17, 2021
1eb5de9
#645 puts changed to LOGGING.info
Mar 17, 2021
1b8a163
#645 logging information now in dockerd renames
Mar 17, 2021
1dfd8c2
#645 logging information now in skipped ensure
Mar 17, 2021
a864e32
#645 checker dockerd now waits for 1 second
Mar 17, 2021
6cf6d0a
Feat(resiliency): Add litmus disk fill chaos test
uditgaurav Mar 17, 2021
a55aca2
#645 pod status now returns false when not found
Mar 17, 2021
5924106
#645 pod status now used for check_dockerd
Mar 17, 2021
de304b8
#645 custom pod status loop now used for check dockerd
Mar 17, 2021
0f21ea3
#645 logging now available for final pod status and current_replicas
Mar 17, 2021
a287ba0
#645 wait time for dockerd now 25 seconds
Mar 17, 2021
0db0a15
#645 pod status now checks for initial status
Mar 17, 2021
d7a5b09
test without source in directory refs #599
williscool Feb 22, 2021
d7642c9
Update .github/workflows/actions.yml
williscool Feb 24, 2021
972c334
add create kind cluster and helm charts #599
williscool Mar 15, 2021
3c8d7a6
doesn't need to depend on specs
williscool Mar 15, 2021
f52e8e6
disable slower tests in test without source #599
williscool Mar 17, 2021
5a9e42f
Merge branch 'master' into bug/#652_statelessness
wvwatson Mar 18, 2021
7b3af69
Merge configuration lifecycle spec files
denverwilliams Mar 18, 2021
7c4cb6a
Update actions.yml
wvwatson Mar 18, 2021
3f817c6
Merge pull request #623 from cncf/feature/#599_test_without_source
wvwatson Mar 18, 2021
a54fa7e
#645 pod status now has spec
Mar 18, 2021
fe26380
Merge branch 'master' into feature/#645-dockerd-skip
wvwatson Mar 18, 2021
a45168e
Build out test list dynamically
denverwilliams Mar 18, 2021
e8eb2b8
Add debug
denverwilliams Mar 18, 2021
fbb7110
Merge pull request #662 from cncf/feature/#645-dockerd-skip
agentpoyo Mar 18, 2021
592c464
Build out test matirx dynamically using tag names
denverwilliams Mar 18, 2021
3cacdf8
Fix bug with merging tags
denverwilliams Mar 18, 2021
918636b
Fix bugs with duplicate test names
denverwilliams Mar 18, 2021
dc1717e
Add debug for old json data
denverwilliams Mar 18, 2021
b4e9eed
Append spec key to json list of tags
denverwilliams Mar 18, 2021
879cc5c
Fix bug with 'debug' job
denverwilliams Mar 18, 2021
5c64a37
Generate test matrix from all tests in the spec dir
denverwilliams Mar 18, 2021
b8612da
Test only microservice specs
denverwilliams Mar 18, 2021
10ffee1
Remove new lines
denverwilliams Mar 18, 2021
3c5df55
Refactor and add missing tags
denverwilliams Mar 18, 2021
ce3d423
Enable CI for all tests
denverwilliams Mar 18, 2021
6b0b719
Disable unused tests
denverwilliams Mar 18, 2021
e46fa5c
Remove dynamic tags
denverwilliams Mar 19, 2021
e00e6ef
#640 litmus now removed from the 'all' spec
denverwilliams Mar 19, 2021
59a787e
#640 Spec files now checked for tags. Litmus now removed from 'all' spec
denverwilliams Mar 19, 2021
07f25eb
#640 missing comma
denverwilliams Mar 19, 2021
1ae44a5
Split conformance all into seperate spec files and tags
denverwilliams Mar 19, 2021
a5a044e
Split immutable config map test
denverwilliams Mar 22, 2021
90b4cbb
Split kubectl-status & rolling upgrade tests
denverwilliams Mar 22, 2021
4a9e185
Remove wait count and fix spec names
denverwilliams Mar 22, 2021
05f534a
Split rolling upgrade/downgrade tests further
denverwilliams Mar 22, 2021
8df1680
#645 update USAGE with pass, failed and skipped documentation (#665)
agentpoyo Mar 23, 2021
9ec7f91
Cache shards & disable setup
denverwilliams Mar 23, 2021
18dbe39
Move clusterctl install into cluster-api setup task
denverwilliams Mar 23, 2021
25b918d
Fix bug with cluster-api setup & merge fast tests
denverwilliams Mar 23, 2021
3423145
Don't wait for cnf to be running for volume_config spec tests
denverwilliams Mar 23, 2021
0a6aa14
Use default wait_count for negative volume_config spec test
denverwilliams Mar 23, 2021
7d5a0af
Re-enable skip tasks
denverwilliams Mar 23, 2021
da3e447
Merge branch 'master' into bug/#652_statelessness
taylor Mar 23, 2021
cba4789
cncf#631 white_list_helm_container_names changed to allow_list_helm_c…
aws-4 Mar 23, 2021
4a661d8
Add extra debug to identify why secrets_used fails
sishbi Mar 24, 2021
e6e3bd4
Merge branch 'master' into add_disk_fill_chaos
wvwatson Mar 24, 2021
8cb4077
Merge branch 'master' of github.com:cncf/cnf-conformance into speedup_ci
denverwilliams Mar 24, 2021
61054e5
Split no source install tests to decrease CI runtime
denverwilliams Mar 24, 2021
e7d0b9f
Speed up build release job
denverwilliams Mar 24, 2021
c417d8b
Remove shards install for build release job
denverwilliams Mar 24, 2021
07bc02b
Fix bug with no source test & remove skip dep for the binary build
denverwilliams Mar 24, 2021
12ca133
Disable debug for build release
denverwilliams Mar 24, 2021
815d9ed
Add tags to the pod_status spec tests
denverwilliams Mar 24, 2021
c733e9b
Disable conformance all tests when running in CI
denverwilliams Mar 24, 2021
3c299df
Merge pull request #670 from cncf/speedup_ci
agentpoyo Mar 24, 2021
3cba919
Merging master into white_list rename PR.
Mar 24, 2021
00045ee
Merge pull request #671 from cncf/inclusive_naming
denverwilliams Mar 24, 2021
89afced
Merging master.
Mar 24, 2021
3bd8dbb
Merge pull request #672 from cncf/bug/#652_statelessness
denverwilliams Mar 24, 2021
80d7461
Fix formatting for points_v1.yml (missing space)
sishbi Mar 25, 2021
50ba013
Update points_v1.yml to comment out tests that are disabled/not imple…
sishbi Mar 25, 2021
ec88f00
secrets_used_#667 master merge
Mar 25, 2021
35aad63
Merge pull request #673 from cncf/bug/#667_secrets_used
denverwilliams Mar 25, 2021
600ccb5
add_disk_fill_chaos #663
Mar 25, 2021
886a037
Fix bug with chaos disk fill spec test
denverwilliams Mar 25, 2021
72fe82b
Add disk_fill test to points yml & spec tests
denverwilliams Mar 25, 2021
c4d3c00
Disable disk_fill test in the cnf-conformance 'all' spec tests
denverwilliams Mar 25, 2021
2221bd1
Merge pull request #674 from cncf/add_disk_fill_chaos
denverwilliams Mar 25, 2021
22ba2c7
Ignore secrets of specific types
sishbi Mar 26, 2021
ba728ae
Merge branch 'master' into bug/#667_secrets_used_ignored
sishbi Mar 27, 2021
29c5340
Revise logic for checking if secrets can be ignored
sishbi Mar 27, 2021
d85c169
Adjust secrets_used integration test configuration
sishbi Mar 27, 2021
580c782
Run secrets ignored test with debug enabled
sishbi Mar 27, 2021
5925df0
Check for ignored secrets even if no container environment variables …
sishbi Mar 27, 2021
4197b63
Adjust tests, remove custom test for ignored secrets and repurposes e…
sishbi Mar 27, 2021
8163fe0
Add test to verify that if a secret is created it should be used by a…
sishbi Mar 27, 2021
1ba260d
Add kubectl.version method
sishbi Mar 29, 2021
53207cb
#576 running a test without a cnf installed now gives a nice message
Mar 29, 2021
8199a9d
#576 platform tests now do not require a cnfs
Mar 29, 2021
556e72a
Merge pull request #678 from cncf/bug/#576-root
agentpoyo Mar 29, 2021
c42da63
init shot at #632
williscool Mar 10, 2021
3817082
add remdiation message collapse optional setup
williscool Mar 29, 2021
01c3a78
Update USAGE.md
williscool Mar 29, 2021
39c7aba
Merge branch 'master' into feature/#632_increase_decrease_capacity_su…
agentpoyo Mar 29, 2021
f2c12a1
Update wget commands to use either curl or http::client
denverwilliams Mar 29, 2021
93e61b2
Merge pull request #644 from cncf/feature/#632_increase_decrease_capa…
agentpoyo Mar 30, 2021
43e3f87
Remove wget dependency checks
denverwilliams Mar 30, 2021
0e0a37f
Add -o for fetching points.yml
denverwilliams Mar 30, 2021
48b3d0e
Remove happy-path tags
denverwilliams Mar 30, 2021
e5e3097
kubectl nodes now retries
denverwilliams Mar 30, 2021
953df95
reasonable startup times now retries
denverwilliams Mar 30, 2021
1c0ebef
kubectl nodes now retries 6 times
denverwilliams Mar 30, 2021
52a3638
kubectl nodes now retries 8 times
denverwilliams Mar 30, 2021
568923a
kubectl nodes now retries 8 times
denverwilliams Mar 30, 2021
01d5d6e
startup time limit now used in microservice test
denverwilliams Mar 30, 2021
1d61cf5
startup time limit now used in microservice test
denverwilliams Mar 30, 2021
e7ab7a7
startup time limit now 3 seconds
denverwilliams Mar 30, 2021
0245122
Merge branch 'master' into switch_to_curl#679
agentpoyo Mar 30, 2021
2591e8f
Merge pull request #681 from cncf/switch_to_curl#679
agentpoyo Mar 30, 2021
05756ff
Fix for rolling_version_change where the version is an integer -> whe…
sishbi Mar 31, 2021
a5f29ae
Extend timeout for rolling_version_change status check
sishbi Mar 31, 2021
6f6999f
#689 partial commit -- curl removed from front end
denverwilliams Apr 1, 2021
8596a48
#689 curl removed from cluster api setup and sonobuoy setup
Apr 1, 2021
831ff9a
#689 curl now not part of prereqs spec
Apr 1, 2021
801e44f
#689 curl logging info
Apr 1, 2021
f92e2b5
#689 curl logging info
Apr 1, 2021
27c1be0
#689 curl logging info
Apr 1, 2021
017d7ae
#689 curl logging info
Apr 1, 2021
b544238
#689 curl logging info
Apr 1, 2021
336bc1a
#689 switched curl code to use halite
Apr 1, 2021
552517d
Merge pull request #692 from cncf/feature/#689-curl
agentpoyo Apr 1, 2021
00a70ea
Merge branch 'master' into bug/#667_secrets_used_ignored
agentpoyo Apr 2, 2021
aa97f5b
#660 resource uninstall now present
denverwilliams Apr 2, 2021
832490c
#660 Add function that checks for all pods associated with a resource
denverwilliams Apr 2, 2021
e87461a
#660 rolling downgrade now has a retry
denverwilliams Apr 5, 2021
c436eb5
Merge pull request #694 from cncf/feature/#660-resource-uninstall
agentpoyo Apr 5, 2021
cdb1307
Merge branch 'master' of github.com:cncf/cnf-conformance into bug/#66…
Apr 6, 2021
835255b
#667 comments
Apr 6, 2021
85b3c54
#695 secrets now skips instead of fail
Apr 6, 2021
68dfc40
Add method comment for optional_key_as_string
sishbi Apr 7, 2021
bbfe0d8
Merge branch 'master' into bug/#682_version_test_tag
sishbi Apr 7, 2021
b041b93
Use semantic_version to compare 2 SemVers
sishbi Apr 7, 2021
706bbb2
Merge branch 'master' into bug/#669_immutable_configmap
sishbi Apr 7, 2021
02bb476
#695 If any secret is used, test passes, else the test skips. Docume…
Apr 7, 2021
025eb73
Merge pull request #697 from cncf/feature/#695-merge
agentpoyo Apr 7, 2021
9e0009a
Merge branch 'master' into bug/#669_immutable_configmap
agentpoyo Apr 7, 2021
05d3f58
Merge pull request #698 from cncf/bug/#669_immutable_configmap
denverwilliams Apr 7, 2021
4fd81e2
Merge branch 'master' into bug/#682_version_test_tag
agentpoyo Apr 7, 2021
50dc43d
Merge pull request #699 from cncf/bug/#682_version_test_tag
denverwilliams Apr 7, 2021
749ae07
Switch to using 'main' as the default branch cncf/cnf-conformance#626
denverwilliams Apr 8, 2021
af4858e
Force snapshot publish for 'main' cncf/cnf-conformance#626
denverwilliams Apr 8, 2021
d2cec2e
Re-enable specs for release publish cncf/cnf-conformance#626
denverwilliams Apr 8, 2021
1814dd4
Merge pull request #700 from cncf/main
denverwilliams Apr 8, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
58 changes: 25 additions & 33 deletions .github/ISSUE_TEMPLATE/bug-report.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,27 +10,6 @@ assignees: ''
**Describe the bug**
A clear and concise description of what the bug is.

NOTE: you can enable higher logging level output via the command line or env var. to help with debugging

```
# cmd line
./cnf-conformance -l debug test

# make sure to use -- if running from source
crystal src/cnf-conformance.cr -- -l debug test

# env var
LOGLEVEL=DEBUG ./cnf-conformance test
```

Also setting the verbose option for many tasks will add extra output to help with debugging

```
crystal src/cnf-conformance.cr test_name verbose
```

Check [usage documentation](https://github.com/cncf/cnf-conformance/blob/master/USAGE.md) for more info about invoking commands and loggin

**To Reproduce**
Steps to reproduce the behavior:
1. Go to '...'
Expand All @@ -44,22 +23,35 @@ A clear and concise description of what you expected to happen.
**Screenshots**
If applicable, add screenshots to help explain your problem.

**Workstation (please complete the following information):**
- OS [e.g. Linux]
**Device (please complete the following information):**
- OS [e.g. Linux, iOS, Windows, Android]
- Distro [e.g. Ubuntu]
- Version [e.g. 18.04]
- Architecture [e.g. x86, arm]

**Desktop (please complete the following information):**
- OS: [e.g. iOS]
- Browser [e.g. chrome, safari]
- Version [e.g. 22]

**Smartphone (please complete the following information):**
- Device: [e.g. iPhone6]
- OS: [e.g. iOS8.1]
- Browser [e.g. stock browser, safari]
- Version [e.g. 22]

**Additional context**
Add any other context about the problem here.

---

NOTE: you can enable higher logging level output via the command line or env var. to help with debugging

```
# cmd line
./cnf-conformance -l debug test

# make sure to use -- if running from source
crystal src/cnf-conformance.cr -- -l debug test

# env var
LOGLEVEL=DEBUG ./cnf-conformance test
```

Also setting the verbose option for many tasks will add extra output to help with debugging

```
crystal src/cnf-conformance.cr test_name verbose
```

Check [usage documentation](https://github.com/cncf/cnf-conformance/blob/master/USAGE.md) for more info about invoking commands and loggin
2 changes: 0 additions & 2 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
# CNF Conformance PR Template

## Description
(name of issue/change)

Expand Down
Loading