Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

first cut at a (somewhat) useful hypothesis test #66

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

kurtbrose
Copy link
Collaborator

No description provided.

@kurtbrose
Copy link
Collaborator Author

running locally gives interesting output:

> python -m pytest glom\test\test_auto.py --hypothesis-show-statistics
============================= test session starts =============================
platform win32 -- Python 2.7.12, pytest-3.5.1, py-1.5.2, pluggy-0.6.0
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase('C:\\Users\\Kurt\\workspace\\glom\\.hypothesis\\examples')
rootdir: C:\Users\Kurt\workspace\glom, inifile: pytest.ini
plugins: hypothesis-3.82.1
collected 1 item

glom\test\test_auto.py .                                                 [100%]
============================ Hypothesis Statistics ============================

glom/test/test_auto.py::TestSpecAndTarget::runTest:

  - 20 passing examples, 0 failing examples, 0 invalid examples
  - Typical runtimes: 0-4404 ms
  - Fraction of time spent in data generation: ~ 0%
  - Stopped because settings.max_examples=20

========================== 1 passed in 8.63 seconds ===========================

so..... does that mean a glom with 50 elements resulted in a 4 second runtime? owch I wonder which one that is

@codecov-io
Copy link

Codecov Report

Merging #66 into master will increase coverage by 0.09%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #66      +/-   ##
==========================================
+ Coverage   94.45%   94.55%   +0.09%     
==========================================
  Files          14       15       +1     
  Lines        1479     1505      +26     
  Branches      231      231              
==========================================
+ Hits         1397     1423      +26     
  Misses         47       47              
  Partials       35       35
Impacted Files Coverage Δ
glom/test/test_auto.py 100% <100%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ab822e3...296f35a. Read the comment docs.

1 similar comment
@codecov-io
Copy link

codecov-io commented Dec 6, 2018

Codecov Report

Merging #66 into master will increase coverage by 0.09%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #66      +/-   ##
==========================================
+ Coverage   94.45%   94.55%   +0.09%     
==========================================
  Files          14       15       +1     
  Lines        1479     1505      +26     
  Branches      231      231              
==========================================
+ Hits         1397     1423      +26     
  Misses         47       47              
  Partials       35       35
Impacted Files Coverage Δ
glom/test/test_auto.py 100% <100%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ab822e3...296f35a. Read the comment docs.

@kurtbrose
Copy link
Collaborator Author

I'm not sure if this is actually useful yet vs our manual testing of every possible scenario

@kurtbrose
Copy link
Collaborator Author

got an idea -- one non-trivial invariant would be ensuring that scope propagates correctly

also: I'll keep building up this branch going off to the side -- the first time that it correctly identifies a new bug I'll merge to master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants