-
Notifications
You must be signed in to change notification settings - Fork 2
Fixes ENG-1176: SDK Decorators V1 #24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
70 commits
Select commit
Hold shift + click to select a range
9fea5d2
Release 0.8.9
fern-api[bot] 5d71003
update eval_utils with runs api change
harry-humanloop 9e50a5b
Eval runs (#26)
harry-humanloop 0e3e0b4
Release 0.8.9a1
fern-api[bot] 4debaa0
SDK Decorators V1
4cc0e3e
Added threading to exporter
bf51f01
Bumped python version in GitHub action
4850ad2
Mypy complaints
22445e9
Switch to 3.9 typing annotations
53db2ee
3.9 typing complaint
555797d
debugging
c55b2d4
Added openai secret for testing
8816382
Fixed mypy type hints
02fcab7
More unit tests for prompt decorators
366a2c6
More decorator tests
7449b5c
Revisited docstrings
96e91c6
QA with live example
791f615
Fix for flaky replicate test
a4db565
Reverted changes to a file modified by Fern
618bcf5
Code is self-aware and modified the docstring to account for daylight…
163193a
Replicate integration tests still flaky
baee7cd
false positive from mypy
abf09e6
Expanded some docstrings
f309e36
Better typing when processing prompt kernel
473e8cd
Added attributes on prompt + jsonify log output if not string
789706e
added retries on log attempts
e2eda00
Reverted unnecessary diff
a95473d
Fixed imports in humanloop client module
20a70af
Remove pyproject.toml ruff section
e1a3389
Removed global tracer; now owned by client
fa2b30f
Changed dependency logic for instrumentors
ad3d3a8
Integrated OTel decorators with local eval utility
71f13dc
Made Otel span I/O more robust
f5f90a4
Fixed mypy error
02f45a6
Fixed warning from OTel
0a7507a
Added error handling at function and exporter levels
8886880
mypy nit
51b518f
Early exit for logs whose parent in trace failed
3b31411
Added more docstrings
86ef9a4
Refactored evaluation context
5104392
Rebase fixes
7052cf8
Added missing logic from #28 and #29
6e79d83
PR feedback
15a0596
Support chat template + parsing log inputs from function call args
84fe73c
QA bugfixing
a3e4783
PR feedback from Harry
1be4150
PR #30
e2e3254
evals_run modification works with simple callable and instrumented ca…
0a499ad
Harry PR feedback
b2bf174
changed relative import
25db659
import
ab050af
deepcopy
ba5ba1c
deepcopy
9365010
Debug session Harry
44285ef
mypy error fixes
95a0901
Custom error message for fancy functions decorated with tool
4640d7b
Use KernelParams for decorators
4704ce2
unpack poetry mypy
2803248
poetry pipeline check
2ad919b
mypy debacle
cdbe070
mypy unpack ignore statements
4d854ed
Rebase changes
649718b
jsonify output of decorators if necessary
558df34
Relax dependency requirements
03261c4
Poetry dependency relaxation follow-up
52c6c7b
Parse '|' annotations in tool decorator
7b2e250
Support for ellipsis parsing
b9668d2
Added support for ellipsis in type parsing
86c20ba
switch to copycontext
9274910
removed redundant code
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,7 +1,12 @@ | ||
| # Specify files that shouldn't be modified by Fern | ||
|
|
||
| src/humanloop/eval_utils.py | ||
| src/humanloop/eval_utils/* | ||
| src/humanloop/prompt_utils.py | ||
| src/humanloop/client.py | ||
| mypy.ini | ||
| README.md | ||
|
|
||
| # Directories used by SDK decorators | ||
|
|
||
| src/humanloop/decorators/* | ||
| src/humanloop/otel/* | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -3,3 +3,7 @@ dist/ | |
| __pycache__/ | ||
| poetry.toml | ||
| .ruff_cache/ | ||
| .idea | ||
| .vscode | ||
| .DS_Store | ||
| .env | ||
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.