Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / MadcowD/ell issues and pull requests
#419 - openai.UnprocessableEntityError: Failed to deserialize the JSON body into the target type: messages[2]: invalid type:
Issue -
State: open - Opened by DrKyro 10 days ago
#418 - error: can't pass polars dataframe to tools
Issue -
State: open - Opened by Light2Dark 10 days ago
#417 - [bug fix] prompt_tokens is 0 when using sonnet
Pull Request -
State: open - Opened by hirune924 13 days ago
#416 - Retry API?
Issue -
State: open - Opened by alex-dixon 17 days ago
- 5 comments
#415 - Metrics are called twice during evaluation
Issue -
State: closed - Opened by brenorb 21 days ago
- 1 comment
#414 - ollama error
Issue -
State: open - Opened by kuatroka 25 days ago
- 1 comment
#413 - Use pydantic field validator to serialize ToolCall callable (#412)
Pull Request -
State: open - Opened by fightingmonk 29 days ago
- 1 comment
#412 - ToolCall should be serializable
Issue -
State: open - Opened by fightingmonk about 1 month ago
- 2 comments
#409 - Update custom install docs link in ell ImportError
Pull Request -
State: closed - Opened by apandy02 about 1 month ago
#408 - No client found for model (Anthropic)
Issue -
State: open - Opened by britannio about 1 month ago
- 2 comments
#407 - Have no response when using the custom model client
Issue -
State: open - Opened by YuhaoCheng about 1 month ago
- 1 comment
#406 - Wguss/evaluation docs
Pull Request -
State: closed - Opened by MadcowD about 1 month ago
#405 - Weird error when executing import ell
Issue -
State: closed - Opened by a2ajinkya about 2 months ago
- 1 comment
#404 - Prompt not properly versioned when in a class
Issue -
State: open - Opened by brenorb about 2 months ago
- 3 comments
#403 - Register Google Gemini Models
Pull Request -
State: closed - Opened by apandy02 about 2 months ago
- 3 comments
#402 - Out of date doc reference in ImportError raised
Issue -
State: closed - Opened by apandy02 about 2 months ago
- 3 comments
#400 - fix: Corrected Evaluation Example
Pull Request -
State: closed - Opened by brenorb about 2 months ago
#399 - eval error
Issue -
State: open - Opened by MadcowD about 2 months ago
- 1 comment
#398 - Evaluation - ValueError: Invalid input type: <class 'str'> - Correction Found
Issue -
State: closed - Opened by brenorb about 2 months ago
- 3 comments
#397 - Evaluation example is wrong.
Issue -
State: closed - Opened by brenorb about 2 months ago
- 1 comment
#394 - LMPs return a 3-tuple when `exempt_from_tracking=True`
Issue -
State: open - Opened by jwang-paradise 2 months ago
- 1 comment
#393 - Export dataset functionality in ell-studio
Issue -
State: open - Opened by lingster 2 months ago
#392 - Stream api
Issue -
State: open - Opened by alex-dixon 2 months ago
- 2 comments
#391 - api design: parsed.model_dump()
Issue -
State: open - Opened by pearli-pearli 2 months ago
- 1 comment
#390 - fix: update install scripts to use quotes for zsh compatibility
Pull Request -
State: closed - Opened by MrPolymath 2 months ago
- 1 comment
#389 - Cache completions
Issue -
State: open - Opened by abrichr 2 months ago
- 2 comments
#388 - docs(readme): use consistent install command
Pull Request -
State: closed - Opened by alex-dixon 2 months ago
#388 - docs(readme): use consistent install command
Pull Request -
State: closed - Opened by alex-dixon 2 months ago
#387 - Tool call renders inconsistently in studio
Issue -
State: open - Opened by alex-dixon 2 months ago
#386 - Tool call missing params in studio
Issue -
State: open - Opened by alex-dixon 2 months ago
#386 - Tool call missing params in studio
Issue -
State: open - Opened by alex-dixon 2 months ago
#385 - fix(stores): allow pg credentials in connection string
Pull Request -
State: closed - Opened by alex-dixon 2 months ago
#385 - fix(stores): allow pg credentials in connection string
Pull Request -
State: closed - Opened by alex-dixon 2 months ago
#384 - alembic automigrations
Pull Request -
State: closed - Opened by MadcowD 2 months ago
#384 - alembic automigrations
Pull Request -
State: closed - Opened by MadcowD 2 months ago
#382 - Dataset construction needs to be easy and there should be libraries around this, also matching parity with OpenAI evals
Issue -
State: open - Opened by MadcowD 3 months ago
#382 - Dataset construction needs to be easy and there should be libraries around this, also matching parity with OpenAI evals
Issue -
State: open - Opened by MadcowD 3 months ago
#381 - Easily be able to isolate datapoints below. a certain score etx
Issue -
State: open - Opened by MadcowD 3 months ago
#381 - Easily be able to isolate datapoints below. a certain score etx
Issue -
State: open - Opened by MadcowD 3 months ago
#380 - # Be able to see the outputs of the criterion function as it used in the eval.
Issue -
State: open - Opened by MadcowD 3 months ago
#380 - # Be able to see the outputs of the criterion function as it used in the eval.
Issue -
State: open - Opened by MadcowD 3 months ago
#379 - Working verbose mode for @function
Issue -
State: open - Opened by MadcowD 3 months ago
#379 - Working verbose mode for @function
Issue -
State: open - Opened by MadcowD 3 months ago
#378 - Easy comparison across many models
Issue -
State: open - Opened by MadcowD 3 months ago
#378 - Easy comparison across many models
Issue -
State: open - Opened by MadcowD 3 months ago
#377 - Run summaries should work with annotations and no metrics or no metrics at all
Issue -
State: open - Opened by MadcowD 3 months ago
#377 - Run summaries should work with annotations and no metrics or no metrics at all
Issue -
State: open - Opened by MadcowD 3 months ago
#376 - Build a UX which is compatible with no metrics & prompt engineering by vibes.
Issue -
State: open - Opened by MadcowD 3 months ago
#375 - fix getsource for jupyter context
Pull Request -
State: closed - Opened by chrisgoddard 3 months ago
- 1 comment
#375 - fix getsource for jupyter context
Pull Request -
State: closed - Opened by chrisgoddard 3 months ago
- 1 comment
#374 - Summaries for other type of data like annotations or criterion
Issue -
State: open - Opened by MadcowD 3 months ago
#374 - Summaries for other type of data like annotations or criterion
Issue -
State: open - Opened by MadcowD 3 months ago
#373 - Implement a bunch of standard criteria
Issue -
State: open - Opened by MadcowD 3 months ago
#373 - Implement a bunch of standard criteria
Issue -
State: open - Opened by MadcowD 3 months ago
#372 - UX for showing the model is different
Issue -
State: open - Opened by MadcowD 3 months ago
#372 - UX for showing the model is different
Issue -
State: open - Opened by MadcowD 3 months ago
#371 - UX for api params
Issue -
State: open - Opened by MadcowD 3 months ago
#371 - UX for api params
Issue -
State: open - Opened by MadcowD 3 months ago
#370 - clicking the graph or tooltip opens the run
Issue -
State: open - Opened by MadcowD 3 months ago
#370 - clicking the graph or tooltip opens the run
Issue -
State: open - Opened by MadcowD 3 months ago
#369 - Update tool_usage.rst
Pull Request -
State: closed - Opened by leeight 3 months ago
- 1 comment
#367 - about multimodal
Issue -
State: open - Opened by a136214808 3 months ago
- 2 comments
#367 - about multimodal
Issue -
State: open - Opened by a136214808 3 months ago
- 1 comment
#366 - default_client is ignored if model is in default registry
Issue -
State: open - Opened by ppabis 3 months ago
- 3 comments
#365 - fix sync
Pull Request -
State: closed - Opened by chenxingqiang 3 months ago
- 2 comments
#364 - examples += `wikipedia_mini_rag.py` for educational LLM+Wikipedia integration
Pull Request -
State: closed - Opened by gwpl 3 months ago
- 1 comment
#364 - examples += `wikipedia_mini_rag.py` for educational LLM+Wikipedia integration
Pull Request -
State: closed - Opened by gwpl 3 months ago
- 1 comment
#363 - feat(examples): add `llm_lottery.py` for demonstrating LLM tool integration
Pull Request -
State: closed - Opened by gwpl 3 months ago
- 1 comment
#362 - ell serialization refactor / distributed 2
Pull Request -
State: open - Opened by alex-dixon 3 months ago
#361 - Fix tool call ID in message object
Pull Request -
State: open - Opened by gurvinder-dhillon 3 months ago
#360 - Fix the store interface.
Issue -
State: open - Opened by MadcowD 3 months ago
- 1 comment
#360 - Fix the store interface.
Issue -
State: open - Opened by MadcowD 3 months ago
- 1 comment
#359 - need to sovle a really good UX for prpompt engineering with no criterion comparion outputs etc
Issue -
State: open - Opened by MadcowD 3 months ago
#359 - need to sovle a really good UX for prpompt engineering with no criterion comparion outputs etc
Issue -
State: open - Opened by MadcowD 3 months ago
#358 - Clarity into why a currently running invocation is working or not
Issue -
State: open - Opened by MadcowD 3 months ago
#358 - Clarity into why a currently running invocation is working or not
Issue -
State: open - Opened by MadcowD 3 months ago
#357 - Full UX for comparing different evals across any arbitrary axis
Issue -
State: open - Opened by MadcowD 3 months ago
#357 - Full UX for comparing different evals across any arbitrary axis
Issue -
State: open - Opened by MadcowD 3 months ago
#356 - Group runs more cleanly so that they are a part of an eval in the invocation view
Issue -
State: open - Opened by MadcowD 3 months ago
#356 - Group runs more cleanly so that they are a part of an eval in the invocation view
Issue -
State: open - Opened by MadcowD 3 months ago
#355 - Implement parsers/structured outputs to make this cleaner
Issue -
State: open - Opened by MadcowD 3 months ago
#355 - Implement parsers/structured outputs to make this cleaner
Issue -
State: open - Opened by MadcowD 3 months ago
#354 - Support failure modes in metric computation
Issue -
State: open - Opened by MadcowD 3 months ago
#354 - Support failure modes in metric computation
Issue -
State: open - Opened by MadcowD 3 months ago
#353 - Fix ell.function in general
Issue -
State: open - Opened by MadcowD 3 months ago
#353 - Fix ell.function in general
Issue -
State: open - Opened by MadcowD 3 months ago
#352 - Distributional view if you hover over one individual datapoint.
Issue -
State: open - Opened by MadcowD 3 months ago
#352 - Distributional view if you hover over one individual datapoint.
Issue -
State: open - Opened by MadcowD 3 months ago
#351 - Resumption of partilaly executed evals..
Issue -
State: open - Opened by MadcowD 3 months ago
#351 - Resumption of partilaly executed evals..
Issue -
State: open - Opened by MadcowD 3 months ago
#350 - Commit messages for evals.
Issue -
State: open - Opened by MadcowD 3 months ago
#350 - Commit messages for evals.
Issue -
State: open - Opened by MadcowD 3 months ago
#349 - Show the actual scores for a given input on ell studio as opposed to just the mean
Issue -
State: open - Opened by MadcowD 3 months ago
#349 - Show the actual scores for a given input on ell studio as opposed to just the mean
Issue -
State: open - Opened by MadcowD 3 months ago
#348 - Embedding view for distribution of outputs with a good looking TSNE for prompting to show if meaning ful distributional changes are occuring or something.
Issue -
State: open - Opened by MadcowD 3 months ago
#348 - Embedding view for distribution of outputs with a good looking TSNE for prompting to show if meaning ful distributional changes are occuring or something.
Issue -
State: open - Opened by MadcowD 3 months ago
- 1 comment
#347 - Open ell studio automatically when the eval gets run...
Issue -
State: open - Opened by MadcowD 3 months ago
#347 - Open ell studio automatically when the eval gets run...
Issue -
State: open - Opened by MadcowD 3 months ago
#346 - Arbitrary support for failure mode in lmp invocations
Issue -
State: open - Opened by MadcowD 3 months ago
#346 - Arbitrary support for failure mode in lmp invocations
Issue -
State: open - Opened by MadcowD 3 months ago