hegelai/prompttools issues and pull requests

#100 - Handling duplicate column name from response

Pull Request - State: closed - Opened by NivekT 11 months ago

#100 - Handling duplicate column name from response

Pull Request - State: closed - Opened by NivekT 11 months ago

#99 - Adding option to clear previous experiment results in `.run()`

Pull Request - State: closed - Opened by NivekT 11 months ago

#99 - Adding option to clear previous experiment results in `.run()`

Pull Request - State: closed - Opened by NivekT 11 months ago

#98 - Backend integration

Pull Request - State: closed - Opened by steventkrawczyk 11 months ago - 1 comment

#98 - Backend integration

Pull Request - State: closed - Opened by steventkrawczyk 11 months ago - 1 comment

#97 - Update README code example

Pull Request - State: closed - Opened by NivekT 12 months ago

#97 - Update README code example

Pull Request - State: closed - Opened by NivekT 12 months ago

#96 - Example in README doesn't work

Issue - State: closed - Opened by stephantul 12 months ago - 1 comment

#96 - Example in README doesn't work

Issue - State: closed - Opened by stephantul 12 months ago - 1 comment

#95 - Added missing dependencies

Pull Request - State: closed - Opened by filopedraz 12 months ago - 2 comments

#95 - Added missing dependencies

Pull Request - State: closed - Opened by filopedraz 12 months ago - 2 comments

#94 - Error when running promptools

Issue - State: closed - Opened by filopedraz 12 months ago - 1 comment

#94 - Error when running promptools

Issue - State: closed - Opened by filopedraz 12 months ago - 1 comment

#93 - fixed sentence in readme

Pull Request - State: closed - Opened by tonykipkemboi 12 months ago - 1 comment

#92 - Add playground support for replicate

Pull Request - State: closed - Opened by steventkrawczyk 12 months ago

#92 - Add playground support for replicate

Pull Request - State: closed - Opened by steventkrawczyk 12 months ago

#91 - Fix a typo in experiment.rst

Pull Request - State: closed - Opened by bweber-rebellion 12 months ago - 1 comment

#91 - Fix a typo in experiment.rst

Pull Request - State: closed - Opened by bweber-rebellion 12 months ago - 1 comment

#90 - Support for Google Vertex AI

Issue - State: closed - Opened by richardguinness about 1 year ago - 1 comment

#90 - Support for Google Vertex AI

Issue - State: closed - Opened by richardguinness about 1 year ago - 1 comment

#89 - SQL Validator

Issue - State: open - Opened by steventkrawczyk about 1 year ago

#89 - SQL Validator

Issue - State: open - Opened by steventkrawczyk about 1 year ago

#88 - Add fine tuning experiment

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago - 1 comment

#88 - Add fine tuning experiment

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago - 1 comment

#87 - Epsilla Integration into Hegel

Pull Request - State: open - Opened by eric-epsilla about 1 year ago - 1 comment

#87 - Epsilla Integration into Hegel

Pull Request - State: open - Opened by eric-epsilla about 1 year ago - 1 comment

#86 - Sd kwargs

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago

#86 - Sd kwargs

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago

#85 - Remove `torch` reference

Pull Request - State: closed - Opened by NivekT about 1 year ago

#85 - Remove `torch` reference

Pull Request - State: closed - Opened by NivekT about 1 year ago

#84 - Harness Visualize does not accept String Literals

Issue - State: closed - Opened by JohnPeng47 about 1 year ago - 1 comment

#84 - Harness Visualize does not accept String Literals

Issue - State: closed - Opened by JohnPeng47 about 1 year ago - 1 comment

#83 - Is it possible to evaluate using models from Azure OpenAI Service?

Issue - State: closed - Opened by ayrtondenner about 1 year ago - 10 comments
Labels: enhancement, help wanted, good first issue

#83 - Is it possible to evaluate using models from Azure OpenAI Service?

Issue - State: closed - Opened by ayrtondenner about 1 year ago - 10 comments
Labels: enhancement, help wanted, good first issue

#82 - MusicGen Support

Issue - State: open - Opened by HashemAlsaket about 1 year ago

#82 - MusicGen Support

Issue - State: open - Opened by HashemAlsaket about 1 year ago

#81 - Examples are mixed/stacking up

Issue - State: closed - Opened by HashemAlsaket about 1 year ago - 3 comments

#81 - Examples are mixed/stacking up

Issue - State: closed - Opened by HashemAlsaket about 1 year ago - 3 comments

#80 - Stable diffusion

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago - 2 comments

#80 - Stable diffusion

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago - 2 comments

#79 - experiment.evaluate() shows stale evaluation results

Issue - State: open - Opened by davidtan-tw about 1 year ago - 3 comments

#79 - experiment.evaluate() shows stale evaluation results

Issue - State: open - Opened by davidtan-tw about 1 year ago - 3 comments

#78 - LanceDB update compat and notebook

Pull Request - State: closed - Opened by AyushExel about 1 year ago

#78 - LanceDB update compat and notebook

Pull Request - State: closed - Opened by AyushExel about 1 year ago

#77 - Instructions to download full HellaSwag dataset for benchmarking

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago

#77 - Instructions to download full HellaSwag dataset for benchmarking

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago

#76 - Error in experiment.evaluate() in introductory example OpenAIChatExperiment.ipynb

Issue - State: closed - Opened by davidtan-tw about 1 year ago - 4 comments
Labels: bug

#76 - Error in experiment.evaluate() in introductory example OpenAIChatExperiment.ipynb

Issue - State: closed - Opened by davidtan-tw about 1 year ago - 4 comments
Labels: bug

#75 - Dataset load for benchmarking

Pull Request - State: open - Opened by LuvvAggarwal about 1 year ago - 2 comments

#75 - Dataset load for benchmarking

Pull Request - State: open - Opened by LuvvAggarwal about 1 year ago - 2 comments

#74 - Stable diffusion support

Issue - State: closed - Opened by steventkrawczyk about 1 year ago - 2 comments

#74 - Stable diffusion support

Issue - State: closed - Opened by steventkrawczyk about 1 year ago - 2 comments

#73 - Replicate integration

Issue - State: closed - Opened by steventkrawczyk about 1 year ago - 1 comment

#73 - Replicate integration

Issue - State: closed - Opened by steventkrawczyk about 1 year ago - 1 comment

#72 - Benchmarking

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago - 6 comments

#72 - Benchmarking

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago - 6 comments

#71 - LanceDB Integration

Pull Request - State: closed - Opened by AyushExel about 1 year ago - 3 comments

#71 - LanceDB Integration

Pull Request - State: closed - Opened by AyushExel about 1 year ago - 3 comments

#70 - LanceDB integration

Pull Request - State: closed - Opened by AyushExel about 1 year ago - 3 comments

#70 - LanceDB integration

Pull Request - State: closed - Opened by AyushExel about 1 year ago - 3 comments

#69 - Robustness evaluation

Issue - State: open - Opened by steventkrawczyk about 1 year ago - 1 comment
Labels: help wanted, good first issue

#69 - Robustness evaluation

Issue - State: open - Opened by steventkrawczyk about 1 year ago - 1 comment
Labels: help wanted, good first issue

#68 - Support for OSS Models behind an API?

Issue - State: open - Opened by rafaelvp-db about 1 year ago - 1 comment
Labels: enhancement, help wanted

#67 - Lang Chain Router Chain Experiment

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago - 1 comment

#67 - Lang Chain Router Chain Experiment

Pull Request - State: closed - Opened by HashemAlsaket about 1 year ago - 1 comment

#66 - Improve link sharing

Issue - State: open - Opened by steventkrawczyk about 1 year ago
Labels: help wanted, playground

#66 - Improve link sharing

Issue - State: open - Opened by steventkrawczyk about 1 year ago
Labels: help wanted, playground

#65 - Adding Sentry

Pull Request - State: closed - Opened by NivekT about 1 year ago

#65 - Adding Sentry

Pull Request - State: closed - Opened by NivekT about 1 year ago

#64 - Export To MongoDB

Pull Request - State: closed - Opened by pramitbhatia25 about 1 year ago - 1 comment

#64 - Export To MongoDB

Pull Request - State: closed - Opened by pramitbhatia25 about 1 year ago - 1 comment

#63 - Ollama Integration

Pull Request - State: open - Opened by osamanatouf2 about 1 year ago - 3 comments

#63 - Ollama Integration

Pull Request - State: open - Opened by osamanatouf2 about 1 year ago - 3 comments

#62 - Add sentry

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago - 1 comment

#62 - Add sentry

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago - 1 comment

#61 - Adding documentation for LangChain and MindsDB experiments

Pull Request - State: closed - Opened by NivekT about 1 year ago

#61 - Adding documentation for LangChain and MindsDB experiments

Pull Request - State: closed - Opened by NivekT about 1 year ago

#60 - Refactor Experiment

Pull Request - State: closed - Opened by NivekT about 1 year ago

#60 - Refactor Experiment

Pull Request - State: closed - Opened by NivekT about 1 year ago

#59 - Add support for other models in AutoEval

Pull Request - State: open - Opened by Divij97 about 1 year ago - 1 comment

#59 - Add support for other models in AutoEval

Pull Request - State: open - Opened by Divij97 about 1 year ago - 1 comment

#58 - Add qs parameters to streamlit app

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago

#58 - Add qs parameters to streamlit app

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago

#57 - Streamlit playground support for localLLMs

Issue - State: open - Opened by LuvvAggarwal about 1 year ago - 1 comment
Labels: playground

#57 - Streamlit playground support for localLLMs

Issue - State: open - Opened by LuvvAggarwal about 1 year ago - 1 comment
Labels: playground

#56 - Add anthropic UI support

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago

#56 - Add anthropic UI support

Pull Request - State: closed - Opened by steventkrawczyk about 1 year ago

#55 - Added support for MongoDB Export of results for Instruction/Prompt Template

Pull Request - State: closed - Opened by pramitbhatia25 about 1 year ago - 4 comments

#55 - Added support for MongoDB Export of results for Instruction/Prompt Template

Pull Request - State: closed - Opened by pramitbhatia25 about 1 year ago - 4 comments

#54 - Implement QdrantExperiment

Pull Request - State: closed - Opened by kacperlukawski about 1 year ago - 9 comments

#54 - Implement QdrantExperiment

Pull Request - State: closed - Opened by kacperlukawski about 1 year ago - 9 comments

#53 - OpenAI Chat Function

Pull Request - State: closed - Opened by mmmaia about 1 year ago - 1 comment

#53 - OpenAI Chat Function

Pull Request - State: closed - Opened by mmmaia about 1 year ago - 1 comment

#52 - Add Qdrant Vector database support

Issue - State: closed - Opened by rafidude about 1 year ago - 1 comment

#52 - Add Qdrant Vector database support

Issue - State: closed - Opened by rafidude about 1 year ago - 1 comment

#51 - Add benchmarks and evals for jailbreaks

Issue - State: open - Opened by steventkrawczyk about 1 year ago
Labels: enhancement, help wanted

#51 - Add benchmarks and evals for jailbreaks

Issue - State: open - Opened by steventkrawczyk about 1 year ago
Labels: enhancement, help wanted

#50 - Add common benchmarks

Issue - State: open - Opened by steventkrawczyk about 1 year ago - 9 comments
Labels: enhancement, good first issue

#50 - Add common benchmarks

Issue - State: open - Opened by steventkrawczyk about 1 year ago - 9 comments
Labels: enhancement, good first issue

GitHub / hegelai/prompttools issues and pull requests