Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / leondz/garak issues and pull requests

#969 - fix: add garak/data to pip package

Pull Request - State: closed - Opened by jmartin-tech 4 months ago

#968 - docs: clarify "contributing" document

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: documentation

#967 - doc: update to use rst toctree href syntax

Pull Request - State: closed - Opened by leondz 4 months ago

#966 - docs: require core config top- and second-level params to be documented

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: documentation

#965 - docs: centralise faq

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: documentation

#964 - docs: make project scope clear and note that contributors should check it

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: documentation

#963 - generators: fix rasa issues #961 & #962

Pull Request - State: closed - Opened by rgstephens 4 months ago - 1 comment

#962 - Rest generator aborts on Rasa responses

Issue - State: closed - Opened by rgstephens 4 months ago - 1 comment
Labels: bug

#961 - UnboundLocalError: local variable 'opts_cli_config' referenced before assignment

Issue - State: closed - Opened by rgstephens 4 months ago - 1 comment
Labels: bug

#960 - feature: amend garak user-agent

Pull Request - State: open - Opened by leondz 4 months ago

#959 - generator: vision nims

Pull Request - State: closed - Opened by leondz 4 months ago

#958 - docs: describe top-level objectives in reference guide

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: documentation

#957 - docs: update faq

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: documentation

#956 - detector: llm as a judge

Pull Request - State: closed - Opened by jmartin-tech 4 months ago - 1 comment

#955 - feature: policy scan base infrastructure

Pull Request - State: open - Opened by leondz 4 months ago
Labels: enhancement

#954 - architecture: factor HFCompatible out

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: enhancement

#953 - update bag reference

Pull Request - State: closed - Opened by emmanuel-ferdman 4 months ago - 3 comments

#952 - REST URI client error: 422

Issue - State: open - Opened by samfhritp 4 months ago - 2 comments
Labels: question

#951 - update hint to reference --parallel_attempts

Pull Request - State: closed - Opened by jmartin-tech 4 months ago

#950 - Add "date first seen" column to python package hallucination dataset

Pull Request - State: open - Opened by arjun-krishna1 4 months ago - 2 comments

#949 - Configurable TAP probe, refactor judge resources to shared red team

Pull Request - State: closed - Opened by jmartin-tech 4 months ago - 3 comments

#947 - probe: add whois injection to latentinjection

Pull Request - State: closed - Opened by leondz 4 months ago - 1 comment
Labels: probes

#946 - rename `replay` probe module to `divergence`

Issue - State: closed - Opened by leondz 4 months ago
Labels: enhancement

#945 - update: rename `replay` plugins to `divergence`

Pull Request - State: closed - Opened by leondz 4 months ago
Labels: enhancement

#944 - probe: autodan-turbo

Issue - State: open - Opened by leondz 4 months ago
Labels: probes, new plugin

#943 - Feature/multilingual

Pull Request - State: open - Opened by SnowMasaya 4 months ago - 4 comments

#942 - Add error handling for empty `node_results` to `base.py`.

Pull Request - State: closed - Opened by erickgalinkin 5 months ago - 1 comment

#941 - ZeroDivisionError in garak/harnesses/probewise.py

Issue - State: closed - Opened by evilsocket 5 months ago - 3 comments
Labels: bug

#940 - limit project actions to primary repo

Pull Request - State: closed - Opened by jmartin-tech 5 months ago

#939 - update: extend calibration with more probes

Pull Request - State: closed - Opened by leondz 5 months ago

#937 - using xdg_data_home for report_path

Issue - State: closed - Opened by lanonse 5 months ago - 3 comments
Labels: question

#936 - reporting: tidy config details, add payload audit info

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: reporting

#935 - reporting: update link to bag

Pull Request - State: closed - Opened by leondz 5 months ago

#934 - add code coverage options

Pull Request - State: closed - Opened by jmartin-tech 5 months ago - 3 comments

#933 - payloads: web-related, incl. `probes.encoding` migration

Pull Request - State: closed - Opened by leondz 5 months ago - 1 comment
Labels: enhancement, probes

#932 - cli: `--parallel_attempts` hint

Pull Request - State: closed - Opened by leondz 5 months ago - 1 comment

#931 - Reorganise `_config` - move run-specific items out of `plugins` and into `run`

Issue - State: open - Opened by leondz 5 months ago
Labels: enhancement

#930 - bugfix: use distinct report entry type for payload init

Pull Request - State: closed - Opened by leondz 5 months ago - 1 comment
Labels: bug

#929 - docs: add example of using `Configurable` to specify a generator name for `load_plugin`

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: documentation

#928 - cli: warn if generator supports parallelisation but none is used

Issue - State: closed - Opened by leondz 5 months ago
Labels: enhancement, generators, cli, ux

#927 - security: warn if `api_key` given in config and config is world-readable

Issue - State: open - Opened by leondz 5 months ago
Labels: enhancement, cli

#926 - `configurable` should validate `dict` format expectations

Issue - State: open - Opened by leondz 5 months ago - 1 comment
Labels: enhancement

#925 - tweak: update migitation strings

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: bug, detectors

#924 - probe: Past Tense Vulnerability

Pull Request - State: open - Opened by Shine-afk 5 months ago - 10 comments

#923 - bugfix: enable latent injection mini latent jailbreak probe by default

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: bug, probes

#922 - generators: update `openai` for o1 models

Pull Request - State: closed - Opened by leondz 5 months ago - 2 comments
Labels: generators

#921 - latent injection doc fix

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: documentation

#920 - tweak: update mitigation strings

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: documentation

#919 - Contributing Probes documentation

Pull Request - State: closed - Opened by erickgalinkin 5 months ago - 1 comment

#918 - bug: set match type correctly in `riskywords` detectors

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: bug, detectors

#917 - docs: NVIDIA generators

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: documentation

#916 - data file override support with precedence

Pull Request - State: closed - Opened by jmartin-tech 5 months ago - 4 comments
Labels: enhancement

#914 - doc: give generatiors.rest list the space it wants and deserves

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: documentation

#913 - support JSON config as well as YAML

Issue - State: open - Opened by leondz 5 months ago
Labels: enhancement

#912 - RST formatting updates to restgenerator page

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: documentation

#911 - Document configuration of garak using YAML

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: documentation

#910 - tweak: new latentinjection probe, add configurability to mini version

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: probes

#909 - add issue and PR templates

Pull Request - State: closed - Opened by jmartin-tech 5 months ago - 1 comment

#908 - tweak: defer import of slow Llava* classes

Pull Request - State: closed - Opened by leondz 5 months ago
Labels: generators

#907 - Force cache build in automation

Pull Request - State: closed - Opened by jmartin-tech 6 months ago

#906 - plugin classes should not access `DEFAULT_PARAMS`

Pull Request - State: closed - Opened by jmartin-tech 6 months ago

#905 - utilized the cache to filter `base` classes

Pull Request - State: closed - Opened by jmartin-tech 6 months ago

#904 - `PackageHallucinationProbe` shouldn't show in `--list_probes`

Issue - State: open - Opened by leondz 6 months ago
Labels: enhancement, probes, cli

#903 - add test status lozenges for lin/win/osx

Pull Request - State: closed - Opened by leondz 6 months ago
Labels: documentation

#901 - reporting tweaks

Pull Request - State: closed - Opened by leondz 6 months ago
Labels: reporting

#900 - only include module summary, and not full docstring, in reports

Pull Request - State: closed - Opened by leondz 6 months ago
Labels: reporting

#899 - probe: perl, raku, dart package hallucination

Pull Request - State: open - Opened by arjun-krishna1 6 months ago - 1 comment
Labels: probes

#898 - paraphrase fast consistent model device

Pull Request - State: closed - Opened by jmartin-tech 6 months ago - 1 comment

#897 - Generator docs are now tested for as intended

Pull Request - State: closed - Opened by leondz 6 months ago
Labels: bug, documentation, tests

#896 - generator: Groq API

Pull Request - State: closed - Opened by mmilenkovic-groq 6 months ago - 4 comments

#895 - Payloads and probes should be decoupled

Issue - State: closed - Opened by leondz 6 months ago
Labels: enhancement, probes

#894 - Map existing probes to policies

Issue - State: open - Opened by leondz 6 months ago
Labels: policy

#893 - Add pre-scan model output policy checks

Issue - State: open - Opened by leondz 6 months ago
Labels: policy

#892 - Build typology of model behaviours

Issue - State: closed - Opened by leondz 6 months ago - 1 comment
Labels: policy

#891 - enable loading resources from XDG_DATA_HOME before hitting package dir

Issue - State: closed - Opened by leondz 6 months ago
Labels: enhancement

#890 - update `divergence` detector

Issue - State: open - Opened by leondz 6 months ago
Labels: detectors

#889 - add support for loading renamed plugins

Issue - State: open - Opened by leondz 6 months ago - 3 comments
Labels: enhancement

#888 - probe: Indirect injection probes focused on RAG vulns

Issue - State: closed - Opened by leondz 6 months ago
Labels: probes, new plugin

#887 - docs: centralise FAQ, make things point to it

Issue - State: closed - Opened by leondz 6 months ago
Labels: documentation

#886 - docs: add guide to first engaging with a good first issue

Issue - State: open - Opened by leondz 6 months ago
Labels: documentation

#885 - docs: add github templates for issue reporting

Issue - State: closed - Opened by leondz 6 months ago
Labels: documentation

#884 - docs: config option descriptions

Issue - State: open - Opened by leondz 6 months ago
Labels: documentation

#883 - docs: configurable

Issue - State: closed - Opened by leondz 6 months ago
Labels: documentation

#882 - have CLI UI render 100% w/o using scientific notation

Pull Request - State: closed - Opened by leondz 6 months ago
Labels: cli, ux

#880 - bag update - 24Q3

Issue - State: closed - Opened by leondz 6 months ago
Labels: reporting

#879 - Bug in Leakreplay Probe

Issue - State: open - Opened by bleszily 6 months ago - 2 comments
Labels: bug, probes

#878 - Add proxy, token refresh, and multi_endpoint features to generators

Pull Request - State: open - Opened by au70ma70n 6 months ago - 4 comments

#877 - Latent prompt injection probe

Pull Request - State: closed - Opened by leondz 6 months ago - 5 comments
Labels: probes, new plugin

#876 - generator: Ollama

Pull Request - State: closed - Opened by martinebl 6 months ago - 4 comments
Labels: generators, new plugin

#875 - Ollama generators

Pull Request - State: closed - Opened by martinebl 6 months ago - 3 comments

#874 - filter detector template in tests

Pull Request - State: closed - Opened by jmartin-tech 6 months ago

#873 - probe: rust crate hallucination

Pull Request - State: closed - Opened by arjun-krishna1 6 months ago - 3 comments

#870 - payload/probe separation

Pull Request - State: closed - Opened by leondz 6 months ago - 3 comments
Labels: enhancement, probes

#862 - The design of ”riskyword.py“might has shortcomings?

Issue - State: closed - Opened by chengsiyangbuaa 6 months ago - 1 comment
Labels: bug, detectors

#844 - migrate away from conda

Issue - State: open - Opened by leondz 6 months ago - 2 comments
Labels: enhancement

#839 - calibration symlink broken

Issue - State: open - Opened by leondz 6 months ago - 4 comments
Labels: bug, windows

#835 - see if we can migrate to either nltk or wn and not both

Issue - State: open - Opened by leondz 6 months ago - 2 comments
Labels: enhancement

#833 - harness: Detector only

Pull Request - State: open - Opened by vidushiMaheshwari 6 months ago - 6 comments
Labels: enhancement