Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / NVIDIA/garak issues and pull requests

#1348 - reporting: update defcon descriptions to talk about risk

Pull Request - State: closed - Opened by leondz 7 days ago - 1 comment
Labels: reporting

#1346 - judge detectors conversation refactor

Pull Request - State: closed - Opened by jmartin-tech 7 days ago

#1344 - Possible bug with detector `judge.Refusal` when set up with `nim` generator.

Issue - State: closed - Opened by aishwaryap 9 days ago
Labels: bug, bug-verified

#1341 - docs: update contact email in readme

Pull Request - State: closed - Opened by leondz 13 days ago
Labels: documentation

#1340 - probe: CurXecute

Issue - State: open - Opened by leondz 14 days ago

#1339 - Add tag probe

Pull Request - State: open - Opened by lucahennemann 14 days ago

#1337 - Configurable system prompt

Pull Request - State: closed - Opened by erickgalinkin 17 days ago

#1333 - reporting: add probe tags to digest

Issue - State: open - Opened by leondz 21 days ago
Labels: bug

#1332 - initial implementation of videoProbe

Pull Request - State: open - Opened by solo-daemon 22 days ago

#1331 - add google and anthropic gens

Pull Request - State: closed - Opened by calvin-promptarmor 23 days ago - 1 comment

#1329 - reporting: tier biased security aggregate

Pull Request - State: open - Opened by leondz 24 days ago
Labels: reporting

#1328 - fix doc extending.rst

Pull Request - State: closed - Opened by solo-daemon 24 days ago - 5 comments

#1326 - feature: ren failure -> attack success

Pull Request - State: closed - Opened by leondz 28 days ago
Labels: cli, ux

#1325 - An API for Garak

Pull Request - State: open - Opened by iamnotcj 28 days ago

#1324 - improve cache and label automation

Pull Request - State: open - Opened by jmartin-tech 28 days ago

#1321 - rename `max_tokens` throughout to `max_generation_tokens`

Issue - State: open - Opened by leondz 30 days ago
Labels: architecture

#1317 - Specify `flit` build-system within `pyproject.toml`

Pull Request - State: closed - Opened by 06kellyjac about 1 month ago - 6 comments
Labels: housekeeping

#1315 - Update how license is defined in pyproject.toml

Pull Request - State: open - Opened by 06kellyjac about 1 month ago

#1314 - Use numpy v2

Pull Request - State: closed - Opened by 06kellyjac about 1 month ago - 3 comments

#1312 - dependency ecoji stale

Issue - State: open - Opened by 06kellyjac about 1 month ago
Labels: question

#1308 - download models used in translation tests early

Pull Request - State: closed - Opened by jmartin-tech about 1 month ago
Labels: tests, housekeeping

#1307 - Adding wider detection of :: and // in malwaregen.AnyCode detector

Pull Request - State: closed - Opened by aishwaryap about 1 month ago

#1305 - Configs

Pull Request - State: open - Opened by dchiitmalla about 1 month ago

#1302 - Bug fix to malwaregen anycode detector in keyword using

Pull Request - State: closed - Opened by aishwaryap about 2 months ago

#1301 - 'Pipeline' object has no attribute 'model'

Issue - State: open - Opened by javadKefayati about 2 months ago
Labels: bug

#1300 - Expand python exploitation payloads

Pull Request - State: closed - Opened by erickgalinkin about 2 months ago - 1 comment

#1299 - Ascii Smuggling

Pull Request - State: closed - Opened by erickgalinkin about 2 months ago - 3 comments

#1293 - Garak UI

Pull Request - State: open - Opened by otavionvidia about 2 months ago

#1290 - restrict datasets version due to new torchcodec dependency

Pull Request - State: closed - Opened by jmartin-tech about 2 months ago

#1289 - Feature/translation cache

Pull Request - State: open - Opened by SnowMasaya about 2 months ago

#1288 - bug: probes.phrasing.FutureTense poses past tense prompts

Issue - State: open - Opened by leondz 2 months ago
Labels: bug

#1287 - reporting: aggregation should add a digest object

Issue - State: open - Opened by leondz 2 months ago

#1286 - typo fix

Pull Request - State: open - Opened by dbaker-arch 2 months ago - 1 comment

#1285 - update: rm sentencepiece dep

Pull Request - State: open - Opened by leondz 2 months ago - 3 comments
Labels: housekeeping

#1285 - update: rm sentencepiece dep

Pull Request - State: open - Opened by leondz 2 months ago
Labels: housekeeping

#1284 - amend docs copyright

Pull Request - State: closed - Opened by leondz 2 months ago
Labels: documentation

#1284 - amend docs copyright

Pull Request - State: open - Opened by leondz 2 months ago
Labels: documentation

#1283 - Replace deprecated `np.infty` with `np.inf`.

Pull Request - State: closed - Opened by erickgalinkin 2 months ago

#1283 - Replace deprecated `np.infty` with `np.inf`.

Pull Request - State: closed - Opened by erickgalinkin 2 months ago

#1282 - Build in ASCII smuggling

Issue - State: open - Opened by erickgalinkin 2 months ago
Labels: buffs

#1281 - reporting: `aggregate_reports` should rebuild report digest jsonl

Issue - State: open - Opened by leondz 2 months ago
Labels: reporting

#1280 - feature: support detectors including `None` in output values

Pull Request - State: open - Opened by leondz 2 months ago
Labels: architecture, detectors

#1278 - reset tiers for `Complete` `leakreplay` probes

Pull Request - State: closed - Opened by leondz 2 months ago

#1278 - reset tiers for `Complete` `leakreplay` probes

Pull Request - State: closed - Opened by leondz 2 months ago

#1277 - Scanning o3-mini in Azure Gov

Issue - State: open - Opened by wpabon123 2 months ago
Labels: question

#1275 - feature: make llmaaj prompts switchable

Issue - State: open - Opened by leondz 2 months ago - 1 comment

#1274 - actions: add 'high priortiy' to never-stale label list

Pull Request - State: closed - Opened by leondz 2 months ago
Labels: housekeeping

#1273 - Added total latency logging for each attempt

Pull Request - State: open - Opened by sammykao 2 months ago - 1 comment

#1272 - add stale exempt tags

Pull Request - State: closed - Opened by leondz 2 months ago

#1272 - add stale exempt tags

Pull Request - State: closed - Opened by leondz 2 months ago - 2 comments

#1271 - Add latency logging for each attempt sequence

Pull Request - State: open - Opened by sammykao 2 months ago

#1271 - Add latency logging for each attempt sequence

Pull Request - State: closed - Opened by sammykao 2 months ago - 4 comments
Labels: needs unique branch

#1270 - docs: mistral syntax fix and minor code cleanup

Pull Request - State: closed - Opened by jmartin-tech 2 months ago

#1270 - docs: mistral syntax fix and minor code cleanup

Pull Request - State: closed - Opened by jmartin-tech 2 months ago

#1269 - add action for closing stale PRs/issues

Pull Request - State: open - Opened by leondz 2 months ago
Labels: housekeeping

#1269 - add action for closing stale PRs/issues

Pull Request - State: closed - Opened by leondz 2 months ago - 2 comments
Labels: housekeeping

#1268 - chore: Reformat docstrings to reduce docs issues

Pull Request - State: closed - Opened by mikemckiernan 2 months ago
Labels: documentation

#1267 - chore: Update pre-commit hooks and use RST comment

Pull Request - State: closed - Opened by mikemckiernan 2 months ago

#1266 - Improve OpenAI CLI handling

Pull Request - State: open - Opened by dchiitmalla 3 months ago

#1266 - Improve OpenAI CLI handling

Pull Request - State: closed - Opened by dchiitmalla 3 months ago - 1 comment

#1265 - detector: violence detector and lmrc tests

Pull Request - State: closed - Opened by dchiitmalla 3 months ago
Labels: detectors

#1265 - detector: violence detector and lmrc tests

Pull Request - State: open - Opened by dchiitmalla 3 months ago
Labels: detectors

#1264 - Leakreplay refactor

Pull Request - State: closed - Opened by dchiitmalla 3 months ago
Labels: architecture, probes

#1264 - Leakreplay refactor

Pull Request - State: closed - Opened by dchiitmalla 3 months ago
Labels: architecture, probes

#1263 - docs: Address RST issues

Pull Request - State: closed - Opened by mikemckiernan 3 months ago

#1263 - docs: Address RST issues

Pull Request - State: closed - Opened by mikemckiernan 3 months ago

#1262 - chore: The bare .active has too much blast radius

Pull Request - State: closed - Opened by mikemckiernan 3 months ago - 3 comments

#1261 - Branch jailbreakv

Pull Request - State: open - Opened by N0xAh 3 months ago - 2 comments
Labels: probes, detectors, new plugin

#1260 - Reworked Garak UI

Pull Request - State: open - Opened by otavionvidia 3 months ago - 2 comments
Labels: reporting

#1259 - Added more generalized version of Markdown exfil probe

Pull Request - State: closed - Opened by aishwaryap 3 months ago - 4 comments
Labels: architecture, probes

#1259 - Added more generalized version of Markdown exfil probe

Pull Request - State: open - Opened by aishwaryap 3 months ago - 1 comment
Labels: architecture, probes

#1258 - Probe: jailbreakv + detector

Pull Request - State: closed - Opened by N0xAh 3 months ago - 4 comments
Labels: needs unique branch

#1258 - Probe: jailbreakv + detector

Pull Request - State: closed - Opened by N0xAh 3 months ago - 4 comments
Labels: needs unique branch

#1257 - UX: add progress indicators for translation tasks

Pull Request - State: closed - Opened by jmartin-tech 3 months ago
Labels: cli, ux

#1256 - Llava tests

Pull Request - State: closed - Opened by dchiitmalla 3 months ago - 2 comments

#1255 - feature: stable, useful config capture

Issue - State: open - Opened by leondz 3 months ago

#1254 - Feature: conversation support

Pull Request - State: closed - Opened by jmartin-tech 3 months ago - 5 comments

#1254 - Feature: conversation support

Pull Request - State: open - Opened by jmartin-tech 3 months ago - 5 comments

#1253 - docs: correct reference to langproviders configuration

Pull Request - State: closed - Opened by jmartin-tech 3 months ago

#1252 - cohere version upgrade

Pull Request - State: open - Opened by dchiitmalla 3 months ago - 2 comments
Labels: generators

#1251 - remove modality redundant check

Pull Request - State: closed - Opened by jmartin-tech 3 months ago

#1251 - remove modality redundant check

Pull Request - State: closed - Opened by jmartin-tech 3 months ago

#1250 - bug: probes.suffix.GCG - `nf.infty` deprecated

Issue - State: closed - Opened by leondz 3 months ago - 1 comment
Labels: bug

#1249 - bug: core cfg listed twice in report in default run

Issue - State: open - Opened by leondz 3 months ago
Labels: bug

#1248 - rm octo generator

Pull Request - State: closed - Opened by leondz 3 months ago - 3 comments
Labels: generators

#1247 - generator remove: octo

Issue - State: closed - Opened by leondz 3 months ago
Labels: generators

#1246 - adjust calling convention for perf_stats.py

Pull Request - State: closed - Opened by jmartin-tech 3 months ago

#1246 - adjust calling convention for perf_stats.py

Pull Request - State: open - Opened by jmartin-tech 3 months ago

#1245 - reporting: result summary object

Pull Request - State: closed - Opened by leondz 3 months ago
Labels: architecture, reporting

#1244 - dropbox repeated token attack

Pull Request - State: open - Opened by dchiitmalla 3 months ago - 1 comment
Labels: probes

#1244 - dropbox repeated token attack

Pull Request - State: open - Opened by dchiitmalla 3 months ago

#1243 - Consolidate dart perl raku

Pull Request - State: open - Opened by dchiitmalla 3 months ago
Labels: probes

#1242 - Add dart detector

Pull Request - State: closed - Opened by dchiitmalla 3 months ago - 5 comments
Labels: probes

#1242 - Add dart detector

Pull Request - State: closed - Opened by dchiitmalla 3 months ago - 5 comments
Labels: probes

#1241 - Add perl detector

Pull Request - State: closed - Opened by dchiitmalla 3 months ago - 3 comments
Labels: probes

#1241 - Add perl detector

Pull Request - State: closed - Opened by dchiitmalla 3 months ago - 3 comments
Labels: probes