# PySentry - pip-audit Benchmark Report

**Generated:** 2026-02-24 22:22:15
**Duration:** 1m 47.35s
**Total Tests:** 20

## Executive Summary

**Overall Success Rate:** 100.0% (20/20 successful runs)

### Small_Requirements Dataset - Cold Cache
- **Fastest:** pysentry-pypi (0.736s) - 11.65x faster than slowest
- **Memory Efficient:** pysentry-osv (19.06 MB) - 5.28x less memory than highest

### Small_Requirements Dataset - Hot Cache
- **Fastest:** pysentry-pypi (0.271s) - 28.50x faster than slowest
- **Memory Efficient:** pysentry-osv (11.48 MB) - 8.13x less memory than highest

### Large_Requirements Dataset - Cold Cache
- **Fastest:** pysentry-pypi (1.424s) - 11.03x faster than slowest
- **Memory Efficient:** pysentry-osv (43.26 MB) - 2.69x less memory than highest

### Large_Requirements Dataset - Hot Cache
- **Fastest:** pysentry-pypi (0.789s) - 18.60x faster than slowest
- **Memory Efficient:** pysentry-osv (11.85 MB) - 5.97x less memory than highest

## Test Environment

- **Platform:** Linux-6.11.0-1018-azure-x86_64-with-glibc2.39
- **Python Version:** 3.11.14
- **CPU Cores:** 4
- **Total Memory:** 15.62 GB
- **Available Memory:** 14.67 GB

## Performance Comparison

### Small_Requirements Dataset - Cold Cache

#### Execution Time Comparison

| Tool Configuration | Execution Time | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-pypi | 0.736s | 1.00x |
| 🥈 pysentry-osv | 0.850s | 1.15x |
|  pysentry-all-sources | 1.937s | 2.63x |
|  pysentry-pypa | 2.186s | 2.97x |
|  pip-audit-default | 8.573s | 11.65x |

#### Memory Usage Comparison

| Tool Configuration | Peak Memory | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-osv | 19.06 MB | 1.00x |
| 🥈 pysentry-pypi | 19.95 MB | 1.05x |
|  pip-audit-default | 45.51 MB | 2.39x |
|  pysentry-pypa | 69.07 MB | 3.62x |
|  pysentry-all-sources | 100.54 MB | 5.28x |

### Small_Requirements Dataset - Hot Cache

#### Execution Time Comparison

| Tool Configuration | Execution Time | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-pypi | 0.271s | 1.00x |
| 🥈 pysentry-osv | 0.436s | 1.61x |
|  pysentry-pypa | 1.616s | 5.97x |
|  pysentry-all-sources | 1.624s | 5.99x |
|  pip-audit-default | 7.721s | 28.50x |

#### Memory Usage Comparison

| Tool Configuration | Peak Memory | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-osv | 11.48 MB | 1.00x |
| 🥈 pysentry-pypi | 12.43 MB | 1.08x |
|  pip-audit-default | 44.31 MB | 3.86x |
|  pysentry-pypa | 62.77 MB | 5.47x |
|  pysentry-all-sources | 93.39 MB | 8.13x |

### Large_Requirements Dataset - Cold Cache

#### Execution Time Comparison

| Tool Configuration | Execution Time | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-pypi | 1.424s | 1.00x |
| 🥈 pysentry-osv | 1.585s | 1.11x |
|  pysentry-all-sources | 2.366s | 1.66x |
|  pysentry-pypa | 2.369s | 1.66x |
|  pip-audit-default | 15.703s | 11.03x |

#### Memory Usage Comparison

| Tool Configuration | Peak Memory | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-osv | 43.26 MB | 1.00x |
| 🥈 pysentry-pypi | 45.46 MB | 1.05x |
|  pip-audit-default | 48.27 MB | 1.12x |
|  pysentry-pypa | 83.00 MB | 1.92x |
|  pysentry-all-sources | 116.46 MB | 2.69x |

### Large_Requirements Dataset - Hot Cache

#### Execution Time Comparison

| Tool Configuration | Execution Time | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-pypi | 0.789s | 1.00x |
| 🥈 pysentry-osv | 1.098s | 1.39x |
|  pysentry-pypa | 2.066s | 2.62x |
|  pysentry-all-sources | 2.301s | 2.92x |
|  pip-audit-default | 14.674s | 18.60x |

#### Memory Usage Comparison

| Tool Configuration | Peak Memory | Relative Performance |
|---------------------|---------------------|---------------------|
| 🥇 pysentry-osv | 11.85 MB | 1.00x |
| 🥈 pysentry-pypi | 13.50 MB | 1.14x |
|  pip-audit-default | 47.66 MB | 4.02x |
|  pysentry-pypa | 56.06 MB | 4.73x |
|  pysentry-all-sources | 70.73 MB | 5.97x |

## Detailed Analysis

### Pysentry Performance

- **Execution Time:** Avg: 1.478s, Min: 0.271s, Max: 2.369s

- **Memory Usage:** Avg: 51.81 MB, Min: 11.48 MB, Max: 116.46 MB

- **Success Rate:** 100.0% (16/16)

### Pip-Audit Performance

- **Execution Time:** Avg: 11.668s, Min: 7.721s, Max: 15.703s

- **Memory Usage:** Avg: 46.44 MB, Min: 44.31 MB, Max: 48.27 MB

- **Success Rate:** 100.0% (4/4)