Quantization
The quantization module handles vector encoding and compression.
simplevecdb.engine.quantization.QuantizationStrategy
Handles vector quantization and serialization.
Supports FLOAT (32-bit), INT8 (8-bit), and BIT (1-bit) quantization modes.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
quantization
|
Quantization
|
Quantization mode to use |
required |
Source code in src/simplevecdb/engine/quantization.py
31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 | |
serialize(vector)
Serialize a normalized float vector according to quantization mode.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
vector
|
ndarray
|
Input vector to serialize |
required |
Returns:
| Type | Description |
|---|---|
bytes
|
Serialized bytes ready for SQLite storage |
Raises:
| Type | Description |
|---|---|
ValueError
|
If quantization mode is unsupported |
Source code in src/simplevecdb/engine/quantization.py
deserialize(blob, dim)
Reverse serialization for fallback path.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
blob
|
bytes
|
Serialized bytes from SQLite |
required |
dim
|
int | None
|
Original vector dimension (required for BIT mode) |
required |
Returns:
| Type | Description |
|---|---|
ndarray
|
Deserialized float32 vector |
Raises:
| Type | Description |
|---|---|
ValueError
|
If quantization mode unsupported or dim missing for BIT |
Source code in src/simplevecdb/engine/quantization.py
simplevecdb.engine.quantization.normalize_l2(vector)
L2-normalize a vector.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
vector
|
ndarray
|
Input vector to normalize |
required |
Returns:
| Type | Description |
|---|---|
ndarray
|
L2-normalized vector (unit length), or original if effectively zero. |