Transform Secrets Engine (API)
This is the API documentation for the Transform secrets engine. For general information about the usage and operation of the secrets engine, please see the Transform secrets engine documentation.
This documentation assumes the transform secrets engine is enabled at the
/transform
path in Vault. Since it is possible to enable secrets engines at any
location, please update your API calls accordingly.
Create/Update Role
This endpoint creates or updates the role with the given name
. If a role with
the name does not exist, it will be created. If the role exists, it will be
updated with the new attributes.
Method | Path |
---|---|
POST | /transform/role/:name |
Parameters
name
(string: <required>)
– Specifies the name of the role to create. This is part of the request URL.transformations
(list: []
) - Specifies the transformations that can be used with this role.
Sample Payload
Sample Request
Read Role
This endpoint queries an existing role by the given name.
Method | Path |
---|---|
GET | /transform/role/:name |
Parameters
name
(string: <required>)
– Specifies the name of the role to read. This is part of the request URL.
Sample Request
Sample Response
List Roles
This endpoint lists all existing roles in the secrets engine.
Method | Path |
---|---|
LIST | /transform/role |
Parameters
filter
(string: "*")
– If provided, only returns role names that match the given glob.
Sample Request
Sample Response
Delete Role
This endpoint deletes an existing role by the given name.
Method | Path |
---|---|
DELETE | /transform/role/:name |
Parameters
name
(string: <required>)
– Specifies the name of the role to delete. This is part of the request URL.
Sample Request
Create/Update Transformation DEPRECATED (1.6)
This endpoint creates or updates a transformation with the given name
. If a
transformation with the name does not exist, it will be created. If the
transformation exists, it will be updated with the new attributes. This
endpoint is deprecated as of version 1.6 in favor of the type specific
configuration endpoints, and will be removed in a future release.
Method | Path |
---|---|
POST | /transform/transformation/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to create or update. This is part of the request URL.type
(string: <required>)
- Specifies the type of transformation to perform. The types currently supported by this backend arefpe
,masking
, andtokenization
. This value cannot be modified by an update operation after creation.template
(string: <required>)
- Specifies the template name to use for matching value on encode and decode operations when using this transformation. Ignored by the tokenization transformation type.tweak_source
(string: "supplied")
- Specifies the source of where the tweak value comes from. Valid sources aresupplied
,generated
, andinternal
. Only used when the type is FPE.masking_character
(string: "*")
- Specifies the character to use for masking. If multiple characters are provided, only the first one is used and the rest is ignored. Only used when the type is masking.allowed_roles
(list: [])
- Specifies a list of allowed roles that this transformation can be assigned to. A role using this transformation must exist in this list in order for encode and decode operations to properly function.
Sample Payload
Sample Request
Create/Update FPE Transformation
This endpoint creates or updates an FPE transformation with the given name
. If a
transformation with the name does not exist, it will be created. If the
transformation exists, it will be updated with the new attributes.
Method | Path |
---|---|
POST | /transform/transformations/fpe/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to create or update. This is part of the request URL.template
(string: <required>)
- Specifies the template name to use for matching value on encode and decode operations when using this transformation.tweak_source
(string: "supplied")
- Specifies the source of where the tweak value comes from. Valid sources aresupplied
,generated
, andinternal
. Only used when the type is FPE.allowed_roles
(list: [])
- Specifies a list of allowed roles that this transformation can be assigned to. A role using this transformation must exist in this list in order for encode and decode operations to properly function.
Sample Payload
Sample Request
Create/Update Masking Transformation
This endpoint creates or updates a masking transformation with the given name
. If a
transformation with the name does not exist, it will be created. If the
transformation exists, it will be updated with the new attributes.
Method | Path |
---|---|
POST | /transform/transformations/masking/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to create or update. This is part of the request URL.template
(string: <required>)
- Specifies the template name to use for matching value on encode and decode operations when using this transformation.masking_character
(string: "*")
- Specifies the character to use for masking. If multiple characters are provided, only the first one is used and the rest is ignored. Only used when the type is masking.allowed_roles
(list: [])
- Specifies a list of allowed roles that this transformation can be assigned to. A role using this transformation must exist in this list in order for encode and decode operations to properly function.
Sample Payload
Sample Request
Create/Update Tokenization Transformation
This endpoint creates or updates a tokenization transformation with the given name
. If a
transformation with the name does not exist, it will be created. If the
transformation exists, it will be updated with the new attributes.
Method | Path |
---|---|
POST | /transform/transformations/tokenization/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to create or update. This is part of the request URL.mapping_mode
(string: "default")
- Specifies the mapping mode for stored tokenization values.default
is strongly recommended for highest security.exportable
allows for all plaintexts to be decoded via the export-decoded endpoint in an emergency.max_ttl
: `(duration: "0") The maximum TTL of a token. If 0 or unspecified, tokens may have no expiration.allowed_roles
(list: [])
- Specifies a list of allowed roles that this transformation can be assigned to. A role using this transformation must exist in this list in order for encode and decode operations to properly function.stores
(list: ["builtin/internal"])
- The list of tokenization stores to use for tokenization state. Vault's internal storage is used by default.
Sample Payload
Sample Request
Read Transformation
This endpoint queries an existing transformation by the given name.
Method | Path |
---|---|
GET | /transform/transformation/:name |
name
(string: <required>)
– Specifies the name of the role to read. This is part of the request URL.
Sample Request
Sample Response
List Transformation
This endpoint lists all existing transformations in the secrets engine.
Method | Path |
---|---|
LIST | /transform/transformation |
Sample Request
Sample Response
Delete Transformation
This endpoint deletes an existing transformation by the given name.
Method | Path |
---|---|
DELETE | /transform/transformation/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to delete. This is part of the request URL.
Sample Request
Create/Update Template
This endpoint creates or updates a template with the given name
. If a
template with the name does not exist, it will be created. If the
template exists, it will be updated with the new attributes.
Method | Path |
---|---|
POST | /transform/template/:name |
Parameters
name
(string: <required>)
– Specifies the name of the template to create. This is part of the request URL.type
(string: <required>)
- Specifies the type of pattern matching to perform. The ony type currently supported by this backend isregex
.pattern
(string: <required>)
- Specifies the pattern used to match a particular value. For regex type matching, capture group determines the set of character that should be matched against. Any matches outside of capture groups are retained post-transformation.alphabet
(string)
- Specifies the name of the alphabet to use when this template is used for FPE encoding and decoding operations.
Sample Payload
Sample Request
Read Template
This endpoint queries an existing template by the given name.
Method | Path |
---|---|
GET | /transform/template/:name |
name
(string: <required>)
– Specifies the name of the role to read. This is part of the request URL.
Sample Request
Sample Response
List Template
This endpoint lists all existing templates in the secrets engine.
Method | Path |
---|---|
LIST | /transform/template |
Sample Request
Sample Response
Delete Template
This endpoint deletes an existing template by the given name.
Method | Path |
---|---|
DELETE | /transform/template/:name |
Parameters
name
(string: <required>)
– Specifies the name of the template to delete. This is part of the request URL.
Sample Request
Create/Update Alphabet
This endpoint creates or updates an alphabet with the given name
. If an
alphabet with the name does not exist, it will be created. If the
alphabet exists, it will be updated with the new attributes.
Method | Path |
---|---|
POST | /transform/alphabet/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to create. This is part of the request URL.alphabet
(string: <required>)
– Specifies the set of characters that can exist within the provided value and the encoded or decoded value for a FPE transformation.
Sample Payload
Sample Request
Read Alphabet
This endpoint queries an existing alphabet by the given name.
Method | Path |
---|---|
GET | /transform/alphabet/:name |
name
(string: <required>)
– Specifies the name of the role to read. This is part of the request URL.
Sample Request
Sample Response
List Alphabets
This endpoint lists all existing alphabets in the secrets engine.
Method | Path |
---|---|
LIST | /transform/alphabet |
Sample Request
Sample Response
Delete Alphabet
This endpoint deletes an existing alphabet by the given name.
Method | Path |
---|---|
DELETE | /transform/alphabet/:name |
Parameters
name
(string: <required>)
– Specifies the name of the alphabet to delete. This is part of the request URL.
Sample Request
Create/Update Tokenization Store
This endpoint creates or updates a storage configuration for use with tokenization.
The database user configured here should only have permission to SELECT
,
INSERT
, and UPDATE
rows in the tables.
Method | Path |
---|---|
POST | /transform/stores/:name |
Parameters
name
(string: <required>)
– Specifies the name of the store to create or update. This is part of the request URL.type
(string: <required>)
- Specifies the type of store. Currently onlysql
is supported.driver
(string: <required>)
- Specifies the database driver to use, and thus which SQL database type. Currently the supported options arepostgres
ormysql
supported_transformations:
(list: ["tokenization"])The types of transformations this store can host. Currently only
tokenization` is supported.connection_string
(string: <required>)
- A database connection string with template slots for username and password that Vault will use for locating and connecting to a database. Each database driver type has a different syntax for its connection strings.When using MySQL, make sure to append
?parseTime=true
to enable timestamp parsing.username
:(string: <required>)
- The username value to use when connecting to the database.password
:(string: <required>)
- The password value to use when connecting to the database.schema
:(string: "public")
- The schema within the database to expect tokenization state tables.max_open_connections
(int: 4)
- The maximum number of connections to the database at any given time.max_idle_connections
(int: 4)
- The maximum number of idle connections to the database at any given time.max_connection_lifetime
(duration: 0)
- The maximum amount of time a connection can be open before closing it.
0 means no limit.
Sample Payloads
Sample Request
Create/Update Store Schema
This endpoint creates or updates the underlying schema in an SQL type tokenization store. The provided username and password are only used during this call. This is so one may use a user with DDL privileges to create or update the schema, but still use a much more limited user for ordinary operation.
Method | Path |
---|---|
POST | /transform/stores/:name/schema |
Parameters
name
(string: <required>)
– Specifies the name of the store to create or update. This is part of the request URL.transformation_type
:(string: "tokenization")
- The transformation type. Currently only tokenization is supported.username
:(string: <required>)
- The username value to use when connecting to the database.password
:(string: <required>)
- The password value to use when connecting to the database.
Sample Payload
Sample Request
Read Store
This endpoint queries an existing store by the given name.
Method | Path |
---|---|
GET | /transform/stores/:name |
name
(string: <required>)
– Specifies the name of the role to read. This is part of the request URL.
Sample Request
Sample Response
List Stores
This endpoint lists all existing stores in the secrets engine.
Method | Path |
---|---|
LIST | /transform/stores |
Sample Request
Sample Response
Delete Store
This endpoint deletes an existing store configuration by the given name.
Method | Path |
---|---|
DELETE | /transform/stores/:name |
Parameters
name
(string: <required>)
– Specifies the name of the store to delete. This is part of the request URL.
Sample Request
Encode
This endpoint encodes the provided value using a named role.
Method | Path |
---|---|
POST | /transform/encode/:role_name |
Parameters
role_name
(string: <required>)
– Specifies the role name to use for this operation. This is specified as part of the URL.value
(string: <required>)
– Specifies the value to be encoded.transformation
(string)
– Specifies the transformation within the role that should be used for this encode operation. If a single transformation exists for role, this parameter may be skipped and will be inferred. If multiple transformations exist, one must be specified.ttl
`(duration "0") - Specifies the TTL of the resulting token. Only applicable for tokenization transformations.metadata
(string)
- For tokenization transforms, a list of key value pairs of the formkey1=value1,key2=value2,
... These optional metadata values will be stored with the value and can be retrieved with the metadata endpoint.tweak
(string)
– Specifies the base64 encoded tweak to use. Only applicable for FPE transformations withsupplied
as the tweak source. The tweak must be a 7-byte value that is then base64 encoded.batch_input
(array<object>: nil)
- Specifies a list of items to be encoded in a single batch. When this parameter is set, the 'value', 'transformation', 'ttl' and 'tweak' parameters are ignored. Instead, the aforementioned parameters should be provided within each object in the list.
NOTE: The response payload may return a tweak along with the encoded value
if the tweak_source
for the specified transformation is set to generated
.
The resource owner should properly store this tweak, which must be supplied back
when decrypting the encoded value.
Sample Payload
Sample Request
Sample Response
Sample Payload
Sample Request
Sample Response
Decode
This endpoint decodes the provided value using a named role.
Method | Path |
---|---|
POST | /transform/decode/:role_name |
Parameters
role_name
(string: <required>)
– Specifies the role name to use for this operation. This is specified as part of the URL.value
(string: <required>)
– Specifies the value to be decoded.transformation
(string)
– Specifies the transformation within the role that should be used for this decode operation. If a single transformation exists for role, this parameter may be skipped and will be inferred. If multiple transformations exist, one must be specified.tweak
(string)
– Specifies the base64 encoded tweak to use. Only applicable for FPE transformations withsupplied
orgenerated
as the tweak source. The tweak must be a 7-byte value that is then base64 encoded.batch_input
(array<object>: nil)
- Specifies a list of items to be decoded in a single batch. When this parameter is set, the 'value', 'transformation' and 'tweak' parameters are ignored. Instead, the aforementioned parameters should be provided within each object in the list.
Sample Payload
Sample Request
Sample Response
Sample Payload
Sample Request
Sample Response
Validate Token
This endpoint determines if a provided tokenized value is valid and unexpired. Only valid for tokenization transformations.
Method | Path |
---|---|
POST | /transform/validate/:role_name |
Parameters
role_name
(string: <required>)
– Specifies the role name to use for this operation. This is specified as part of the URL.value
(string: <required>)
– Specifies the token for which to check validity.transformation
(string)
– Specifies the transformation within the role that should be used for this decode operation. If a single transformation exists for role, this parameter may be skipped and will be inferred. If multiple transformations exist, one must be specified.batch_input
(array<object>: nil)
- Specifies a list of items to be decoded in a single batch. When this parameter is set, the 'value' parameter is ignored. Instead, the aforementioned parameters should be provided within each object in the list.
Sample Payload
Sample Request
Sample Response
Check Tokenization
This endpoint determines if a provided plaintext value has an valid, unexpired tokenized value. Note that this cannot return the token, just confirm that a tokenized value exists. This endpoint is only valid for tokenization transformations.
Method | Path |
---|---|
POST | /transform/tokenized/:role_name |
Parameters
role_name
(string: <required>)
– Specifies the role name to use for this operation. This is specified as part of the URL.value
(string: <required>)
– Specifies the token to test for whether it has a valid tokenization.transformation
(string)
– Specifies the transformation within the role that should be used for this decode operation. If a single transformation exists for role, this parameter may be skipped and will be inferred. If multiple transformations exist, one must be specified.batch_input
(array<object>: nil)
- Specifies a list of items to be decoded in a single batch. When this parameter is set, the 'value' parameter is ignored. Instead, the aforementioned parameters should be provided within each object in the list.
Sample Payload
Sample Request
Sample Response
Retrieve Token Metadata
This endpoint retrieves metadata for a tokenized value using a named role. Only valid for tokenization transformations.
Method | Path |
---|---|
POST | /transform/metadata/:role_name |
Parameters
role_name
(string: <required>)
– Specifies the role name to use for this operation. This is specified as part of the URL.value
(string: <required>)
– Specifies the token for which to retrieve metadata.transformation
(string)
– Specifies the transformation within the role that should be used for this decode operation. If a single transformation exists for role, this parameter may be skipped and will be inferred. If multiple transformations exist, one must be specified.batch_input
(array<object>: nil)
- Specifies a list of items to be decoded in a single batch. When this parameter is set, the 'value' parameter is ignored. Instead, the aforementioned parameters should be provided within each object in the list.
Sample Payload
Sample Request
Sample Response
Snapshot Tokenization State
This endpoint starts or continues retrieving a snapshot of the stored state of a tokenization transform. This state is protected as it is in the underlying store, and so is safe for storage or transport. Snapshots may be used for backup purposes or to migrate from one store to another. If more than one store is configured for a tokenization transform, the snapshot data contains the contents of the first store.
Since more values may exist than can be returned in a single call, if
a snapshot has more values, the response will contain the continuation
field, an opaque value that if provided on a subsequent call will resume
snapshotting at the next value. If absent, the end of the snapshot has
been reached.
Snapshots are guaranteed to contain the values present at the time of the first call to start the snapshot. Values tokenized after the snapshot began may or may not be included.
Method | Path |
---|---|
POST | /transform/transformations/tokenization/snapshot/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to snapshot.limit
(int: 1000)
- The maximum number of tokenized value states to return on this call.continuation
string: ""
- If absent or empty, a new snapshot is started. If present, the snapshot should continue at the next available value.
Sample Payload
Sample Request
Sample Response
Restore Tokenization State
This endpoint restores previously snapshotted tokenization state values to the underlying store(s) of a tokenization transform. Calls to this endpoint are idempotent, so multiple outputs from a snapshot run can be applied via restore in any order and duplicates will not cause a problem.
Values snapshotted from a default
mapping mode store cannot be restored
into an exportable
mode store and vice versa.
Method | Path |
---|---|
POST | /transform/transformations/tokenization/restore/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to restore.values
([]string: <required>)
- Any number of tokenization state values from a previous snapshot call.
Sample Payload
Sample Request
Export Decoded Tokenization State
This endpoint starts or continues retrieving an export of tokenization
state, including the tokens and their decoded values. This call is only
supported on tokenization stores configured with the exportable
mapping
mode. Refer to the Tokenization
documentation
for when to use the exportable
mapping mode.
Decoded values are in Base64 representation.
Since more values may exist than can be returned in a single call, if
an export has more values, the response will contain the continuation
field, an opaque value that if provided on a subsequent call will resume
snapshotting at the next value. If absent, the end of the export has
been reached.
Exports are guaranteed to contain the values present at the time of the first call to start the export. Values tokenized after the snapshot began may or may not be included.
Method | Path |
---|---|
POST | /transform/transformations/tokenization/export-decoded/:name |
Parameters
name
(string: <required>)
– Specifies the name of the transformation to export.limit
(int: 1000)
- The maximum number of tokenized value states to return on this call.continuation
string: ""
- If absent or empty, a new export is started. If present, the export should continue at the next available value.
Sample Payload
Sample Request
Sample Response
Rotate Tokenization Key
This endpoint rotates the version of the named key. After rotation, new requests will be encoded with the new version of the key.
Method | Path |
---|---|
POST | /transform/tokenization/keys/:transform_name/rotate |
Parameters
transform_name
(string: <required>)
– Specifies the transform name to use for this operation. This is specified as part of the URL.
Sample Request
Update Tokenization Key Config
This endpoint allows the minimum key version to be set for decode operations. Only valid for tokenization transformations.
Method | Path |
---|---|
POST | /transform/tokenization/keys/:transform_name/config |
Parameters
transform_name
(string: <required>)
– Specifies the transform name to use for this operation. This is specified as part of the URL.min_decryption_version
(int: <optional>)
– Specifies the minimum key version that vault can use to decode values for the corresponding transform.
Sample Payload
Sample Request
List Tokenization Key Configuration
List all tokenization keys. Only valid for tokenization transformations.
Method | Path |
---|---|
LIST | /transform/tokenization/keys/ |
Sample Request
Read Tokenization Key Configuration
Read tokenization key configuration for a particular transform. Only valid for tokenization transformations.
Method | Path |
---|---|
GET | /transform/tokenization/keys/:transform_name |
Parameters
transform_name
(string: <required>)
– Specifies the transform name to use for this operation. This is specified as part of the URL.
Sample Request
Sample Response
Trim Tokenization Key Version
This endpoint trims older key versions setting a minimum version for the keyring. Once trimmed, previous versions of the key cannot be recovered.
Method | Path |
---|---|
POST | /transform/tokenization/keys/:transform_name/trim |
Parameters
transform_name
(string: <required>)
– Specifies the transform name to use for this operation. This is specified as part of the URL.min_available_version
(int: <required>)
– Specifies minimum key version available for use for this transform. All versions below this will be permanently forgotten. Cannot be set belowmin_decryption_version
or abovelatest_version
.
Sample Payload
Sample Request