Introduction¶
aerospike
is a package which provides a Python client for
Aerospike database clusters. The Python client is a CPython module, built on
the Aerospike C client.
aerospike
- the module containing the Client, Query, and Scan Classes.- Scan Class — Scan is a class built to handle scan operations of entire sets.
- Query Class — Query is a class built to handle queries over secondary indexes.
aerospike.predicates
is a submodule containing predicate helpers for use with the Query class.aerospike.predexp
is a submodule containing predicate expression helpers for use with the Query class.aerospike.exception
is a submodule containing the exception hierarchy for AerospikeError and its subclasses.aerospike_helpers
is a helper package for bin operations (list, map, bitwise, etc.).- GeoJSON Class — GeoJSON is a class to handle GeoJSON type data.
- Data_Mapping — Python Data Mappings How Python types map to Aerospike Server types.
See also
The Python Client Manual for a quick guide.
Content¶
aerospike
— Aerospike Client for Python¶
The Aerospike client enables you to build an application in Python with an Aerospike cluster as its database. The client manages the connections to the cluster and handles the transactions performed against it.
Data Model
At the top is the namespace
, a container that has one set of policy rules
for all its data, and is similar to the database concept in an RDBMS, only
distributed across the cluster. A namespace is subdivided into sets
,
similar to tables.
Pairs of key-value data called bins
make up records
, similar to
columns of a row in a standard RDBMS. Aerospike is schema-less, meaning
that you do not need to define your bins in advance.
Records are uniquely identified by their key, and record metadata is contained in an in-memory primary index.
See also
Architecture Overview and Aerospike Data Model for more information about Aerospike.
Methods¶
-
aerospike.
client
(config)¶ Creates a new instance of the Client class. This client can
connect()
to the cluster and perform operations against it, such asput()
andget()
records.This is a wrapper function which calls the constructor for the
Client
class. The client may also be constructed by calling the constructor directly.Parameters: config (dict) – the client’s configuration.
- hosts a required
list
of (address, port, [tls-name]) tuples identifying a node (or multiple nodes) in the cluster. - The client will connect to the first available node in the list, the seed node, and will learn about the cluster and partition map from it. If tls-name is specified, it must match the tls-name specified in the node’s server configuration file and match the server’s CA certificate.
Note
TLS usage requires Aerospike Enterprise Edition
- hosts a required
- lua an optional
dict
containing the paths to two types of Lua modules - system_path
- The location of the system modules such as
aerospike.lua
Default:/usr/local/aerospike/lua
- user_path
- The location of the user’s record and stream UDFs .Default:
./
- lua an optional
- policies a
dict
of policies - read (
dict
) - A dictionary containing Read Policies.
- read (
- write (
dict
) - A dictionary containing Write Policies.
- write (
- apply (
dict
) - A dictionary containing Apply Policies.
- apply (
- operate (
dict
) - A dictionary containing Operate Policies.
- operate (
- remove (
dict
) - A dictionary containing Remove Policies.
- remove (
- query (
dict
) - A dictionary containing Query Policies.
- query (
- scan (
dict
) - A dictionary containing Scan Policies.
- scan (
- batch (
dict
) - A dictionary containing Batch Policies.
- batch (
- total_timeout default connection timeout in milliseconds
- Deprecated: set this individually in the Policies dictionaries.
- auth_mode
- A value of Auth Mode Constants defining how the authentication mode with the server, such as
aerospike.AUTH_INTERNAL
.Default:aerospike.AUTH_INTERNAL
- login_timeout_ms (
int
) - Representing the node login timeout in milliseconds.Default:
5000
.
- login_timeout_ms (
- key default key policy
- Deprecated: set this individually in the Policies dictionaries.
- exists default exists policy
- Deprecated: set in the Write Policies dictionary
- max_retries representing the number of times to retry a transaction
- Deprecated: set this individually in the Policies dictionaries.
- replica default replica policy
- Deprecated: set this in one or all of the other policies’ Read Policies, Write Policies, Apply Policies, Operate Policies, Remove Policies dictionaries.
- commit_level default commit level policy
- Deprecated: set this as needed individually in the Write Policies, Apply Policies, Operate Policies, Remove Policies dictionaries.
- policies a
- shm a
dict
with optional shared-memory cluster tending parameters - Shared-memory cluster tending is on if the
dict
is provided. If multiple clients are instantiated talking to the same cluster the shm cluster-tending should be used.- max_nodes (
int
) - Maximum number of nodes allowed. Pad so new nodes can be added without configuration changesDefault:
16
- max_nodes (
- max_namespaces (
int
) - Similarly padDefault:
8
- max_namespaces (
- takeover_threshold_sec (
int
) - Take over tending if the cluster hasn’t been checked for this many secondsDefault:
30
- takeover_threshold_sec (
- shm_key
- Explicitly set the shm key for this client.If use_shared_connection is not set, or set to
False
, the user must provide a value for this field in order for shared memory to work correctly.If , and only if, use_shared_connection is set toTrue
, the key will be implicitly evaluated per unique hostname, and can be inspected withshm_key()
.It is still possible to specify a key when using use_shared_connection = True.default:0xA8000000
- shm a
- use_shared_connection (
bool
) - Indicating whether this instance should share its connection to the Aerospike cluster with other client instances in the same process.Default:
False
- use_shared_connection (
- tls a
dict
of optional TLS configuration parameters.Note
TLS usage requires Aerospike Enterprise Edition
- enable (
bool
) - Indicating whether tls should be enabled or not.Default:
False
- enable (
- cafile (
str
) - Path to a trusted CA certificate file. By default TLS will use system standard trusted CA certificates
- cafile (
- capath (
str
) - Path to a directory of trusted certificates. See the OpenSSL SSL_CTX_load_verify_locations manual page for more information about the format of the directory.
- capath (
- protocols (
str
) - Specifies enabled protocols. This format is the same as Apache’s SSLProtocol documented at https://httpd.apache.org/docs/current/mod/mod_ssl.html#sslprotocol .If not specified the client will use “-all +TLSv1.2”.
- protocols (
- cipher_suite (
str
) - Specifies enabled cipher suites. The format is the same as OpenSSL’s Cipher List Format documented at https://www.openssl.org/docs/manmaster/apps/ciphers.html .If not specified the OpenSSL default cipher suite described in the ciphers documentation will be used. If you are not sure what cipher suite to select this option is best left unspecified
- cipher_suite (
- keyfile (
str
) - Path to the client’s key for mutual authentication. By default mutual authentication is disabled.
- keyfile (
- keyfile_pw (
str
) - Decryption password for the client’s key for mutual authentication. By default the key is assumed not to be encrypted.
- keyfile_pw (
- cert_blacklist (
str
) - Path to a certificate blacklist file. The file should contain one line for each blacklisted certificate. Each line starts with the certificate serial number expressed in hex. Each entry may optionally specify the issuer name of the certificate (serial numbers are only required to be unique per issuer). Example records: 867EC87482B2 /C=US/ST=CA/O=Acme/OU=Engineering/CN=Test Chain CA E2D4B0E570F9EF8E885C065899886461
- cert_blacklist (
- certfile (
str
) - Path to the client’s certificate chain file for mutual authentication. By default mutual authentication is disabled.
- certfile (
- crl_check (
bool
) - Enable CRL checking for the certificate chain leaf certificate. An error occurs if a suitable CRL cannot be found. By default CRL checking is disabled.
- crl_check (
- crl_check_all (
bool
) - Enable CRL checking for the entire certificate chain. An error occurs if a suitable CRL cannot be found. By default CRL checking is disabled.
- crl_check_all (
- log_session_info (
bool
) - Log session information for each connection.
- log_session_info (
- for_login_only (
bool
) - Log session information for each connection. Use TLS connections only for login authentication. All other communication with the server will be done with non-TLS connections.Default:
False
(Use TLS connections for all communication with server.)
- for_login_only (
- serialization an optional instance-level
tuple()
of (serializer, deserializer). - Takes precedence over a class serializer registered with
set_serializer()
.
- serialization an optional instance-level
- thread_pool_size (
int
) - Number of threads in the pool that is used in batch/scan/query commands.Default:
16
- thread_pool_size (
- max_socket_idle (
int
) - Maximum socket idle time in seconds. Connection pools will discard sockets that have been idle longer than the maximum. The value is limited to 24 hours (86400). It’s important to set this value to a few seconds less than the server’s proto-fd-idle-ms (default 60000 milliseconds, or 1 minute), so the client does not attempt to use a socket that has already been reaped by the server.Default:
0
seconds (disabled) for non-TLS connections, 55 seconds for TLS connections
- max_socket_idle (
- max_conns_per_node (
int
) - Maximum number of pipeline connections allowed for each node
- max_conns_per_node (
- tend_interval (
int
) - Polling interval in milliseconds for tending the clusterDefault:
1000
- tend_interval (
- compression_threshold (
int
) - Compress data for transmission if the object size is greater than a given number of bytesDefault:
0
, meaning ‘never compress’Deprecated, set this in the ‘write’ policy dictionary.
- compression_threshold (
- cluster_name (
str
) - Only server nodes matching this name will be used when determining the cluster name.
- cluster_name (
- rack_id (
int
) - Rack id where this client instance resides.In order to enable this functionality, the rack_aware needs to be set to true, the Read Policies replica needs to be set to
POLICY_REPLICA_PREFER_RACK
. The server rack configuration must also be configured.Default:0
- rack_id (
- rack_aware (
bool
) - Track server rack data. This is useful when directing read operations to run on the same rack as the client.This is useful to lower cloud provider costs when nodes are distributed across different availability zones (represented as racks).In order to enable this functionality, the rack_id needs to be set to local rack, the read policy replica needs to be set to
POLICY_REPLICA_PREFER_RACK
. The server rack configuration must also be configured.Default:False
- rack_aware (
- use_services_alternate (
bool
) - Flag to signify if “services-alternate” should be used instead of “services”Default:
False
- use_services_alternate (
- connect_timeout (
int
) - Initial host connection timeout in milliseconds. The timeout when opening a connection to the server host for the first time.Default:
1000
.
- connect_timeout (
Returns: an instance of the aerospike.Client
class.See also
import aerospike # configure the client to first connect to a cluster node at 127.0.0.1 # the client will learn about the other nodes in the cluster from the # seed node. # in this configuration shared-memory cluster tending is turned on, # which is appropriate for a multi-process context, such as a webserver config = { 'hosts': [ ('127.0.0.1', 3000) ], 'policies': {'read': {total_timeout': 1000}}, 'shm': { }} client = aerospike.client(config)
Changed in version 2.0.0.
import aerospike import sys # NOTE: Use of TLS Requires Aerospike Enterprise Server Version >= 3.11 and Python Client version 2.1.0 or greater # To view Instructions for server configuration for TLS see https://www.aerospike.com/docs/guide/security/tls.html tls_name = "some-server-tls-name" tls_ip = "127.0.0.1" tls_port = 4333 # If tls-name is specified, it must match the tls-name specified in the node’s server configuration file # and match the server’s CA certificate. tls_host_tuple = (tls_ip, tls_port, tls_name) hosts = [tls_host_tuple] # Example configuration which will use TLS with the specifed cafile tls_config = { "cafile": "/path/to/cacert.pem", "enable": True } client = aerospike.client({ "hosts": hosts, "tls": tls_config }) try: client.connect() except Exception as e: print(e) print("Failed to connect") sys.exit() key = ('test', 'demo', 1) client.put(key, {'aerospike': 'aerospike'}) print(client.get(key))
-
aerospike.
null
()¶ A type for distinguishing a server-side null from a Python
None
. Replaces the constantaerospike.null
.Returns: a type representing the server-side type as_null
.New in version 2.0.1.
-
aerospike.
CDTWildcard
()¶ A type representing a wildcard object. This type may only be used as a comparison value in operations. It may not be stored in the database.
Returns: a type representing a wildcard value. import aerospike from aerospike_helpers.operations import list_operations as list_ops client = aerospike.client({'hosts': [('localhost', 3000)]}).connect() key = 'test', 'demo', 1 # get all values of the form [1, ...] from a list of lists. # For example if list is [[1, 2, 3], [2, 3, 4], [1, 'a']], this operation will match # [1, 2, 3] and [1, 'a'] operations = [list_ops.list_get_by_value('list_bin', [1, aerospike.CDTWildcard()], aerospike.LIST_RETURN_VALUE)] _, _, bins = client.operate(key, operations)
New in version 3.5.0.
Note
This requires Aerospike Server 4.3.1.3 or greater
-
aerospike.
CDTInfinite
()¶ A type representing an infinte value. This type may only be used as a comparison value in operations. It may not be stored in the database.
Returns: a type representing an infinite value. import aerospike from aerospike_helpers.operations import list_operations as list_ops client = aerospike.client({'hosts': [('localhost', 3000)]}).connect() key = 'test', 'demo', 1 # get all values of the form [1, ...] from a list of lists. # For example if list is [[1, 2, 3], [2, 3, 4], [1, 'a']], this operation will match # [1, 2, 3] and [1, 'a'] operations = [list_ops.list_get_by_value_range('list_bin', aerospike.LIST_RETURN_VALUE, [1], [1, aerospike.CDTInfinite()])] _, _, bins = client.operate(key, operations)
New in version 3.5.0.
Note
This requires Aerospike Server 4.3.1.3 or greater
-
aerospike.
calc_digest
(ns, set, key) → bytearray¶ Calculate the digest of a particular key. See: Key Tuple.
Parameters: Returns: a RIPEMD-160 digest of the input tuple.
Return type: import aerospike import pprint digest = aerospike.calc_digest("test", "demo", 1 ) pp.pprint(digest)
Serialization
Note
By default, the aerospike.Client
maps the supported types int
, str
, float
, bytearray
, list
, dict
to matching aerospike server types (int, string, double, bytes, list, map). When an unsupported type is encountered, the module uses cPickle to serialize and deserialize the data, storing it into as_bytes of type ‘Python’ (AS_BYTES_PYTHON).
The functions set_serializer()
and set_deserializer()
allow for user-defined functions to handle serialization, instead. The serialized data is stored as ‘Generic’ as_bytes of type (AS_BYTES_BLOB). The serialization config param of aerospike.client()
registers an instance-level pair of functions that handle serialization.
-
aerospike.
set_serializer
(callback)¶ Register a user-defined serializer available to all
aerospike.Client
instances.Parameters: callback (callable) – the function to invoke for serialization. See also
To use this function with
put()
the argument to serializer should beaerospike.SERIALIZER_USER
.import aerospike import json def my_serializer(val): return json.dumps(val) aerospike.set_serializer(my_serializer)
New in version 1.0.39.
-
aerospike.
set_deserializer
(callback)¶ Register a user-defined deserializer available to all
aerospike.Client
instances. Once registered, all read methods (such asget()
) will run bins containing ‘Generic’ as_bytes of type (AS_BYTES_BLOB) through this deserializer.Parameters: callback (callable) – the function to invoke for deserialization.
-
aerospike.
unset_serializers
()¶ Deregister the user-defined de/serializer available from
aerospike.Client
instances.New in version 1.0.53.
Note
Serialization Examples
The following example shows the three modes of serialization - built-in, class-level user functions, instance-level user functions:
from __future__ import print_function
import aerospike
import marshal
import json
def go_marshal(val):
return marshal.dumps(val)
def demarshal(val):
return marshal.loads(val)
def jsonize(val):
return json.dumps(val)
def dejsonize(val):
return json.loads(val)
aerospike.set_serializer(go_marshal)
aerospike.set_deserializer(demarshal)
config = {'hosts':[('127.0.0.1', 3000)]}
client = aerospike.client(config).connect()
config['serialization'] = (jsonize,dejsonize)
client2 = aerospike.client(config).connect()
for i in xrange(1, 4):
try:
client.remove(('test', 'demo', 'foo' + i))
except:
pass
bin_ = {'t': (1, 2, 3)} # tuple is an unsupported type
print("Use the built-in serialization (cPickle)")
client.put(('test','demo','foo1'), bin_)
(key, meta, bins) = client.get(('test','demo','foo1'))
print(bins)
print("Use the class-level user-defined serialization (marshal)")
client.put(('test','demo','foo2'), bin_, serializer=aerospike.SERIALIZER_USER)
(key, meta, bins) = client.get(('test','demo','foo2'))
print(bins)
print("Use the instance-level user-defined serialization (json)")
client2.put(('test','demo','foo3'), bin_, serializer=aerospike.SERIALIZER_USER)
# notice that json-encoding a tuple produces a list
(key, meta, bins) = client2.get(('test','demo','foo3'))
print(bins)
client.close()
The expected output is:
Use the built-in serialization (cPickle)
{'i': 321, 't': (1, 2, 3)}
Use the class-level user-defined serialization (marshal)
{'i': 321, 't': (1, 2, 3)}
Use the instance-level user-defined serialization (json)
{'i': 321, 't': [1, 2, 3]}
While AQL shows the records as having the following structure:
aql> select i,t from test.demo where PK='foo1'
+-----+----------------------------------------------+
| i | t |
+-----+----------------------------------------------+
| 321 | 28 49 31 0A 49 32 0A 49 33 0A 74 70 31 0A 2E |
+-----+----------------------------------------------+
1 row in set (0.000 secs)
aql> select i,t from test.demo where PK='foo2'
+-----+-------------------------------------------------------------+
| i | t |
+-----+-------------------------------------------------------------+
| 321 | 28 03 00 00 00 69 01 00 00 00 69 02 00 00 00 69 03 00 00 00 |
+-----+-------------------------------------------------------------+
1 row in set (0.000 secs)
aql> select i,t from test.demo where PK='foo3'
+-----+----------------------------+
| i | t |
+-----+----------------------------+
| 321 | 5B 31 2C 20 32 2C 20 33 5D |
+-----+----------------------------+
1 row in set (0.000 secs)
Logging
-
aerospike.
set_log_handler
(callback)¶ Set a user-defined function as the log handler for all aerospike objects. The callback is invoked whenever a log event passing the logging level threshold is encountered.
Parameters: callback (callable) – the function used as the logging handler. Note
The callback function must have the five parameters (level, func, path, line, msg)
from __future__ import print_function import aerospike def as_logger(level, func, path, line, msg): def as_logger(level, func, myfile, line, msg): print("**", myfile, line, func, ':: ', msg, "**") aerospike.set_log_level(aerospike.LOG_LEVEL_DEBUG) aerospike.set_log_handler(as_logger)
-
aerospike.
set_log_level
(log_level)¶ Declare the logging level threshold for the log handler.
Parameters: log_level (int) – one of the Log Level constant values.
Geospatial
-
aerospike.
geodata
([geo_data])¶ Helper for creating an instance of the
GeoJSON
class. Used to wrap a geospatial object, such as a point, polygon or circle.Parameters: geo_data (dict) – a dict
representing the geospatial data.Returns: an instance of the aerospike.GeoJSON
class.import aerospike # Create GeoJSON point using WGS84 coordinates. latitude = 45.920278 longitude = 63.342222 loc = aerospike.geodata({'type': 'Point', 'coordinates': [longitude, latitude]})
New in version 1.0.54.
-
aerospike.
geojson
([geojson_str])¶ Helper for creating an instance of the
GeoJSON
class from a raw GeoJSONstr
.Parameters: geojson_str (dict) – a str
of raw GeoJSON.Returns: an instance of the aerospike.GeoJSON
class.import aerospike # Create GeoJSON point using WGS84 coordinates. loc = aerospike.geojson('{"type": "Point", "coordinates": [-80.604333, 28.608389]}')
New in version 1.0.54.
Operators¶
Operators for the multi-ops method operate()
.
Note
Starting version 3.4.0, it is highly recommended to use the aerospike_helpers.operations package to create the arguments for operate()
and operate_ordered()
-
aerospike.
OPERATOR_WRITE
¶ Write a value into a bin
{ "op" : aerospike.OPERATOR_WRITE, "bin": "name", "val": "Peanut" }
-
aerospike.
OPERATOR_APPEND
¶ Append to a bin with
str
type data{ "op" : aerospike.OPERATOR_APPEND, "bin": "name", "val": "Mr. " }
-
aerospike.
OPERATOR_PREPEND
¶ Prepend to a bin with
str
type data{ "op" : aerospike.OPERATOR_PREPEND, "bin": "name", "val": " Esq." }
-
aerospike.
OPERATOR_INCR
¶ Increment a bin with
int
orfloat
type data{ "op" : aerospike.OPERATOR_INCR, "bin": "age", "val": 1 }
-
aerospike.
OPERATOR_READ
¶ Read a specific bin
{ "op" : aerospike.OPERATOR_READ, "bin": "name" }
-
aerospike.
OPERATOR_TOUCH
¶ Touch a record, setting its TTL. May be combined with
OPERATOR_READ
{ "op" : aerospike.OPERATOR_TOUCH }
-
aerospike.
OP_LIST_APPEND
¶ Append an element to a bin with
list
type data{ "op" : aerospike.OP_LIST_APPEND, "bin": "events", "val": 1234, "list_policy": {"write_flags": aerospike.LIST_WRITE_ADD_UNIQUE} # Optional, new in client 3.4.0 }
Changed in version 3.4.0.
-
aerospike.
OP_LIST_APPEND_ITEMS
¶ Extend a bin with
list
type data with a list of items{ "op" : aerospike.OP_LIST_APPEND_ITEMS, "bin": "events", "val": [ 123, 456 ], "list_policy": {"write_flags": aerospike.LIST_WRITE_ADD_UNIQUE} # Optional, new in client 3.4.0 }
Changed in version 3.4.0.
-
aerospike.
OP_LIST_INSERT
¶ Insert an element at a specified index of a bin with
list
type data{ "op" : aerospike.OP_LIST_INSERT, "bin": "events", "index": 2, "val": 1234, "list_policy": {"write_flags": aerospike.LIST_WRITE_ADD_UNIQUE} # Optional, new in client 3.4.0 }
Changed in version 3.4.0.
-
aerospike.
OP_LIST_INSERT_ITEMS
¶ Insert the items at a specified index of a bin with
list
type data{ "op" : aerospike.OP_LIST_INSERT_ITEMS, "bin": "events", "index": 2, "val": [ 123, 456 ] "list_policy": {"write_flags": aerospike.LIST_WRITE_ADD_UNIQUE} # Optional, new in client 3.4.0 }
Changed in version 3.4.0.
-
aerospike.
OP_LIST_INCREMENT
¶ Increment the value of an item at the given index in a list stored in the specified bin
{ "op": aerospike.OP_LIST_INCREMENT, "bin": "bin_name", "index": 2, "val": 5, "list_policy": {"write_flags": aerospike.LIST_WRITE_ADD_UNIQUE} # Optional, new in client 3.4.0 }
Changed in version 3.4.0.
-
aerospike.
OP_LIST_POP
¶ Remove and return the element at a specified index of a bin with
list
type data{ "op" : aerospike.OP_LIST_POP, # removes and returns a value "bin": "events", "index": 2 }
-
aerospike.
OP_LIST_POP_RANGE
¶ Remove and return a list of elements at a specified index range of a bin with
list
type data{ "op" : aerospike.OP_LIST_POP_RANGE, "bin": "events", "index": 2, "val": 3 # remove and return 3 elements starting at index 2 }
-
aerospike.
OP_LIST_REMOVE
¶ Remove the element at a specified index of a bin with
list
type data{ "op" : aerospike.OP_LIST_REMOVE, # remove a value "bin": "events", "index": 2 }
-
aerospike.
OP_LIST_REMOVE_RANGE
¶ Remove a list of elements at a specified index range of a bin with
list
type data{ "op" : aerospike.OP_LIST_REMOVE_RANGE, "bin": "events", "index": 2, "val": 3 # remove 3 elements starting at index 2 }
-
aerospike.
OP_LIST_CLEAR
¶ Remove all the elements in a bin with
list
type data{ "op" : aerospike.OP_LIST_CLEAR, "bin": "events" }
-
aerospike.
OP_LIST_SET
¶ Set the element val in a specified index of a bin with
list
type data{ "op" : aerospike.OP_LIST_SET, "bin": "events", "index": 2, "val": "latest event at index 2" # set this value at index 2, "list_policy": {"write_flags": aerospike.LIST_WRITE_ADD_UNIQUE} # Optional, new in client 3.4.0 }
Changed in version 3.4.0.
-
aerospike.
OP_LIST_GET
¶ Get the element at a specified index of a bin with
list
type data{ "op" : aerospike.OP_LIST_GET, "bin": "events", "index": 2 }
-
aerospike.
OP_LIST_GET_RANGE
¶ Get the list of elements starting at a specified index of a bin with
list
type data{ "op" : aerospike.OP_LIST_GET_RANGE, "bin": "events", "index": 2, "val": 3 # get 3 elements starting at index 2 }
-
aerospike.
OP_LIST_TRIM
¶ Remove elements from a bin with
list
type data which are not within the range starting at a given index plus val{ "op" : aerospike.OP_LIST_TRIM, "bin": "events", "index": 2, "val": 3 # remove all elements not in the range between index 2 and index 2 + 3 }
-
aerospike.
OP_LIST_SIZE
¶ Count the number of elements in a bin with
list
type data{ "op" : aerospike.OP_LIST_SIZE, "bin": "events" # gets the size of a list contained in the bin }
-
aerospike.
OP_LIST_GET_BY_INDEX
¶ Get the item at the specified index from a list bin. Server selects list item identified by index and returns selected data specified by
return_type
.{ "op" : aerospike.OP_LIST_GET_BY_INDEX, "bin": "events", "index": 2, # Index of the item to fetch "return_type": aerospike.LIST_RETURN_VALUE }
New in version 3.4.0.
-
aerospike.
OP_LIST_GET_BY_INDEX_RANGE
¶ Server selects
count
list items starting at specified index and returns selected data specified by return_type. ifcount
is omitted, the server returns all items fromindex
to the end of list.If
inverted
is set toTrue
, return all items outside of the specified range.{ "op" : aerospike.OP_LIST_GET_BY_INDEX_RANGE, "bin": "events", "index": 2, # Beginning index of range, "count": 2, # Optional Count. "return_type": aerospike.LIST_RETURN_VALUE, "inverted": False # Optional. }
New in version 3.4.0.
-
aerospike.
OP_LIST_GET_BY_RANK
¶ Server selects list item identified by
rank
and returns selected data specified by return_type.{ "op" : aerospike.OP_LIST_GET_BY_RANK, "bin": "events", "rank": 2, # Rank of the item to fetch "return_type": aerospike.LIST_RETURN_VALUE }
New in version 3.4.0.
-
aerospike.
OP_LIST_GET_BY_RANK_RANGE
¶ Server selects
count
list items starting at specified rank and returns selected data specified by return_type. Ifcount
is not specified, the server returns items starting at the specified rank to the last ranked item.If
inverted
is set toTrue
, return all items outside of the specified range.{ "op" : aerospike.OP_LIST_GET_BY_RANK_RANGE, "bin": "events", "rank": 2, # Rank of the item to fetch "count": 3, "return_type": aerospike.LIST_RETURN_VALUE, "inverted": False # Optional, defaults to False }
New in version 3.4.0.
-
aerospike.
OP_LIST_GET_BY_VALUE
¶ Server selects list items identified by
val
and returns selected data specified by return_type.{ "op" : aerospike.OP_LIST_GET_BY_VALUE, "bin": "events", "val": 5, "return_type": aerospike.LIST_RETURN_COUNT }
New in version 3.4.0.
-
aerospike.
OP_LIST_GET_BY_VALUE_LIST
¶ Server selects list items contained in by
value_list
and returns selected data specified by return_type.If
inverted
is set toTrue
, returns items not included invalue_list
{ "op" : aerospike.OP_LIST_GET_BY_VALUE_LIST, "bin": "events", "value_list": [5, 6, 7], "return_type": aerospike.LIST_RETURN_COUNT, "inverted": False # Optional, defaults to False }
New in version 3.4.0.
-
aerospike.
OP_LIST_GET_BY_VALUE_RANGE
¶ Create list get by value range operation. Server selects list items identified by value range (begin inclusive, end exclusive). If
value_begin
is not present the range is less thanvalue_end
. Ifvalue_end
is not specified, the range is greater than or equal tovalue_begin
.If
inverted
is set toTrue
, returns items not included in the specified range.{ "op" : aerospike.OP_LIST_GET_BY_VALUE_RANGE, "bin": "events", "value_begin": 3, # Optional "value_end": 6, Optional "return_type": aerospike.LIST_RETURN_VALUE, "inverted": False # Optional, defaults to False }
New in version 3.4.0.
-
aerospike.
OP_LIST_REMOVE_BY_INDEX
¶ Remove and return the item at the specified index from a list bin. Server selects list item identified by index and returns selected data specified by
return_type
.{ "op" : aerospike.OP_LIST_REMOVE_BY_INDEX, "bin": "events", "index": 2, # Index of the item to fetch "return_type": aerospike.LIST_RETURN_VALUE }
New in version 3.4.0.
-
aerospike.
OP_LIST_REMOVE_BY_INDEX_RANGE
¶ Server remove
count
list items starting at specified index and returns selected data specified by return_type. ifcount
is omitted, the server removes and returns all items fromindex
to the end of list.If
inverted
is set toTrue
, remove and return all items outside of the specified range.{ "op" : aerospike.OP_LIST_REMOVE_BY_INDEX_RANGE, "bin": "events", "index": 2, # Beginning index of range, "count": 2, # Optional Count. "return_type": aerospike.LIST_RETURN_VALUE, "inverted": False # Optional. }
New in version 3.4.0.
-
aerospike.
OP_LIST_REMOVE_BY_RANK
¶ Server removes and returns list item identified by
rank
and returns selected data specified by return_type.{ "op" : aerospike.OP_LIST_REMOVE_BY_RANK, "bin": "events", "rank": 2, # Rank of the item to fetch "return_type": aerospike.LIST_RETURN_VALUE }
New in version 3.4.0.
-
aerospike.
OP_LIST_REMOVE_BY_RANK_RANGE
¶ Server removes and returns
count
list items starting at specified rank and returns selected data specified by return_type. Ifcount
is not specified, the server removes and returns items starting at the specified rank to the last ranked item.If
inverted
is set toTrue
, removes return all items outside of the specified range.{ "op" : aerospike.OP_LIST_REMOVE_BY_RANK_RANGE, "bin": "events", "rank": 2, # Rank of the item to fetch "count": 3, "return_type": aerospike.LIST_RETURN_VALUE, "inverted": False # Optional, defaults to False }
New in version 3.4.0.
-
aerospike.
OP_LIST_REMOVE_BY_VALUE
¶ Server removes and returns list items identified by
val
and returns selected data specified by return_type.If
inverted
is set toTrue
, removes and returns list items with a value not equal toval
.{ "op" : aerospike.OP_LIST_REMOVE_BY_VALUE, "bin": "events", "val": 5, "return_type": aerospike.LIST_RETURN_COUNT, "inverted", # Optional, defaults to False }
New in version 3.4.0.
-
aerospike.
OP_LIST_REMOVE_BY_VALUE_LIST
¶ Server removes and returns list items contained in by
value_list
and returns selected data specified by return_type.If
inverted
is set toTrue
, removes and returns items not included invalue_list
{ "op" : aerospike.OP_LIST_REMOVE_BY_VALUE_LIST, "bin": "events", "value_list": [5, 6, 7], "return_type": aerospike.LIST_RETURN_COUNT, "inverted": False # Optional, defaults to False }
New in version 3.4.0.
-
aerospike.
OP_LIST_REMOVE_BY_VALUE_RANGE
¶ Create list remove by value range operation. Server removes and returns list items identified by value range (begin inclusive, end exclusive). If
value_begin
is not present the range is less thanvalue_end
. Ifvalue_end
is not specified, the range is greater than or equal tovalue_begin
.If
inverted
is set toTrue
, removes and returns items not included in the specified range.{ "op" : aerospike.OP_LIST_REMOVE_BY_VALUE_RANGE, "bin": "events", "value_begin": 3, # Optional "value_end": 6, Optional "return_type": aerospike.LIST_RETURN_VALUE, "inverted": False # Optional, defaults to False }
New in version 3.4.0.
-
aerospike.
OP_LIST_SET_ORDER
¶ Assign an ordering to the specified list bin.
list_order
should be one ofaerospike.LIST_ORDERED
,aerospike.LIST_UNORDERED
.{ "op": aerospike.OP_LIST_SET_ORDER, "list_order": aerospike.LIST_ORDERED, "bin": "events" }
New in version 3.4.0.
-
aerospike.
OP_LIST_SORT
¶ Perform a sort operation on the bin.
sort_flags
, if provided, can be one of:aerospike.LIST_SORT_DROP_DUPLICATES
indicating that duplicate elements should be removed from the sorted list.{ 'op': aerospike.OP_LIST_SORT, 'sort_flags': aerospike.LIST_SORT_DROP_DUPLICATES, # Optional flags or'd together specifying behavior 'bin': self.test_bin }
New in version 3.4.0.
-
aerospike.
OP_MAP_SET_POLICY
¶ Set the policy for a map bin. The policy controls the write mode and the ordering of the map entries.
{ "op" : aerospike.OP_MAP_SET_POLICY, "bin": "scores", "map_policy": {"map_write_mode": Aeorspike.MAP_UPDATE, "map_order": Aerospike.MAP_KEY_VALUE_ORDERED} }
-
aerospike.
OP_MAP_PUT
¶ Put a key/value pair into a map. Operator accepts an optional map_policy dictionary (see OP_MAP_SET_POLICY for an example).
{ "op" : aerospike.OP_MAP_PUT, "bin": "my_map", "key": "age", "val": 97 }
-
aerospike.
OP_MAP_PUT_ITEM
¶ Put a dictionary of key/value pairs into a map. Operator accepts an optional map_policy dictionary (see OP_MAP_SET_POLICY for an example).
{ "op" : aerospike.OP_MAP_PUT_ITEMS, "bin": "my_map", "val": {"name": "bubba", "occupation": "dancer"} }
-
aerospike.
OP_MAP_INCREMENT
¶ Increment the value of map entry by the given “val” argument. Operator accepts an optional map_policy dictionary (see OP_MAP_SET_POLICY for an example).
{ "op" : aerospike.OP_MAP_INCREMENT, "bin": "my_map", "key": "age", "val": 1 }
-
aerospike.
OP_MAP_DECREMENT
¶ Decrement the value of map entry by the given “val” argument. Operator accepts an optional map_policy dictionary (see OP_MAP_SET_POLICY for an example).
{ "op" : aerospike.OP_MAP_DECREMENT, "bin": "my_map", "key": "age", "val": 1 }
-
aerospike.
OP_MAP_SIZE
¶ Return the number of entries in the given map bin.
{ "op" : aerospike.OP_MAP_SIZE, "bin": "my_map" }
-
aerospike.
OP_MAP_CLEAR
¶ Remove all entries from the given map bin.
{ "op" : aerospike.OP_MAP_CLEAR, "bin": "my_map" }
Note that if “return_type” is not specified in the parameters for a map operation, the default is aerospike.MAP_RETURN_NONE
-
aerospike.
OP_MAP_REMOVE_BY_KEY
¶ Remove the first entry from the map bin that matches the given key.
{ "op" : aerospike.OP_MAP_REMOVE_BY_KEY, "bin": "my_map", "key": "age", "return_type": aerospike.MAP_RETURN_VALUE }
-
aerospike.
OP_MAP_REMOVE_BY_KEY_LIST
¶ Remove the entries from the map bin that match the list of given keys. If
inverted
is set toTrue
, remove all items except those in the list of keys.{ "op" : aerospike.OP_MAP_REMOVE_BY_KEY_LIST, "bin": "my_map", "val": ["name", "rank", "serial"], "inverted": False #Optional }
-
aerospike.
OP_MAP_REMOVE_BY_KEY_RANGE
¶ Remove the entries from the map bin that have keys which fall between the given “key” (inclusive) and “val” (exclusive). If
inverted
is set toTrue
, remove all items outside of the specified range.{ "op" : aerospike.OP_MAP_REMOVE_BY_KEY_RANGE, "bin": "my_map", "key": "i", "val": "j", "return_type": aerospike.MAP_RETURN_KEY_VALUE, "inverted": False # Optional }
-
aerospike.
OP_MAP_REMOVE_BY_VALUE
¶ Remove the entry or entries from the map bin that have values which match the given “val” parameter. If
inverted
is set toTrue
, remove all items with a value other thanval
{ "op" : aerospike.OP_MAP_REMOVE_BY_VALUE, "bin": "my_map", "val": 97, "return_type": aerospike.MAP_RETURN_KEY "inverted": False #optional }
-
aerospike.
OP_MAP_REMOVE_BY_VALUE_LIST
¶ Remove the entries from the map bin that have values which match the list of values given in the “val” parameter. If
inverted
is set toTrue
, remove all items with values not contained in the list of values.{ "op" : aerospike.OP_MAP_REMOVE_BY_VALUE_LIST, "bin": "my_map", "val": [97, 98, 99], "return_type": aerospike.MAP_RETURN_KEY, "inverted": False # Optional }
-
aerospike.
OP_MAP_REMOVE_BY_VALUE_RANGE
¶ Remove the entries from the map bin that have values starting with the given “val” parameter (inclusive) up to the given “range” parameter (exclusive). If
inverted
is set toTrue
, remove all items outside of the specified range.{ "op" : aerospike.OP_MAP_REMOVE_BY_VALUE_RANGE, "bin": "my_map", "val": 97, "range": 100, "return_type": aerospike.MAP_RETURN_KEY, "inverted": False # Optional }
-
aerospike.
OP_MAP_REMOVE_BY_INDEX
¶ Remove the entry from the map bin at the given “index” location.
{ "op" : aerospike.OP_MAP_REMOVE_BY_INDEX, "bin": "my_map", "index": 0, "return_type": aerospike.MAP_RETURN_KEY_VALUE }
-
aerospike.
OP_MAP_REMOVE_BY_INDEX_RANGE
¶ Remove the entries from the map bin starting at the given “index” location and removing “range” items. If
inverted
is set toTrue
, remove all items outside of the specified range.{ "op" : aerospike.OP_MAP_REMOVE_BY_INDEX_RANGE, "bin": "my_map", "index": 0, "val": 2, "return_type": aerospike.MAP_RETURN_KEY_VALUE, "inverted": False # Optional }
-
aerospike.
OP_MAP_REMOVE_BY_RANK
¶ Remove the first entry from the map bin that has a value with a rank matching the given “index”.
{ "op" : aerospike.OP_MAP_REMOVE_BY_RANK, "bin": "my_map", "index": 10 }
-
aerospike.
OP_MAP_REMOVE_BY_RANK_RANGE
¶ Remove the entries from the map bin that have values with a rank starting at the given “index” and removing “range” items. If
inverted
is set toTrue
, remove all items outside of the specified range.{ "op" : aerospike.OP_MAP_REMOVE_BY_RANK_RANGE, "bin": "my_map", "index": 10, "val": 2, "return_type": aerospike.MAP_RETURN_KEY_VALUE, "inverted": False # Optional }
-
aerospike.
OP_MAP_GET_BY_KEY
¶ Return the entry from the map bin that which has a key that matches the given “key” parameter.
{ "op" : aerospike.OP_MAP_GET_BY_KEY, "bin": "my_map", "key": "age", "return_type": aerospike.MAP_RETURN_KEY_VALUE }
-
aerospike.
OP_MAP_GET_BY_KEY_RANGE
¶ Return the entries from the map bin that have keys which fall between the given “key” (inclusive) and “val” (exclusive). If
inverted
is set toTrue
, return all items outside of the specified range.{ "op" : aerospike.OP_MAP_GET_BY_KEY_RANGE, "bin": "my_map", "key": "i", "range": "j", "return_type": aerospike.MAP_RETURN_KEY_VALUE "inverted": False # Optional }
-
aerospike.
OP_MAP_GET_BY_VALUE
¶ Return the entry or entries from the map bin that have values which match the given “val” parameter. If
inverted
is set toTrue
, return all items with a value not equal to the given “val” parameter.{ "op" : aerospike.OP_MAP_GET_BY_VALUE, "bin": "my_map", "val": 97, "return_type": aerospike.MAP_RETURN_KEY }
-
aerospike.
OP_MAP_GET_BY_VALUE_RANGE
¶ Return the entries from the map bin that have values starting with the given “val” parameter (inclusive) up to the given “range” parameter (exclusive). If
inverted
is set toTrue
, return all items outside of the specified range.{ "op" : aerospike.OP_MAP_GET_BY_VALUE_RANGE, "bin": "my_map", "val": 97, "range": 100, "return_type": aerospike.MAP_RETURN_KEY, "inverted": False # Optional }
-
aerospike.
OP_MAP_GET_BY_INDEX
¶ Return the entry from the map bin at the given “index” location.
{ "op" : aerospike.OP_MAP_GET_BY_INDEX, "bin": "my_map", "index": 0, "return_type": aerospike.MAP_RETURN_KEY_VALUE }
-
aerospike.
OP_MAP_GET_BY_INDEX_RANGE
¶ Return the entries from the map bin starting at the given “index” location and returning “range” items. If
inverted
is set toTrue
, return all items outside of the specified range.{ "op" : aerospike.OP_MAP_GET_BY_INDEX_RANGE, "bin": "my_map", "index": 0, "val": 2, "return_type": aerospike.MAP_RETURN_KEY_VALUE, "inverted": False # Optional }
-
aerospike.
OP_MAP_GET_BY_RANK
¶ Return the first entry from the map bin that has a value with a rank matching the given “index”.
{ "op" : aerospike.OP_MAP_GET_BY_RANK, "bin": "my_map", "index": 10 }
-
aerospike.
OP_MAP_GET_BY_RANK_RANGE
¶ Return the entries from the map bin that have values with a rank starting at the given “index” and removing “range” items. If
inverted
is set toTrue
, return all items outside of the specified range.{ "op" : aerospike.OP_MAP_GET_BY_RANK_RANGE, "bin": "my_map", "index": 10, "val": 2, "return_type": aerospike.MAP_RETURN_KEY_VALUE, "inverted": False # Optional }
Changed in version 2.0.4.
Policy Options¶
Commit Level Policy Options¶
Specifies the number of replicas required to be successfully committed before returning success in a write operation to provide the desired consistency guarantee.
-
aerospike.
POLICY_COMMIT_LEVEL_ALL
¶ Return succcess only after successfully committing all replicas
-
aerospike.
POLICY_COMMIT_LEVEL_MASTER
¶ Return succcess after successfully committing the master replica
AP Read Mode Policy Options¶
Read policy for AP (availability) namespaces.
-
aerospike.
POLICY_READ_MODE_AP_ONE
¶ Involve single node in the read operation.
-
aerospike.
POLICY_READ_MODE_AP_ALL
¶ Involve all duplicates in the read operation.
New in version 3.7.0.
SC Read Mode Policy Options¶
Read policy for SC (strong consistency) namespaces.
-
aerospike.
POLICY_READ_MODE_SC_SESSION
¶ Ensures this client will only see an increasing sequence of record versions. Server only reads from master. This is the default.
-
aerospike.
POLICY_READ_MODE_SC_LINEARIZE
¶ Ensures ALL clients will only see an increasing sequence of record versions. Server only reads from master.
-
aerospike.
POLICY_READ_MODE_SC_ALLOW_REPLICA
¶ Server may read from master or any full (non-migrating) replica. Increasing sequence of record versions is not guaranteed.
-
aerospike.
POLICY_READ_MODE_SC_ALLOW_UNAVAILABLE
¶ Server may read from master or any full (non-migrating) replica or from unavailable partitions. Increasing sequence of record versions is not guaranteed.
New in version 3.7.0.
Existence Policy Options¶
Specifies the behavior for writing the record depending whether or not it exists.
-
aerospike.
POLICY_EXISTS_CREATE
¶ Create a record, ONLY if it doesn’t exist
-
aerospike.
POLICY_EXISTS_CREATE_OR_REPLACE
¶ Completely replace a record if it exists, otherwise create it
-
aerospike.
POLICY_EXISTS_IGNORE
¶ Write the record, regardless of existence. (i.e. create or update)
-
aerospike.
POLICY_EXISTS_REPLACE
¶ Completely replace a record, ONLY if it exists
-
aerospike.
POLICY_EXISTS_UPDATE
¶ Update a record, ONLY if it exists
Generation Policy Options¶
Specifies the behavior of record modifications with regard to the generation value.
-
aerospike.
POLICY_GEN_IGNORE
¶ Write a record, regardless of generation
-
aerospike.
POLICY_GEN_EQ
¶ Write a record, ONLY if generations are equal
-
aerospike.
POLICY_GEN_GT
¶ Write a record, ONLY if local generation is greater-than remote generation
Key Policy Options¶
Specifies the behavior for whether keys or digests should be sent to the cluster.
-
aerospike.
POLICY_KEY_DIGEST
¶ Calculate the digest on the client-side and send it to the server
-
aerospike.
POLICY_KEY_SEND
¶ Send the key in addition to the digest. This policy causes a write operation to store the key on the server
Replica Options¶
Specifies which partition replica to read from.
-
aerospike.
POLICY_REPLICA_SEQUENCE
¶ Always try node containing master partition first. If connection fails and retry_on_timeout is true, try node containing prole partition. Currently restricted to master and one prole.
-
aerospike.
POLICY_REPLICA_MASTER
¶ Read from the partition master replica node
-
aerospike.
POLICY_REPLICA_ANY
¶ Distribute reads across nodes containing key’s master and replicated partition in round-robin fashion. Currently restricted to master and one prole.
-
aerospike.
POLICY_REPLICA_PREFER_RACK
¶ Try node on the same rack as the client first. If there are no nodes on the same rack, use POLICY_REPLICA_SEQUENCE instead.
rack_aware and rack_id must be set in the config argument of the client constructor in order to enable this functionality
Constants¶
TTL Constants¶
Specifies the TTL constants.
-
aerospike.
TTL_NAMESPACE_DEFAULT
¶ Use the namespace default TTL.
-
aerospike.
TTL_NEVER_EXPIRE
¶ Set TTL to never expire.
-
aerospike.
TTL_DONT_UPDATE
¶ Do not change the current TTL of the record.
Auth Mode Constants¶
Specifies the type of authentication to be used when communicating with the server.
-
aerospike.
AUTH_INTERNAL
¶ Use internal authentication only. Hashed password is stored on the server. Do not send clear password. This is the default.
-
aerospike.
AUTH_EXTERNAL
¶ Use external authentication (like LDAP). Specific external authentication is configured on server. If TLS defined, send clear password on node login via TLS. Throw exception if TLS is not defined.
-
aerospike.
AUTH_EXTERNAL_INSECURE
¶ Use external authentication (like LDAP). Specific external authentication is configured on server. Send clear password on node login whether or not TLS is defined. This mode should only be used for testing purposes because it is not secure authentication.
Scan Constants¶
-
aerospike.
SCAN_PRIORITY
¶ Deprecated since version 3.10.0: Scan priority has been replaced by the records_per_second policy see Scan Policies.
-
aerospike.
SCAN_STATUS_ABORTED
¶ Deprecated since version 1.0.50: used by
scan_info()
-
aerospike.
SCAN_STATUS_COMPLETED
¶ Deprecated since version 1.0.50: used by
scan_info()
-
aerospike.
SCAN_STATUS_INPROGRESS
¶ Deprecated since version 1.0.50: used by
scan_info()
-
aerospike.
SCAN_STATUS_UNDEF
¶ Deprecated since version 1.0.50: used by
scan_info()
New in version 1.0.39.
Job Constants¶
-
aerospike.
JOB_SCAN
¶ Scan job type argument for the module parameter of
job_info()
-
aerospike.
JOB_QUERY
¶ Query job type argument for the module parameter of
job_info()
Job Statuses¶
-
aerospike.
JOB_STATUS_UNDEF
¶
-
aerospike.
JOB_STATUS_INPROGRESS
¶
-
aerospike.
JOB_STATUS_COMPLETED
¶
New in version 1.0.50.
Serialization Constants¶
-
aerospike.
SERIALIZER_PYTHON
¶ Use the cPickle serializer to handle unsupported types (default)
-
aerospike.
SERIALIZER_USER
¶ Use a user-defined serializer to handle unsupported types. Must have been registered for the aerospike class or configured for the Client object
-
aerospike.
SERIALIZER_NONE
¶ Do not serialize bins whose data type is unsupported
New in version 1.0.47.
List Write Flags¶
Flags used by list write flag.
-
aerospike.
LIST_WRITE_DEFAULT
¶ Default. Allow duplicate values and insertions at any index.
-
aerospike.
LIST_WRITE_ADD_UNIQUE
¶ Only add unique values.
-
aerospike.
LIST_WRITE_INSERT_BOUNDED
¶ Enforce list boundaries when inserting. Do not allow values to be inserted at index outside current list boundaries.
Note
Requires server version >= 4.3.0
-
aerospike.
LIST_WRITE_NO_FAIL
¶ Do not raise error if a list item fails due to write flag constraints (always succeed).
Note
Requires server version >= 4.3.0
-
aerospike.
LIST_WRITE_PARTIAL
¶ Allow other valid list items to be committed if a list item fails due to write flag constraints.
List Return Types¶
Return types used by various list operations.
-
aerospike.
LIST_RETURN_NONE
¶ Do not return any value.
-
aerospike.
LIST_RETURN_INDEX
¶ Return key index order.
-
aerospike.
LIST_RETURN_REVERSE_INDEX
¶ Return reverse key order.
-
aerospike.
LIST_RETURN_RANK
¶ Return value order.
-
aerospike.
LIST_RETURN_REVERSE_RANK
¶ Return reverse value order.
-
aerospike.
LIST_RETURN_COUNT
¶ Return count of items selected.
-
aerospike.
LIST_RETURN_VALUE
¶ Return value for single key read and value list for range read.
List Order¶
Flags used by list order.
-
aerospike.
LIST_UNORDERED
¶ List is not ordered. This is the default.
-
aerospike.
LIST_ORDERED
¶ Ordered list.
List Sort Flags¶
Flags used by list sort.
-
aerospike.
LIST_SORT_DEFAULT
¶ Default. Preserve duplicates when sorting the list.
-
aerospike.
LIST_SORT_DROP_DUPLICATES
¶ Drop duplicate values when sorting the list.
Map Write Flag¶
Flags used by map write flag.
Note
Requires server version >= 4.3.0
-
aerospike.
MAP_WRITE_FLAGS_DEFAULT
¶ Default. Allow create or update.
-
aerospike.
MAP_WRITE_FLAGS_CREATE_ONLY
¶ If the key already exists, the item will be denied. If the key does not exist, a new item will be created.
-
aerospike.
MAP_WRITE_FLAGS_UPDATE_ONLY
¶ If the key already exists, the item will be overwritten. If the key does not exist, the item will be denied.
-
aerospike.
MAP_WRITE_FLAGS_NO_FAIL
¶ Do not raise error if a map item is denied due to write flag constraints (always succeed).
-
aerospike.
MAP_WRITE_FLAGS_PARTIAL
¶ Allow other valid map items to be committed if a map item is denied due to write flag constraints.
Map Write Mode¶
Flags used by map write mode.
Note
This should only be used for Server version < 4.3.0
-
aerospike.
MAP_UPDATE
¶ Default. Allow create or update.
-
aerospike.
MAP_CREATE_ONLY
¶ If the key already exists, the item will be denied. If the key does not exist, a new item will be created.
-
aerospike.
MAP_UPDATE_ONLY
¶ If the key already exists, the item will be overwritten. If the key does not exist, the item will be denied.
Map Order¶
Flags used by map order.
-
aerospike.
UNORDERED
¶ Map is not ordered. This is the default.
-
aerospike.
KEY_ORDERED
¶ Order map by key.
-
aerospike.
MAP_KEY_VALUE_ORDERED
¶ Order map by key, then value.
Map Return Types¶
Return types used by various map operations.
-
aerospike.
MAP_RETURN_NONE
¶ Do not return any value.
-
aerospike.
MAP_RETURN_INDEX
¶ Return key index order.
-
aerospike.
MAP_RETURN_REVERSE_INDEX
¶ Return reverse key order.
-
aerospike.
MAP_RETURN_RANK
¶ Return value order.
-
aerospike.
MAP_RETURN_REVERSE_RANK
¶ Return reserve value order.
-
aerospike.
MAP_RETURN_COUNT
¶ Return count of items selected.
-
aerospike.
MAP_RETURN_KEY
¶ Return key for single key read and key list for range read.
-
aerospike.
MAP_RETURN_VALUE
¶ Return value for single key read and value list for range read.
-
aerospike.
MAP_RETURN_KEY_VALUE
¶ Return key/value items. Note that key/value pairs will be returned as a list of tuples (i.e. [(key1, value1), (key2, value2)])
Bitwise Write Flags¶
-
aerospike.
BIT_WRITE_DEFAULT
¶ Allow create or update (default).
-
aerospike.
BIT_WRITE_CREATE_ONLY
¶ If bin already exists the operation is denied. Otherwise the bin is created.
-
aerospike.
BIT_WRITE_UPDATE_ONLY
¶ If bin does not exist the operation is denied. Otherwise the bin is updated.
-
aerospike.
BIT_WRITE_NO_FAIL
¶ Do not raise error if operation failed.
-
aerospike.
BIT_WRITE_PARTIAL
¶ Allow other valid operations to be committed if this operation is denied due to flag constraints. i.e. If the number of bytes from the offset to the end of the existing Bytes bin is less than the specified number of bytes, then only apply operations from the offset to the end.
New in version 3.9.0.
Bitwise Resize Flags¶
-
aerospike.
BIT_RESIZE_DEFAULT
¶ Add/remove bytes from the end (default).
-
aerospike.
BIT_RESIZE_FROM_FRONT
¶ Add/remove bytes from the front.
-
aerospike.
BIT_RESIZE_GROW_ONLY
¶ Only allow the bitmap size to increase.
-
aerospike.
BIT_RESIZE_SHRINK_ONLY
¶ Only allow the bitmap size to decrease.
New in version 3.9.0.
Bitwise Overflow¶
-
aerospike.
BIT_OVERFLOW_FAIL
¶ Operation will fail on overflow/underflow.
-
aerospike.
BIT_OVERFLOW_SATURATE
¶ If add or subtract ops overflow/underflow, set to max/min value. Example: MAXINT + 1 = MAXINT.
-
aerospike.
BIT_OVERFLOW_WRAP
¶ If add or subtract ops overflow/underflow, wrap the value. Example: MAXINT + 1 = MININT.
New in version 3.9.0.
HyperLogLog Write Flags¶
-
aerospike.
HLL_WRITE_DEFAULT
¶ Default. Allow create or update.
-
aerospike.
HLL_WRITE_CREATE_ONLY
¶ If the bin already exists, the operation will be denied. If the bin does not exist, a new bin will be created.
-
aerospike.
HLL_WRITE_UPDATE_ONLY
¶ If the bin already exists, the bin will be overwritten. If the bin does not exist, the operation will be denied.
-
aerospike.
HLL_WRITE_NO_FAIL
¶ Do not raise error if operation is denied.
-
aerospike.
HLL_WRITE_ALLOW_FOLD
¶ Allow the resulting set to be the minimum of provided index bits. For intersect_counts and similarity, allow the usage of less precise HLL algorithms when minhash bits of all participating sets do not match.
New in version 3.11.0.
Miscellaneous¶
-
aerospike.
null
A value for distinguishing a server-side null from a Python
None
.Deprecated since version 2.0.1: use the function
aerospike.null()
instead.
-
aerospike.
UDF_TYPE_LUA
¶ UDF type is LUA (which is the only UDF type).
-
aerospike.
INDEX_STRING
¶ An index whose values are of the aerospike string data type.
-
aerospike.
INDEX_NUMERIC
¶ An index whose values are of the aerospike integer data type.
-
aerospike.
INDEX_GEO2DSPHERE
¶ An index whose values are of the aerospike GetJSON data type.
See also
-
aerospike.
INDEX_TYPE_LIST
¶ Index a bin whose contents is an aerospike list.
-
aerospike.
INDEX_TYPE_MAPKEYS
¶ Index the keys of a bin whose contents is an aerospike map.
-
aerospike.
INDEX_TYPE_MAPVALUES
¶ Index the values of a bin whose contents is an aerospike map.
Log Level¶
-
aerospike.
LOG_LEVEL_TRACE
¶
-
aerospike.
LOG_LEVEL_DEBUG
¶
-
aerospike.
LOG_LEVEL_INFO
¶
-
aerospike.
LOG_LEVEL_WARN
¶
-
aerospike.
LOG_LEVEL_ERROR
¶
-
aerospike.
LOG_LEVEL_OFF
¶
Privileges¶
Permission codes define the type of permission granted for a user’s role.
-
aerospike.
PRIV_READ
¶ The user is granted read access.
-
aerospike.
PRIV_WRITE
¶ The user is granted write access.
-
aerospike.
PRIV_READ_WRITE
¶ The user is granted read and write access.
-
aerospike.
PRIV_READ_WRITE_UDF
¶ The user is granted read and write access, and the ability to invoke UDFs.
-
aerospike.
PRIV_SYS_ADMIN
¶ The user is granted the ability to perform system administration operations. Global scope only.
-
aerospike.
PRIV_USER_ADMIN
¶ The user is granted the ability to perform user administration operations. Global scope only.
-
aerospike.
PRIV_DATA_ADMIN
¶ User can perform systems administration functions on a database that do not involve user administration. Examples include setting dynamic server configuration. Global scope only.
Regex Flag Values¶
Flags used for the predexp.string_regex function.
-
aerospike.
REGEX_NONE
¶ Use default behavior.
-
aerospike.
REGEX_ICASE
¶ Do not differentiate case.
-
aerospike.
REGEX_EXTENDED
¶ Use POSIX Extended Regular Expression syntax when interpreting regex.
-
aerospike.
REGEX_NOSUB
¶ Do not report position of matches.
-
aerospike.
REGEX_NEWLINE
¶ Match-any-character operators don’t match a newline.
Client Class — Client
¶
Client
¶
The client connects through a seed node (the address of a single node) to an Aerospike database cluster. From the seed node, the client learns of the other nodes and establishes connections to them. It also gets the partition map of the cluster, which is how it knows where every record actually lives.
The client handles the connections, including re-establishing them ahead of executing an operation. It keeps track of changes to the cluster through a cluster-tending thread.
See also
Example:
from __future__ import print_function
# import the module
import aerospike
from aerospike import exception as ex
import sys
# Configure the client
config = {
'hosts': [ ('127.0.0.1', 3000) ]
}
# Optionally set policies for various method types
write_policies = {'total_timeout': 2000, 'max_retries': 0}
read_policies = {'total_timeout': 1500, 'max_retries': 1}
policies = {'write': write_policies, 'read': read_policies}
config['policies'] = policies
# Create a client and connect it to the cluster
try:
client = aerospike.client(config).connect()
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
# Records are addressable via a tuple of (namespace, set, primary key)
key = ('test', 'demo', 'foo')
try:
# Write a record
client.put(key, {
'name': 'John Doe',
'age': 32
})
except ex.RecordError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
# Read a record
(key, meta, record) = client.get(key)
# Close the connection to the Aerospike cluster
client.close()
.. index::
single: Connection
.. _aerospike_connection_operations:
Connection¶
-
class
aerospike.
Client
¶ -
connect
([username, password])¶ Connect to the cluster. The optional username and password only apply when connecting to the Enterprise Edition of Aerospike.
Parameters: - username (str) – a defined user with roles in the cluster. See
admin_create_user()
. - password (str) – the password will be hashed by the client using bcrypt.
Raises: ClientError
, for example when a connection cannot be established to a seed node (any single node in the cluster from which the client learns of the other nodes).See also
- username (str) – a defined user with roles in the cluster. See
-
is_connected
()¶ Tests the connections between the client and the nodes of the cluster. If the result is
False
, the client will require another call toconnect()
.Return type: bool
Changed in version 2.0.0.
-
close
()¶ Close all connections to the cluster. It is recommended to explicitly call this method when the program is done communicating with the cluster.
-
Key Tuple¶
key
The key tuple, which is sent and returned by various operations, has the structure
(namespace, set, primary key[, the record's RIPEMD-160 digest])
- namespace the
str
name of the namespace, which must be preconfigured on the cluster.- set the
str
name of the set. Will be created automatically if it does not exist.- primary key the value by which the client-side application identifies the record, which can be of type
str
,int
orbytearray
.- digest the first three parts of the tuple get hashed through RIPEMD-160, and the digest used by the clients and cluster nodes to locate the record. A key tuple is also valid if it has the digest part filled and the primary key part set to
None
.>>> client = aerospike.client(config).connect() >>> client.put(('test','demo','oof'), {'id':0, 'a':1}) >>> (key, meta, bins) = client.get(('test','demo','oof')) >>> key ('test', 'demo', None, bytearray(b'\ti\xcb\xb9\xb6V#V\xecI#\xealu\x05\x00H\x98\xe4=')) >>> (key2, meta2, bins2) = client.get(key) >>> bins2 {'a': 1, 'id': 0} >>> client.close()See also
Record Tuple¶
-
record
The record tuple
(key, meta, bins)
which is returned by various read operations.See also
Operations¶
Record Operations¶
-
class
aerospike.
Client
-
put
(key, bins[, meta[, policy[, serializer]]])¶ Write a record with a given key to the cluster.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bins (dict) – a
dict
of bin-name / bin-value pairs. - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Write Policies.
- serializer – optionally override the serialization mode of the
client with one of the Serialization Constants. To
use a class-level user-defined serialization function registered with
aerospike.set_serializer()
useaerospike.SERIALIZER_USER
.
Raises: a subclass of
AerospikeError
.from __future__ import print_function import aerospike from aerospike import exception as ex config = { 'hosts': [ ('127.0.0.1', 3000) ], 'total_timeout': 1500 } client = aerospike.client(config).connect() try: key = ('test', 'demo', 1) bins = { 'l': [ "qwertyuiop", 1, bytearray("asd;as[d'as;d", "utf-8") ], 'm': { "key": "asd';q;'1';" }, 'i': 1234, 'f': 3.14159265359, 's': '!@#@#$QSDAsd;as' } client.put(key, bins, policy={'key': aerospike.POLICY_KEY_SEND}, meta={'ttl':180}) # adding a bin client.put(key, {'smiley': u"\ud83d\ude04"}) # removing a bin client.put(key, {'i': aerospike.null()}) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Note
Version >= 3.10.0 Supports predicate expressions for record operations see
predexp
. Requires server version >= 4.7.0.from __future__ import print_function import aerospike from aerospike import predexp from aerospike import exception as ex import sys config = {"hosts": [("127.0.0.1", 3000)]} client = aerospike.client(config).connect() try: keys = [("test", "demo", 1), ("test", "demo", 2), ("test", "demo", 3)] records = [{"number": 1}, {"number": 2}, {"number": 3}] for i in range(3): client.put(keys[i], records[i]) preds = [ # check that the record has a value < 2 bin 'name' predexp.integer_bin("number"), predexp.integer_value(2), predexp.integer_less(), ] records = [] for i in range(3): try: records.append(client.get(keys[i], policy={"predexp": preds})) except ex.FilteredOut as e: print("Error: {0} [{1}]".format(e.msg, e.code)) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close() # the get only returns records that match the preds # otherwise, an error is returned # EXPECTED OUTPUT: # Error: 127.0.0.1:3000 AEROSPIKE_FILTERED_OUT [27] # Error: 127.0.0.1:3000 AEROSPIKE_FILTERED_OUT [27] # [(('test', 'demo', 1, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'gen': 8, 'ttl': 2592000}, {'charges': [10, 20, 14], 'name': 'John', 'number': 1})]
Note
Using Generation Policy
The generation policy allows a record to be written only when the generation is a specific value. In the following example, we only want to write the record if no change has occurred since
exists()
was called.from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [ ('127.0.0.1',3000)]} client = aerospike.client(config).connect() try: (key, meta) = client.exists(('test','test','key1')) print(meta) print('============') client.put(('test','test','key1'), {'id':1,'a':2}, meta={'gen': 33}, policy={'gen':aerospike.POLICY_GEN_EQ}) print('Record written.') except ex.RecordGenerationError: print("put() failed due to generation policy mismatch") except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close()
-
exists
(key[, policy]) -> (key, meta)¶ Check if a record with a given key exists in the cluster and return the record as a
tuple()
consisting of key and meta. If the record does not exist the meta data will beNone
.Parameters: - key (tuple) – a Key Tuple associated with the record.
- policy (dict) – optional Read Policies.
Return type: tuple()
(key, meta)Raises: a subclass of
AerospikeError
.from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: # assuming a record with such a key exists in the cluster key = ('test', 'demo', 1) (key, meta) = client.exists(key) print(key) print('--------------------------') print(meta) except ex.RecordNotFound: print("Record not found:", key) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Changed in version 2.0.3.
-
get
(key[, policy]) -> (key, meta, bins)¶ Read a record with a given key, and return the record as a
tuple()
consisting of key, meta and bins.Parameters: - key (tuple) – a Key Tuple associated with the record.
- policy (dict) – optional Read Policies.
Returns: a Record Tuple. See Unicode Handling.
Raises: from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = {'hosts': [('127.0.0.1', 3000)]} client = aerospike.client(config).connect() try: # assuming a record with such a key exists in the cluster key = ('test', 'demo', 1) (key, meta, bins) = client.get(key) print(key) print('--------------------------') print(meta) print('--------------------------') print(bins) except ex.RecordNotFound: print("Record not found:", key) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Warning
The client has been changed to raise a
RecordNotFound
exception whenget()
does not find the record. Code that used to check formeta != None
should be modified.Changed in version 2.0.0.
-
select
(key, bins[, policy]) -> (key, meta, bins)¶ Read a record with a given key, and return the record as a
tuple()
consisting of key, meta and bins, with the specified bins projected. Prior to Aerospike server 3.6.0, if a selected bin does not exist its value will beNone
. Starting with 3.6.0, if a bin does not exist it will not be present in the returned Record Tuple.Parameters: - key (tuple) – a Key Tuple associated with the record.
- bins (list) – a list of bin names to select from the record.
- policy (dict) – optional Read Policies.
Returns: a Record Tuple. See Unicode Handling.
Raises: from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: # assuming a record with such a key exists in the cluster key = ('test', 'demo', 1) (key, meta, bins) = client.select(key, ['name']) print("name: ", bins.get('name')) except ex.RecordNotFound: print("Record not found:", key) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Warning
The client has been changed to raise a
RecordNotFound
exception whenselect()
does not find the record. Code that used to check formeta != None
should be modified.Changed in version 2.0.0.
-
touch
(key[, val=0[, meta[, policy]]])¶ Touch the given record, setting its time-to-live and incrementing its generation.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- val (int) – the optional ttl in seconds, with
0
resolving to the default value in the server config. - meta (dict) – optional record metadata to be set.
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.See also
import aerospike config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() key = ('test', 'demo', 1) client.touch(key, 120, policy={'total_timeout': 100}) client.close()
-
remove
(key[meta, policy])¶ Remove a record matching the key from the cluster.
Parameters: - key (tuple) – a Key Tuple associated with the record.
- meta (dict) – Optional dictonary allowing a user to specify the expected generation of the record.
- policy (dict) – optional Remove Policies. May be passed as a keyword argument.
Raises: a subclass of
AerospikeError
.import aerospike config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() key = ('test', 'demo', 1) client.remove(key, meta={'gen': 5}, policy={'gen': aerospike.POLICY_GEN_EQ}) client.close()
-
get_key_digest
(ns, set, key) → bytearray¶ Calculate the digest of a particular key. See: Key Tuple.
Parameters: Returns: a RIPEMD-160 digest of the input tuple.
Return type: import aerospike import pprint pp = pprint.PrettyPrinter(indent=2) config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() digest = client.get_key_digest("test", "demo", 1 ) pp.pprint(digest) key = ('test', 'demo', None, digest) (key, meta, bins) = client.get(key) pp.pprint(bins) client.close()
Deprecated since version 2.0.1: use the function
aerospike.calc_digest()
instead.
Removing a Bin
-
remove_bin
(key, list[, meta[, policy]])¶ Remove a list of bins from a record with a given key. Equivalent to setting those bins to
aerospike.null()
with aput()
.Parameters: - key (tuple) – a Key Tuple associated with the record.
- list (list) – the bins names to be removed from the record.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Write Policies.
Raises: a subclass of
AerospikeError
.import aerospike config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() key = ('test', 'demo', 1) meta = { 'ttl': 3600 } client.remove_bin(key, ['name', 'age'], meta, {'retry': aerospike.POLICY_RETRY_ONCE}) client.close()
-
Batch Operations¶
-
class
aerospike.
Client
-
get_many
(keys[, policy]) → [ (key, meta, bins)]¶ Batch-read multiple records, and return them as a
list
. Any record that does not exist will have aNone
value for metadata and bins in the record tuple.Parameters: - keys (list) – a list of Key Tuple.
- policy (dict) – optional Batch Policies.
Returns: a
list
of Record Tuple.Raises: a
ClientError
if the batch is too big.See also
More information about the Batch Index interface new to Aerospike server >= 3.6.0.
from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: # assume the fourth key has no matching record keys = [ ('test', 'demo', '1'), ('test', 'demo', '2'), ('test', 'demo', '3'), ('test', 'demo', '4') ] records = client.get_many(keys) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Note
We expect to see something like:
[ (('test', 'demo', '1', bytearray(b'ev\xb4\x88\x8c\xcf\x92\x9c \x0bo\xbd\x90\xd0\x9d\xf3\xf6\xd1\x0c\xf3')), {'gen': 1, 'ttl': 2592000}, {'age': 1, 'name': u'Name1'}), (('test', 'demo', '2', bytearray(b'n\xcd7p\x88\xdcF\xe1\xd6\x0e\x05\xfb\xcbs\xa68I\xf0T\xfd')), {'gen': 1, 'ttl': 2592000}, {'age': 2, 'name': u'Name2'}), (('test', 'demo', '3', bytearray(b'\x9f\xf2\xe3\xf3\xc0\xc1\xc3q\xb5$n\xf8\xccV\xa9\xed\xd91a\x86')), {'gen': 1, 'ttl': 2592000}, {'age': 3, 'name': u'Name3'}), (('test', 'demo', '4', bytearray(b'\x8eu\x19\xbe\xe0(\xda ^\xfa\x8ca\x93s\xe8\xb3%\xa8]\x8b')), None, None) ]
Note
Version >= 3.10.0 Supports predicate expressions for batch operations see
predexp
. Requires server version >= 4.7.0from __future__ import print_function import aerospike from aerospike import predexp from aerospike import exception as ex import sys config = {"hosts": [("127.0.0.1", 3000)]} client = aerospike.client(config).connect() try: keys = [("test", "demo", 1), ("test", "demo", 2), ("test", "demo", 3)] records = [{"number": 1}, {"number": 2}, {"number": 3}] for i in range(3): client.put(keys[i], records[i]) preds = [ # check that the record has a value less than 2 in bin 'name' predexp.integer_bin("number"), predexp.integer_value(2), predexp.integer_less(), ] records = client.get_many(keys, policy={"predexp": preds}) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close() # the get_many only returns the records that matched the preds # EXPECTED OUTPUT: # [ # (('test', 'demo', 1, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'gen': 8, 'ttl': 2592000}, {'charges': [10, 20, 14], 'name': 'John', 'number': 1}), # (('test', 'demo', 2, bytearray(b'\xaejQ_7\xdeJ\xda\xccD\x96\xe2\xda\x1f\xea\x84\x8c:\x92p')), None, None), # ('test', 'demo', 3, bytearray(b'\xb1\xa5`g\xf6\xd4\xa8\xa4D9\xd3\xafb\xbf\xf8ha\x01\x94\xcd')), None, None) # ]
Warning
The return type changed to
list
starting with version 1.0.50.
-
exists_many
(keys[, policy]) → [ (key, meta)]¶ Batch-read metadata for multiple keys, and return it as a
list
. Any record that does not exist will have aNone
value for metadata in the result tuple.Parameters: - keys (list) – a list of Key Tuple.
- policy (dict) – optional Batch Policies.
Returns: a
list
of (key, metadata)tuple()
.See also
More information about the Batch Index interface new to Aerospike server >= 3.6.0.
from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: # assume the fourth key has no matching record keys = [ ('test', 'demo', '1'), ('test', 'demo', '2'), ('test', 'demo', '3'), ('test', 'demo', '4') ] records = client.exists_many(keys) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Note
We expect to see something like:
[ (('test', 'demo', '1', bytearray(b'ev\xb4\x88\x8c\xcf\x92\x9c \x0bo\xbd\x90\xd0\x9d\xf3\xf6\xd1\x0c\xf3')), {'gen': 2, 'ttl': 2592000}), (('test', 'demo', '2', bytearray(b'n\xcd7p\x88\xdcF\xe1\xd6\x0e\x05\xfb\xcbs\xa68I\xf0T\xfd')), {'gen': 7, 'ttl': 1337}), (('test', 'demo', '3', bytearray(b'\x9f\xf2\xe3\xf3\xc0\xc1\xc3q\xb5$n\xf8\xccV\xa9\xed\xd91a\x86')), {'gen': 9, 'ttl': 543}), (('test', 'demo', '4', bytearray(b'\x8eu\x19\xbe\xe0(\xda ^\xfa\x8ca\x93s\xe8\xb3%\xa8]\x8b')), None) ]
Warning
The return type changed to
list
starting with version 1.0.50.
-
select_many
(keys, bins[, policy]) → [(key, meta, bins), ...]}¶ Batch-read multiple records, and return them as a
list
. Any record that does not exist will have aNone
value for metadata and bins in the record tuple. The bins will be filtered as specified.Parameters: - keys (list) – a list of Key Tuple.
- bins (list) – the bin names to select from the matching records.
- policy (dict) – optional Batch Policies.
Returns: a
list
of Record Tuple.See also
More information about the Batch Index interface new to Aerospike server >= 3.6.0.
from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: # assume the fourth key has no matching record keys = [ ('test', 'demo', None, bytearray(b'ev\xb4\x88\x8c\xcf\x92\x9c \x0bo\xbd\x90\xd0\x9d\xf3\xf6\xd1\x0c\xf3'), ('test', 'demo', None, bytearray(b'n\xcd7p\x88\xdcF\xe1\xd6\x0e\x05\xfb\xcbs\xa68I\xf0T\xfd'), ('test', 'demo', None, bytearray(b'\x9f\xf2\xe3\xf3\xc0\xc1\xc3q\xb5$n\xf8\xccV\xa9\xed\xd91a\x86'), ('test', 'demo', None, bytearray(b'\x8eu\x19\xbe\xe0(\xda ^\xfa\x8ca\x93s\xe8\xb3%\xa8]\x8b') ] records = client.select_many(keys, [u'name']) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Note
We expect to see something like:
[ (('test', 'demo', None, bytearray(b'ev\xb4\x88\x8c\xcf\x92\x9c \x0bo\xbd\x90\xd0\x9d\xf3\xf6\xd1\x0c\xf3'), {'gen': 1, 'ttl': 2592000}, {'name': u'Name1'}), (('test', 'demo', None, bytearray(b'n\xcd7p\x88\xdcF\xe1\xd6\x0e\x05\xfb\xcbs\xa68I\xf0T\xfd'), {'gen': 1, 'ttl': 2592000}, {'name': u'Name2'}), (('test', 'demo', None, bytearray(b'\x9f\xf2\xe3\xf3\xc0\xc1\xc3q\xb5$n\xf8\xccV\xa9\xed\xd91a\x86'), {'gen': 1, 'ttl': 2592000}, {'name': u'Name3'}), (('test', 'demo', None, bytearray(b'\x8eu\x19\xbe\xe0(\xda ^\xfa\x8ca\x93s\xe8\xb3%\xa8]\x8b'), None, None) ]
Warning
The return type changed to
list
starting with version 1.0.50.
-
String Operations¶
-
class
aerospike.
Client
Note
Please see
aerospike_helpers.operations.operations
for the new way to use string operations.-
append
(key, bin, val[, meta[, policy]])¶ Append the string val to the string value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- val (str) – the string to append to the value of bin.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: key = ('test', 'demo', 1) client.append(key, 'name', ' jr.', policy={'total_timeout': 1200}) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
-
prepend
(key, bin, val[, meta[, policy]])¶ Prepend the string value in bin with the string val.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- val (str) – the string to prepend to the value of bin.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: key = ('test', 'demo', 1) client.prepend(key, 'name', 'Dr. ', policy={'total_timeout': 1200}) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
-
Numeric Operations¶
-
class
aerospike.
Client
Note
Please see
aerospike_helpers.operations.operations
for the new way to use numeric operations using the operate command.-
increment
(key, bin, offset[, meta[, policy]])¶ Increment the integer value in bin by the integer val.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- offset (
int
orfloat
) – the value by which to increment the value in bin. - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies. Note: the
exists
policy option may not be:aerospike.POLICY_EXISTS_CREATE_OR_REPLACE
noraerospike.POLICY_EXISTS_REPLACE
Raises: a subclass of
AerospikeError
.from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: client.put(('test', 'cats', 'mr. peppy'), {'breed':'persian'}, policy={'exists': aerospike.POLICY_EXISTS_CREATE_OR_REPLACE}) (key, meta, bins) = client.get(('test', 'cats', 'mr. peppy')) print("Before:", bins, "\n") client.increment(key, 'lives', -1) (key, meta, bins) = client.get(key) print("After:", bins, "\n") client.increment(key, 'lives', -1) (key, meta, bins) = client.get(key) print("Poor Kitty:", bins, "\n") print(bins) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
-
List Operations¶
-
class
aerospike.
Client
Note
Please see
aerospike_helpers.operations.list_operations
for the new way to use list operations.Note
List operations require server version >= 3.7.0
List operations support negative indexing. If the index is negative, the resolved index starts backwards from end of list.
- Index examples:
- 0: first element in the list
- 4: fifth element in the list
- -1: last element in the list
- Index range examples:
- 1, count 2: second and third elements in the list
- -3, count 3: last three elements in the list
If an index is out of bounds, a parameter error will be returned. If a range is partially out of bounds, the valid part of the range will be returned.
- Comparisons:
- A wildcard function is available
aerospike.CDTWildcard()
. - An infinite function is available
aerospike.CDTInfinite()
.
- A wildcard function is available
Those values are for comparison only and will not be saved in the database.
See also
-
list_append
(key, bin, val[, meta[, policy]])¶ Append a single element to a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- val –
int
,str
,float
,bytearray
,list
,dict
. An unsupported type will be serialized. - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_extend
(key, bin, items[, meta[, policy]])¶ Extend the list value in bin with the given items.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- items (list) – the items to append the list in bin.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_insert
(key, bin, index, val[, meta[, policy]])¶ Insert an element at the specified index of a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the position in the index where the value should be inserted.
- val –
int
,str
,float
,bytearray
,list
,dict
. An unsupported type will be serialized. - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_insert_items
(key, bin, index, items[, meta[, policy]])¶ Insert the items at the specified index of a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the position in the index where the items should be inserted.
- items (list) – the items to insert into the list in bin.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_pop
(key, bin, index[, meta[, policy]]) → val¶ Remove and get back a list element at a given index of a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the index position in the list element which should be removed and returned.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Returns: a single list element.
Raises: a subclass of
AerospikeError
.
-
list_pop_range
(key, bin, index, count[, meta[, policy]]) → val¶ Remove and get back list elements at a given index of a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the index of first element in a range which should be removed and returned.
- count (int) – the number of elements in the range.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Returns: a
list
of elements.Raises: a subclass of
AerospikeError
.
-
list_remove
(key, bin, index[, meta[, policy]])¶ Remove a list element at a given index of a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the index position in the list element which should be removed.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_remove_range
(key, bin, index, count[, meta[, policy]])¶ Remove list elements at a given index of a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the index of first element in a range which should be removed.
- count (int) – the number of elements in the range.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_clear
(key, bin[, meta[, policy]])¶ Remove all the elements from a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_set
(key, bin, index, val[, meta[, policy]])¶ Set list element val at the specified index of a list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the position in the index where the value should be set.
- val –
int
,str
,float
,bytearray
,list
,dict
. An unsupported type will be serialized. - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
list_get
(key, bin, index[, meta[, policy]]) → val¶ Get the list element at the specified index of a list value in bin.
Parameters: Raises: a subclass of
AerospikeError
.Returns: the list elements at the given index.
-
list_get_range
(key, bin, index, count[, meta[, policy]]) → val¶ Get the list of count elements starting at a specified index of a list value in bin.
Parameters: Raises: a subclass of
AerospikeError
.Returns: a
list
of elements.
-
list_trim
(key, bin, index, count[, meta[, policy]]) → val¶ Remove elements from the list which are not within the range starting at the given index plus count.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index (int) – the position in the index marking the start of the range.
- index – the index position of the first element in a range which should not be removed.
- count (int) – the number of elements in the range.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: a
list
of elements.
-
list_size
(key, bin[, meta[, policy]]) → count¶ Count the number of elements in the list value in bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: a
int
.
Map Operations¶
-
class
aerospike.
Client
Note
Please see
aerospike_helpers.operations.map_operations
for the new way to use map operations.Note
Map operations require server version >= 3.8.4
All maps maintain an index and a rank. Map supports negative indexing for index and rank.
An index in the context of the map API is the order of a particular key in a map. The key with the lowest key value has index 0.
A rank is the order of a particular value in a map. If multiple copies of a value exist, the ranks of those copies are based on their key ordering.
- Index examples:
- 0: lowest key in the map
- 4: fifth key in the map
- -1: highest key in the map
- Index range examples:
- 1, count 2: second and third keys in the map
- -3, count 3: highest three keys in the map
- Rank examples:
- 0: element with the lowest value rank in the map
- -1: element with the highest ranked value in the map
- Rank range examples:
- 1, count 2: second and third lowest ranked elements in the map
- -3, count 3: top three ranked elements in the map.
The default map order is
aerospike.MAP_UNORDERED
.- Comparisons:
- A wildcard function is available
aerospike.CDTWildcard()
. - An infinite function is available
aerospike.CDTInfinite()
.
- A wildcard function is available
Those values are for comparison only and will not be saved in the database.
from __future__ import print_function import aerospike from aerospike import exception as e config = {'hosts': [('127.0.0.1', 3000)]} try: client = aerospike.client(config).connect() except e.ClientError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(2) key = ('test', 'demo', 'map-example') abc = {} for i in xrange(1, 10, 1): abc[chr(64 + i)] = i for i in xrange(11, 26, 1): abc[chr(64 + i)] = i try: if client.exists(key): client.remove(key) map_policy = { 'map_write_mode': aerospike.MAP_UPDATE, 'map_order': aerospike.MAP_KEY_VALUE_ORDERED } client.map_put_items(key, 'abc', abc, map_policy) client.map_put(key, 'abc', 'J', 10, map_policy) print(client.map_get_by_key_range(key, 'abc', 'A', 'D', aerospike.MAP_RETURN_KEY_VALUE)) client.map_put(key, 'abc', 'Z', 26, map_policy) print(client.map_get_by_index_range(key, 'abc', -3, 3, aerospike.MAP_RETURN_VALUE)) print(client.map_get_by_rank_range(key, 'abc', 0, 10, aerospike.MAP_RETURN_KEY)) print("\nRound 2") more = {'AA': 100, 'BB': 200, 'ZZ': 2600} client.map_put_items(key, 'abc', more, map_policy) print(client.map_get_by_key_range(key, 'abc', 'A', 'D', aerospike.MAP_RETURN_KEY_VALUE)) print(client.map_get_by_index_range(key, 'abc', -3, 3, aerospike.MAP_RETURN_VALUE)) print(client.map_get_by_rank_range(key, 'abc', 0, 10, aerospike.MAP_RETURN_KEY)) except e.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close()
Note
We expect to see
[('A', 1), ('B', 2), ('C', 3)] [24, 25, 26] ['A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J'] Round 2 [('A', 1), ('AA', 100), ('B', 2), ('BB', 200), ('C', 3)] [25, 26, 2600] ['A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J']
See also
-
map_set_policy
(key, bin, map_policy)¶ Set the map policy for the given bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- map_policy (dict) – Map Policies.
Raises: a subclass of
AerospikeError
.
-
map_put
(key, bin, map_key, val[, map_policy[, meta[, policy]]])¶ Add the given map_key/val pair to the map at key and bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- map_key –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - val –
int
,str
,float
,bytearray
,list
,dict
. An unsupported type will be serialized. - map_policy (dict) – optional Map Policies.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
map_put_items
(key, bin, items[, map_policy[, meta[, policy]]])¶ Add the given items dict of key/value pairs to the map at key and bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- items (dict) – key/value pairs.
- map_policy (dict) – optional Map Policies.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
map_increment
(key, bin, map_key, incr[, map_policy[, meta[, policy]]])¶ Increment the value of a numeric map element by incr. Element is specified by key, bin and map_key.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- map_key –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - incr –
int
orfloat
- map_policy (dict) – optional Map Policies.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
map_decrement
(key, bin, map_key, decr[, map_policy[, meta[, policy]]])¶ Decrement the value of a numeric map element by decr. Element is specified by key, bin and map_key.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- map_key –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - decr –
int
orfloat
- map_policy (dict) – optional Map Policies.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
map_size
(key, bin[, meta[, policy]]) → count¶ Return the size of the map at key and bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: a
int
.
-
map_clear
(key, bin[, meta[, policy]])¶ Remove all elements from the map at key and bin.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.
-
map_remove_by_key
(key, bin, map_key, return_type[, meta[, policy]])¶ Remove and return a map element specified by key, bin and map_key.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- map_key –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_key_list
(key, bin, list, return_type[, meta[, policy]][, meta[, policy]])¶ Remove and return map elements specified by key, bin and list of keys.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- list –
list
the list of keys to match - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_key_range
(key, bin, map_key, range, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin and identified by a key range [map_key inclusive, range exclusive).
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- map_key –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - range –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_value
(key, bin, val, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin and val.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- val –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_value_list
(key, bin, list, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin and list of values.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- list –
list
the list of values to match - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_value_range
(key, bin, val, range, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin and value range [val inclusive, range exclusive).
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- val –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - range –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_index
(key, bin, index, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin and index.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index –
int
the index position of the map element - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_index_range
(key, bin, index, range, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin starting at index position and removing range number of elements.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index –
int
the index position of the first map element to remove - range –
int
the number of items to remove from the map - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_rank
(key, bin, rank, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin and rank.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- rank –
int
the rank of the value of the element in the map - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_remove_by_rank_range
(key, bin, rank, range, return_type[, meta[, policy]])¶ Remove and return map elements specified by key, bin with starting rank and removing range number of elements.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- rank –
int
the rank of the value of the first map element to remove - range –
int
the number of items to remove from the map - return_type –
int
Map Return Types - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_key
(key, bin, map_key, return_type[, meta[, policy]])¶ Return map element specified by key, bin and map_key.
Parameters: Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_key_range
(key, bin, map_key, range, return_type[, meta[, policy]])¶ Return map elements specified by key, bin and key range [map_key inclusive, range exclusive).
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- map_key –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - range –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_key_list
(key, bin, key_list, return_type[, meta[, policy]])¶ Return map elements specified by key, bin and key_list.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- key_list –
list
A list of map keys to fetch entries for - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
Note
Requires server version >= 3.16.0.1
New in version 3.2.0.
-
map_get_by_value
(key, bin, val, return_type[, meta[, policy]])¶ Return map elements specified by key, bin and val.
Parameters: Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_value_range
(key, bin, val, range, return_type[, meta[, policy]])¶ Return map elements specified by key, bin and value range [val inclusive, range exclusive).
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- val –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - range –
int
,str
,float
,bytearray
. An unsupported type will be serialized. - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_value_list
(key, bin, value_list, return_type[, meta[, policy]])¶ Return map elements specified by key, bin and value_list.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- value_list –
list
A list of map values specifying the entries to be retrieved. - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
Note
Requires server version >= 3.16.0.1
New in version 3.2.0.
-
map_get_by_index
(key, bin, index, return_type[, meta[, policy]])¶ Return the map element specified by key, bin and index position.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index –
int
the index position of the map element - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_index_range
(key, bin, index, range, return_type[, meta[, policy]])¶ Return a range number of elements from the map at key and bin, starting at the given index.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- index –
int
the starting index for the range - range –
int
number of elements in the range - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_rank
(key, bin, rank, return_type[, meta[, policy]])¶ Return the map element specified by key, bin and rank.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- rank –
int
the rank of the value of the element in the map - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
-
map_get_by_rank_range
(key, bin, rank, range, return_type[, meta[, policy]])¶ Return map elements specified by key, bin with starting rank and range number of elements.
Parameters: - key (tuple) – a Key Tuple tuple associated with the record.
- bin (str) – the name of the bin.
- rank –
int
the rank of the value of the first map element to remove - range –
int
the number of items to remove from the map - return_type –
int
Map Return Types - meta (dict) – unused for this operation
- policy (dict) – optional Operate Policies.
Raises: a subclass of
AerospikeError
.Returns: depends on return_type parameter
Multi-Ops (Operate)¶
-
class
aerospike.
Client
-
operate
(key, list[, meta[, policy]]) -> (key, meta, bins)¶ Perform multiple bin operations on a record with a given key, In Aerospike server versions prior to 3.6.0, non-existent bins being read will have a
None
value. Starting with 3.6.0 non-existent bins will not be present in the returned Record Tuple. The returned record tuple will only contain one element per bin, even if multiple operations were performed on the bin.Parameters: - key (tuple) – a Key Tuple associated with the record.
- list (list) – a
list
of one or more bin operations, each structured as thedict
{'bin': bin name, 'op': aerospike.OPERATOR_* [, 'val': value]}
. See aerospike_helpers.operations package. - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Returns: a Record Tuple. See Unicode Handling.
Raises: a subclass of
AerospikeError
.Note
Version >= 3.10.0 Supports predicate expressions for Multi-Ops see
predexp
. Requires server version >= 4.7.0.from __future__ import print_function import aerospike from aerospike import predexp from aerospike_helpers.operations import list_operations, operations from aerospike import exception as ex import sys config = {"hosts": [("127.0.0.1", 3000)]} client = aerospike.client(config).connect() try: unique_id = 1 key = ("test", "demo", unique_id) client.put(key, {"name": "John", "charges": [10, 20, 14]}) ops = [list_operations.list_append("charges", 25)] preds = [ # check that the record has value 'Kim' in bin 'name' predexp.string_bin("name"), predexp.string_value("Kim"), predexp.string_equal(), ] # Because the record's name bin is 'John' and not 'Kim', # client.operate() will fail with AEROSPIKE_FILTERED_OUT and the # operations will not be applied. try: client.operate(key, ops, policy={"predexp": preds}) except ex.FilteredOut as e: print("Error: {0} [{1}]".format(e.msg, e.code)) record = client.get(key) print(record) # This client.operate() will succeed because the name bin is 'John'. preds = [ # check that the record has value 'John' in bin 'name' predexp.string_bin("name"), predexp.string_value("John"), predexp.string_equal(), ] client.operate(key, ops, policy={"predexp": preds}) record = client.get(key) print(record) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close() # Error: 127.0.0.1:3000 AEROSPIKE_FILTERED_OUT [27] # (('test', 'demo', None, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'ttl': 2592000, 'gen': 23}, {'number': 1, 'name': 'John', 'charges': [10, 20, 14]}) # (('test', 'demo', None, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'ttl': 2592000, 'gen': 24}, {'number': 1, 'name': 'John', 'charges': [10, 20, 14, 25]})
Note
In version 2.1.3 the return format of certain bin entries for this method, only in cases when a map operation specifying a `return_type` is used, has changed. Bin entries for map operations using “return_type” of aerospike.MAP_RETURN_KEY_VALUE will now return a bin value of a list of keys and corresponding values, rather than a list of key/value tuples. See the following code block for details.
# pre 2.1.3 formatting of key/value bin value [('key1', 'val1'), ('key2', 'val2'), ('key3', 'val3')] # >= 2.1.3 formatting ['key1', 'val1', 'key2', 'val2', 'key3', 'val3']
Note
operate()
can now have multiple write operations on a single bin.from __future__ import print_function import aerospike from aerospike_helpers.operations import operations as op_helpers from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: key = ('test', 'demo', 1) client.put(key, {'age': 25, 'career': 'delivery boy'}) ops = [ op_helpers.increment("age", 1000), op_helpers.write("name", "J."), op_helpers.prepend("name", "Phillip "), op_helpers.append("name", " Fry"), op_helpers.read("name"), op_helpers.read("career"), op_helpers.read("age") ] (key, meta, bins) = client.operate(key, ops, {'ttl':360}, {'total_timeout':500}) print(key) print('--------------------------') print(meta) print('--------------------------') print(bins) # will display all bins selected by OPERATOR_READ operations except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Note
OPERATOR_TOUCH
should only ever combine withOPERATOR_READ
, for example to implement LRU expiry on the records of a set.Warning
Having val associated with
OPERATOR_TOUCH
is deprecated. Use the meta ttl field instead.from __future__ import print_function import aerospike from aerospike import exception as ex import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: key = ('test', 'demo', 1) ops = [ { "op" : aerospike.OPERATOR_TOUCH, }, { "op" : aerospike.OPERATOR_READ, "bin": "name" } ] (key, meta, bins) = client.operate(key, ops, {'ttl':1800}) print("Touched the record for {0}, extending its ttl by 30m".format(bins)) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Changed in version 2.1.3.
-
operate_ordered
(key, list[, meta[, policy]]) -> (key, meta, bins)¶ Perform multiple bin operations on a record with the results being returned as a list of (bin-name, result) tuples. The order of the elements in the list will correspond to the order of the operations from the input parameters.
Parameters: - key (tuple) – a Key Tuple associated with the record.
- list (list) – a
list
of one or more bin operations, each structured as thedict
{'bin': bin name, 'op': aerospike.OPERATOR_* [, 'val': value]}
. See aerospike_helpers.operations package. - meta (dict) – optional record metadata to be set, with field
'ttl'
set toint
number of seconds or one of the TTL Constants, and'gen'
set toint
generation number to compare. - policy (dict) – optional Operate Policies.
Returns: a Record Tuple. See Unicode Handling.
Raises: a subclass of
AerospikeError
.Note
In version 2.1.3 the return format of bin entries for this method, only in cases when a map operation specifying a `return_type` is used, has changed. Map operations using “return_type” of aerospike.MAP_RETURN_KEY_VALUE will now return a bin value of a list of keys and corresponding values, rather than a list of key/value tuples. See the following code block for details. In addition, some operations which did not return a value in versions <= 2.1.2 will now return a response.
# pre 2.1.3 formatting of key/value bin value [('key1', 'val1'), ('key2', 'val2'), ('key3', 'val3')] # >= 2.1.3 formatting ['key1', 'val1', 'key2', 'val2', 'key3', 'val3']
from __future__ import print_function import aerospike from aerospike import exception as ex from aerospike_helpers.operations import operations as op_helpers import sys config = { 'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() try: key = ('test', 'demo', 1) policy = { 'total_timeout': 1000, 'key': aerospike.POLICY_KEY_SEND, 'commit_level': aerospike.POLICY_COMMIT_LEVEL_MASTER } llist = [ op_helpers.append("name", "aa"), op_helpers.read("name"), op_helpers.increment("age", 3), op_helpers.read("age") ] client.operate_ordered(key, llist, {}, policy) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close()
Changed in version 2.1.3.
-
Scan and Query¶
-
class
aerospike.
Client
-
scan
(namespace[, set]) → Scan¶ Return a
aerospike.Scan
object to be used for executing scans over a specified set (which can be omitted orNone
) in a namespace. A scan with aNone
set returns all the records in the namespace.Parameters: Returns: an
aerospike.Scan
class.
-
query
(namespace[, set]) → Query¶ Return a
aerospike.Query
object to be used for executing queries over a specified set (which can be omitted orNone
) in a namespace. A query with aNone
set returns records which are not in any named set. This is different than the meaning of aNone
set in a scan.Parameters: Returns: an
aerospike.Query
class.
-
User Defined Functions¶
-
class
aerospike.
Client
-
udf_put
(filename[, udf_type=aerospike.UDF_TYPE_LUA[, policy]])¶ Register a UDF module with the cluster.
Parameters: - filename (str) – the path to the UDF module to be registered with the cluster.
- udf_type (int) –
aerospike.UDF_TYPE_LUA
. - policy (dict) – currently timeout in milliseconds is the available policy.
Raises: a subclass of
AerospikeError
.Note
Register the UDF module and copy it to the Lua ‘user_path’, a directory that should contain a copy of the modules registered with the cluster.
config = { 'hosts': [ ('127.0.0.1', 3000)], 'lua': { 'user_path': '/path/to/lua/user_path'}} client = aerospike.client(config).connect() client.udf_put('/path/to/my_module.lua') client.close()
-
udf_remove
(module[, policy])¶ Remove a previously registered UDF module from the cluster.
Parameters: Raises: a subclass of
AerospikeError
.client.udf_remove('my_module.lua')
-
udf_list
([policy]) → []¶ Return the list of UDF modules registered with the cluster.
Parameters: policy (dict) – currently timeout in milliseconds is the available policy. Return type: list
Raises: a subclass of AerospikeError
.from __future__ import print_function import aerospike config = {'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() print(client.udf_list()) client.close()
Note
We expect to see something like:
[{'content': bytearray(b''), 'hash': bytearray(b'195e39ceb51c110950bd'), 'name': 'my_udf1.lua', 'type': 0}, {'content': bytearray(b''), 'hash': bytearray(b'8a2528e8475271877b3b'), 'name': 'stream_udf.lua', 'type': 0}, {'content': bytearray(b''), 'hash': bytearray(b'362ea79c8b64857701c2'), 'name': 'aggregate_udf.lua', 'type': 0}, {'content': bytearray(b''), 'hash': bytearray(b'635f47081431379baa4b'), 'name': 'module.lua', 'type': 0}]
-
udf_get
(module[, language=aerospike.UDF_TYPE_LUA[, policy]]) → str¶ Return the content of a UDF module which is registered with the cluster.
Parameters: - module (str) – the UDF module to read from the cluster.
- udf_type (int) –
aerospike.UDF_TYPE_LUA
- policy (dict) – currently timeout in milliseconds is the available policy.
Return type: Raises: a subclass of
AerospikeError
.
-
apply
(key, module, function, args[, policy])¶ Apply a registered (see
udf_put()
) record UDF to a particular record.Parameters: - key (tuple) – a Key Tuple associated with the record.
- module (str) – the name of the UDF module.
- function (str) – the name of the UDF to apply to the record identified by key.
- args (list) – the arguments to the UDF.
- policy (dict) – optional Apply Policies.
Returns: the value optionally returned by the UDF, one of
str
,int
,float
,bytearray
,list
,dict
.Raises: a subclass of
AerospikeError
.See also
Note
Version >= 3.10.0 Supports predicate expressions for apply, scan_apply, and query_apply see
predexp
. Requires server version 4.7.0.from __future__ import print_function import aerospike from aerospike import predexp from aerospike import exception as ex import sys config = {"hosts": [("127.0.0.1", 3000)]} client = aerospike.client(config).connect() # register udf try: client.udf_put("/path/to/my_udf.lua") except ex.FilteredOut as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close() sys.exit(1) # put records and apply udf try: keys = [("test", "demo", 1), ("test", "demo", 2), ("test", "demo", 3)] records = [{"number": 1}, {"number": 2}, {"number": 3}] for i in range(3): client.put(keys[i], records[i]) preds = [ # check that the record has value < 2 or == 3 in bin 'name' predexp.integer_bin("number"), predexp.integer_value(2), predexp.integer_less(), predexp.integer_bin("number"), predexp.integer_value(3), predexp.integer_equal(), predexp.predexp_or(2), ] policy = {"predexp": preds} client.scan_apply("test", None, "my_udf", "my_udf", ["number", 10], policy) records = client.get_many(keys) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close() # the udf has only modified the records that matched the preds # EXPECTED OUTPUT: # [ # (('test', 'demo', 1, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'gen': 2, 'ttl': 2591999}, {'number': 11}), # (('test', 'demo', 2, bytearray(b'\xaejQ_7\xdeJ\xda\xccD\x96\xe2\xda\x1f\xea\x84\x8c:\x92p')), {'gen': 12, 'ttl': 2591999}, {'number': 2}), # (('test', 'demo', 3, bytearray(b'\xb1\xa5`g\xf6\xd4\xa8\xa4D9\xd3\xafb\xbf\xf8ha\x01\x94\xcd')), {'gen': 13, 'ttl': 2591999}, {'number': 13}) # ]
# contents of my_udf.lua function my_udf(rec, bin, offset) info("my transform: %s", tostring(record.digest(rec))) rec[bin] = rec[bin] + offset aerospike:update(rec) end
-
scan_apply
(ns, set, module, function[, args[, policy[, options]]]) → int¶ Initiate a scan and apply a record UDF to each record matched by the scan. This method blocks until the scan is complete.
Parameters: - ns (str) – the namespace in the aerospike cluster.
- set (str) – the set name. Should be
None
if the entire namespace is to be scanned. - module (str) – the name of the UDF module.
- function (str) – the name of the UDF to apply to the records matched by the scan.
- args (list) – the arguments to the UDF.
- policy (dict) – optional Scan Policies.
- options (dict) – the Scan Options that will apply to the scan.
Return type: Returns: a job ID that can be used with
job_info()
to check the status of theaerospike.JOB_SCAN
.Raises: a subclass of
AerospikeError
.See also
-
query_apply
(ns, set, predicate, module, function[, args[, policy]]) → int¶ Initiate a query and apply a record UDF to each record matched by the query. This method blocks until the query is completed.
Parameters: - ns (str) – the namespace in the aerospike cluster.
- set (str) – the set name. Should be
None
if you want to query records in the ns which are in no set. - predicate (tuple) – the
tuple()
produced by one of theaerospike.predicates
methods. - module (str) – the name of the UDF module.
- function (str) – the name of the UDF to apply to the records matched by the query.
- args (list) – the arguments to the UDF.
- policy (dict) – optional Write Policies.
Return type: Returns: a job ID that can be used with
job_info()
to check the status of theaerospike.JOB_QUERY
.Raises: a subclass of
AerospikeError
.See also
-
job_info
(job_id, module[, policy]) → dict¶ Return the status of a job running in the background.
Parameters: - job_id (int) – the job ID returned by
scan_apply()
andquery_apply()
. - module – one of Job Constants.
Returns: a
dict
with keys status, records_read, and progress_pct. The value of status is one of Job Statuses.Raises: a subclass of
AerospikeError
.from __future__ import print_function import aerospike from aerospike import exception as ex import time config = {'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() try: # run the UDF 'add_val' in Lua module 'simple' on the records of test.demo job_id = client.scan_apply('test', 'demo', 'simple', 'add_val', ['age', 1]) while True: time.sleep(0.25) response = client.job_info(job_id, aerospike.JOB_SCAN) if response['status'] == aerospike.JOB_STATUS_COMPLETED: break print("Job ", str(job_id), " completed") print("Progress percentage : ", response['progress_pct']) print("Number of scanned records : ", response['records_read']) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close()
- job_id (int) – the job ID returned by
-
scan_info
(scan_id) → dict¶ Return the status of a scan running in the background.
Parameters: scan_id (int) – the scan ID returned by scan_apply()
.Returns: a dict
with keys status, records_scanned, and progress_pct. The value of status is one of Job Statuses.Raises: a subclass of AerospikeError
.Deprecated since version 1.0.50: Use
job_info()
instead.from __future__ import print_function import aerospike from aerospike import exception as ex config = {'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() try: scan_id = client.scan_apply('test', 'demo', 'simple', 'add_val', ['age', 1]) while True: response = client.scan_info(scan_id) if response['status'] == aerospike.SCAN_STATUS_COMPLETED or \ response['status'] == aerospike.SCAN_STATUS_ABORTED: break if response['status'] == aerospike.SCAN_STATUS_COMPLETED: print("Background scan successful") print("Progress percentage : ", response['progress_pct']) print("Number of scanned records : ", response['records_scanned']) print("Background scan status : ", "SCAN_STATUS_COMPLETED") else: print("Scan_apply failed") except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close()
-
Info Operations¶
-
class
aerospike.
Client
-
get_nodes
() → []¶ Return the list of hosts present in a connected cluster.
Returns: a list
of node address tuples.Raises: a subclass of AerospikeError
.import aerospike config = {'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() nodes = client.get_nodes() print(nodes) client.close()
Note
We expect to see something like:
[('127.0.0.1', 3000), ('127.0.0.1', 3010)]
Changed in version 3.0.0.
Warning
In versions < 3.0.0
get_nodes
will not work when using TLS
-
info
(command[, hosts[, policy]]) → {}¶ Deprecated since version 3.0.0: Use
info_node()
to send a request to a single node, orinfo_all()
to send a request to the entire cluster. Sending requests to specific nodes can be better handled with a simple Python function such as:def info_to_host_list(client, request, hosts, policy=None): output = {} for host in hosts: try: response = client.info_node(request, host, policy) output[host] = response except Exception as e: # Handle the error gracefully here output[host] = e return output
Send an info command to all nodes in the cluster and filter responses to only include nodes specified in a hosts list.
Parameters: - command (str) – the info command.
- hosts (list) – a
list
containing an address, porttuple()
. Example:[('127.0.0.1', 3000)]
- policy (dict) – optional Info Policies.
Return type: Raises: a subclass of
AerospikeError
.See also
import aerospike config = {'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() response = client.info(command) client.close()
Note
We expect to see something like:
{'BB9581F41290C00': (None, '127.0.0.1:3000\n'), 'BC3581F41290C00': (None, '127.0.0.1:3010\n')}
Changed in version 3.0.0.
-
info_all
(command[, policy]]) → {}¶ Send an info command to all nodes in the cluster to which the client is connected. If any of the individual requests fail, this will raise an exception.
Parameters: - command (str) – the info command.
- policy (dict) – optional Info Policies.
Return type: Raises: a subclass of
AerospikeError
.See also
import aerospike config = {'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect() response = client.info_all(command) client.close()
Note
We expect to see something like:
{'BB9581F41290C00': (None, '127.0.0.1:3000\n'), 'BC3581F41290C00': (None, '127.0.0.1:3010\n')}
New in version 3.0.0.
-
info_node
(command, host[, policy]) → str¶ Send an info command to a single node specified by host.
Parameters: - command (str) – the info command.
- host (tuple) – a
tuple()
containing an address, port , optional tls-name . Example:('127.0.0.1', 3000)
or when using TLS('127.0.0.1', 4333, 'server-tls-name')
. In order to send an info request when TLS is enabled, the tls-name must be present. - policy (dict) – optional Info Policies.
Return type: Raises: a subclass of
AerospikeError
.See also
Changed in version 3.0.0.
Warning
for client versions < 3.0.0
info_node
will not work when using TLS
-
has_geo
() → bool¶ Check whether the connected cluster supports geospatial data and indexes.
Return type: bool
Raises: a subclass of AerospikeError
.
-
shm_key
() → int¶ Expose the value of the shm_key for this client if shared-memory cluster tending is enabled,
Return type: int
orNone
-
truncate
(namespace, set, nanos[, policy])¶ Remove records in specified namespace/set efficiently. This method is many orders of magnitude faster than deleting records one at a time. See Truncate command reference.
Note
Requires Aerospike Server versions >= 3.12
This asynchronous server call may return before the truncation is complete. The user can still write new records after the server returns because new records will have last update times greater than the truncate cutoff (set at the time of truncate call)
Parameters: - namespace (str) – The namespace on which the truncation operation should be performed.
- set (str) – The set to truncate. Pass in
None
to indicate that all records in the namespace should be truncated. - nanos (long) – A cutoff threshold indicating that records last updated before the threshold will be removed.Units are in nanoseconds since unix epoch (1970-01-01). A value of
0
indicates that all records in the set should be truncated regardless of update time. The value must not be in the future. - policy (dict) – Optional Info Policies
Return type: Status indicating the success of the operation.
Raises: a subclass of
AerospikeError
.import aerospike import time client = aerospike.client({'hosts': [('localhost', 3000)]}).connect() # Store 10 items in the database for i in range(10): key = ('test', 'truncate', i) record = {'item': i} client.put(key, record) time.sleep(2) current_time = time.time() # Convert the current time to nanoseconds since epoch threshold_ns = int(current_time * 10 ** 9) time.sleep(2) # Make sure some time passes before next round of additions # Store another 10 items into the database for i in range(10, 20): key = ('test', 'truncate', i) record = {'item': i} client.put(key, record) # Store a record in the 'test' namespace without a set key = ('test', None, 'no set') record = ({'item': 'no set'}) client.put(key, record) # Remove all items created before the threshold time # The first 10 records we added will be removed by this call. # The second 10 will remain. client.truncate('test', 'truncate', threshold_ns) # Remove all records from test/truncate. # After this the record with key ('test', None, 'no set') still exists client.truncate('test', 'truncate', 0) # Remove all records from the test namespace client.truncate('test', None, 0) client.close()
-
Index Operations¶
-
class
aerospike.
Client
-
index_string_create
(ns, set, bin, index_name[, policy])¶ Create a string index with index_name on the bin in the specified ns, set.
Parameters: Raises: a subclass of
AerospikeError
.
-
index_integer_create
(ns, set, bin, index_name[, policy])¶ Create an integer index with index_name on the bin in the specified ns, set.
Parameters: Raises: a subclass of
AerospikeError
.
-
index_list_create
(ns, set, bin, index_datatype, index_name[, policy])¶ Create an index named index_name for numeric, string or GeoJSON values (as defined by index_datatype) on records of the specified ns, set whose bin is a list.
Parameters: - ns (str) – the namespace in the aerospike cluster.
- set (str) – the set name.
- bin (str) – the name of bin the secondary index is built on.
- index_datatype – Possible values are
aerospike.INDEX_STRING
,aerospike.INDEX_NUMERIC
andaerospike.INDEX_GEO2DSPHERE
. - index_name (str) – the name of the index.
- policy (dict) – optional Info Policies.
Raises: a subclass of
AerospikeError
.Note
Requires server version >= 3.8.0
-
index_map_keys_create
(ns, set, bin, index_datatype, index_name[, policy])¶ Create an index named index_name for numeric, string or GeoJSON values (as defined by index_datatype) on records of the specified ns, set whose bin is a map. The index will include the keys of the map.
Parameters: - ns (str) – the namespace in the aerospike cluster.
- set (str) – the set name.
- bin (str) – the name of bin the secondary index is built on.
- index_datatype – Possible values are
aerospike.INDEX_STRING
,aerospike.INDEX_NUMERIC
andaerospike.INDEX_GEO2DSPHERE
. - index_name (str) – the name of the index.
- policy (dict) – optional Info Policies.
Raises: a subclass of
AerospikeError
.Note
Requires server version >= 3.8.0
-
index_map_values_create
(ns, set, bin, index_datatype, index_name[, policy])¶ Create an index named index_name for numeric, string or GeoJSON values (as defined by index_datatype) on records of the specified ns, set whose bin is a map. The index will include the values of the map.
Parameters: - ns (str) – the namespace in the aerospike cluster.
- set (str) – the set name.
- bin (str) – the name of bin the secondary index is built on.
- index_datatype – Possible values are
aerospike.INDEX_STRING
,aerospike.INDEX_NUMERIC
andaerospike.INDEX_GEO2DSPHERE
. - index_name (str) – the name of the index.
- policy (dict) – optional Info Policies.
Raises: a subclass of
AerospikeError
.Note
Requires server version >= 3.8.0
import aerospike client = aerospike.client({ 'hosts': [ ('127.0.0.1', 3000)]}).connect() # assume the bin fav_movies in the set test.demo bin should contain # a dict { (str) _title_ : (int) _times_viewed_ } # create a secondary index for string values of test.demo records whose 'fav_movies' bin is a map client.index_map_keys_create('test', 'demo', 'fav_movies', aerospike.INDEX_STRING, 'demo_fav_movies_titles_idx') # create a secondary index for integer values of test.demo records whose 'fav_movies' bin is a map client.index_map_values_create('test', 'demo', 'fav_movies', aerospike.INDEX_NUMERIC, 'demo_fav_movies_views_idx') client.close()
-
index_geo2dsphere_create
(ns, set, bin, index_name[, policy])¶ Create a geospatial 2D spherical index with index_name on the bin in the specified ns, set.
Parameters: Raises: a subclass of
AerospikeError
.See also
Note
Requires server version >= 3.7.0
import aerospike client = aerospike.client({ 'hosts': [ ('127.0.0.1', 3000)]}).connect() client.index_geo2dsphere_create('test', 'pads', 'loc', 'pads_loc_geo') client.close()
-
index_remove
(ns, index_name[, policy])¶ Remove the index with index_name from the namespace.
Parameters: - ns (str) – the namespace in the aerospike cluster.
- index_name (str) – the name of the index.
- policy (dict) – optional Info Policies.
Raises: a subclass of
AerospikeError
.
-
Admin Operations¶
-
class
aerospike.
Client
Note
The admin methods implement the security features of the Enterprise Edition of Aerospike. These methods will raise a
SecurityNotSupported
when the client is connected to a Community Edition cluster (seeaerospike.exception
).A user is validated by the client against the server whenever a connection is established through the use of a username and password (passwords hashed using bcrypt). When security is enabled, each operation is validated against the user’s roles. Users are assigned roles, which are collections of Privilege Objects.
import aerospike from aerospike import exception as ex import time config = {'hosts': [('127.0.0.1', 3000)] } client = aerospike.client(config).connect('ipji', 'life is good') try: dev_privileges = [{'code': aerospike.PRIV_READ}, {'code': aerospike.PRIV_READ_WRITE}] client.admin_create_role('dev_role', dev_privileges) client.admin_grant_privileges('dev_role', [{'code': aerospike.PRIV_READ_WRITE_UDF}]) client.admin_create_user('dev', 'you young whatchacallit... idiot', ['dev_role']) time.sleep(1) print(client.admin_query_user('dev')) print(admin_query_users()) except ex.AdminError as e: print("Error [{0}]: {1}".format(e.code, e.msg)) client.close()
See also
-
admin_create_role
(role, privileges[, policy])¶ Create a custom, named role containing a
list
of privileges.Parameters: - role (str) – the name of the role.
- privileges (list) – a list of Privilege Objects.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_drop_role
(role[, policy])¶ Drop a custom role.
Parameters: - role (str) – the name of the role.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_grant_privileges
(role, privileges[, policy])¶ Add privileges to a role.
Parameters: - role (str) – the name of the role.
- privileges (list) – a list of Privilege Objects.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_revoke_privileges
(role, privileges[, policy])¶ Remove privileges from a role.
Parameters: - role (str) – the name of the role.
- privileges (list) – a list of Privilege Objects.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_query_role
(role[, policy]) → []¶ Get the
list
of privileges associated with a role.Parameters: - role (str) – the name of the role.
- policy (dict) – optional Admin Policies.
Returns: a
list
of Privilege Objects.Raises: one of the
AdminError
subclasses.
-
admin_query_roles
([policy]) → {}¶ Get all named roles and their privileges.
Parameters: policy (dict) – optional Admin Policies. Returns: a dict
of Privilege Objects keyed by role name.Raises: one of the AdminError
subclasses.
-
admin_create_user
(username, password, roles[, policy])¶ Create a user with a specified username and grant it roles.
Parameters: - username (str) – the username to be added to the aerospike cluster.
- password (str) – the password associated with the given username.
- roles (list) – the list of role names assigned to the user.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_drop_user
(username[, policy])¶ Drop the user with a specified username from the cluster.
Parameters: - username (str) – the username to be dropped from the aerospike cluster.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_change_password
(username, password[, policy])¶ Change the password of the user username. This operation can only be performed by that same user.
Parameters: - username (str) – the username.
- password (str) – the password associated with the given username.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_set_password
(username, password[, policy])¶ Set the password of the user username by a user administrator.
Parameters: - username (str) – the username to be added to the aerospike cluster.
- password (str) – the password associated with the given username.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_grant_roles
(username, roles[, policy])¶ Add roles to the user username.
Parameters: - username (str) – the username to be granted the roles.
- roles (list) – a list of role names.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_revoke_roles
(username, roles[, policy])¶ Remove roles from the user username.
Parameters: - username (str) – the username to have the roles revoked.
- roles (list) – a list of role names.
- policy (dict) – optional Admin Policies.
Raises: one of the
AdminError
subclasses.
-
admin_query_user
(username[, policy]) → []¶ Return the list of roles granted to the specified user username.
Parameters: - username (str) – the username to query for.
- policy (dict) – optional Admin Policies.
Returns: a
list
of role names.Raises: one of the
AdminError
subclasses.
-
admin_query_users
([policy]) → {}¶ Return the
dict
of users, with their roles keyed by username.Parameters: policy (dict) – optional Admin Policies. Returns: a dict
of roles keyed by username.Raises: one of the AdminError
subclasses.
-
Policies¶
Write Policies¶
-
policy
A
dict
of optional write policies, which are applicable toput()
,query_apply()
.remove_bin()
.- max_retries (
int
) - Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:0
Warning
Database writes that are not idempotent (such as “add”) should not be retried because the write operation may be performed multiple times if the client timed out previous transaction attempts. It’s important to use a distinct write policy for non-idempotent writes, which sets max_retries = 0;
- max_retries (
- sleep_between_retries (
int
) - Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries (
- socket_timeout (
int
) - Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:0
- socket_timeout (
- total_timeout (
int
) - Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
andtotal_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:1000
- total_timeout (
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- key
- One of the Key Policy Options values such as
aerospike.POLICY_KEY_DIGEST
Default:aerospike.POLICY_KEY_DIGEST
- exists
- One of the Existence Policy Options values such as
aerospike.POLICY_EXISTS_CREATE
Default:aerospike.POLICY_EXISTS_IGNORE
- gen
- One of the Generation Policy Options values such as
aerospike.POLICY_GEN_IGNORE
Default:aerospike.POLICY_GEN_IGNORE
- commit_level
- One of the Commit Level Policy Options values such as
aerospike.POLICY_COMMIT_LEVEL_ALL
Default:aerospike.POLICY_COMMIT_LEVEL_ALL
- durable_delete (
bool
) - Perform durable deleteDefault:
False
Note
Requires Enterprise server version >= 3.10
- durable_delete (
- predexp
list
- A list of
aerospike.predexp
used as a predicate filter for record, bin, batch, and record UDF operations.Default: None
- predexp
Read Policies¶
-
policy
A
dict
of optional read policies, which are applicable toget()
,exists()
,select()
.- max_retries (
int
) - Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:2
- max_retries (
- sleep_between_retries (
int
) - Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries (
- socket_timeout (
int
) - Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:0
- socket_timeout (
- total_timeout (
int
) - Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
andtotal_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:1000
- total_timeout (
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- deserialize (
bool
) - Should raw bytes representing a list or map be deserialized to a list or dictionary.Set to False for backup programs that just need access to raw bytes.Default:
True
- deserialize (
- key
- One of the Key Policy Options values such as
aerospike.POLICY_KEY_DIGEST
Default:aerospike.POLICY_KEY_DIGEST
- read_mode_ap
- One of the AP Read Mode Policy Options values such as
aerospike.AS_POLICY_READ_MODE_AP_ONE
Default:aerospike.AS_POLICY_READ_MODE_AP_ONE
New in version 3.7.0.
- read_mode_sc
- One of the SC Read Mode Policy Options values such as
aerospike.POLICY_READ_MODE_SC_SESSION
New in version 3.7.0.
- replica
- One of the Replica Options values such as
aerospike.POLICY_REPLICA_MASTER
Default:aerospike.POLICY_REPLICA_SEQUENCE
- predexp
list
- A list of
aerospike.predexp
used as a predicate filter for record, bin, batch, and record UDF operations.Default: None
- predexp
Operate Policies¶
-
policy
A
dict
of optional operate policies, which are applicable toappend()
,prepend()
,increment()
,operate()
, and atomic list and map operations.- max_retries (
int
) - Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:0
Warning
Database writes that are not idempotent (such as “add”) should not be retried because the write operation may be performed multiple times if the client timed out previous transaction attempts. It’s important to use a distinct write policy for non-idempotent writes, which sets max_retries = 0;
- max_retries (
- sleep_between_retries (
int
) - Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries (
- socket_timeout (
int
) - Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:0
- socket_timeout (
- total_timeout (
int
) - Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
andtotal_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:1000
- total_timeout (
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- key
- One of the Key Policy Options values such as
aerospike.POLICY_KEY_DIGEST
Default:aerospike.POLICY_KEY_DIGEST
- gen
- One of the Generation Policy Options values such as
aerospike.POLICY_GEN_IGNORE
Default:aerospike.POLICY_GEN_IGNORE
- replica
- One of the Replica Options values such as
aerospike.POLICY_REPLICA_MASTER
Default:aerospike.POLICY_REPLICA_SEQUENCE
- commit_level
- One of the Commit Level Policy Options values such as
aerospike.POLICY_COMMIT_LEVEL_ALL
Default:aerospike.POLICY_COMMIT_LEVEL_ALL
- read_mode_ap
- One of the AP Read Mode Policy Options values such as
aerospike.AS_POLICY_READ_MODE_AP_ONE
Default:aerospike.AS_POLICY_READ_MODE_AP_ONE
New in version 3.7.0.
- read_mode_sc
- One of the SC Read Mode Policy Options values such as
aerospike.POLICY_READ_MODE_SC_SESSION
New in version 3.7.0.
- exists
- One of the Existence Policy Options values such as
aerospike.POLICY_EXISTS_CREATE
Default:aerospike.POLICY_EXISTS_IGNORE
- durable_delete (
bool
) - Perform durable deleteDefault:
False
Note
Requires Enterprise server version >= 3.10
- durable_delete (
- predexp
list
- A list of
aerospike.predexp
used as a predicate filter for record, bin, batch, and record UDF operations.Default: None
- predexp
Apply Policies¶
-
policy
A
dict
of optional apply policies, which are applicable toapply()
.- max_retries (
int
) - Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:0
Warning
Database writes that are not idempotent (such as “add”) should not be retried because the write operation may be performed multiple times if the client timed out previous transaction attempts. It’s important to use a distinct write policy for non-idempotent writes, which sets max_retries = 0;
- max_retries (
- sleep_between_retries (
int
) - Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries (
- socket_timeout (
int
) - Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:0
- socket_timeout (
- total_timeout (
int
) - Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
andtotal_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:1000
- total_timeout (
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- key
- One of the Key Policy Options values such as
aerospike.POLICY_KEY_DIGEST
Default:aerospike.POLICY_KEY_DIGEST
- replica
- One of the Replica Options values such as
aerospike.POLICY_REPLICA_MASTER
Default:aerospike.POLICY_REPLICA_SEQUENCE
- gen
- One of the Generation Policy Options values such as
aerospike.POLICY_GEN_IGNORE
Default:aerospike.POLICY_GEN_IGNORE
- commit_level
- One of the Commit Level Policy Options values such as
aerospike.POLICY_COMMIT_LEVEL_ALL
Default:aerospike.POLICY_COMMIT_LEVEL_ALL
- durable_delete (
bool
) - Perform durable deleteDefault:
False
Note
Requires Enterprise server version >= 3.10
- durable_delete (
- predexp
list
- A list of
aerospike.predexp
used as a predicate filter for record, bin, batch, and record UDF operations.Default: None
- predexp
Remove Policies¶
-
policy
A
dict
of optional remove policies, which are applicable toremove()
.- max_retries (
int
) - Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:0
Warning
Database writes that are not idempotent (such as “add”) should not be retried because the write operation may be performed multiple times if the client timed out previous transaction attempts. It’s important to use a distinct write policy for non-idempotent writes, which sets max_retries = 0;
- max_retries (
- sleep_between_retries (
int
) - Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries (
- socket_timeout (
int
) - Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:0
- socket_timeout (
- total_timeout (
int
) - Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
andtotal_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:1000
- total_timeout (
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- key
- One of the Key Policy Options values such as
aerospike.POLICY_KEY_DIGEST
Default:aerospike.POLICY_KEY_DIGEST
- commit_level
- One of the Commit Level Policy Options values such as
aerospike.POLICY_COMMIT_LEVEL_ALL
Default:aerospike.POLICY_COMMIT_LEVEL_ALL
- gen
- One of the Generation Policy Options values such as
aerospike.POLICY_GEN_IGNORE
Default:aerospike.POLICY_GEN_IGNORE
- durable_delete (
bool
) - Perform durable deleteDefault:
False
Note
Requires Enterprise server version >= 3.10
- durable_delete (
- replica
- One of the Replica Options values such as
aerospike.POLICY_REPLICA_MASTER
Default:aerospike.POLICY_REPLICA_SEQUENCE
- predexp
list
- A list of
aerospike.predexp
used as a predicate filter for record, bin, batch, and record UDF operations.Default: None
- predexp
Batch Policies¶
-
policy
A
dict
of optional batch policies, which are applicable toget_many()
,exists_many()
andselect_many()
.- max_retries (
int
) - Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:2
- max_retries (
- sleep_between_retries (
int
) - Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries (
- socket_timeout (
int
) - Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:0
- socket_timeout (
- total_timeout (
int
) - Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
andtotal_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:1000
- total_timeout (
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- read_mode_ap
- One of the AP Read Mode Policy Options values such as
aerospike.AS_POLICY_READ_MODE_AP_ONE
Default:aerospike.AS_POLICY_READ_MODE_AP_ONE
New in version 3.7.0.
- read_mode_sc
- One of the SC Read Mode Policy Options values such as
aerospike.POLICY_READ_MODE_SC_SESSION
New in version 3.7.0.
- replica
- One of the Replica Options values such as
aerospike.POLICY_REPLICA_MASTER
Default:aerospike.POLICY_REPLICA_SEQUENCE
- concurrent (
bool
) - Determine if batch commands to each server are run in parallel threads.Default
False
- concurrent (
- allow_inline (
bool
) - Allow batch to be processed immediately in the server’s receiving thread when the server deems it to be appropriate. If False, the batch will always be processed in separate transaction threads. This field is only relevant for the new batch index protocol.Default
True
- allow_inline (
- send_set_name (
bool
) - Send set name field to server for every key in the batch for batch index protocol. This is only necessary when authentication is enabled and security roles are defined on a per set basis.Default:
False
- send_set_name (
- deserialize (
bool
) - Should raw bytes be deserialized to as_list or as_map. Set to False for backup programs that just need access to raw bytes.Default:
True
- deserialize (
- predexp
list
- A list of
aerospike.predexp
used as a predicate filter for record, bin, batch, and record UDF operations.Default: None
- predexp
Info Policies¶
-
policy
A
dict
of optional info policies, which are applicable toinfo()
,info_node()
and index operations.- timeout (
int
) - Read timeout in milliseconds
- timeout (
Admin Policies¶
List Policies¶
-
policy
A
dict
of optional list policies, which are applicable to list operations.- write_flags
- Write flags for the operation.One of the List Write Flags values such as
aerospike.LIST_WRITE_DEFAULT
Default:aerospike.LIST_WRITE_DEFAULT
Values should be or’d together:aerospike.LIST_WRITE_ADD_UNIQUE | aerospike.LIST_WRITE_INSERT_BOUNDED
- list_order
- Ordering to maintain for the list.One of List Order, such as
aerospike.LIST_ORDERED
Default:aerospike.LIST_UNORDERED
Example:
list_policy = { "write_flags": aerospike.LIST_WRITE_ADD_UNIQUE | aerospike.LIST_WRITE_INSERT_BOUNDED, "list_order": aerospike.LIST_ORDERED }
Map Policies¶
-
policy
A
dict
of optional map policies, which are applicable to map operations. Only one ofmap_write_mode
ormap_write_flags
should be provided.map_write_mode
should be used for Aerospike Server versions < 4.3.0 andmap_write_flags
should be used for Aerospike server versions greater than or equal to 4.3.0 .- map_write_mode
- Write mode for the map operation.One of the Map Write Mode values such as
aerospike.MAP_UPDATE
Default:aerospike.MAP_UPDATE
Note
This should only be used for Server version < 4.3.0.
- map_write_flags
- Write flags for the map operation.One of the Map Write Flag values such as
aerospike.MAP_WRITE_FLAGS_DEFAULT
Default:aerospike.MAP_WRITE_FLAGS_DEFAULT
Values should be or’d together:aerospike.LIST_WRITE_ADD_UNIQUE | aerospike.LIST_WRITE_INSERT_BOUNDED
Note
This is only valid for Aerospike Server versions >= 4.3.0.
- map_order
- Ordering to maintain for the map entries.One of Map Order, such as
aerospike.KEY_ORDERED
Default:aerospike.UNORDERED
Example:
# Server >= 4.3.0 map_policy = { 'map_order': aerospike.MAP_UNORDERED, 'map_write_flags': aerospike.MAP_WRITE_FLAGS_CREATE_ONLY } # Server < 4.3.0 map_policy = { 'map_order': aerospike.MAP_UNORDERED, 'map_write_mode': aerospike.MAP_CREATE_ONLY }
Bit Policies¶
-
policy
A
dict
of optional bit policies, which are applicable to bit operations.Note
Requires server version >= 4.6.0
- bit_write_flags
- Write flags for the bit operation.One of the Bitwise Write Flags values such as
aerospike.BIT_WRITE_DEFAULT
Default:aerospike.BIT_WRITE_DEFAULT
Example:
bit_policy = { 'bit_write_flags': aerospike.BIT_WRITE_UPDATE_ONLY }
HyperLogLog Policies¶
-
policy
A
dict
of optional HyperLogLog policies, which are applicable to bit operations.Note
Requires server version >= 4.9.0
- flags
- Write flags for the HLL operation.One of the HyperLogLog Write Flags values such as
aerospike.HLL_WRITE_DEFAULT
Default:aerospike.HLL_WRITE_DEFAULT
Example:
HLL_policy = { 'flags': aerospike.HLL_WRITE_UPDATE_ONLY }
Misc¶
Privilege Objects¶
-
privilege
A
dict
describing a privilege associated with a specific role.- code one of the Privileges values such as
aerospike.PRIV_READ
- ns optional namespace, to which the privilege applies, otherwise the privilege applies globally.
- set optional set within the ns, to which the privilege applies, otherwise to the entire namespace.
Example:
{'code': aerospike.PRIV_READ, 'ns': 'test', 'set': 'demo'}
- code one of the Privileges values such as
Unicode Handling¶
Both str
and unicode()
values are converted by the
client into UTF-8 encoded strings for storage on the aerospike server.
Read methods such as get()
,
query()
, scan()
and
operate()
will return that data as UTF-8 encoded
str
values. To get a unicode()
you will need to manually decode.
Warning
Prior to release 1.0.43 read operations always returned strings as unicode()
.
>>> client.put(key, { 'name': 'Dr. Zeta Alphabeta', 'age': 47})
>>> (key, meta, record) = client.get(key)
>>> type(record['name'])
<type 'str'>
>>> record['name']
'Dr. Zeta Alphabeta'
>>> client.put(key, { 'name': unichr(0x2603), 'age': 21})
>>> (key, meta, record) = client.get(key)
>>> type(record['name'])
<type 'str'>
>>> record['name']
'\xe2\x98\x83'
>>> print(record['name'])
☃
>>> name = record['name'].decode('utf-8')
>>> type(name)
<type 'unicode'>
>>> name
u'\u2603'
>>> print(name)
☃
Scan Class — Scan
¶
Scan
¶
The Scan object is used to return all the records in a specified set (which can be ommitted or
None
). A Scan with aNone
set returns all the records in the namespace.The scan can (optionally) be assigned one of the following
- One of the
predicates
(between()
orequals()
) usingwhere()
.- A list of
predexp
usingpredexp()
The scan is invoked using
foreach()
,results()
, orexecute_background()
. The bins returned can be filtered usingselect()
.See also
Scans and Managing Scans.
Scan Methods¶
-
class
aerospike.
Scan
¶ -
select
(bin1[, bin2[, bin3..]])¶ Set a filter on the record bins resulting from
results()
orforeach()
. If a selected bin does not exist in a record it will not appear in the bins portion of that record tuple.
-
apply
(module, function[, arguments])¶ Apply a record UDF to each record found by the scan UDF.
Parameters: - module (str) – the name of the Lua module.
- function (str) – the name of the Lua function within the module.
- arguments (list) – optional arguments to pass to the function. NOTE: these arguments must be types supported by Aerospike See: supported data types. If you need to use an unsuported type, (e.g. set or tuple) you can use a serializer such as pickle first.
Returns: one of the supported types,
int
,str
,float
(double),list
,dict
(map),bytearray
(bytes).See also
-
add_ops
(ops)¶ Add a list of write ops to the scan. When used with
Scan.execute_background()
the scan will perform the write ops on any records found. If no predicate is attached to the scan it will apply ops to all the records in the specified set. Seeaerospike_helpers
for available ops.Parameters: ops – list A list of write operations generated by the aerospike_helpers e.g. list_operations, map_operations, etc. Note
Requires server version >= 4.7.0.
import aerospike from aerospike_helpers.operations import list_operations from aerospike_helpers.operations import operations scan = client.scan('test', 'demo') ops = [ operations.append(test_bin, 'val_to_append'), list_operations.list_remove_by_index(test_bin, list_index_to_remove, aerospike.LIST_RETURN_NONE) ] scan.add_ops(ops) id = scan.execute_background() client.close()
For a more comprehensive example, see using a list of write ops with
Query.execute_background()
.
-
results
([policy[, nodename]]) -> list of (key, meta, bins)¶ Buffer the records resulting from the scan, and return them as a
list
of records.Parameters: - policy (dict) – optional Scan Policies.
- nodename (str) – optional Node ID of node used to limit the scan to a single node.
Returns: a
list
of Record Tuple.import aerospike import pprint pp = pprint.PrettyPrinter(indent=2) config = { 'hosts': [ ('127.0.0.1',3000)]} client = aerospike.client(config).connect() client.put(('test','test','key1'), {'id':1,'a':1}, policy={'key':aerospike.POLICY_KEY_SEND}) client.put(('test','test','key2'), {'id':2,'b':2}, policy={'key':aerospike.POLICY_KEY_SEND}) scan = client.scan('test', 'test') scan.select('id','a','zzz') res = scan.results() pp.pprint(res) client.close()
Note
We expect to see:
[ ( ( 'test', 'test', u'key2', bytearray(b'\xb2\x18\n\xd4\xce\xd8\xba:\x96s\xf5\x9ba\xf1j\xa7t\xeem\x01')), { 'gen': 52, 'ttl': 2592000}, { 'id': 2}), ( ( 'test', 'test', u'key1', bytearray(b'\x1cJ\xce\xa7\xd4Vj\xef+\xdf@W\xa5\xd8o\x8d:\xc9\xf4\xde')), { 'gen': 52, 'ttl': 2592000}, { 'a': 1, 'id': 1})]
Note
Python client versions >= 3.10.0 Supports predicate expressions for results, foreach, and execute_background see
predexp
. Requires server version >= 4.7.0.from __future__ import print_function import aerospike from aerospike import predexp from aerospike import exception as ex import sys import time config = { 'hosts': [('127.0.0.1', 3000)]} client = aerospike.client(config).connect() # register udf try: client.udf_put('/path/to/my_udf.lua') except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close() sys.exit(1) # put records and run scan try: keys = [('test', 'demo', 1), ('test', 'demo', 2), ('test', 'demo', 3)] records = [{'number': 1}, {'number': 2}, {'number': 3}] for i in range(3): client.put(keys[i], records[i]) scan = client.scan('test', 'demo') preds = [ # check that the record has value < 2 or value == 3 in bin 'name' predexp.integer_bin('number'), predexp.integer_value(2), predexp.integer_less(), predexp.integer_bin('number'), predexp.integer_value(3), predexp.integer_equal(), predexp.predexp_or(2) ] policy = { 'predexp': preds } records = scan.results(policy) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close() # the scan only returns records that match the predexp # EXPECTED OUTPUT: # [ # (('test', 'demo', 1, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'gen': 2, 'ttl': 2591999}, {'number': 1}), # (('test', 'demo', 3, bytearray(b'\xb1\xa5`g\xf6\xd4\xa8\xa4D9\xd3\xafb\xbf\xf8ha\x01\x94\xcd')), {'gen': 13, 'ttl': 2591999}, {'number': 3}) # ]
# contents of my_udf.lua function my_udf(rec, bin, offset) info("my transform: %s", tostring(record.digest(rec))) rec[bin] = rec[bin] + offset aerospike:update(rec) end
-
foreach
(callback[, policy[, options[, nodename]]])¶ Invoke the callback function for each of the records streaming back from the scan.
Parameters: - callback (callable) – the function to invoke for each record.
- policy (dict) – optional Scan Policies.
- options (dict) – the Scan Options that will apply to the scan.
- nodename (str) – optional Node ID of node used to limit the scan to a single node.
Note
A Record Tuple is passed as the argument to the callback function.
import aerospike import pprint pp = pprint.PrettyPrinter(indent=2) config = { 'hosts': [ ('127.0.0.1',3000)]} client = aerospike.client(config).connect() client.put(('test','test','key1'), {'id':1,'a':1}, policy={'key':aerospike.POLICY_KEY_SEND}) client.put(('test','test','key2'), {'id':2,'b':2}, policy={'key':aerospike.POLICY_KEY_SEND}) def show_key(record): key, meta, bins = record print(key) scan = client.scan('test', 'test') scan_opts = { 'concurrent': True, 'nobins': True, 'priority': aerospike.SCAN_PRIORITY_MEDIUM } scan.foreach(show_key, options=scan_opts) client.close()
Note
We expect to see:
('test', 'test', u'key2', bytearray(b'\xb2\x18\n\xd4\xce\xd8\xba:\x96s\xf5\x9ba\xf1j\xa7t\xeem\x01')) ('test', 'test', u'key1', bytearray(b'\x1cJ\xce\xa7\xd4Vj\xef+\xdf@W\xa5\xd8o\x8d:\xc9\xf4\xde'))
Note
To stop the stream return
False
from the callback function.from __future__ import print_function import aerospike config = { 'hosts': [ ('127.0.0.1',3000)]} client = aerospike.client(config).connect() def limit(lim, result): c = [0] # integers are immutable so a list (mutable) is used for the counter def key_add(record): key, metadata, bins = record if c[0] < lim: result.append(key) c[0] = c[0] + 1 else: return False return key_add scan = client.scan('test','user') keys = [] scan.foreach(limit(100, keys)) print(len(keys)) # this will be 100 if the number of matching records > 100 client.close()
-
execute_background
([policy])¶ Execute a record UDF on records found by the scan in the background. This method returns before the scan has completed. A UDF can be added to the scan with
Scan.apply()
.Parameters: policy (dict) – optional Write Policies. Returns: a job ID that can be used with aerospike.Client.job_info()
to track the status of theaerospike.JOB_SCAN
, as it runs in the background.Note
Python client version 3.10.0 implemented scan execute_background.
from __future__ import print_function import aerospike from aerospike import exception as ex import sys import time config = {"hosts": [("127.0.0.1", 3000)]} client = aerospike.client(config).connect() # register udf try: client.udf_put("/path/to/my_udf.lua") except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close() sys.exit(1) # put records and apply udf try: keys = [("test", "demo", 1), ("test", "demo", 2), ("test", "demo", 3)] records = [{"number": 1}, {"number": 2}, {"number": 3}] for i in range(3): client.put(keys[i], records[i]) scan = client.scan("test", "demo") scan.apply("my_udf", "my_udf", ["number", 10]) job_id = scan.execute_background() # wait for job to finish while True: response = client.job_info(job_id, aerospike.JOB_SCAN) if response["status"] != aerospike.JOB_STATUS_INPROGRESS: break time.sleep(0.25) records = client.get_many(keys) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close() # EXPECTED OUTPUT: # [ # (('test', 'demo', 1, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'gen': 2, 'ttl': 2591999}, {'number': 11}), # (('test', 'demo', 2, bytearray(b'\xaejQ_7\xdeJ\xda\xccD\x96\xe2\xda\x1f\xea\x84\x8c:\x92p')), {'gen': 12, 'ttl': 2591999}, {'number': 12}), # (('test', 'demo', 3, bytearray(b'\xb1\xa5`g\xf6\xd4\xa8\xa4D9\xd3\xafb\xbf\xf8ha\x01\x94\xcd')), {'gen': 13, 'ttl': 2591999}, {'number': 13}) # ]
# contents of my_udf.lua function my_udf(rec, bin, offset) info("my transform: %s", tostring(record.digest(rec))) rec[bin] = rec[bin] + offset aerospike:update(rec) end
-
Scan Policies¶
-
policy
A
dict
of optional scan policies which are applicable toScan.results()
andScan.foreach()
. See Policy Options.- max_retries
int
- Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:0
Warning
Database writes that are not idempotent (such as “add”) should not be retried because the write operation may be performed multiple times if the client timed out previous transaction attempts. It’s important to use a distinct write policy for non-idempotent writes which sets max_retries = 0;
- max_retries
- sleep_between_retries
int
- Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries
- socket_timeout
int
- Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:30000
.
- socket_timeout
- total_timeout
int
- Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
andtotal_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:0
- total_timeout
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- fail_on_cluster_change
bool
- Abort the scan if the cluster is not in a stable state. Only used for server versions < 4.9.Default:
False
- fail_on_cluster_change
- durable_delete
bool
- Perform durable delete (requires Enterprise server version >= 3.10)If the transaction results in a record deletion, leave a tombstone for the record.Default:
False
- durable_delete
- records_per_second
int
- Limit the scan to process records at records_per_second.Requires server version >= 4.7.0.Default:
0
(no limit).
- records_per_second
Scan Options¶
-
options
A
dict
of optional scan options which are applicable toScan.foreach()
.- priority
- Scan priority has been replaced by the records_per_second policy see Scan Policies.
- nobins
bool
- nobins
- concurrent
bool
- Whether to run the scan concurrently on all nodes of the cluster.Default
False
.
- concurrent
- percent
int
- Percentage of records to return from the scan.Default
100
.
- percent
New in version 1.0.39.
Query Class — Query
¶
Query
¶
The query object created by calling
aerospike.Client.query()
is used for executing queries over a secondary index of a specified set (which can be omitted orNone
). For queries, theNone
set contains those records which are not part of any named set.The query can (optionally) be assigned one of the following
A query without a predicate will match all the records in the given set, similar to a
Scan
.The query is invoked using
foreach()
,results()
, orexecute_background()
The bins returned can be filtered by usingselect()
.If a list of write operations is added to the query with
add_ops()
, they will be applied to each record processed by the query. See available write operations at Seeaerospike_helpers
Finally, a stream UDF may be applied with
apply()
. It will aggregate results out of the records streaming back from the query.See also
Queries and Managing Queries.
Query Methods¶
-
class
aerospike.
Query
¶ -
select
(bin1[, bin2[, bin3..]])¶ Set a filter on the record bins resulting from
results()
orforeach()
. If a selected bin does not exist in a record it will not appear in the bins portion of that record tuple.
-
where
(predicate)¶ Set a where predicate for the query, without which the query will behave similar to
aerospike.Scan
. The predicate is produced by one of theaerospike.predicates
methodsequals()
andbetween()
.Parameters: predicate (tuple) – the tuple()
produced by one of theaerospike.predicates
methods.Note
Currently, you can assign at most one predicate to the query.
-
results
([,policy [, options]]) -> list of (key, meta, bins)¶ Buffer the records resulting from the query, and return them as a
list
of records.Parameters: - policy (dict) – optional Query Policies.
- options (dict) – optional Query Options.
Returns: a
list
of Record Tuple.import aerospike from aerospike import predicates as p import pprint config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() pp = pprint.PrettyPrinter(indent=2) query = client.query('test', 'demo') query.select('name', 'age') # matched records return with the values of these bins # assuming there is a secondary index on the 'age' bin of test.demo query.where(p.equals('age', 40)) records = query.results( {'total_timeout':2000}) pp.pprint(records) client.close()
Note
Queries require a secondary index to exist on the bin being queried.
Note
Python client version >= 3.10.0 Supports predicate expressions for results, foreach, and execute_background see
predexp
. Requires server versions >= 4.7.0.from __future__ import print_function import aerospike from aerospike import predexp from aerospike import exception as ex import sys import time config = {"hosts": [("127.0.0.1", 3000)]} client = aerospike.client(config).connect() # register udf try: client.udf_put( "/path/to/my_udf.lua" ) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) client.close() sys.exit(1) # put records and apply udf try: keys = [("test", "demo", 1), ("test", "demo", 2), ("test", "demo", 3)] records = [{"number": 1}, {"number": 2}, {"number": 3}] for i in range(3): client.put(keys[i], records[i]) try: client.index_integer_create("test", "demo", "number", "test_demo_number_idx") except ex.IndexFoundError: pass query = client.query("test", "demo") query.apply("my_udf", "my_udf", ["number", 10]) job_id = query.execute_background() # wait for job to finish while True: response = client.job_info(job_id, aerospike.JOB_SCAN) print(response) if response["status"] != aerospike.JOB_STATUS_INPROGRESS: break time.sleep(0.25) records = client.get_many(keys) print(records) except ex.AerospikeError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) finally: client.close() # EXPECTED OUTPUT: # [ # (('test', 'demo', 1, bytearray(b'\xb7\xf4\xb88\x89\xe2\xdag\xdeh>\x1d\xf6\x91\x9a\x1e\xac\xc4F\xc8')), {'gen': 2, 'ttl': 2591999}, {'number': 11}), # (('test', 'demo', 2, bytearray(b'\xaejQ_7\xdeJ\xda\xccD\x96\xe2\xda\x1f\xea\x84\x8c:\x92p')), {'gen': 12, 'ttl': 2591999}, {'number': 12}), # (('test', 'demo', 3, bytearray(b'\xb1\xa5`g\xf6\xd4\xa8\xa4D9\xd3\xafb\xbf\xf8ha\x01\x94\xcd')), {'gen': 13, 'ttl': 2591999}, {'number': 13}) # ]
# contents of my_udf.lua function my_udf(rec, bin, offset) info("my transform: %s", tostring(record.digest(rec))) rec[bin] = rec[bin] + offset aerospike:update(rec) end
Note
For a similar example using .results() see
aerospike.Scan.results()
.-
foreach
(callback[, policy[, options]])¶ Invoke the callback function for each of the records streaming back from the query.
Parameters: - callback (callable) – the function to invoke for each record.
- policy (dict) – optional Query Policies.
- options (dict) – optional Query Options.
Note
A Record Tuple is passed as the argument to the callback function.
import aerospike from aerospike import predicates as p import pprint config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() pp = pprint.PrettyPrinter(indent=2) query = client.query('test', 'demo') query.select('name', 'age') # matched records return with the values of these bins # assuming there is a secondary index on the 'age' bin of test.demo query.where(p.between('age', 20, 30)) names = [] def matched_names(record): key, metadata, bins = record pp.pprint(bins) names.append(bins['name']) query.foreach(matched_names, {'total_timeout':2000}) pp.pprint(names) client.close()
Note
To stop the stream return
False
from the callback function.from __future__ import print_function import aerospike from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1',3000)]} client = aerospike.client(config).connect() def limit(lim, result): c = [0] # integers are immutable so a list (mutable) is used for the counter def key_add(record): key, metadata, bins = record if c[0] < lim: result.append(key) c[0] = c[0] + 1 else: return False return key_add query = client.query('test','user') query.where(p.between('age', 20, 30)) keys = [] query.foreach(limit(100, keys)) print(len(keys)) # this will be 100 if the number of matching records > 100 client.close()
-
apply
(module, function[, arguments])¶ Aggregate the
results()
using a stream UDF. If no predicate is attached to theQuery
the stream UDF will aggregate over all the records in the specified set.Parameters: - module (str) – the name of the Lua module.
- function (str) – the name of the Lua function within the module.
- arguments (list) – optional arguments to pass to the function. NOTE: these arguments must be types supported by Aerospike See: supported data types. If you need to use an unsuported type, (e.g. set or tuple) you can use a serializer like pickle first.
Returns: one of the supported types,
int
,str
,float
(double),list
,dict
(map),bytearray
(bytes).See also
Note
Assume we registered the following Lua module with the cluster as stream_udf.lua using
aerospike.Client.udf_put()
.local function having_ge_threshold(bin_having, ge_threshold) return function(rec) debug("group_count::thresh_filter: %s > %s ?", tostring(rec[bin_having]), tostring(ge_threshold)) if rec[bin_having] < ge_threshold then return false end return true end end local function count(group_by_bin) return function(group, rec) if rec[group_by_bin] then local bin_name = rec[group_by_bin] group[bin_name] = (group[bin_name] or 0) + 1 debug("group_count::count: bin %s has value %s which has the count of %s", tostring(bin_name), tostring(group[bin_name])) end return group end end local function add_values(val1, val2) return val1 + val2 end local function reduce_groups(a, b) return map.merge(a, b, add_values) end function group_count(stream, group_by_bin, bin_having, ge_threshold) if bin_having and ge_threshold then local myfilter = having_ge_threshold(bin_having, ge_threshold) return stream : filter(myfilter) : aggregate(map{}, count(group_by_bin)) : reduce(reduce_groups) else return stream : aggregate(map{}, count(group_by_bin)) : reduce(reduce_groups) end end
Find the first name distribution of users in their twenties using a query aggregation:
import aerospike from aerospike import predicates as p import pprint config = {'hosts': [('127.0.0.1', 3000)], 'lua': {'system_path':'/usr/local/aerospike/lua/', 'user_path':'/usr/local/aerospike/usr-lua/'}} client = aerospike.client(config).connect() pp = pprint.PrettyPrinter(indent=2) query = client.query('test', 'users') query.where(p.between('age', 20, 29)) query.apply('stream_udf', 'group_count', [ 'first_name' ]) names = query.results() # we expect a dict (map) whose keys are names, each with a count value pp.pprint(names) client.close()
With stream UDFs, the final reduce steps (which ties the results from the reducers of the cluster nodes) executes on the client-side. Explicitly setting the Lua
user_path
in the config helps the client find the local copy of the module containing the stream UDF. Thesystem_path
is constructed when the Python package is installed, and contains system modules such asaerospike.lua
,as.lua
, andstream_ops.lua
. The default value for the Luasystem_path
is/usr/local/aerospike/lua
.
-
add_ops
(ops)¶ Add a list of write ops to the query. When used with
Query.execute_background()
the query will perform the write ops on any records found. If no predicate is attached to the Query it will apply ops to all the records in the specified set.Parameters: ops – list A list of write operations generated by the aerospike_helpers e.g. list_operations, map_operations, etc. Note
Requires server version >= 4.7.0.
import aerospike from aerospike_helpers.operations import list_operations from aerospike_helpers.operations import operations query = client.query('test', 'demo') ops = [ operations.append(test_bin, 'val_to_append'), list_operations.list_remove_by_index(test_bin, list_index_to_remove, aerospike.LIST_RETURN_NONE) ] query.add_ops(ops) id = query.execute_background() client.close()
For a more comprehensive example, see using a list of write ops with
Query.execute_background()
.
-
predexp
(predicates)¶ Set the predicate expression filters to be used by this query.
Parameters: predicates – list A list of predicates generated by the aerospike.predexp — Query Predicate Expressions functions import aerospike from aerospike import predexp as predexp query = client.query('test', 'demo') predexps = [ predexp.rec_device_size(), predexp.integer_value(65 * 1024), predexp.integer_greater() ] query.predexp(predexps) big_records = query.results() client.close()
-
execute_background
([policy])¶ Execute a record UDF or write operations on records found by the query in the background. This method returns before the query has completed. A UDF or a list of write operations must have been added to the query with
Query.apply()
orQuery.add_ops()
respectively.Parameters: policy (dict) – optional Write Policies. Returns: a job ID that can be used with aerospike.Client.job_info()
to track the status of theaerospike.JOB_QUERY
, as it runs in the background.# Using a record UDF import aerospike query = client.query('test', 'demo') query.apply('myudfs', 'myfunction', ['a', 1]) query_id = query.execute_background() # This id can be used to monitor the progress of the background query
# Using a list of write ops. from __future__ import print_function import aerospike from aerospike import predicates from aerospike import exception as ex from aerospike_helpers.operations import list_operations import sys import time # Configure the client. config = {"hosts": [("127.0.0.1", 3000)]} # Create a client and connect it to the cluster. try: client = aerospike.client(config).connect() except ex.ClientError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) TEST_NS = "test" TEST_SET = "demo" nested_list = [{"name": "John", "id": 100}, {"name": "Bill", "id": 200}] # Write the records. try: keys = [(TEST_NS, TEST_SET, i) for i in range(5)] for i, key in enumerate(keys): client.put(key, {"account_number": i, "members": nested_list}) except ex.RecordError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) # EXAMPLE 1: Append a new account member to all accounts. try: new_member = {"name": "Cindy", "id": 300} ops = [list_operations.list_append("members", new_member)] query = client.query(TEST_NS, TEST_SET) query.add_ops(ops) id = query.execute_background() # allow for query to complete time.sleep(3) print("EXAMPLE 1") for i, key in enumerate(keys): _, _, bins = client.get(key) print(bins) except ex.ClientError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) # EXAMPLE 2: Remove a member from a specific account using predicates. try: # Add index to the records for use with predex. client.index_integer_create( TEST_NS, TEST_SET, "account_number", "test_demo_account_number_idx" ) ops = [ list_operations.list_remove_by_index("members", 0, aerospike.LIST_RETURN_NONE) ] query = client.query(TEST_NS, TEST_SET) number_predicate = predicates.equals("account_number", 3) query.where(number_predicate) query.add_ops(ops) id = query.execute_background() # allow for query to complete time.sleep(3) print("EXAMPLE 2") for i, key in enumerate(keys): _, _, bins = client.get(key) print(bins) except ex.ClientError as e: print("Error: {0} [{1}]".format(e.msg, e.code)) sys.exit(1) # Cleanup and close the connection to the Aerospike cluster. for i, key in enumerate(keys): client.remove(key) client.index_remove(TEST_NS, "test_demo_account_number_idx") client.close() """ EXPECTED OUTPUT: EXAMPLE 1 {'account_number': 0, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 1, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 2, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 3, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 4, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} EXAMPLE 2 {'account_number': 0, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 1, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 2, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 3, 'members': [{'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} {'account_number': 4, 'members': [{'name': 'John', 'id': 100}, {'name': 'Bill', 'id': 200}, {'name': 'Cindy', 'id': 300}]} """
-
Query Policies¶
-
policy
A
dict
of optional query policies which are applicable toQuery.results()
andQuery.foreach()
. See Policy Options.- max_retries
int
- Maximum number of retries before aborting the current transaction. The initial attempt is not counted as a retry.If max_retries is exceeded, the transaction will return error
AEROSPIKE_ERR_TIMEOUT
.Default:0
Warning
: Database writes that are not idempotent (such as “add”) should not be retried because the write operation may be performed multiple times if the client timed out previous transaction attempts. It’s important to use a distinct write policy for non-idempotent writes which sets max_retries = 0;
- max_retries
- sleep_between_retries
int
- Milliseconds to sleep between retries. Enter
0
to skip sleep.Default:0
- sleep_between_retries
- socket_timeout
int
- Socket idle timeout in milliseconds when processing a database command.If socket_timeout is not
0
and the socket has been idle for at least socket_timeout, both max_retries and total_timeout are checked. If max_retries and total_timeout are not exceeded, the transaction is retried.If bothsocket_timeout
andtotal_timeout
are non-zero andsocket_timeout
>total_timeout
, thensocket_timeout
will be set tototal_timeout
. Ifsocket_timeout
is0
, there will be no socket idle limit.Default:30000
.
- socket_timeout
- total_timeout
int
- Total transaction timeout in milliseconds.The total_timeout is tracked on the client and sent to the server along with the transaction in the wire protocol. The client will most likely timeout first, but the server also has the capability to timeout the transaction.If
total_timeout
is not0
total_timeout
is reached before the transaction completes, the transaction will return errorAEROSPIKE_ERR_TIMEOUT
. Iftotal_timeout
is0
, there will be no total time limit.Default:0
- total_timeout
- compress (
bool
) - Compress client requests and server responses.Use zlib compression on write or batch read commands when the command buffer size is greater than 128 bytes. In addition, tell the server to compress it’s response on read commands. The server response compression threshold is also 128 bytes.This option will increase cpu and memory usage (for extra compressed buffers), but decrease the size of data sent over the network.Default:
False
- compress (
- deserialize
bool
- Should raw bytes representing a list or map be deserialized to a list or dictionary.Set to False for backup programs that just need access to raw bytes.Default:
True
- deserialize
- fail_on_cluster_change
bool
- Terminate query if cluster is in migration state.Default
False
- fail_on_cluster_change
Query Options¶
-
options
A
dict
of optional query options which are applicable toQuery.foreach()
andQuery.results()
.- nobins
bool
- nobins
New in version 3.0.0.
aerospike.predicates
— Query Predicates¶
-
aerospike.predicates.
between
(bin, min, max)¶ Represent a bin BETWEEN min AND max predicate.
Parameters: Returns: tuple()
to be used inaerospike.Query.where()
.from __future__ import print_function import aerospike from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() query = client.query('test', 'demo') query.where(p.between('age', 20, 30)) res = query.results() print(res) client.close()
-
aerospike.predicates.
equals
(bin, val)¶ Represent a bin = val predicate.
Parameters: Returns: tuple()
to be used inaerospike.Query.where()
.from __future__ import print_function import aerospike from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() query = client.query('test', 'demo') query.where(p.equals('name', 'that guy')) res = query.results() print(res) client.close()
-
aerospike.predicates.
geo_within_geojson_region
(bin, shape[, index_type])¶ Predicate for finding any point in bin which is within the given shape. Requires a geo2dsphere index (
index_geo2dsphere_create()
) over a bin containingGeoJSON
point data.Parameters: - bin (str) – the bin name.
- shape (str) – the shape formatted as a GeoJSON string.
- index_type – Optional. Possible
aerospike.INDEX_TYPE_*
values are detailed in Miscellaneous.
Returns: tuple()
to be used inaerospike.Query.where()
.Note
Requires server version >= 3.7.0
from __future__ import print_function import aerospike from aerospike import GeoJSON from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() client.index_geo2dsphere_create('test', 'pads', 'loc', 'pads_loc_geo') bins = {'pad_id': 1, 'loc': aerospike.geojson('{"type":"Point", "coordinates":[-80.604333, 28.608389]}')} client.put(('test', 'pads', 'launchpad1'), bins) # Create a search rectangle which matches screen boundaries: # (from the bottom left corner counter-clockwise) scrn = GeoJSON({ 'type': "Polygon", 'coordinates': [ [[-80.590000, 28.60000], [-80.590000, 28.61800], [-80.620000, 28.61800], [-80.620000, 28.60000], [-80.590000, 28.60000]]]}) # Find all points contained in the rectangle. query = client.query('test', 'pads') query.select('pad_id', 'loc') query.where(p.geo_within_geojson_region('loc', scrn.dumps())) records = query.results() print(records) client.close()
New in version 1.0.58.
-
aerospike.predicates.
geo_within_radius
(bin, long, lat, radius_meters[, index_type])¶ Predicate helper builds an AeroCircle GeoJSON shape, and returns a ‘within GeoJSON region’ predicate. Requires a geo2dsphere index (
index_geo2dsphere_create()
) over a bin containingGeoJSON
point data.Parameters: - bin (str) – the bin name.
- long (float) – the longitude of the center point of the AeroCircle.
- lat (float) – the latitude of the center point of the AeroCircle.
- radius_meters (float) – the radius length in meters of the AeroCircle.
- index_type – Optional. Possible
aerospike.INDEX_TYPE_*
values are detailed in Miscellaneous.
Returns: tuple()
to be used inaerospike.Query.where()
.Note
Requires server version >= 3.8.1
from __future__ import print_function import aerospike from aerospike import GeoJSON from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() client.index_geo2dsphere_create('test', 'pads', 'loc', 'pads_loc_geo') bins = {'pad_id': 1, 'loc': aerospike.geojson('{"type":"Point", "coordinates":[-80.604333, 28.608389]}')} client.put(('test', 'pads', 'launchpad1'), bins) query = client.query('test', 'pads') query.select('pad_id', 'loc') query.where(p.geo_within_radius('loc', -80.605000, 28.60900, 400.0)) records = query.results() print(records) client.close()
New in version 1.0.58.
-
aerospike.predicates.
geo_contains_geojson_point
(bin, point[, index_type])¶ Predicate for finding any regions in the bin which contain the given point. Requires a geo2dsphere index (
index_geo2dsphere_create()
) over a bin containingGeoJSON
point data.Parameters: - bin (str) – the bin name.
- point (str) – the point formatted as a GeoJSON string.
- index_type – Optional. Possible
aerospike.INDEX_TYPE_*
values are detailed in Miscellaneous.
Returns: tuple()
to be used inaerospike.Query.where()
.Note
Requires server version >= 3.7.0
from __future__ import print_function import aerospike from aerospike import GeoJSON from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() client.index_geo2dsphere_create('test', 'launch_centers', 'area', 'launch_area_geo') rect = GeoJSON({ 'type': "Polygon", 'coordinates': [ [[-80.590000, 28.60000], [-80.590000, 28.61800], [-80.620000, 28.61800], [-80.620000, 28.60000], [-80.590000, 28.60000]]]}) bins = {'area': rect} client.put(('test', 'launch_centers', 'kennedy space center'), bins) # Find all geo regions containing a point point = GeoJSON({'type': "Point", 'coordinates': [-80.604333, 28.608389]}) query = client.query('test', 'launch_centers') query.where(p.geo_contains_geojson_point('area', point.dumps())) records = query.results() print(records) client.close()
New in version 1.0.58.
-
aerospike.predicates.
geo_contains_point
(bin, long, lat[, index_type])¶ Predicate helper builds a GeoJSON point, and returns a ‘contains GeoJSON point’ predicate. Requires a geo2dsphere index (
index_geo2dsphere_create()
) over a bin containingGeoJSON
point data.Parameters: - bin (str) – the bin name.
- long (float) – the longitude of the point.
- lat (float) – the latitude of the point.
- index_type – Optional. Possible
aerospike.INDEX_TYPE_*
values are detailed in Miscellaneous.
Returns: tuple()
to be used inaerospike.Query.where()
.Note
Requires server version >= 3.7.0
from __future__ import print_function import aerospike from aerospike import GeoJSON from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() client.index_geo2dsphere_create('test', 'launch_centers', 'area', 'launch_area_geo') rect = GeoJSON({ 'type': "Polygon", 'coordinates': [ [[-80.590000, 28.60000], [-80.590000, 28.61800], [-80.620000, 28.61800], [-80.620000, 28.60000], [-80.590000, 28.60000]]]}) bins = {'area': rect} client.put(('test', 'launch_centers', 'kennedy space center'), bins) # Find all geo regions containing a point query = client.query('test', 'launch_centers') query.where(p.geo_contains_point('area', -80.604333, 28.608389)) records = query.results() print(records) client.close()
New in version 1.0.58.
-
aerospike.predicates.
contains
(bin, index_type, val)¶ Represent the predicate bin CONTAINS val for a bin with a complex (list or map) type.
Parameters: - bin (str) – the bin name.
- index_type – Possible
aerospike.INDEX_TYPE_*
values are detailed in Miscellaneous. - val (
str
orint
) – match records whose bin is an index_type (ex: list) containing val.
Returns: tuple()
to be used inaerospike.Query.where()
.Note
Requires server version >= 3.8.1
from __future__ import print_function import aerospike from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() # assume the bin fav_movies in the set test.demo bin should contain # a dict { (str) _title_ : (int) _times_viewed_ } # create a secondary index for string values of test.demo records whose 'fav_movies' bin is a map client.index_map_keys_create('test', 'demo', 'fav_movies', aerospike.INDEX_STRING, 'demo_fav_movies_titles_idx') # create a secondary index for integer values of test.demo records whose 'fav_movies' bin is a map client.index_map_values_create('test', 'demo', 'fav_movies', aerospike.INDEX_NUMERIC, 'demo_fav_movies_views_idx') client.put(('test','demo','Dr. Doom'), {'age':43, 'fav_movies': {'12 Monkeys': 1, 'Brasil': 2}}) client.put(('test','demo','The Hulk'), {'age':38, 'fav_movies': {'Blindness': 1, 'Eternal Sunshine': 2}}) query = client.query('test', 'demo') query.where(p.contains('fav_movies', aerospike.INDEX_TYPE_MAPKEYS, '12 Monkeys')) res = query.results() print(res) client.close()
-
aerospike.predicates.
range
(bin, index_type, min, max))¶ Represent the predicate bin CONTAINS values BETWEEN min AND max for a bin with a complex (list or map) type.
Parameters: - bin (str) – the bin name.
- index_type – Possible
aerospike.INDEX_TYPE_*
values are detailed in Miscellaneous. - min (int) – the minimum value to be used for matching with the range operator.
- max (int) – the maximum value to be used for matching with the range operator.
Returns: tuple()
to be used inaerospike.Query.where()
.Note
Requires server version >= 3.8.1
from __future__ import print_function import aerospike from aerospike import predicates as p config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() # create a secondary index for numeric values of test.demo records whose 'age' bin is a list client.index_list_create('test', 'demo', 'age', aerospike.INDEX_NUMERIC, 'demo_age_nidx') # query for records whose 'age' bin has a list with numeric values between 20 and 30 query = client.query('test', 'demo') query.where(p.range('age', aerospike.INDEX_TYPE_LIST, 20, 30)) res = query.results() print(res) client.close()
aerospike.predexp
— Query Predicate Expressions¶
The following methods allow a user to define a predicate expression filter. Predicate expression filters are applied on the query results on the server. Predicate expression filters may occur on any bin in the record.
-
aerospike.predexp.
predexp_and
(nexpr)¶ Create an AND logical predicate expression.
Parameters: nexpr – int
Number of expressions to combine with “and” . The value of nexpr must be between 1 and 65535.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “c” is between 11 and 20 inclusive:
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("c"), predexp.integer_value(11), predexp.integer_greatereq(), predexp.integer_bin("c"), predexp.integer_value(20), predexp.integer_lesseq(), predexp.predexp_and(2) ]
-
aerospike.predexp.
predexp_or
(nexpr)¶ Create an Or logical predicate expression.
Parameters: nexpr – int
Number of expressions to combine with “or”. The value of nexpr must be between 1 and 65535.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “pet” is “dog” or “cat”
from aerospike import predexp as predexp predexps = [ predexp.string_bin("pet"), predexp.string_value("cat"), predexp.string_equal(), predexp.string_bin("pet"), predexp.string_value("dog"), predexp.string_equal(), predexp.predexp_or(2) ]
-
aerospike.predexp.
predexp_not
()¶ Create a not logical predicate expression which negates the previouse predicate expression on the stack.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “pet” is not “cat”
from aerospike import predexp as predexp predexps = [ predexp.string_bin("pet"), predexp.string_value("cat"), predexp.string_equal(), predexp.predexp_not() ]
-
aerospike.predexp.
integer_bin
(bin_name)¶ Create an integer bin value predicate expression.
Parameters: bin_name – str
The name of the bin containing an integer.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “age” is 42
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("age"), predexp.integer_value(42), predexp.integer_equal() ]
-
aerospike.predexp.
string_bin
(bin_name)¶ Create a string bin value predicate expression.
Parameters: bin_name – str
The name of the bin containing a string.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “name” is “Bob”.
from aerospike import predexp as predexp predexps = [ predexp.string_bin("name"), predexp.string_value("Bob"), predexp.string_equal() ]
-
aerospike.predexp.
geojson_bin
(bin_name)¶ Create a GeoJSON bin value predicate expression.
Parameters: bin_name – str
The name of the bin containing a GeoJSON value.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “location” is within a specified region.
from aerospike import predexp as predexp geo_region = aerospike.GeoJSON( {"type": "AeroCircle", "coordinates": [[-122.0, 37.5], 1000]}).dumps() predexps = [ predexp.geojson_bin("location"), predexp.geojson_value(geo_region), predexp.geojson_within() ]
-
aerospike.predexp.
list_bin
(bin_name)¶ Create a list bin value predicate expression.
Parameters: bin_name – str
The name of the bin containing a list.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the list in bin “names” contains an entry equal to “Alice”
from aerospike import predexp as predexp predexps = [ predexp.string_var("list_entry"), predexp.string_value("Alice"), predexp.string_equal(), predexp.list_bin("names"), predexp.list_iterate_or("list_entry") ]
-
aerospike.predexp.
map_bin
(bin_name)¶ Create a map bin value predicate expression.
Parameters: bin_name – str
The name of the bin containing a map value.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the map in bin “pet_count” has an entry with a key equal to “Cat”
from aerospike import predexp as predexp predexps = [ predexp.string_var("map_key"), predexp.string_value("Cat"), predexp.string_equal(), predexp.map_bin("pet_count"), predexp.mapkey_iterate_or("map_key") ]
-
aerospike.predexp.
geojson_value
(geo_value)¶ Create a GeoJSON value predicate expression.
Parameters: bin_name – str
The geojson string.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “location” is within a specified region.
from aerospike import predexp as predexp geo_region = aerospike.GeoJSON( {"type": "AeroCircle", "coordinates": [[-122.0, 37.5], 1000]}).dumps() predexps = [ predexp.geojson_bin("location"), predexp.geojson_value(geo_region), predexp.geojson_within() ]
-
aerospike.predexp.
integer_value
(int_value)¶ Create an integer value predicate expression.
Parameters: bin_name – int
The integer valueReturns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “age” is 42
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("age"), predexp.integer_value(42), predexp.integer_equal() ]
-
aerospike.predexp.
string_value
(string_value)¶ Create a string value predicate expression.
Parameters: bin_name – str
The string value.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records where the value of bin “name” is “Bob”.
from aerospike import predexp as predexp predexps = [ predexp.string_bin("name"), predexp.string_value("Bob"), predexp.string_equal() ]
-
aerospike.predexp.
integer_var
(var_name)¶ Create an integer iteration variable predicate expression.
Parameters: var_name – str
The name of the variable. This should match a value used when specifying the iteration.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example the following selects a record where the list in bin “numbers” contains an entry equal to
42
from aerospike import predexp as predexp predexps = [ predexp.integer_var("item"), predexp.integer_value(42), predexp.integer_equal(), predexp.list_bin("numbers"), predexp.list_iterate_or("item") ]
-
aerospike.predexp.
string_var
(var_name)¶ Create an string iteration variable predicate expression.
Parameters: var_name – str
The name of the variable. This should match a value used when specifying the iteration.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example the following selects a record where the list in bin “languages” contains an entry equal to
"Python"
from aerospike import predexp as predexp predexps = [ predexp.string_var("item"), predexp.string_value("Python"), predexp.string_equal(), predexp.list_bin("languages"), predexp.list_iterate_or("item") ]
-
aerospike.predexp.
geojson_var
(var_name)¶ Create an GeoJSON iteration variable predicate expression.
Parameters: var_name – str
The name of the variable. This should match a value used when specifying the iteration.Returns: tuple()
to be used inaerospike.Query.predexp()
.
-
aerospike.predexp.
list_iterate_or
(var_name)¶ Create an list iteration OR logical predicate expression.
Parameters: bin_name – str
The name of the iteration variableReturns: tuple()
to be used inaerospike.Query.predexp()
.The list iteration expression pops two children off the expression stack. The left child (pushed earlier) must contain a logical subexpression containing one or more matching iteration variable expressions. The right child (pushed later) must specify a list bin. The list iteration traverses the list and repeatedly evaluates the subexpression substituting each list element’s value into the matching iteration variable. The result of the iteration expression is a logical OR of all of the individual element evaluations.
If the list bin contains zero elements
list_iterate_or()
will evaluate to false.For example, the following sequence of predicate expressions selects records where the list in bin “names” contains an entry equal to “Alice”
from aerospike import predexp as predexp predexps = [ predexp.string_var("list_entry"), predexp.string_value("Alice"), predexp.string_equal(), predexp.list_bin("names"), predexp.list_iterate_or("list_entry") ]
-
aerospike.predexp.
list_iterate_and
(var_name)¶ Create an list iteration And logical predicate expression.
Parameters: var_name – str
The name of the iteration variableReturns: tuple()
to be used inaerospike.Query.predexp()
.The list iteration expression pops two children off the expression stack. The left child (pushed earlier) must contain a logical subexpression containing one or more matching iteration variable expressions. The right child (pushed later) must specify a list bin. The list iteration traverses the list and repeatedly evaluates the subexpression substituting each list element’s value into the matching iteration variable. The result of the iteration expression is a logical AND of all of the individual element evaluations.
If the list bin contains zero elements
list_iterate_and()
will evaluate to true. This is useful when testing for exclusion (see example).For example, the following sequence of predicate expressions selects records where the list in bin “names” contains no entries equal to “Bob”.
from aerospike import predexp as predexp predexps = [ predexp.string_var("list_entry"), predexp.string_value("Bob"), predexp.string_equal(), predexp.predexp_not(), predexp.list_bin("names"), predexp.list_iterate_and("list_entry") ]
-
aerospike.predexp.
mapkey_iterate_or
(var_name)¶ Create an map key iteration Or logical predicate expression.
Parameters: var_name – str
The name of the iteration variableReturns: tuple()
to be used inaerospike.Query.predexp()
.The mapkey iteration expression pops two children off the expression stack. The left child (pushed earlier) must contain a logical subexpression containing one or more matching iteration variable expressions. The right child (pushed later) must specify a map bin. The mapkey iteration traverses the map and repeatedly evaluates the subexpression substituting each map key value into The matching iteration variable. The result of the iteration expression is a logical OR of all of the individual element evaluations.
If the map bin contains zero elements
mapkey_iterate_or()
will return false. For example, the following sequence of predicate expressions selects records where the map in bin “pet_count” has an entry with a key equal to “Cat”from aerospike import predexp as predexp predexps = [ predexp.string_var("map_key"), predexp.string_value("Cat"), predexp.string_equal(), predexp.map_bin("pet_count"), predexp.mapkey_iterate_or("map_key") ]
-
aerospike.predexp.
mapkey_iterate_and
(var_name)¶ Create an map key iteration AND logical predicate expression.
Parameters: var_name – str
The name of the iteration variableReturns: tuple()
to be used inaerospike.Query.predexp()
.The mapkey iteration expression pops two children off the expression stack. The left child (pushed earlier) must contain a logical subexpression containing one or more matching iteration variable expressions. The right child (pushed later) must specify a map bin. The mapkey iteration traverses the map and repeatedly evaluates the subexpression substituting each map key value into The matching iteration variable. The result of the iteration expression is a logical AND of all of the individual element evaluations.
If the map bin contains zero elements
mapkey_iterate_and()
will return true. This is useful when testing for exclusion (see example).For example, the following sequence of predicate expressions selects records where the map in bin “pet_count” does not contain an entry with a key equal to “Cat”.
from aerospike import predexp as predexp predexps = [ predexp.string_var("map_key"), predexp.string_value("Cat"), predexp.string_equal(), predexp.predexp_not(), predexp.map_bin("pet_count"), predexp.mapkey_iterate_and("map_key") ]
-
aerospike.predexp.
mapval_iterate_or
(var_name)¶ Create an map value iteration Or logical predicate expression.
Parameters: var_name – str
The name of the iteration variableReturns: tuple()
to be used inaerospike.Query.predexp()
.The mapval iteration expression pops two children off the expression stack. The left child (pushed earlier) must contain a logical subexpression containing one or more matching iteration variable expressions. The right child (pushed later) must specify a map bin. The mapval iteration traverses the map and repeatedly evaluates the subexpression substituting each map value into the matching iteration variable. The result of the iteration expression is a logical OR of all of the individual element evaluations.
If the map bin contains zero elements
mapval_iterate_or()
will return false.For example, the following sequence of predicate expressions selects records where at least one of the values in the map in bin “pet_count” is
0
from aerospike import predexp as predexp predexps = [ predexp.string_var("map_key"), predexp.integer_value(0), predexp.integer_equal(), predexp.map_bin("pet_count"), predexp.mapval_iterate_or("map_key") ]
-
aerospike.predexp.
mapval_iterate_and
(var_name)¶ Create an map value iteration AND logical predicate expression.
Parameters: var_name – str
The name of the iteration variableReturns: tuple()
to be used inaerospike.Query.predexp()
.The mapval iteration expression pops two children off the expression stack. The left child (pushed earlier) must contain a logical subexpression containing one or more matching iteration variable expressions. The right child (pushed later) must specify a map bin. The mapval iteration traverses the map and repeatedly evaluates the subexpression substituting each map value into the matching iteration variable. The result of the iteration expression is a logical AND of all of the individual element evaluations.
If the map bin contains zero elements
mapval_iterate_and()
will return true. This is useful when testing for exclusion (see example).For example, the following sequence of predicate expressions selects records where none of the values in the map in bin “pet_count” is
0
from aerospike import predexp as predexp predexps = [ predexp.string_var("map_key"), predexp.integer_value(0), predexp.integer_equal(), predexp.predexp_not(), predexp.map_bin("pet_count"), predexp.mapval_iterate_and("map_key") ]
-
aerospike.predexp.
rec_digest_modulo
(mod)¶ Create a digest modulo record metadata value predicate expression.
Parameters: mod – int
The value of this expression assumes the value of 4 bytes of the digest modulo this argument.Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have
digest(key) % 3 == 1
:from aerospike import predexp as predexp predexps = [ predexp.rec_digest_modulo(3), predexp.integer_value(1), predexp.integer_equal() ]
-
aerospike.predexp.
rec_last_update
()¶ Create a last update record metadata value predicate expression. The record last update expression assumes the value of the number of nanoseconds since the unix epoch that the record was last updated.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have been updated after a timestamp:
from aerospike import predexp as predexp predexps = [ predexp.rec_last_update(), predexp.integer_value(timestamp_ns), predexp.integer_greater() ]
-
aerospike.predexp.
rec_void_time
()¶ Create a void time record metadata value predicate expression. The record void time expression assumes the value of the number of nanoseconds since the unix epoch when the record will expire. The special value of 0 means the record will not expire.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have void time set to 0 (no expiration):
from aerospike import predexp as predexp predexps = [ predexp.rec_void_time(), predexp.integer_value(0), predexp.integer_equal() ]
-
aerospike.predexp.
rec_device_size
()¶ Create a record device size metadata value predicate expression. The record device size expression assumes the value of the size in bytes that the record occupies on device storage. For non-persisted records, this value is 0.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records whose device storage size is larger than 65K:
from aerospike import predexp as predexp predexps = [ predexp.rec_device_size(), predexp.integer_value(65 * 1024), predexp.integer_greater() ]
-
aerospike.predexp.
integer_equal
()¶ Create an integer comparison logical predicate expression. If the value of either of the child expressions is unknown because a specified bin does not exist or contains a value of the wrong type the result of the comparison is false. If a true outcome is desirable in this situation use the complimentary comparison and enclose in a logical NOT.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have bin “foo” equal to 42:
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("foo"), predexp.integer_value(42), predexp.integer_equal() ]
-
aerospike.predexp.
integer_greater
()¶ Create an integer comparison logical predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have bin “foo” greater than 42:
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("foo"), predexp.integer_value(42), predexp.integer_greater() ]
-
aerospike.predexp.
integer_greatereq
()¶ Create an integer comparison logical predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have bin “foo” greater than or equal to 42:
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("foo"), predexp.integer_value(42), predexp.integer_greatereq() ]
-
aerospike.predexp.
integer_less
()¶ Create an integer comparison logical predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have bin “foo” less than 42:
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("foo"), predexp.integer_value(42), predexp.integer_less() ]
-
aerospike.predexp.
integer_lesseq
()¶ Create an integer comparison logical predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have bin “foo” less than or equal to 42:
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("foo"), predexp.integer_value(42), predexp.integer_lesseq() ]
-
aerospike.predexp.
integer_unequal
()¶ Create an integer comparison logical predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.This expression will evaluate to true if, and only if, both children of the expression exist, and are of type integer, and are not equal to each other. If this is not desired, utilize
aerospike.predexp.integer_equal()
in conjunction withaerospike.predexp.predexp_not()
.For example, the following sequence of predicate expressions selects records that have bin “foo” not equal to 42:
from aerospike import predexp as predexp predexps = [ predexp.integer_bin("foo"), predexp.integer_value(42), predexp.integer_unequal() ]
-
aerospike.predexp.
string_equal
()¶ Create an integer comparison logical predicate expression. If the value of either of the child expressions is unknown because a specified bin does not exist or contains a value of the wrong type the result of the comparison is false. If a true outcome is desirable in this situation use the complimentary comparison and enclose in a logical NOT.
Returns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have bin “foo” equal to “bar”:
from aerospike import predexp as predexp predexps = [ predexp.string_bin("foo"), predexp.string_value("bar"), predexp.string_equal() ]
-
aerospike.predexp.
string_unequal
()¶ Create an integer comparison logical predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.This expression will evaluate to true if, and only if, both children of the expression exist, and are of type string, and are not equal to each other. If this is not desired, utilize
aerospike.predexp.string_equal()
in conjunction withaerospike.predexp.predexp_not()
.For example, the following sequence of predicate expressions selects records that have bin “foo” not equal to “bar”:
from aerospike import predexp as predexp predexps = [ predexp.string_bin("foo"), predexp.string_value("bar"), predexp.string_unequal() ]
-
aerospike.predexp.
geojson_within
()¶ Create a Geojson within predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.from aerospike import predexp as predexp predexps = [ predexp.geojson_bin("location"), predexp.geojson_value(my_geo_region), predexp.geojson_within() ]
-
aerospike.predexp.
geojson_contains
()¶ Create a Geojson contains predicate expression.
Returns: tuple()
to be used inaerospike.Query.predexp()
.from aerospike import predexp as predexp predexps = [ predexp.geojson_bin("region"), predexp.geojson_value(my_geo_point), predexp.geojson_contains() ]
-
aerospike.predexp.
string_regex
(*flags)¶ Create a string regex predicate. May be called without any arguments to specify default behavior.
Parameters: flags – int
Regex Flag Values Any, or none of the aerospike REGEX constantsReturns: tuple()
to be used inaerospike.Query.predexp()
.For example, the following sequence of predicate expressions selects records that have bin “hex” value ending in ‘1’ or ‘2’:
from aerospike import predexp as predexp predexps = [ predexp.string_bin('hex'), predexp.string_value('0x00.[12]'), predexp.string_regex(aerospike.REGEX_ICASE) ]
aerospike.exception
— Aerospike Exceptions¶
from __future__ import print_function
import aerospike
from aerospike import exception as ex
try:
config = { 'hosts': [ ('127.0.0.1', 3000)], 'policies': { 'total_timeout': 1200}}
client = aerospike.client(config).connect()
client.close()
except ex.AerospikeError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
New in version 1.0.44.
In Doubt Status¶
The in doubt status of a caught exception can be checked by looking at the 5th element of its args tuple
key = 'test', 'demo', 1 record = {'some': 'thing'} try: client.put(key, record) except AerospikeError as exc: print("The in doubt nature of the operation is: {}".format(exc.args[4])
New in version 3.0.1.
Exception Types¶
-
exception
aerospike.exception.
AerospikeError
¶ The parent class of all exceptions raised by the Aerospike client, inherits from
exceptions.Exception
. These attributes should be checked by executing `exc.args[i] where i is the index of the attribute. For example to check in_doubt, run exc.args[4]-
code
¶ The associated status code.
-
msg
¶ The human-readable error message.
-
file
¶
-
line
¶
-
in_doubt
¶ True if it is possible that the operation succeeded.
-
-
exception
aerospike.exception.
ClientError
¶ Exception class for client-side errors, often due to mis-configuration or misuse of the API methods. Subclass of
AerospikeError
.
-
exception
aerospike.exception.
InvalidHostError
¶ Subclass of
ClientError
.
-
exception
aerospike.exception.
ParamError
¶ The operation was not performed because of invalid parameters.
-
exception
aerospike.exception.
ServerError
¶ The parent class for all errors returned from the cluster.
-
exception
aerospike.exception.
InvalidRequest
¶ Protocol-level error. Subclass of
ServerError
.
-
exception
aerospike.exception.
OpNotApplicable
¶ The operation cannot be applied to the current bin value on the server. Subclass of
ServerError
.
-
exception
aerospike.exception.
FilteredOut
¶ The transaction was not performed because the predexp was false.
-
exception
aerospike.exception.
ServerFull
¶ The server node is running out of memory and/or storage device space reserved for the specified namespace. Subclass of
ServerError
.
-
exception
aerospike.exception.
AlwaysForbidden
¶ Operation not allowed in current configuration. Subclass of
ServerError
.
-
exception
aerospike.exception.
UnsupportedFeature
¶ Encountered an unimplemented server feature. Subclass of
ServerError
.
-
exception
aerospike.exception.
DeviceOverload
¶ The server node’s storage device(s) can’t keep up with the write load. Subclass of
ServerError
.
-
exception
aerospike.exception.
NamespaceNotFound
¶ Namespace in request not found on server. Subclass of
ServerError
.
-
exception
aerospike.exception.
ForbiddenError
¶ Operation not allowed at this time. Subclass of
ServerError
.
-
exception
aerospike.exception.
ElementExistsError
¶ Raised when trying to alter a map key which already exists, when using a create_only policy.
Subclass of
ServerError
.
-
exception
aerospike.exception.
ElementNotFoundError
¶ Raised when trying to alter a map key which does not exist, when using an update_only policy.
Subclass of
ServerError
.
-
exception
aerospike.exception.
RecordError
¶ The parent class for record and bin exceptions exceptions associated with read and write operations. Subclass of
ServerError
.-
key
¶ The key identifying the record.
-
bin
¶ Optionally the bin associated with the error.
-
-
exception
aerospike.exception.
RecordKeyMismatch
¶ Record key sent with transaction did not match key stored on server. Subclass of
RecordError
.
-
exception
aerospike.exception.
RecordNotFound
¶ Record does not exist in database. May be returned by read, or write with policy
aerospike.POLICY_EXISTS_UPDATE
. Subclass ofRecordError
.
-
exception
aerospike.exception.
RecordGenerationError
¶ Generation of record in database does not satisfy write policy. Subclass of
RecordError
.
-
exception
aerospike.exception.
RecordExistsError
¶ Record already exists. May be returned by write with policy
aerospike.POLICY_EXISTS_CREATE
. Subclass ofRecordError
.
-
exception
aerospike.exception.
RecordBusy
¶ Too may concurrent requests for one record - a “hot-key” situation. Subclass of
RecordError
.
-
exception
aerospike.exception.
RecordTooBig
¶ Record being (re-)written can’t fit in a storage write block. Subclass of
RecordError
.
-
exception
aerospike.exception.
BinNameError
¶ Length of bin name exceeds the limit of 14 characters. Subclass of
RecordError
.
-
exception
aerospike.exception.
BinIncompatibleType
¶ Bin modification operation can’t be done on an existing bin due to its value type (for example appending to an integer). Subclass of
RecordError
.
-
exception
aerospike.exception.
IndexError
¶ The parent class for indexing exceptions. Subclass of
ServerError
.-
index_name
¶ The name of the index associated with the error.
-
-
exception
aerospike.exception.
IndexNotFound
¶ Subclass of
IndexError
.
-
exception
aerospike.exception.
IndexFoundError
¶ Subclass of
IndexError
.
-
exception
aerospike.exception.
IndexOOM
¶ The index is out of memory. Subclass of
IndexError
.
-
exception
aerospike.exception.
IndexNotReadable
¶ Subclass of
IndexError
.
-
exception
aerospike.exception.
IndexNameMaxLen
¶ Subclass of
IndexError
.
-
exception
aerospike.exception.
IndexNameMaxCount
¶ Reached the maximum allowed number of indexes. Subclass of
IndexError
.
-
exception
aerospike.exception.
QueryError
¶ Exception class for query errors. Subclass of
AerospikeError
.
-
exception
aerospike.exception.
QueryQueueFull
¶ Subclass of
QueryError
.
-
exception
aerospike.exception.
QueryTimeout
¶ Subclass of
QueryError
.
-
exception
aerospike.exception.
ClusterError
¶ Cluster discovery and connection errors. Subclass of
AerospikeError
.
-
exception
aerospike.exception.
ClusterChangeError
¶ A cluster state change occurred during the request. This may also be returned by scan operations with the fail-on-cluster-change flag set. Subclass of
ClusterError
.
-
exception
aerospike.exception.
AdminError
¶ The parent class for exceptions of the security API.
-
exception
aerospike.exception.
ExpiredPassword
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
ForbiddenPassword
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
IllegalState
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
InvalidCommand
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
InvalidCredential
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
InvalidField
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
InvalidPassword
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
InvalidPrivilege
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
InvalidRole
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
InvalidUser
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
NotAuthenticated
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
RoleExistsError
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
RoleViolation
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
SecurityNotEnabled
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
SecurityNotSupported
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
SecuritySchemeNotSupported
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
UserExistsError
¶ Subclass of
AdminError
.
-
exception
aerospike.exception.
UDFError
¶ The parent class for UDF exceptions exceptions. Subclass of
ServerError
.-
module
¶ The UDF module associated with the error.
-
func
¶ Optionally the name of the UDF function.
-
Exception Hierarchy¶
AerospikeError (*)
+-- TimeoutError (9)
+-- ClientError (-1)
| +-- InvalidHost (-4)
| +-- ParamError (-2)
+-- ServerError (1)
+-- InvalidRequest (4)
+-- ServerFull (8)
+-- AlwaysForbidden (10)
+-- UnsupportedFeature (16)
+-- DeviceOverload (18)
+-- NamespaceNotFound (20)
+-- ForbiddenError (22)
+-- ElementNotFoundError (23)
+-- ElementExistsError (24)
+-- RecordError (*)
| +-- RecordKeyMismatch (19)
| +-- RecordNotFound (2)
| +-- RecordGenerationError (3)
| +-- RecordExistsError (5)
| +-- RecordTooBig (13)
| +-- RecordBusy (14)
| +-- BinNameError (21)
| +-- BinIncompatibleType (12)
+-- IndexError (204)
| +-- IndexNotFound (201)
| +-- IndexFoundError (200)
| +-- IndexOOM (202)
| +-- IndexNotReadable (203)
| +-- IndexNameMaxLen (205)
| +-- IndexNameMaxCount (206)
+-- QueryError (213)
| +-- QueryQueueFull (211)
| +-- QueryTimeout (212)
+-- ClusterError (11)
| +-- ClusterChangeError (7)
+-- AdminError (*)
| +-- SecurityNotSupported (51)
| +-- SecurityNotEnabled (52)
| +-- SecuritySchemeNotSupported (53)
| +-- InvalidCommand (54)
| +-- InvalidField (55)
| +-- IllegalState (56)
| +-- InvalidUser (60)
| +-- UserExistsError (61)
| +-- InvalidPassword (62)
| +-- ExpiredPassword (63)
| +-- ForbiddenPassword (64)
| +-- InvalidCredential (65)
| +-- InvalidRole (70)
| +-- RoleExistsError (71)
| +-- RoleViolation (81)
| +-- InvalidPrivilege (72)
| +-- NotAuthenticated (80)
+-- UDFError (*)
+-- UDFNotFound (1301)
+-- LuaFileNotFound (1302)
aerospike_helpers
— Aerospike Helper Package for bin operations (list, map, bit, etc.)¶
This package contains helpers to be used by the operate and operate_ordered methods for bin operations. (list, map, bitwise, etc.)
Subpackages¶
aerospike_helpers.operations package¶
aerospike_helpers.operations.operations module¶
Module with helper functions to create dictionaries consumed by
the aerospike.Client.operate
and aerospike.Client.operate_ordered
methods for the aerospike.client class.
-
aerospike_helpers.operations.operations.
append
(bin_name, append_item)¶ Create an append operation dictionary.
The append operation appends append_item to the value in bin_name.
Parameters: - bin (string) – The name of the bin to be used.
- append_item – The value which will be appended to the item contained in the specified bin.
Returns: A dictionary to be passed to operate or operate_ordered.
-
aerospike_helpers.operations.operations.
delete
()¶ Create a delete operation dictionary.
The delete operation deletes a record and all associated bins. Requires server version >= 4.7.0.8.
Returns: A dictionary to be passed to operate or operate_ordered.
-
aerospike_helpers.operations.operations.
increment
(bin_name, amount)¶ Create an increment operation dictionary.
The increment operation increases a value in bin_name by the specified amount, or creates a bin with the value of amount.
Parameters: - bin (string) – The name of the bin to be incremented.
- amount – The amount by which to increment the item in the specified bin.
Returns: A dictionary to be passed to operate or operate_ordered.
-
aerospike_helpers.operations.operations.
prepend
(bin_name, prepend_item)¶ Create a prepend operation dictionary.
The prepend operation prepends prepend_item to the value in bin_name.
Parameters: - bin (string) – The name of the bin to be used.
- prepend_item – The value which will be prepended to the item contained in the specified bin.
Returns: A dictionary to be passed to operate or operate_ordered.
-
aerospike_helpers.operations.operations.
read
(bin_name)¶ Create a read operation dictionary.
The read operation reads and returns the value in bin_name.
Parameters: bin – String the name of the bin from which to read. Returns: A dictionary to be passed to operate or operate_ordered.
-
aerospike_helpers.operations.operations.
touch
(ttl=None)¶ Create a touch operation dictionary.
Using ttl here is deprecated. It should be set in the record metadata for the operate method.
Parameters: ttl (int) – Deprecated. The ttl that should be set for the record. This should be set in the metadata passed to the operate or operate_ordered methods. Returns: A dictionary to be passed to operate or operate_ordered.
-
aerospike_helpers.operations.operations.
write
(bin_name, write_item)¶ Create a write operation dictionary.
The write operation writes write_item into the bin specified by bin_name.
Parameters: - bin (string) – The name of the bin into which write_item will be stored.
- write_item – The value which will be written into the bin.
Returns: A dictionary to be passed to operate or operate_ordered.
aerospike_helpers.operations.list_operations module¶
This module provides helper functions to produce dictionaries to be used with the
aerospike.Client.operate
and aerospike.Client.operate_ordered
methods of the aerospike module.
- List operations support nested CDTs through an optional ctx context argument.
- The ctx argument is a list of cdt_ctx objects. See
aerospike_helpers.cdt_ctx
.
Note
Nested CDT (ctx) requires server version >= 4.6.0
-
aerospike_helpers.operations.list_operations.
list_append
(bin_name, value, policy=None, ctx=None)¶ Creates a list append operation to be used with operate, or operate_ordered
The list append operation instructs the aerospike server to append an item to the end of a list bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- value – The value to be appended to the end of the list.
- policy (dict) – An optional dictionary of list write options.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_append_items
(bin_name, values, policy=None, ctx=None)¶ Creates a list append items operation to be used with operate, or operate_ordered
The list append items operation instructs the aerospike server to append multiple items to the end of a list bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- values – (list): A sequence of items to be appended to the end of the list.
- policy (dict) – An optional dictionary of list write options.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_clear
(bin_name, ctx=None)¶ Create list clear operation.
The list clear operation removes all items from the list specified by bin_name
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get
(bin_name, index, ctx=None)¶ Create a list get operation.
The list get operation gets the value of the item at index and returns the value
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_index
(bin_name, index, return_type, ctx=None)¶ Create a list get index operation.
The list get operation gets the item at index and returns a value specified by return_type
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- index (int) – The index of the item to be returned.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_index_range
(bin_name, index, return_type, count=None, inverted=False, ctx=None)¶ Create a list get index range operation.
The list get by index range operation gets count items starting at index and returns a value specified by return_type
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- index (int) – The index of the first item to be returned.
- count (int) – The number of list items to be selected.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values.
- inverted (bool) – Optional bool specifying whether to invert the return type. If set to True, all items outside of the specified range will be returned. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_rank
(bin_name, rank, return_type, ctx=None)¶ Create a list get by rank operation.
Server selects list item identified by rank and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch a value from.
- rank (int) – The rank of the item to be fetched.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_rank_range
(bin_name, rank, return_type, count=None, inverted=False, ctx=None)¶ Create a list get by rank range operation.
Server selects count items starting at the specified rank and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- rank (int) – The rank of the first items to be returned.
- count (int) – A positive number indicating number of items to be returned.
- return_type (int) – Value specifying what should be returned from the operation.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs. This should be one of the List Return Types values - inverted (bool) – Optional bool specifying whether to invert the return type. If set to True, all items outside of the specified rank range will be returned. Default: False
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_value
(bin_name, value, return_type, inverted=False, ctx=None)¶ Create a list get by value operation.
Server selects list items with a value equal to value and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- value – The server returns all items matching this value
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- inverted (bool) – Optional bool specifying whether to invert the return type. If set to True, all items not equal to value will be selected. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_value_list
(bin_name, value_list, return_type, inverted=False, ctx=None)¶ Create a list get by value list operation.
Server selects list items with a value contained in value_list and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- value_list (list) – Return items from the list matching an item in this list.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- inverted (bool) – Optional bool specifying whether to invert the return type. If set to True, all items not matching an entry in value_list will be selected. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_value_range
(bin_name, return_type, value_begin, value_end, inverted=False, ctx=None)¶ Create a list get by value list operation.
Server selects list items with a value greater than or equal to value_begin and less than value_end. Server returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- value_begin – The start of the value range.
- value_end – The end of the value range.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- inverted (bool) – Optional bool specifying whether to invert the return type. If set to True, all items not included in the specified range will be returned. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_by_value_rank_range_relative
(bin_name, value, offset, return_type, count=None, inverted=False, ctx=None)¶ Create a list get by value rank range relative operation
Create list get by value relative to rank range operation. Server selects list items nearest to value and greater by relative rank. Server returns selected data specified by return_type.
Note
This operation requires server version 4.3.0 or greater.
Examples
These examples show what would be returned for specific arguments when dealing with an ordered list:
[0,4,5,9,11,15]
(value, offset, count) = [selected items] (5, 0, None) = [5,9,11,15] (5, 0, 2) = [5, 9] (5, -1, None) = [4, 5, 9, 11, 15] (5, -1, 3) = [4, 5, 9] (3,3, None) = [11, 15] (3,-3, None) = [0, 4,5,9,11,15] (3, 0, None) = [4,5,9,11,15]
Parameters: - bin_name (str) – The name of the bin containing the list.
- value (str) – The value of the item in the list for which to search
- offset (int) – Begin returning items with rank == rank(found_item) + offset
- count (int) – If specified, the number of items to return. If None, all items until end of list are returned.
- inverted (bool) – If True, the operation is inverted, and items outside of the specified range are returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_get_range
(bin_name, index, count, ctx=None)¶ Create a list get range operation.
The list get range operation gets count items starting index and returns the values.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_increment
(bin_name, index, value, policy=None, ctx=None)¶ Creates a list increment operation to be used with operate, or operate_ordered
The list insert operation inserts an item at index: index into the list contained in the specified bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- index (int) – The index of the list item to increment.
- value (int, float) – The value to be added to the list item.
- policy (dict) – An optional dictionary of list write options.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_insert
(bin_name, index, value, policy=None, ctx=None)¶ Creates a list insert operation to be used with operate, or operate_ordered
The list insert operation inserts an item at index: index into the list contained in the specified bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- index (int) – The index at which to insert an item. The value may be positive to use zero based indexing or negative to index from the end of the list.
- value – The value to be inserted into the list.
- policy (dict) – An optional dictionary of list write options.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_insert_items
(bin_name, index, values, policy=None, ctx=None)¶ Creates a list insert items operation to be used with operate, or operate_ordered
The list insert items operation inserts items at index: index into the list contained in the specified bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- index (int) – The index at which to insert the items. The value may be positive to use zero based indexing or negative to index from the end of the list.
- values (list) – The values to be inserted into the list.
- policy (dict) – An optional dictionary of list write options.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_pop
(bin_name, index, ctx=None)¶ Creates a list pop operation to be used with operate, or operate_ordered
The list pop operation removes and returns an item index: index from list contained in the specified bin.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_pop_range
(bin_name, index, count, ctx=None)¶ Creates a list pop range operation to be used with operate, or operate_ordered
The list insert range operation removes and returns count items starting from index: index from the list contained in the specified bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- index (int) – The index of the first item to be removed.
- count (int) – A positive number indicating how many items, including the first,
- be removed and returned (to) –
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove
(bin_name, index, ctx=None)¶ Create list remove operation.
The list remove operation removes an item located at index in the list specified by bin_name
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_index
(bin_name, index, return_type, ctx=None)¶ Create a list remove by index operation.
The list_remove_by_index operation removes the value of the item at index and returns a value specified by return_type
Parameters: - bin_name (str) – The name of the bin containing the list to remove an item from.
- index (int) – The index of the item to be removed.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_index_range
(bin_name, index, return_type, count=None, inverted=False, ctx=None)¶ Create a list remove by index range operation.
The list remove by index range operation removes count starting at index and returns a value specified by return_type
Parameters: - bin_name (str) – The name of the bin containing the list to remove items from.
- index (int) – The index of the first item to be removed.
- count (int) – The number of items to be removed
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values.
- inverted (bool) – Optional bool specifying whether to invert the operation. If set to True, all items outside of the specified range will be removed. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_rank
(bin_name, rank, return_type, ctx=None)¶ Create a list remove by rank operation.
Server removes a list item identified by rank and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch a value from.
- rank (int) – The rank of the item to be removed.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_rank_range
(bin_name, rank, return_type, count=None, inverted=False, ctx=None)¶ Create a list remove by rank range operation.
Server removes count items starting at the specified rank and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- rank (int) – The rank of the first item to removed.
- count (int) – A positive number indicating number of items to be removed.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- inverted (bool) – Optional bool specifying whether to invert the operation. If set to True, all items outside of the specified rank range will be removed. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_value
(bin_name, value, return_type, inverted=False, ctx=None)¶ Create a list remove by value operation.
Server removes list items with a value equal to value and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to remove items from.
- value – The server removes all list items matching this value.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- inverted (bool) – Optional bool specifying whether to invert the operation. If set to True, all items not equal to value will be removed. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_value_list
(bin_name, value_list, return_type, inverted=False, ctx=None)¶ Create a list remove by value list operation.
Server removes list items with a value matching one contained in value_list and returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to remove items from.
- value_list (list) – The server removes all list items matching one of these values.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- inverted (bool) – Optional bool specifying whether to invert the operation. If set to True, all items not equal to a value contained in value_list will be removed. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_value_range
(bin_name, return_type, value_begin=None, value_end=None, inverted=False, ctx=None)¶ Create a list remove by value range operation.
Server removes list items with a value greater than or equal to value_begin and less than value_end. Server returns selected data specified by return_type.
Parameters: - bin_name (str) – The name of the bin containing the list to fetch items from.
- value_begin – The start of the value range.
- value_end – The end of the value range.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the List Return Types values
- inverted (bool) – Optional bool specifying whether to invert the operation. If set to True, all items not included in the specified range will be removed. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_by_value_rank_range_relative
(bin_name, value, offset, return_type, count=None, inverted=False, ctx=None)¶ Create a list get by value rank range relative operation
Create list remove by value relative to rank range operation. Server removes and returns list items nearest to value and greater by relative rank. Server returns selected data specified by return_type.
Note
This operation requires server version 4.3.0 or greater.
These examples show what would be removed and returned for specific arguments when dealing with an ordered list:
[0,4,5,9,11,15]
(value, offset, count) = [selected items] (5,0,None) = [5,9,11,15] (5,0,2) = [5, 9] (5,-1, None) = [4,5,9,11,15] (5, -1, 3) = [4,5,9] (3,3, None) = [11,15] (3,-3, None) = [0,4,5,9,11,15] (3, 0, None) = [4,5,9,11,15]
Parameters: - bin_name (str) – The name of the bin containing the list.
- value (str) – The value of the item in the list for which to search
- offset (int) – Begin removing and returning items with rank == rank(found_item) + offset
- count (int) – If specified, the number of items to remove and return. If None, all items until end of list are returned.
- inverted (bool) – If True, the operation is inverted, and items outside of the specified range are removed and returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_remove_range
(bin_name, index, count, ctx=None)¶ Create list remove range operation.
The list remove range operation removes count items starting at index in the list specified by bin_name
Parameters: - bin_name (str) – The name of the bin containing the items to be removed.
- index (int) – The index of the first item to remove.
- count (int) – A positive number representing the number of items to be removed.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_set
(bin_name, index, value, policy=None, ctx=None)¶ Create a list set operation.
The list set operations sets the value of the item at index to value
Parameters: - bin_name (str) – The name of the bin containing the list to be operated on.
- index (int) – The index of the item to be set.
- value – The value to be assigned to the list item.
- policy (dict) – An optional dictionary of list write options.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_set_order
(bin_name, list_order, ctx=None)¶ Create a list set order operation.
The list_set_order operation sets an order on a specified list bin.
Parameters: Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_size
(bin_name, ctx=None)¶ Create a list size operation.
Server returns the size of the list in the specified bin.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_sort
(bin_name, sort_flags=<MagicMock id='139983124730208'>, ctx=None)¶ Create a list sort operation
The list sort operation will sort the specified list bin.
Parameters: - bin_name (str) – The name of the bin to sort.
- sort_flags – Optional flags modifiying the behavior of list_sort. This should be constructed by bitwise or’ing together values from List Sort Flags.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.list_operations.
list_trim
(bin_name, index, count, ctx=None)¶ Create a list trim operation.
Server removes items in list bin that do not fall into range specified by index and count range.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
aerospike_helpers.operations.map_operations module¶
Helper functions to create map operation dictionaries arguments for.
the aerospike.Client.operate
and aerospike.Client.operate_ordered
methods of the aerospike client.
- Map operations support nested CDTs through an optional ctx context argument.
- The ctx argument is a list of cdt_ctx objects. See
aerospike_helpers.cdt_ctx
.
Note
Nested CDT (ctx) requires server version >= 4.6.0
-
aerospike_helpers.operations.map_operations.
map_clear
(bin_name, ctx=None)¶ Creates a map_clear operation to be used with operate or operate_ordered
The operation removes all items from the map stored in the specified bin.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_decrement
(bin_name, key, amount, map_policy=None, ctx=None)¶ Creates a map_decrement operation to be used with operate or operate_ordered
The operation allows a user to decrement the value of a value stored in the map on the server.
Parameters: - bin_name (str) – The name of the bin containing the map.
- key – The key for the value to be decremented.
- amount – The amount by which to decrement the value stored in map[key]
- map_policy (list, optional) – Optional map_policy dictionary dictates the type of map to create when it does not exist. The map policy also specifies the mode used when writing items to the map. Defaults to None.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_index
(bin_name, index, return_type, ctx=None)¶ Creates a map_get_by_index operation to be used with operate or operate_ordered
The operation returns the entry at index from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- index (int) – The index of the entry to return.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_index_range
(bin_name, index_start, get_amt, return_type, inverted=False, ctx=None)¶ Creates a map_get_by_index_range operation to be used with operate or operate_ordered
The operation returns get_amt entries starting at index_start from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- index_start (int) – The index of the first entry to return.
- get_amt (int) – The number of entries to return from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If true, entries in the specified index range should be ignored, and all other entries returned. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_key
(bin_name, key, return_type, ctx=None)¶ Creates a map_get_by_key operation to be used with operate or operate_ordered
The operation returns an item, specified by the key from the map stored in the specified bin.
Parameters: - bin_name (str) – The name of the bin containing the map.
- key – The key of the item to be returned from the map
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_key_index_range_relative
(bin_name, value, offset, return_type, count=None, inverted=False, ctx=None)¶ Create a map get by value rank range relative operation
Create map get by key relative to index range operation. Server removes and returns map items with key nearest to value and greater by relative index. Server returns selected data specified by return_type.
Note
This operation requires server version 4.3.0 or greater.
Examples
Examples for a key ordered map
{0: 6, 6: 12, 10: 18, 15: 24}
and return type ofaerospike.MAP_RETURN_KEY
(value, offset, count) = [returned keys] (5, 0, None) = [6, 10, 15] (5, 0, 2) = [6, 10] (5,-1, None) = [0, 6, 10, 15] (5, -1, 3) = [0, 6, 10] (3, 2, None) = [15] (3, 5, None) = []
Parameters: - bin_name (str) – The name of the bin containing the list.
- value (str) – The value of the item in the list for which to search
- offset (int) – Begin removing and returning items with rank == rank(fount_item) + offset
- count (int) – If specified, the number of items to remove and return. If None, all items until end of list are returned.
- inverted (bool) – If True, the operation is inverted and items outside of the specified range are returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_key_list
(bin_name, key_list, return_type, inverted=False, ctx=None)¶ Creates a map_get_by_key_list operation to be used with operate or operate_ordered
The operation returns items, specified by the keys in key_list from the map stored in the specified bin.
Parameters: - bin_name (str) – The name of the bin containing the map.
- key_list (list) – A list of keys to be returned from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If true, keys with values not specified in the key_list will be returned, and those keys specified in the key_list will be ignored. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_key_range
(bin_name, key_range_start, key_range_end, return_type, inverted=False, ctx=None)¶ Creates a map_get_by_key_range operation to be used with operate or operate_ordered
The operation returns items with keys between key_range_start(inclusive) and key_range_end(exclusive) from the map
Parameters: - bin_name (str) – The name of the bin containing the map.
- key_range_start – The start of the range of keys to be returned. (Inclusive)
- key_range_end – The end of the range of keys to be returned. (Exclusive)
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, values outside of the specified range will be returned, and values inside of the range will be ignored. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_rank
(bin_name, rank, return_type, ctx=None)¶ Creates a map_get_by_rank operation to be used with operate or operate_ordered
The operation returns the item with the specified rank from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- rank (int) – The rank of the entry to return.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_rank_range
(bin_name, rank_start, get_amt, return_type, inverted=False, ctx=None)¶ Creates a map_get_by_rank_range operation to be used with operate or operate_ordered
The operation returns item within the specified rank range from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- rank_start (int) – The start of the rank of the entries to return.
- get_amt (int) – The number of entries to return.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, items with ranks inside the specified range should be ignored, and all other entries returned. Default: False.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_value
(bin_name, value, return_type, inverted=False, ctx=None)¶ Creates a map_get_by_value operation to be used with operate or operate_ordered
The operation returns entries whose value matches the specified value.
Parameters: - bin_name (str) – The name of the bin containing the map.
- value – Entries with a value matching this argument will be returned from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, entries with a value different than the specified value will be returned. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_value_list
(bin_name, key_list, return_type, inverted=False, ctx=None)¶ Creates a map_get_by_value_list operation to be used with operate or operate_ordered
The operation returns entries whose values are specified in the value_list.
Parameters: - bin_name (str) – The name of the bin containing the map.
- value_list (list) – Entries with a value contained in this list will be returned from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, entries with a value contained in value_list will be ignored, and all others will be returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_value_range
(bin_name, value_start, value_end, return_type, inverted=False, ctx=None)¶ Creates a map_get_by_value_range operation to be used with operate or operate_ordered
The operation returns items, with values between value_start(inclusive) and value_end(exclusive) from the map
Parameters: - bin_name (str) – The name of the bin containing the map.
- value_start – The start of the range of values to be returned. (Inclusive)
- value_end – The end of the range of values to be returned. (Exclusive)
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, values outside of the specified range will be returned, and values inside of the range will be ignored. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_get_by_value_rank_range_relative
(bin_name, value, offset, return_type, count=None, inverted=False, ctx=None)¶ Create a map remove by value rank range relative operation
Create list map get by value relative to rank range operation. Server returns map items with value nearest to value and greater by relative rank. Server returns selected data specified by return_type.
Note
This operation requires server version 4.3.0 or greater.
Examples
Examples for map
{0: 6, 10: 18, 6: 12, 15: 24}
and return type ofaerospike.MAP_RETURN_KEY
(value, offset, count) = [returned keys] (6, 0, None) = [0, 6, 10, 15] (5, 0, 2) = [0, 6] (7, -1, 1) = [0] (7, -1, 3) = [0, 6, 10]
Parameters: - bin_name (str) – The name of the bin containing the map.
- value (str) – The value of the item in the list for which to search
- offset (int) – Begin removing and returning items with rank == rank(fount_item) + offset
- count (int) – If specified, the number of items to remove and return. If None, all items until end of list are returned.
- inverted (bool) – If True, the operation is inverted and items outside of the specified range are returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_increment
(bin_name, key, amount, map_policy=None, ctx=None)¶ Creates a map_increment operation to be used with operate or operate_ordered
The operation allows a user to increment the value of a value stored in the map on the server.
Parameters: - bin_name (str) – The name of the bin containing the map.
- key – The key for the value to be incremented.
- amount – The amount by which to increment the value stored in map[key]
- map_policy (list, optional) – Optional map_policy dictionary dictates the type of map to create when it does not exist. The map policy also specifies the mode used when writing items to the map. Defaults to None.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_put
(bin_name, key, value, map_policy=None, ctx=None)¶ Creates a map_put operation to be used with operate or operate_ordered
The operation allows a user to set the value of an item in the map stored on the server.
Parameters: - bin_name (str) – The name of the bin containing the map.
- key – The key for the map.
- value – The item to store in the map with the corresponding key.
- map_policy (list, optional) – Optional map_policy dictionary dictates the type of map to create when it does not exist. The map policy also specifies the mode used when writing items to the map. Defaults to None.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_put_items
(bin_name, item_dict, map_policy=None, ctx=None)¶ Creates a map_put_items operation to be used with operate or operate_ordered
The operation allows a user to add or update items in the map stored on the server.
Parameters: - bin_name (str) – The name of the bin containing the map.
- item_dict (dict) – A dictionary of key value pairs to be added to the map on the server.
- map_policy (list, optional) – Optional map_policy dictionary dictates the type of map to create when it does not exist. The map policy also specifies the mode used when writing items to the map. Defaults to None.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_index
(bin_name, index, return_type, ctx=None)¶ Creates a map_remove_by_index operation to be used with operate or operate_ordered
The operation removes the entry at index from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- index (int) – The index of the entry to remove.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_index_range
(bin_name, index_start, remove_amt, return_type, inverted=False, ctx=None)¶ Creates a map_remove_by_index_range operation to be used with operate or operate_ordered
The operation removes remove_amt entries starting at index_start from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- index_start (int) – The index of the first entry to remove.
- remove_amt (int) – The number of entries to remove from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If true, entries in the specified index range should be kept, and all other entries removed. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_key
(bin_name, key, return_type, ctx=None)¶ Creates a map_remove_by_key operation to be used with operate or operate_ordered
The operation removes an item, specified by the key from the map stored in the specified bin.
Parameters: - bin_name (str) – The name of the bin containing the map.
- key – The key to be removed from the map
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_key_index_range_relative
(bin_name, key, offset, return_type, count=None, inverted=False, ctx=None)¶ Create a map get by value rank range relative operation
Create map remove by key relative to index range operation. Server removes and returns map items with key nearest to value and greater by relative index. Server returns selected data specified by return_type.
Note
This operation requires server version 4.3.0 or greater.
Examples
Examples for a key ordered map
{0: 6, 6: 12, 10: 18, 15: 24}
and return type ofaerospike.MAP_RETURN_KEY
(value, offset, count) = [removed keys] (5, 0, None) = [6, 10, 15] (5, 0, 2) = [6, 10] (5,-1, None) = [0, 6, 10, 15] (5, -1, 3) = [0, 6, 10] (3, 2, None) = [15] (3, 5, None) = []
Parameters: - bin_name (str) – The name of the bin containing the list.
- key (str) – The key of the item in the list for which to search
- offset (int) – Begin removing and returning items with rank == rank(fount_item) + offset
- count (int) – If specified, the number of items to remove and return. If None, all items until end of list are returned.
- inverted (bool) – If True, the operation is inverted and items outside of the specified range are returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_key_list
(bin_name, key_list, return_type, inverted=False, ctx=None)¶ Creates a map_remove_by_key operation to be used with operate or operate_ordered
The operation removes items, specified by the keys in key_list from the map stored in the specified bin.
Parameters: - bin_name (str) – The name of the bin containing the map.
- key_list (list) – A list of keys to be removed from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If true, keys with values not specified in the key_list will be removed, and those keys specified in the key_list will be kept. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_key_range
(bin_name, key_range_start, key_range_end, return_type, inverted=False, ctx=None)¶ Creates a map_remove_by_key_range operation to be used with operate or operate_ordered
The operation removes items, with keys between key_range_start(inclusive) and key_range_end(exclusive) from the map
Parameters: - bin_name (str) – The name of the bin containing the map.
- key_range_start – The start of the range of keys to be removed. (Inclusive)
- key_range_end – The end of the range of keys to be removed. (Exclusive)
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, values outside of the specified range will be removed, and values inside of the range will be kept. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_rank
(bin_name, rank, return_type, ctx=None)¶ Creates a map_remove_by_rank operation to be used with operate or operate_ordered
The operation removes the item with the specified rank from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- rank (int) – The rank of the entry to remove.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_rank_range
(bin_name, rank_start, remove_amt, return_type, inverted=False, ctx=None)¶ Creates a map_remove_by_rank_range operation to be used with operate or operate_ordered
The operation removes remove_amt items beginning with the item with the specified rank from the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- rank_start (int) – The rank of the entry to remove.
- remove_amt (int) – The number of entries to remove.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, items with ranks inside the specified range should be kept, and all other entries removed. Default: False.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_value
(bin_name, value, return_type, inverted=False, ctx=None)¶ Creates a map_remove_by_value operation to be used with operate or operate_ordered
The operation removes key value pairs whose value matches the specified value.
Parameters: - bin_name (str) – The name of the bin containing the map.
- value – Entries with a value matching this argument will be removed from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, entries with a value different than the specified value will be removed. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_value_list
(bin_name, value_list, return_type, inverted=False, ctx=None)¶ Creates a map_remove_by_value_list operation to be used with operate or operate_ordered
The operation removes key value pairs whose values are specified in the value_list.
Parameters: - bin_name (str) – The name of the bin containing the map.
- value_list (list) – Entries with a value contained in this list will be removed from the map.
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, entries with a value contained in value_list will be kept, and all others will be removed and returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_value_range
(bin_name, value_start, value_end, return_type, inverted=False, ctx=None)¶ Creates a map_remove_by_value_range operation to be used with operate or operate_ordered
The operation removes items, with values between value_start(inclusive) and value_end(exclusive) from the map
Parameters: - bin_name (str) – The name of the bin containing the map.
- value_start – The start of the range of values to be removed. (Inclusive)
- value_end – The end of the range of values to be removed. (Exclusive)
- return_type (int) – Value specifying what should be returned from the operation. This should be one of the Map Return Types values.
- inverted (bool) – If True, values outside of the specified range will be removed, and values inside of the range will be kept. Default: False
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_remove_by_value_rank_range_relative
(bin_name, value, offset, return_type, count=None, inverted=False, ctx=None)¶ Create a map remove by value rank range relative operation
Create map remove by value relative to rank range operation. Server removes and returns map items nearest to value and greater by relative rank. Server returns selected data specified by return_type.
Note
This operation requires server version 4.3.0 or greater.
Examples
Examples for map
{0: 6, 10: 18, 6: 12, 15: 24}
and return type ofaerospike.MAP_RETURN_KEY
(value, offset, count) = [removed keys] (6, 0, None) = [0, 6, 10, 15] (5, 0, 2) = [0, 6] (7, -1, 1) = [0] (7, -1, 3) = [0, 6, 10]
Parameters: - bin_name (str) – The name of the bin containing the map.
- value – The value of the entry in the map for which to search
- offset (int) – Begin removing and returning items with rank == rank(found_item) + offset
- count (int) – If specified, the number of items to remove and return. If None, all items with rank greater than found_item are returned.
- return_type – Specifies what to return from the operation.
- inverted (bool) – If True, the operation is inverted and items outside of the specified range are returned.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered.The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_set_policy
(bin_name, policy, ctx=None)¶ Creates a map_set_policy_operation to be used with operate or operate_ordered
The operation allows a user to set the policy for the map.
Parameters: - bin_name (str) – The name of the bin containing the map.
- policy (dict) – The map_policy dictionary.
- ctx (list) – An optional list of nested CDT context operations (
cdt_cdx
object) for use on nested CDTs.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.map_operations.
map_size
(bin_name, ctx=None)¶ Creates a map_size operation to be used with operate or operate_ordered
The operation returns the size of the map stored in the specified bin.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
aerospike_helpers.operations.bit_operations module¶
Helper functions to create bit operation dictionary arguments for
the aerospike.Client.operate
and aerospike.Client.operate_ordered
methods of the aerospike client.
Note
Bitwise operations require server version >= 4.6.0
Bit offsets are oriented left to right. Negative offsets are supported and start backwards from the end of the target bitmap.
- Offset examples:
- 0: leftmost bit in the map
- 4: fifth bit in the map
- -1: rightmost bit in the map
- -4: 3 bits from rightmost
Example:
from __future__ import print_function
import aerospike
from aerospike import exception as ex
from aerospike_helpers.operations import bitwise_operations
import sys
# Configure the client.
config = {"hosts": [("127.0.0.1", 3000)]}
# Create a client and connect it to the cluster.
try:
client = aerospike.client(config).connect()
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
key = ("test", "demo", "foo")
five_ones_bin_name = "bitwise1"
five_one_blob = bytearray([1] * 5)
# Write the record.
try:
client.put(key, {five_ones_bin_name: five_one_blob})
except ex.RecordError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
# EXAMPLE 1: resize the five_ones bin to a bytesize of 10.
try:
ops = [bitwise_operations.bit_resize(five_ones_bin_name, 10)]
_, _, bins = client.get(key)
_, _, _ = client.operate(key, ops)
_, _, newbins = client.get(key)
print("EXAMPLE 1: before resize: ", bins)
print("EXAMPLE 1: is now: ", newbins)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
# EXAMPLE 2: shrink the five_ones bin to a bytesize of 5 from the front.
try:
ops = [
bitwise_operations.bit_resize(
five_ones_bin_name, 5, resize_flags=aerospike.BIT_RESIZE_FROM_FRONT
)
]
_, _, bins = client.get(key)
_, _, _ = client.operate(key, ops)
_, _, newbins = client.get(key)
print("EXAMPLE 2: before resize: ", bins)
print("EXAMPLE 2: is now: ", newbins)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
# Cleanup and close the connection to the Aerospike cluster.
client.remove(key)
client.close()
"""
EXPECTED OUTPUT:
EXAMPLE 1: before resize: {'bitwise1': bytearray(b'\x01\x01\x01\x01\x01')}
EXAMPLE 1: is now: {'bitwise1': bytearray(b'\x01\x01\x01\x01\x01\x00\x00\x00\x00\x00')}
EXAMPLE 2: before resize: {'bitwise1': bytearray(b'\x01\x01\x01\x01\x01\x00\x00\x00\x00\x00')}
EXAMPLE 2: is now: {'bitwise1': bytearray(b'\x00\x00\x00\x00\x00')}
"""
Example:
from __future__ import print_function
import aerospike
from aerospike import exception as e
from aerospike_helpers.operations import bitwise_operations
config = {'hosts': [('127.0.0.1', 3000)]}
try:
client = aerospike.client(config).connect()
except e.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(2)
key = ('test', 'demo', 'bit_example')
five_one_blob = bytearray([1] * 5)
five_one_bin = 'bitwise1'
try:
if client.exists(key):
client.remove(key)
bit_policy = {
'map_write_mode': aerospike.BIT_WRITE_DEFAULT,
}
client.put(
key,
{
five_one_bin: five_one_blob
}
)
# Example 1: read bits
ops = [
bitwise_operations.bit_get(five_one_bin, 0, 40)
]
print('=====EXAMPLE1=====')
_, _, results = client.operate(key, ops)
print(results)
# Example 2: modify bits using the 'or' op, then read bits
ops = [
bitwise_operations.bit_or(five_one_bin, 0, 8, 1, bytearray([255]), bit_policy),
bitwise_operations.bit_get(five_one_bin, 0, 40)
]
print('=====EXAMPLE2=====')
_, _, results = client.operate(key, ops)
print(results)
# Example 3: modify bits using the 'remove' op, then read bits'
ops = [
bitwise_operations.bit_remove(five_one_bin, 0, 2, bit_policy),
bitwise_operations.bit_get(five_one_bin, 0, 24)
]
print('=====EXAMPLE3=====')
_, _, results = client.operate(key, ops)
print(results)
except e.AerospikeError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
client.close()
"""
EXPECTED OUTPUT:
=====EXAMPLE1=====
{'bitwise1': bytearray(b'\x01\x01\x01\x01\x01')}
=====EXAMPLE2=====
{'bitwise1': bytearray(b'\xff\x01\x01\x01\x01')}
=====EXAMPLE3=====
{'bitwise1': bytearray(b'\x01\x01\x01')}
"""
See also
-
aerospike_helpers.operations.bitwise_operations.
bit_add
(bin_name, bit_offset, bit_size, value, sign, action, policy=None)¶ Creates a bit_add_operation to be used with operate or operate_ordered.
Creates a bit add operation. Server adds value to the bin at bit_offset for bit_size. bit_size must <= 64. If Sign is true value will be treated as a signed number. If an underflow or overflow occurs, as_bit_overflow_action is used. Server returns nothing.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will be added.
- bit_size (int) – How many bits of value to add.
- value (int) – The value to be added.
- sign (bool) – True: treat value as signed, False: treat value as unsigned.
- action (aerospike.constant) – Action taken if an overflow/underflow occurs.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_and
(bin_name, bit_offset, bit_size, value_byte_size, value, policy=None)¶ Creates a bit_and_operation to be used with operate or operate_ordered.
Creates a bit and operation. Server performs an and op with value and bitmap in bin at bit_offset for bit_size. Server returns nothing.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will be modified.
- bit_size (int) – How many bits of value to and.
- value_byte_size (int) – Length of value in bytes.
- value (bytes/byte array) – Bytes to be used in and operation.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_count
(bin_name, bit_offset, bit_size)¶ Creates a bit_count_operation to be used with operate or operate_ordered.
Server returns an integer count of all set bits starting at bit_offset for bit_size bits.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_get
(bin_name, bit_offset, bit_size)¶ Creates a bit_get_operation to be used with operate or operate_ordered.
Server returns bits from bitmap starting at bit_offset for bit_size.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_get_int
(bin_name, bit_offset, bit_size, sign)¶ Creates a bit_get_int_operation to be used with operate or operate_ordered.
Server returns an integer formed from the bits read from bitmap starting at bit_offset for bit_size.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_insert
(bin_name, byte_offset, value_byte_size, value, policy=None)¶ Creates a bit_insert_operation to be used with operate or operate_ordered.
Server inserts the bytes from value into the bitmap at byte_offset. No value is returned.
Parameters: - bin_name (str) – The name of the bin containing the map.
- byte_offset (int) – The offset where the bytes will be inserted.
- value_byte_size (int) – Size of value in bytes.
- value (bytes/byte array) –
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_lscan
(bin_name, bit_offset, bit_size, value)¶ Creates a bit_lscan_operation to be used with operate or operate_ordered.
Server returns an integer representing the bit offset of the first occurence of the specified value bit. Starts scanning at bit_offset for bit_size. Returns -1 if value not found.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_lshift
(bin_name, bit_offset, bit_size, shift, policy=None)¶ Creates a bit_lshift_operation to be used with operate or operate_ordered.
Server left shifts bitmap starting at bit_offset for bit_size by shift bits. No value is returned.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will start being shifted.
- bit_size (int) – The number of bits that will be shifted by shift places.
- shift (int) – How many bits to shift by.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_not
(bin_name, bit_offset, bit_size, policy=None)¶ Creates a bit_not_operation to be used with operate or operate_ordered.
Server negates bitmap starting at bit_offset for bit_size. No value is returned.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will start being scanned.
- bit_size (int) – How many bits to scan.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_or
(bin_name, bit_offset, bit_size, value_byte_size, value, policy=None)¶ Creates a bit_or_operation to be used with operate or operate_ordered.
Creates a bit or operation. Server performs bitwise or with value and bitmap in bin at bit_offset for bit_size. Server returns nothing.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will start being compared.
- bit_size (int) – How many bits of value to or.
- value_byte_size (int) – Length of value in bytes.
- value (bytes/byte array) – Value to be used in or operation.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_remove
(bin_name, byte_offset, byte_size, policy=None)¶ Creates a bit_remove_operation to be used with operate or operate_ordered.
Remove bytes from bitmap at byte_offset for byte_size.
Parameters: - bin_name (str) – The name of the bin containing the map.
- byte_offset (int) – Position of bytes to be removed.
- byte_size (int) – How many bytes to remove.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_resize
(bin_name, byte_size, policy=None, resize_flags=<MagicMock id='139983121549744'>)¶ Creates a bit_resize_operation to be used with operate or operate_ordered.
Change the size of a bytes bin stored in a record on the Aerospike Server.
Parameters: - bin_name (str) – The name of the bin containing the map.
- byte_size (int) – The new size of the bytes.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
- resize_flags (int, optional) – Flags modifying the behavior of the resize.
This should be constructed by bitwise or’ing together any of the values: Bitwise Resize Flags .
e.g. aerospike.BIT_RESIZE_GROW_ONLY | aerospike.BIT_RESIZE_FROM_FRONT
default:
aerospike.BIT_RESIZE_DEFAULT
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_rscan
(bin_name, bit_offset, bit_size, value)¶ Creates a bit_rscan_operation to be used with operate or operate_ordered.
Server returns an integer representing the bit offset of the last occurence of the specified value bit. Starts scanning at bit_offset for bit_size. Returns -1 if value not found.
Parameters: Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_rshift
(bin_name, bit_offset, bit_size, shift, policy=None)¶ Creates a bit_rshift_operation to be used with operate or operate_ordered.
Server right shifts bitmap starting at bit_offset for bit_size by shift bits. No value is returned.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will start being shifted.
- bit_size (int) – The number of bits that will be shifted by shift places.
- shift (int) – How many bits to shift by.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_set
(bin_name, bit_offset, bit_size, value_byte_size, value, policy=None)¶ Creates a bit_set_operation to be used with operate or operate_ordered.
Set the value on a bitmap at bit_offset for bit_size in a record on the Aerospike Server.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will be set.
- bit_size (int) – How many bits of value to write.
- value_byte_size (int) – Size of value in bytes.
- value (bytes/byte array) – The value to be set.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_subtract
(bin_name, bit_offset, bit_size, value, sign, action, policy=None)¶ Creates a bit_subtract_operation to be used with operate or operate_ordered.
Creates a bit add operation. Server subtracts value from the bits at bit_offset for bit_size. bit_size must <= 64. If sign is true value will be treated as a signed number. If an underflow or overflow occurs, as_bit_overflow_action is used. Server returns nothing.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will be subtracted.
- bit_size (int) – How many bits of value to subtract.
- value (int) – The value to be subtracted.
- sign (bool) – True: treat value as signed, False: treat value as unsigned.
- action (aerospike.constant) – Action taken if an overflow/underflow occurs.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
-
aerospike_helpers.operations.bitwise_operations.
bit_xor
(bin_name, bit_offset, bit_size, value_byte_size, value, policy=None)¶ Creates a bit_xor_operation to be used with operate or operate_ordered.
Creates a bit and operation. Server performs bitwise xor with value and bitmap in bin at bit_offset for bit_size. Server returns nothing.
Parameters: - bin_name (str) – The name of the bin containing the map.
- bit_offset (int) – The offset where the bits will start being compared.
- bit_size (int) – How many bits of value to xor.
- value_byte_size (int) – Length of value in bytes.
- value (bytes/byte array) – Value to be used in xor operation.
- policy (dict, optional) – The bit_policy policy dictionary. default: None.
Returns: A dictionary usable in operate or operate_ordered. The format of the dictionary should be considered an internal detail, and subject to change.
aerospike_helpers.operations.hll_operations module¶
Helper functions to create HyperLogLog operation dictionary arguments for
the aerospike.Client.operate
and aerospike.Client.operate_ordered
methods of the aerospike client.
HyperLogLog bins and operations allow for your application to form fast, reasonable approximations
of members in the union or intersection between multiple HyperLogLog bins.
HyperLogLog’s estimates are a balance between complete accuracy and efficient savings
in space and speed in dealing with extremely large datasets.
Note
HyperLogLog operations require server version >= 4.9.0
See also
Example:
from __future__ import print_function
import sys
import aerospike
from aerospike import exception as ex
from aerospike_helpers.operations import hll_operations as hll_ops
from aerospike_helpers.operations import operations
TEST_NS = "test"
TEST_SET = "demo"
NUM_INDEX_BITS = 12
NUM_MH_BITS = 24
# Configure the client.
config = {"hosts": [("127.0.0.1", 3000)]}
# Create a client and connect it to the cluster.
try:
client = aerospike.client(config).connect()
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
# Add HLL bins.
customers = ["Amy", "Farnsworth", "Scruffy"]
customer_record_keys = [
(TEST_NS, TEST_SET, "Amy"),
(TEST_NS, TEST_SET, "Farnsworth"),
(TEST_NS, TEST_SET, "Scruffy"),
]
items_viewed = [
("item%s" % str(i) for i in range(0, 500)),
("item%s" % str(i) for i in range(0, 750)),
("item%s" % str(i) for i in range(250, 1000)),
]
for customer, key, items in zip(customers, customer_record_keys, items_viewed):
ops = [
operations.write("name", customer),
hll_ops.hll_add("viewed", list(items), NUM_INDEX_BITS, NUM_MH_BITS),
]
try:
client.operate(key, ops)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
# Find out how many items viewed Amy, Farnsworth, and Scruffy have in common.
Farnsworth_viewed = client.get(customer_record_keys[1])[2]["viewed"]
Scruffy_viewed = client.get(customer_record_keys[2])[2]["viewed"]
viewed = [Farnsworth_viewed, Scruffy_viewed]
ops = [hll_ops.hll_get_intersect_count("viewed", viewed)]
try:
_, _, res = client.operate(customer_record_keys[0], ops)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
print(
"Estimated items viewed intersection: %d."
% res["viewed"]
)
print("Actual intersection: 250.\n")
# Find out how many unique products Amy, Farnsworth, and Scruffy have viewed.
Farnsworth_viewed = client.get(customer_record_keys[1])[2]["viewed"]
Scruffy_viewed = client.get(customer_record_keys[2])[2]["viewed"]
viewed = [Farnsworth_viewed, Scruffy_viewed]
ops = [hll_ops.hll_get_union_count("viewed", viewed)]
try:
_, _, res = client.operate(customer_record_keys[0], ops)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
print(
"Estimated items viewed union: %d."
% res["viewed"]
)
print("Actual union: 1000.\n")
# Find the similarity of Amy, Farnsworth, and Scruffy's product views.
Farnsworth_viewed = client.get(customer_record_keys[1])[2]["viewed"]
Scruffy_viewed = client.get(customer_record_keys[2])[2]["viewed"]
viewed = [Farnsworth_viewed, Scruffy_viewed]
ops = [hll_ops.hll_get_similarity("viewed", viewed)]
try:
_, _, res = client.operate(customer_record_keys[0], ops)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
print(
"Estimated items viewed similarity: %f%%."
% (res["viewed"] * 100)
)
print("Actual similarity: 25%.")
"""
Expected output:
Estimated items viewed intersection: 235.
Actual intersection: 250.
Estimated items viewed union: 922.
Actual union: 1000.
Estimated items viewed similarity: 25.488069%.
Actual similarity: 25%.
"""
-
aerospike_helpers.operations.hll_operations.
hll_add
(bin_name, values, index_bit_count=None, mh_bit_count=None, policy=None)¶ Creates a hll_add operation to be used with operate, or operate_ordered.
Server will add the values to the hll bin. If the HLL bin does not exist, it will be created with index_bit_count and/or mh_bit_count if they have been supplied.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- values – The values to be added to the HLL set.
- index_bit_count – An optional number of index bits. Must be bewtween 4 and 16 inclusive.
- mh_bit_count – An optional number of min hash bits. Must be bewtween 4 and 58 inclusive.
- policy (dict) – An optional dictionary of hll policy options.
-
aerospike_helpers.operations.hll_operations.
hll_describe
(bin_name)¶ Creates a hll_describe operation to be used with operate, or operate_ordered.
Server returns index and minhash bit counts used to create HLL bin in a list of integers. The list size is 2.
Parameters: bin_name (str) – The name of the bin to be operated on.
-
aerospike_helpers.operations.hll_operations.
hll_fold
(bin_name, index_bit_count)¶ Creates a hll_fold operation to be used with operate, or operate_ordered.
Servers folds index_bit_count to the specified value. This can only be applied when minhash bit count on the HLL bin is 0. Server does not return a value.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- index_bit_count – number of index bits. Must be bewtween 4 and 16 inclusive.
-
aerospike_helpers.operations.hll_operations.
hll_get_count
(bin_name)¶ Creates a hll_get_count operation to be used with operate, or operate_ordered.
Server returns estimated count of elements in the HLL bin.
Parameters: bin_name (str) – The name of the bin to be operated on.
-
aerospike_helpers.operations.hll_operations.
hll_get_intersect_count
(bin_name, hll_list)¶ Creates a hll_get_intersect_count operation to be used with operate, or operate_ordered.
Server returns estimate of elements that would be contained by the intersection of these HLL objects.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- hll_list (list) – The HLLs to be intersected.
-
aerospike_helpers.operations.hll_operations.
hll_get_similarity
(bin_name, hll_list)¶ Creates a hll_get_similarity operation to be used with operate, or operate_ordered.
Server returns estimated similarity of the HLL objects. Server returns a float.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- hll_list (list) – The HLLs used for similarity estimation.
-
aerospike_helpers.operations.hll_operations.
hll_get_union
(bin_name, hll_list)¶ Creates a hll_get_union operation to be used with operate, or operate_ordered.
Server returns an HLL object that is the union of all specified HLL objects in hll_list with the HLL bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- hll_list (list) – The HLLs to be unioned.
-
aerospike_helpers.operations.hll_operations.
hll_get_union_count
(bin_name, hll_list)¶ Creates a hll_get_union_count operation to be used with operate, or operate_ordered.
Server returns the estimated count of elements that would be contained by the union of all specified HLL objects in the list with the HLL bin.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- hll_list (list) – The HLLs to be unioned.
-
aerospike_helpers.operations.hll_operations.
hll_init
(bin_name, index_bit_count=None, mh_bit_count=None, policy=None)¶ Creates a hll_init operation to be used with operate, or operate_ordered.
Server creates a new HLL or resets an existing HLL. If index_bit_count and mh_bit_count are None, an existing HLL bin will be reset but retain its configuration. If 1 of index_bit_count or mh_bit_count are set, an existing HLL bin will set that config and retain its current value for the unset config. If the HLL bin does not exist, index_bit_count is required to create it, mh_bit_count is optional. Server does not return a value.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- index_bit_count – An optional number of index bits. Must be bewtween 4 and 16 inclusive.
- mh_bit_count – An optional number of min hash bits. Must be bewtween 4 and 58 inclusive.
- policy (dict) – An optional dictionary of hll policy options.
-
aerospike_helpers.operations.hll_operations.
hll_refresh_count
(bin_name)¶ Creates a hll_refresh_count operation to be used with operate, or operate_ordered.
Server updates the cached count if it is stale. Server returns the count.
Parameters: bin_name (str) – The name of the bin to be operated on.
-
aerospike_helpers.operations.hll_operations.
hll_set_union
(bin_name, hll_list, policy=None)¶ Creates a hll_set_union operation to be used with operate, or operate_ordered.
Server sets the union of all specified HLL objects with the HLL bin. Server returns nothing.
Parameters: - bin_name (str) – The name of the bin to be operated on.
- hll_list (list) – The HLLs who’s union will be set.
- policy (dict) – An optional dictionary of hll policy options.
aerospike_helpers.cdt_ctx module¶
Note
Requires server version >= 4.6.0
Helper functions to generate complex data type context (cdt_ctx) objects for use with operations on nested CDTs (list, map, etc).
Example:
from __future__ import print_function
import aerospike
from aerospike import exception as ex
from aerospike_helpers import cdt_ctx
from aerospike_helpers.operations import map_operations
from aerospike_helpers.operations import list_operations
import sys
# Configure the client.
config = {"hosts": [("127.0.0.1", 3000)]}
# Create a client and connect it to the cluster.
try:
client = aerospike.client(config).connect()
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
key = ("test", "demo", "foo")
nested_list = [{"name": "John", "id": 100}, {"name": "Bill", "id": 200}]
nested_list_bin_name = "nested_list"
# Write the record.
try:
client.put(key, {nested_list_bin_name: nested_list})
except ex.RecordError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
# EXAMPLE 1: read a value from the map nested at list index 1.
try:
ctx = [cdt_ctx.cdt_ctx_list_index(1)]
ops = [
map_operations.map_get_by_key(
nested_list_bin_name, "id", aerospike.MAP_RETURN_VALUE, ctx
)
]
_, _, result = client.operate(key, ops)
print("EXAMPLE 1, id is: ", result)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
# EXAMPLE 2: write a new nested map at list index 2 and get the value at its 'name' key.
# NOTE: The map is appened to the list, then the value is read using the ctx.
try:
new_map = {"name": "Cindy", "id": 300}
ctx = [cdt_ctx.cdt_ctx_list_index(2)]
ops = [
list_operations.list_append(nested_list_bin_name, new_map),
map_operations.map_get_by_key(
nested_list_bin_name, "name", aerospike.MAP_RETURN_VALUE, ctx
),
]
_, _, result = client.operate(key, ops)
print("EXAMPLE 2, name is: ", result)
except ex.ClientError as e:
print("Error: {0} [{1}]".format(e.msg, e.code))
sys.exit(1)
# Cleanup and close the connection to the Aerospike cluster.
client.remove(key)
client.close()
"""
EXPECTED OUTPUT:
EXAMPLE 1, id is: {'nested_list': 200}
EXAMPLE 2, name is: {'nested_list': 'Cindy'}
"""
-
aerospike_helpers.cdt_ctx.
cdt_ctx_list_index
(index)¶ Creates a nested cdt_ctx object for use with list or map operations.
The cdt_ctx object is initialized to lookup an object in a list by index. If the index is negative, the lookup starts backwards from the end of the list. If it is out of bounds, a parameter error will be returned.
Parameters: index (int) – The index to look for in the list. Returns: A cdt_ctx object, a list of these is usable with list and map operations.
-
aerospike_helpers.cdt_ctx.
cdt_ctx_list_rank
(rank)¶ Creates a nested cdt_ctx object for use with list or map operations.
The cdt_ctx object is initialized to lookup an object in a list by rank. If the rank is negative, the lookup starts backwards from the largest rank value.
Parameters: rank (int) – The rank to look for in the list. Returns: A cdt_ctx object, a list of these is usable with list and map operations.
-
aerospike_helpers.cdt_ctx.
cdt_ctx_list_value
(value)¶ Creates a nested cdt_ctx object for use with list or map operations.
The cdt_ctx object is initialized to lookup an object in a list by value.
Parameters: value (object) – The value to look for in the list. Returns: A cdt_ctx object, a list of these is usable with list and map operations.
-
aerospike_helpers.cdt_ctx.
cdt_ctx_map_index
(index)¶ Creates a nested cdt_ctx object for use with list or map operations.
The cdt_ctx object is initialized to lookup an object in a map by index. If the index is negative, the lookup starts backwards from the end of the map. If it is out of bounds, a parameter error will be returned.
Parameters: index (int) – The index to look for in the map. Returns: A cdt_ctx object, a list of these is usable with list and map operations.
-
aerospike_helpers.cdt_ctx.
cdt_ctx_map_key
(key)¶ Creates a nested cdt_ctx object for use with list or map operations.
The cdt_ctx object is initialized to lookup an object in a map by key.
Parameters: key (object) – The key to look for in the map. Returns: A cdt_ctx object, a list of these is usable with list and map operations.
-
aerospike_helpers.cdt_ctx.
cdt_ctx_map_rank
(rank)¶ Creates a nested cdt_ctx object for use with list or map operations.
The cdt_ctx object is initialized to lookup an object in a map by index. If the rank is negative, the lookup starts backwards from the largest rank value.
Parameters: rank (int) – The rank to look for in the map. Returns: A cdt_ctx object, a list of these is usable with list and map operations.
-
aerospike_helpers.cdt_ctx.
cdt_ctx_map_value
(value)¶ Creates a nested cdt_ctx object for use with list or map operations.
The cdt_ctx object is initialized to lookup an object in a map by value.
Parameters: value (object) – The value to look for in the map. Returns: A cdt_ctx object, a list of these is usable with list and map operations.
GeoJSON Class — GeoJSON
¶
GeoJSON
¶
-
class
aerospike.
GeoJSON
¶ Starting with version 3.7.0, the Aerospike server supports storing GeoJSON data. A Geo2DSphere index can be built on a bin which contains GeoJSON data, enabling queries for the points contained within given shapes using
geo_within_geojson_region()
andgeo_within_radius()
, and for the regions which contain a point usinggeo_contains_geojson_point()
andgeo_contains_point()
.On the client side, wrapping geospatial data in an instance of the
aerospike.GeoJSON
class enables serialization of the data into the correct type during write operation, such asput()
. On reading a record from the server, bins with geospatial data it will be deserialized into aGeoJSON
instance.See also
from __future__ import print_function import aerospike from aerospike import GeoJSON config = { 'hosts': [ ('127.0.0.1', 3000)]} client = aerospike.client(config).connect() client.index_geo2dsphere_create('test', 'pads', 'loc', 'pads_loc_geo') # Create GeoJSON point using WGS84 coordinates. latitude = 28.608389 longitude = -80.604333 loc = GeoJSON({'type': "Point", 'coordinates': [longitude, latitude]}) print(loc) # Alternatively create the GeoJSON point from a string loc = aerospike.geojson('{"type": "Point", "coordinates": [-80.604333, 28.608389]}') # Create a user record. bins = {'pad_id': 1, 'loc': loc} # Store the record. client.put(('test', 'pads', 'launchpad1'), bins) # Read the record. (k, m, b) = client.get(('test', 'pads', 'launchpad1')) print(b) client.close()
-
class
GeoJSON
([geo_data])¶ Optionally initializes an object with a GeoJSON
str
or adict
of geospatial data.
-
wrap
(geo_data)¶ Sets the geospatial data of the
GeoJSON
wrapper class.Parameters: geo_data (dict) – a dict
representing the geospatial data.
-
unwrap
() → dict of geospatial data¶ Gets the geospatial data contained in the
GeoJSON
class.Returns: a dict
representing the geospatial data.
-
class
New in version 1.0.53.
Data_Mapping
— Python Data Mappings¶
How Python types map to server types
Note
By default, the aerospike.Client
maps the supported types int
, str
, float
, bytearray
, list
, dict
to matching aerospike server types (int, string, double, blob, list, map). When an unsupported type is encountered, the module uses cPickle to serialize and deserialize the data, storing it into a blob of type ‘Python’ (AS_BYTES_PYTHON).
The functions set_serializer()
and set_deserializer()
allow for user-defined functions to handle serialization, instead. The user provided function will be run instead of cPickle. The serialized data is stored as type (AS_BYTES_BLOB). This type allows the storage of binary data readable by Aerospike Clients in other languages. The serialization config param of aerospike.client()
registers an instance-level pair of functions that handle serialization.
Unless a user specified serializer has been provided, all other types will be stored as Python specific bytes. Python specific bytes may not be readable by Aerospike Clients for other languages.
The following table shows which Python types map directly to Aerospike server types.
Python Type | Server type |
---|---|
int | integer |
long | integer |
str | string |
unicode | string |
float | double |
dict | map |
list | list |
bytearray | blob |
aerospike.GeoJSON | GeoJSON |
It is possible to nest these datatypes. For example a list may contain a dictionary, or a dictionary may contain a list as a value.
Note
Unless a user specified serializer has been provided, all other types will be stored as Python specific bytes. Python specific bytes may not be readable by Aerospike Clients for other languages.