NVIDIA&#39;s quantum computing SDK, cuQuantum version 23.10, has been updated. In this update, we want to review the enhancements made to the software development kit. The SDK is primarily divided into three parts. The first is called cuStateVec, which is a state vector simulator that serves as a traditional simulator and constitutes the core of cuQuantum. The second is a new simulator known as cuTensorNet, which is different from the traditional approach and may require some skill to use effectively. The last part is a Python wrapper for operating these two simulators, which has been updated under the name cuQuantum Python. These three components have been updated, and we would like to review the changes. Release Note<a href="https://docs.nvidia.com/cuda/cuquantum/latest/cuquantum_sdk_release_notes.html#cuquantum-sdk-v23-10" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500); background-color: rgb(255, 255, 255);">https://docs.nvidia.com/cuda/cuquantum/latest/cuquantum_sdk_release_notes.html#cuquantum-sdk-v23-10 </a> cuStateVec is now 1.5.0 <a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/release_notes.html#custatevec-v1-5-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/release_notes.html#custatevec-v1-5-0 </a> <h2>cuStateVec v1.5.0<a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/release_notes.html#custatevec-v1-5-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">¶ </a></h2><ul><li class="ql-indent-1">Added new API:</li><li class="ql-indent-1">Migration of sub state vectors (see <a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/host_state_vector_migration.html" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">Host state vector migration  </a> and <a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/api/functions.html#_CPPv430custatevecSubSVMigratorMigrate18custatevecHandle_t35custatevecSubSVMigratorDescriptor_tiPKvPv17custatevecIndex_t17custatevecIndex_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">custatevecSubSVMigratorMigrate()  </a>)</li><li class="ql-indent-1">Improved performance/functionality:</li><li class="ql-indent-1">Improved the performance of <a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/api/functions.html#_CPPv428custatevecApplyPauliRotation18custatevecHandle_tPv14cudaDataType_tK8uint32_tdPK17custatevecPauli_tPK7int32_tK8uint32_tPK7int32_tPK7int32_tK8uint32_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">custatevecApplyPauliRotation()  </a>.</li><li class="ql-indent-1">Resolved issues:</li><li class="ql-indent-1">Fixed an issue that <a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/api/functions.html#_CPPv434custatevecMultiDeviceSwapIndexBitsP18custatevecHandle_tK8uint32_tPPvK14cudaDataType_tK8uint32_tK8uint32_tPK4int2K8uint32_tPK7int32_tPK7int32_tK8uint32_tK29custatevecDeviceNetworkType_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">custatevecMultiDeviceSwapIndexBits()  </a> accepted wrong index bit positions specified to the indexBitSwaps argument. If the indexBitSwaps argument is properly given, the function works properly.</li></ul> Firstly, let&#39;s talk about cuStateVec. The first point is about a new API, which is important. The second is about performance improvements. The third is the resolution of issues, so we will skip the third and focus on the first two points. Regarding the API, it appears to be a significant update. NVIDIA has recently entered the CPU market as well, releasing the Grace CPU. This release seems to be compatible with the new Grace CPU. For a detailed explanation of the overview, please refer to the following website. <a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/host_state_vector_migration.html" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/host_state_vector_migration.html </a> Regarding Host State Vector Migration The cuStateVec library now provides the custatevecSubSVMigrator API, which allows users to combine host CPU memory and device GPU memory to scale up simulations. It seems likely that simulations for quantum computers will become faster, as both the Grace CPU and GPU can be used efficiently. custatevecSubSVMigrator API The custatevecSubSVMigrator API is a utility for migrating state vectors allocated on the CPU (host) and additionally those allocated on the GPU (device). By using this API, CPU memory can be leveraged to accommodate the state vector. Furthermore, by utilizing both CPU and GPU memory for a single state vector, it is possible to maximize the number of qubits that can be simulated. API is here<a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/api/functions.html#_CPPv430custatevecSubSVMigratorMigrate18custatevecHandle_t35custatevecSubSVMigratorDescriptor_tiPKvPv17custatevecIndex_t17custatevecIndex_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/api/functions.html#_CPPv430custatevecSubSVMigratorMigrate18custatevecHandle_t35custatevecSubSVMigratorDescriptor_tiPKvPv17custatevecIndex_t17custatevecIndex_t </a> NextcuTensorNet is v2.3.0<a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/release_notes.html#cutensornet-v2-3-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/release_notes.html#cutensornet-v2-3-0 </a> <h2>cuTensorNet v2.3.0<a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/release_notes.html#cutensornet-v2-3-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">¶ </a></h2><ul><li class="ql-indent-1">New functionalities:</li><li class="ql-indent-1">New high-level APIs for defining tensor network operators and computing their expectation values over user-defined tensor network states.</li><li class="ql-indent-1">See the introduction at <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/overview.html#high-level-tn" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">High-level tensor network specification and processing  </a>.</li><li class="ql-indent-1">New high-level APIs for computing arbitrary slices of tensor network states.</li><li class="ql-indent-1">New high-level APIs for computing the Matrix-Product-State (MPS) factorization of a given tensor network state.</li><li class="ql-indent-1">New truncation option <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/api/types.html#_CPPv4N38cutensornetTensorSVDConfigAttributes_t53CUTENSORNET_TENSOR_SVD_CONFIG_DISCARDED_WEIGHT_CUTOFFE" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">CUTENSORNET_TENSOR_SVD_CONFIG_DISCARDED_WEIGHT_CUTOFF  </a> for tensor SVD computation.</li><li class="ql-indent-1">Bugs fixed:</li><li class="ql-indent-1">Fix a bug when the automatic distributed contraction path optimization is invoked with the TIME as a cost function to ensure the optimal path is chosen.</li><li class="ql-indent-1">Fix a bug for potentially inconsistent library handles management when <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/api/functions.html#_CPPv435cutensornetWorkspaceComputeSVDSizesK19cutensornetHandle_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_tK28cutensornetTensorSVDConfig_t32cutensornetWorkspaceDescriptor_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cutensornetWorkspaceComputeSVDSizes()  </a>, <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/api/functions.html#_CPPv434cutensornetWorkspaceComputeQRSizesK19cutensornetHandle_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_t32cutensornetWorkspaceDescriptor_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cutensornetWorkspaceComputeQRSizes()  </a> and <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/api/functions.html#_CPPv441cutensornetWorkspaceComputeGateSplitSizesK19cutensornetHandle_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_tK29cutensornetTensorDescriptor_tK26cutensornetGateSplitAlgo_tK28cutensornetTensorSVDConfig_t24cutensornetComputeType_t32cutensornetWorkspaceDescriptor_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cutensornetWorkspaceComputeGateSplitSizes()  </a> are called.</li><li class="ql-indent-1">Fix a bug for <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/api/functions.html#_CPPv419cutensornetTensorQRK19cutensornetHandle_tK29cutensornetTensorDescriptor_tPCKvK29cutensornetTensorDescriptor_tPvK29cutensornetTensorDescriptor_tPvK32cutensornetWorkspaceDescriptor_t12cudaStream_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cutensornetTensorQR()  </a> when the combined matrix row/column extent of the input tensor equals 1.</li><li class="ql-indent-1">Fix a performance bug when the tensor network contraction path finder is run by multiple processes on the same node.</li><li class="ql-indent-1">Other changes:</li><li class="ql-indent-1">Complex-valued gradients computed with the experimental API <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/api/functions.html#_CPPv435cutensornetComputeGradientsBackwardK19cutensornetHandle_t28cutensornetContractionPlan_tA_PCKvPKvA_PCv7int32_t32cutensornetWorkspaceDescriptor_t12cudaStream_t" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cutensornetComputeGradientsBackward()  </a> are complex conjugated now, as compared to what would be returned in the previous release.</li></ul> As part of the second update, which includes bug fixes, I am particularly interested in the first and last changes. To simplify the specification and processing of tensor networks encountered in the quantum field and other domains, cuTensorNet provides a set of high-level API functions that allow users to gradually build a given tensor network state and then compute its properties. It seems there are mainly new API offerings for slicing and decomposition of Matrix Product States (MPS), with new decomposition options for Singular Value Decomposition (SVD). The final &#34;Other changes&#34; are quite intriguing features. There is an experimental release for the calculation of gradients in complex numbers. This is particularly relevant in fields such as machine learning where gradients are required, and in the case of quantum computers, these are complex numbers, which may not be supported by general libraries. Finally we see cuQuantum Python<a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/release_notes.html#cuquantum-python-v23-10-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500); background-color: rgb(255, 255, 255);">https://docs.nvidia.com/cuda/cuquantum/latest/python/release_notes.html#cuquantum-python-v23-10-0 </a> <h2>cuQuantum Python v23.10.0<a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/release_notes.html#cuquantum-python-v23-10-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">¶ </a></h2><ul><li class="ql-indent-1">Add new APIs and functionalities:</li><li class="ql-indent-1">For low-level APIs, please refer to the release notes of <a href="https://docs.nvidia.com/cuda/cuquantum/latest/custatevec/release_notes.html#custatevec-v1-5-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuStateVec v1.5.0  </a> and <a href="https://docs.nvidia.com/cuda/cuquantum/latest/cutensornet/release_notes.html#cutensornet-v2-3-0" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuTensorNet v2.3.0  </a>.</li><li class="ql-indent-1">The function <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.contract.html#cuquantum.contract" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuquantum.contract()  </a> now works like a native PyTorch operator as far as autograd is concerned, if the input operands are PyTorch tensors. This is an experimental feature.</li><li class="ql-indent-1">A new, experimental method <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.Network.html#cuquantum.Network.gradients" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuquantum.Network.gradients()  </a> is added for computing the gradients of the network with respect to the input operands.</li><li class="ql-indent-1">If the gradients are complex-valued, the convention follows <a href="https://pytorch.org/docs/stable/notes/autograd.html#autograd-for-complex-numbers" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">that of PyTorch’s  </a>.</li><li class="ql-indent-1">Added a new attribute <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.cutensornet.tensor.SVDMethod.html#cuquantum.cutensornet.tensor.SVDMethod.discarded_weight_cutoff" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuquantum.cutensornet.tensor.SVDMethod.discarded_weight_cutoff  </a> to allow SVD truncation based on discarded weight.</li><li class="ql-indent-1">The <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.Network.html#cuquantum.Network" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuquantum.Network  </a> constructor and its <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.Network.html#cuquantum.Network.reset_operands" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">reset_operands()  </a> method now accept an optional stream argument.</li><li class="ql-indent-1">Bugs fixed:</li><li class="ql-indent-1">Fix potential data corruption when <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.Network.html#cuquantum.Network.reset_operands" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">reset_operands()  </a> is called when the provided operands don’t outlive the contraction operation.</li><li class="ql-indent-1">For the case of using CPU arrays (from NumPy/PyTorch) as input operands for contraction, the internal streams were not be properly ordered.</li><li class="ql-indent-1">The methods <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.Network.html#cuquantum.Network.autotune" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">autotune()  </a>, <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.Network.html#cuquantum.Network.contract" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">contract()  </a> and the standalone function <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.contract.html#cuquantum.contract" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">contract()  </a> allow passing the pointer address for the stream argument, as promised in the docs.</li><li class="ql-indent-1">The attribute dtypes for <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.cutensornet.MarginalAttribute.html#cuquantum.cutensornet.MarginalAttribute.OPT_NUM_HYPER_SAMPLES" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuquantum.cutensornet.MarginalAttribute.OPT_NUM_HYPER_SAMPLES  </a> and <a href="https://docs.nvidia.com/cuda/cuquantum/latest/python/api/generated/cuquantum.cutensornet.SamplerAttribute.html#cuquantum.cutensornet.SamplerAttribute.OPT_NUM_HYPER_SAMPLES" rel="noopener noreferrer" target="_blank" style="color: var(--chakra-colors-blue-500);">cuquantum.cutensornet.SamplerAttribute.OPT_NUM_HYPER_SAMPLES  </a> are fixed.</li><li class="ql-indent-1">Other changes:</li><li class="ql-indent-1">If Python logging is enabled, cuTensorNet’s run-time (instead of build-time) version is reported.</li><li class="ql-indent-1">For passing PyTorch tensors to contraction APIs, the tensor flags .is_conj() and .requires_grad are now taken into account, unless a user explicitly overwrites them with the qualifiers argument.</li></ul> Looking beyond bug fixes, it&#39;s evident that there were discussions about APIs related to cuStateVec and cuTensorNet. It also seems that there is now compatibility with PyTorch Tensors. It looks like it&#39;s possible to work with objects like Torch Tensors, even when automatic differentiation information is set. Furthermore, the updates support the content previously mentioned for cuStateVec and cuTensorNet. How about that? The significant changes seem to revolve around updates with a focus on the Grace Hopper CPU and GPU, as well as compatibility with existing machine learning frameworks like PyTorch, enabling the differentiation of complex numbers. This should make gradient calculations more straightforward. That&#39;s all for now.

NVIDIA's quantum computer SDK, cuQuantum version 23.10, has been updated! It now includes support for CPU/GPU and calculations for gradients of complex numbers, among other features.

NVIDIA's quantum computer SDK, cuQuantum version 23.10, has been updated! It now includes support for CPU/GPU and calculations for gradients of complex numbers, among other features.

Yuichiro Minato