-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Format: 3.0 (quilt) Source: kerchunk Binary: python3-kerchunk, python-kerchunk-doc Architecture: all Version: 0.2.9-1 Maintainer: Debian GIS Project Uploaders: Antonio Valentino Homepage: https://github.com/fsspec/kerchunk Description: Cloud-friendly access to archival data Kerchunk is a library that provides a unified way to represent a variety of chunked, compressed data formats (e.g. NetCDF, HDF5, GRIB), allowing efficient access to the data from traditional file systems or cloud object storage. It also provides a flexible way to create virtual datasets from multiple files. It does this by extracting the byte ranges, compression information and other information about the data and storing this metadata in a new, separate object. This means that you can create a virtual aggregate dataset over potentially many source files, for efficient, parallel and cloud-friendly *in-situ* access without having to copy or translate the originals. It is a gateway to in-the-cloud massive data processing while the data providers still insist on using legacy formats for archival storage. . Features: . * completely serverless architecture * metadata consolidation, so you can understand a many-file dataset (metadata plus physical storage) in a single read * read from all of the storage backends supported by fsspec, including object storage (s3, gcs, abfs, alibaba), http, cloud user storage (dropbox, gdrive) and network protocols (ftp, ssh, hdfs, smb...) * loading of various file types (currently netcdf4/HDF, grib2, tiff, fits, zarr), potentially heterogeneous within a single dataset, without a need to go via the specific driver (e.g., no need for h5py) * asynchronous concurrent fetch of many data chunks in one go, amortizing the cost of latency * parallel access with a library like zarr without any locks * logical datasets viewing many (>~millions) data files, and direct access/subselection to them via coordinate indexing across an arbitrary number of dimensions Standards-Version: 4.7.2 Vcs-Browser: https://salsa.debian.org/debian-gis-team/kerchunk Vcs-Git: https://salsa.debian.org/debian-gis-team/kerchunk.git Testsuite: autopkgtest-pkg-pybuild Build-Depends: debhelper-compat (= 13), dh-sequence-python3, dh-sequence-sphinxdoc , pybuild-plugin-pyproject, python3-aiohttp , python3-all, python3-astropy , python3-dask , python3-cfgrib, python3-cftime, python3-eccodes , python3-fsspec, python3-h5netcdf , python3-h5py, python3-netcdf4 , python3-numcodecs, python3-numpy, python3-numpydoc , python3-pytest , python3-scipy, python3-setuptools, python3-setuptools-scm, python3-sphinx , python3-sphinx-rtd-theme , python3-tifffile , python3-ujson, python3-xarray, python3-zarr Package-List: python-kerchunk-doc deb doc optional arch=all python3-kerchunk deb python optional arch=all Checksums-Sha1: 63ada0c1db86b612d879c3a88dfd5b7fc58eb65a 124716963 kerchunk_0.2.9.orig.tar.gz 989e33c94316e299a6f644d4737138e970fecf25 6788 kerchunk_0.2.9-1.debian.tar.xz Checksums-Sha256: c9f1d718c46272138d283487a04e1d23a9dd5efcd60ac68baec7059a88829ef7 124716963 kerchunk_0.2.9.orig.tar.gz b95bc61f807541adc780543b62c920ea0fec170520d5deabf572a98d86d6611d 6788 kerchunk_0.2.9-1.debian.tar.xz Files: 37d48624e7e1c39a79f866204090a04c 124716963 kerchunk_0.2.9.orig.tar.gz 11ebcb233ec497e28816f9aa7d308b21 6788 kerchunk_0.2.9-1.debian.tar.xz -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEgYLeQXBWQI1hRlDRZ1DxCuiNSvEFAmlRBJAACgkQZ1DxCuiN SvF/3g//aHd/4BzjgYoLUQ4B9cJf561YUmv0ZY7fK/WykRYSkitL9TDzvQNpzcwT xoXP+KhZHzeb7GkYXdLF1jIbsSWKWagb8/l9QxHLipJ2fRLdScZ2nbDma7wyZaU9 EDK25KLYDTjRVWdqgShvjNwZfs8vDzn/YzomUcS4kENSpBDsFB48/o5ry/MW3zXg UXWi06gExdEBTrBip3Wzlt5cnSDcvhhjq0oYle+X8QcJDK4DTEvBHDxy18FXuTYx b7DAnY/bEAVO9o+NGcsVa7MFXm2hwE2ZvsnrdbWRZp2kuSub1o/l6aXP8wlQHvd9 WW/3/MBy26IgaPNZYQ91PMtroCX443swdkcgP8lOXmuF3d+nghH5ntiLNb/ETicZ 1k9R6QCDevuNs2+mPHuuGez/rt3KuPsTGtadTERm3Eqg5vM9D7i+Mh/gkmOA4qke jr9xXBeSv6X3FdHakis0t5bv/qzpxu1RPX51ojTpj5kOAYt7RbBNGa5stb4E/7sC rp/snwgK4/b0wXmEB5/ydJ52+jDsb1Q8etXrmc0dPVUXZbcO+o56V15yVmYqwyJh arDLxj2oPxtxKYsOZXZ839RocMp5Wvuo9uidO7JACH9WSPuv/d4qpO7CsDO1hYVK ZiJfjyAbEQ0UGGV5SzCx4D17EgyIjXkGlaXa51Ux3P1t2jBazqg= =vty7 -----END PGP SIGNATURE-----