Skip to content

Open the contents of a tar file ​

Click a .tar, .tar.gz, or .tar.xz file in Storage to open a list of the files inside the archive. You do not need to extract it and upload the files to S3 again.

Check entry names and sizes to choose a file to open.
List of MP4 and JSON files inside dataset-00001.tar

Check entry names and sizes to choose a file to open.

Select an entry to preview it ​

Select a file in the list to open text, images, audio, or video individually. For JSON, you can copy the contents. For audio, you can add it to the synchronized player. An entry's Actions menu (⋯) also includes pin and download.

Check JSON inside an archive on its own. The share URL also includes the entry name.
sample-001.json inside a tar file opened in the preview

Check JSON inside an archive on its own. The share URL also includes the entry name.

Fetch large videos partially from uncompressed tar files ​

For an uncompressed .tar, mado fetches from S3 only the ranges needed for playback. Even if a video inside the tar is 500 MB, 1 GB, or larger, you do not need to wait for all of its data to be fetched before it plays. File positions are saved in an index, which the list, playback, and seeking all share.

FormatHow it is read
.tarFetches headers and the needed file data partially. Keeps fetching the rest until the index is complete
.tar.gz / .tar.xzDecompresses sequentially from the start. A preview limit applies to file data

File data inside compressed tar files is limited by PREVIEW_TAR_ENTRY_MAX_BYTES. Waveform and spectrogram analysis of audio has its own input limit, which is different from the limit for direct playback.

While range request… with an entry count and the amount read is shown above the list, mado is still fetching the rest of the index. When the object is updated, the index is rebuilt.

Apache License 2.0