Format
WARC
Summary
- Name
- WARC
- Version
- 1.1
- Identifiers
-
- MIME: application/warc
- PUID: fmt/1281
- Format type
- Aggregate
- Description
- The WARC (Web ARChive) file format offers a convention for concatenating multiple resource records (data objects), each consisting of a set of simple text headers and an arbitrary data block into one long file. The WARC format is an extension of the ARC file format (ARC) that has traditionally been used to store "web crawls" as sequences of content blocks harvested from the World Wide Web (…) Besides the primary content recorded in ARCs, the extended WARC format accommodates related secondary content, such as assigned metadata, abbreviated duplicate detection events, later-date transformations, and segmentation of large resources”. WARC format has been written by the members of the IIPC (http://www.netpreserve.org/) grouped within the ISO/TC46/SC4/WG12.
- File extensions
-
warc - Submitted by
- Landesarchiv Nordrhein-Westfalen / Landesarchiv Nordrhein-Westfalen
Relationships
- Has priority over
Internal signatures
WARC 1.1
- Description
- Matching WARC header. Header: WARC/1.1 CRLF. Then either 'WARC-Record-ID', 'WARC-Date', 'WARC-Type', 'Content-Length' all madatory fields that can appear in any order.
Byte sequences
- Min Frag Length
- Absolute from BOF
- Offset
- 0
- Max offset
- 4096
- Byte Sequence
574152432F312E310D0A{0-512}(574152432D5265636F72642D4944|436F6E74656E742D4C656E677468|574152432D54797065|574152432D44617465)- Endianness
- None
Changelog
-
V97
- Release date
- 1 October 2020
-
Updated
WARC 1.1: Priority over WARC added and signature description amended. Submitted by Landesarchiv Nordrhein-Westfalen.
-
V96
- Release date
- 21 January 2020
-
Added format
WARC 1.1: Full entry added. Submitted by Landesarchiv Nordrhein-Westfalen.
-
Added signature
WARC 1.1: Signature developed and samples provided by Landesarchiv Nordrhein-Westfalen.