marc21-partition(1)

NAME

marc21-partition — Partition records by values.

SYNOPSIS

marc21 partition [OPTIONS] [PATH]…

The partitions are written to the <outdir> directory. The filename can be changed using the --template option. By default, the partitions are saved with the corresponding value and the .mrc file extension.

If a record doesn’t have the field/subfield, the record won’t be written to a partition. A record with multiple values will be written to each partition; thus the partitions may not be disjoint. In order to prevent duplicate records in a partition , all duplicate values of a record will be removed automatically.

ARGUMENTS

<PATH>: A MARC-21 Path expression.

OPTIONS

--template <string>: A template for naming the individual partitions. The placeholder {} is replaced by the value of the path expression. If the template ends with the suffix .gz, the partitions are compressed in Gzip format.
-o, --output <path>: Write output to <path>; by default all partitions are written to the current working directory.

-l, --limit <n>: Limit the result to first <n> records (a limit value 0 means no limit)
-s, --skip-invalid: Skip invalid records that can’t be decoded
--strsim-threshold: The minimum score for string similarity comparisons (0 <= score <= 100)
--where: An expression for filtering records
--filter-normalization <form>: Transliterate the given filter or query expression into the specified Unicode normal form. Possible values: nfd, nfkd, nfc, nfkc. This option can also be specified by setting the environment variable MARC21_FILTER_NORMALIZATION.

COMMON OPTIONS

-p, --progress: If set, show a progress bar
-c, --compression: Specify compression level (0..=9)

EXIT STATUS

0 — Command succeeded.
1 — Command failed.

EXAMPLES

In the following example, all authority records are partitioned based on the date of the last record transaction (field 005), using only the year (positions 0 through 3) as the values:

$ marc21 partition -ps '005[0:4]' authorities-gnd-sachbegriff_dnbmarc.mrc.gz -o out
207,505 records, 0 invalid | 111,473 records/s, elapsed: 00:00:01

$ tree out
out
├── 2009.mrc
├── 2010.mrc
├── 2011.mrc
├── 2012.mrc
├── 2013.mrc
├── 2014.mrc
├── 2015.mrc
├── 2016.mrc
├── 2017.mrc
├── 2018.mrc
├── 2019.mrc
├── 2020.mrc
├── 2021.mrc
├── 2022.mrc
├── 2023.mrc
├── 2024.mrc
├── 2025.mrc
└── 2026.mrc

1 directory, 18 files

Keyboard shortcuts

marc21