This is firstly a string interpolation tool. On top of this it can apply, and chain, over 50 basic string operations to the interpolated variables. Advanced support for pluralization.

string_magic(
  ...,
  .envir = parent.frame(),
  .data = list(),
  .sep = "",
  .vectorize = FALSE,
  .delim = c("{", "}"),
  .last = NULL,
  .post = NULL,
  .nest = FALSE,
  .collapse = NULL,
  .invisible = FALSE,
  .default = NULL,
  .trigger = TRUE,
  .check = TRUE,
  .class = NULL,
  .help = NULL,
  .namespace = NULL
)

.string_magic(
  ...,
  .envir = parent.frame(),
  .data = list(),
  .sep = "",
  .vectorize = FALSE,
  .delim = c("{", "}"),
  .collapse = NULL,
  .last = NULL,
  .nest = FALSE,
  .trigger = TRUE,
  .namespace = NULL
)

sma(
  ...,
  .envir = parent.frame(),
  .data = list(),
  .sep = "",
  .vectorize = FALSE,
  .delim = c("{", "}"),
  .last = NULL,
  .post = NULL,
  .nest = FALSE,
  .collapse = NULL,
  .invisible = FALSE,
  .default = NULL,
  .trigger = TRUE,
  .check = TRUE,
  .class = NULL,
  .help = NULL,
  .namespace = NULL
)

Arguments

...

Character scalars that will be collapsed with the argument sep. Note that named arguments are used for substitution.

To interpolate, you can use "{x}" within each character string to insert the value of x in the string. You can add string operations in each "{}" instance with the syntax "'arg'op ? x" (resp. "'arg'op ! x") to apply the operation 'op' with the argument 'arg' to x (resp. the verbatim of x). Otherwise, what to say? Ah, nesting is enabled, and since there's over 50 operators, it's a bit complicated to sort you out in this small space.

Use the argument .help = "keyword" (or .help = TRUE) to obtain a selective help from the main documentation.

Note that in interpolations you have access to the special variables: .now and .date to get the current time; and the special function .now("format") to format the time. Ex: .now('%Y-%m %H:%m').

.envir

An environment used to evaluate the variables in "{}". By default the variables are evaluated using the environment from where the function is called or using the named arguments passed to the function.

.data

A list used to evaluate the variables in "{}". Default is the empty list. By default the variables are evaluated using the environment from where the function is called or using the named arguments passed to the function.

.sep

Character scalar, default is the empty string "". It is used to collapse all the elements in ... before applying any operation.

.vectorize

Logical scalar, default is FALSE. If TRUE, Further, elements in ... are NOT collapsed together, but instead vectorised.

.delim

Character vector of length 1 or 2. Default is c("{", "}"). Defines the opening and the closing delimiters for interpolation.

If of length 1, it must be of the form: 1) the opening delimiter, 2) a single space, 3) the closing delimiter. Ex: ".[ ]" is equivalent to c(".[", "]"). The default value is equivalent to "{ }".

[ ]: R:%20 [", "]: R:%22,%20%22

.last

Character scalar, a function, or NULL (default). If provided and character: it must be an string_magic chain of operations of the form "'arg1'op1, op2, etc". All these operations are applied just before returning the vector. If a function, it will be applied to the resulting vector.

.post

Function or NULL (default). If not NULL, this function will be applied after all the processing, just before returning the object. This function can have extra arguments which will be caught directly in the ... argument of string_magic. For example if .post = head, you can directly pass the argument n = 3 to string_magic's arguments.

.nest

Logical, default is FALSE. If TRUE, it will nest the original string within interpolation delimiters, so that you can apply operations directly on the string. Example: string_magic("upper ! hello") returns "upper ! hello", while string_magic("upper ! hello", .nest = TRUE) returns "HELLO".

.collapse

Character scalar, default is NULL. If provided, the character vector that should be returned is collapsed with the value of this argument. This leads to return a string of length 1.

.invisible

Logical scalar, default is FALSE. Whether the object returned should be invisible (i.e. not printed on the console).

.default

Character scalar or NULL (default). If provided, it must be a sequence of string_magic operations. It will be applied as a default to any interpolation. Ex: if x = 1:2, then string_magic("x = {x}", .default = "enum") leads to "x = 1 and 2", and is equivalent to string_magic("x = {enum?x}"). Note that this default operations does not apply to nested expressions. That is string_magic("{!x{1:2}}", .default = "enum") leads to c("x1", "x2") and NOT "x1 and 2".

.trigger

Logical, default is TRUE. If FALSE, this function is not run. Can be useful in debugging situations where we want conditional evaluations.

.check

Logical scalar, default is TRUE. Whether to enable error-handling (i.e. human readable error messages). Without error-handling you can save something of the order of 40us. Useful only in long loops.

.class

Character vector representing the class to give to the object returned. By default it is NULL. Note that the class string_magic has a specific print method, usually nicer for small vectors (it base::cat()s the elements).

.help

Character scalar or TRUE, default is NULL. This argument is used to generate a dynamic help on the console. If TRUE, the user can select which topic to read from the main documentation, with the possibility to search for keywords and navigate the help pages. If a character scalar, then a regex search is perfomed on the main documentation and any section containining a match is displayed. The user can easily navigate across matches.

.namespace

Character scalar or NULL (default). Only useful for package developers. As a regular end-user you shouldn't care! If your package uses string_magic, you should care. It is useful only if your package uses 'custom' string_magic operations, set with string_magic_register_fun() or string_magic_register_ops().

Value

It returns a character vector whose length depends on the elements and operations in the interpolations.

Details

There are over 50 basic string operations, it supports pluralization, string operations can be nested, operations can be applied group-wise or conditionally and operators have sensible defaults. You can also declare your own operations with string_magic_register_fun() or string_magic_register_ops(). They will be seamlessly integrated to string_magic.

The function .string_magic (prefixed with a dot) is a leaner version of the function string_magic. It does the same operations but with the following differences:

  • there is no error handling: meaning that the error messages, if any, will be poor and hard to understand

  • default options are not applied: hence the user must always explicitly provide the arguments

This leads to a faster processing time (of about 50 microseconds) at the cost of user experience.

If you want to change the default values of string_magic (like changing the delimiter), use the function string_magic_alias().

Use the argument .help to which you can pass keywords or regular expressions and fecth select pieces from the main documentation.

Functions

  • string_magic(): String interpolation with operation chaining

  • .string_magic(): A simpler version of string_magic without any error handling to save a few micro seconds

  • sma(): Alias to string_magic

Interpolation and string operations

Principle:

To interpolate a variable, say x, simply use {x}. For example x = "world"; string_magic("hello {x}") leads to "hello world".

To any interpolation you can add operations. Taking the previous example, say we want to display "hello W O R L D". This means upper casing all letters of the interpolated variable and adding a space between each of them. Do you think we can do that? Of course yes: string_magic("hello {upper, ''s, c ? x}"). And that's it.

Now let's explain what happened. Within the {} box, we first write a set of operations, here "upper, ''s, c", then add "?" and finally write the variable to interpolate, "x". The operations (explained in more details below) are upper, upper-casing all letters, ''s: splitting with the empty string, 'c': concatenating with spaces the vector of string that was just split. The question mark means that the expression coming after it is to be evaluated (this is opposed to the exclamation mark presented next).

The syntax is always the same: {operations ? expression}, where the operations section is a comma separated list of operations. These operations are of the form 'arg'op, with arg the argument to the operator code op. These operations are performed sequantially from left to right.

Some operations, like upper, accept options. You attach options to an operation with a dot followed by the option name. Formally: op.option1.option2, etc. Example: x = "hi there. what's up? fine." ; string_magic("He said: {upper.sentence, Q ? x}"). Leads to: He said: "Hi there. What's up? Fine.".

Both operators and options are partially matched. So string_magic("He said: {up.s, Q ? x}") would also work.

Verbatim interpolation and nesting

Principle:

Instead of interpolating a variable, say x, with {x}, you can use an exclamation mark to trigger varbatim evaluation. For example string_magic("hello {!x}") would lead to "hello x". It's a bit disappointing, right? What's the point of doing that? Wait until the next two paragraphs.

Verbatim evaluation is a powerful way to apply operations to plain text. For example: string_magic("hello {upper, ''s, c ! world}") leads to "hello W O R L D".

(A note in passing. The spaces surrounding the exclamation mark are non necessary, but when one space is present on both sides of the !, then the verbatim expression only begins after it. Ex: "{upper! hi}" leads to " HI" while "{upper ! hi}" leads to "HI" and "{upper ! hi}" leads to " HI".)

The second advantage of verbatim evaluations is nesting. Anything in a verbatim expression is evaluated with the function string_magic. This means that any box will be evaluated as previously described. Let's give an example. You want to write the expression of a polynomial of order n: a + bx + cx^2 + etc. You can do that with nesting. Assume we have n = 2.

Then string_magic("poly({n}): {' + 'c ! {letters[1 + 0:n]}x^{0:n}}") leads to "poly(2): ax^0 + bx^1 + cx^2".

How does it work? The verbatim expression (the one following the exclamation mark), here "{letters[1 + 0:n]}x^{0:n}", is evaluated with string_magic. string_magic("{letters[1 + 0:n]}x^{0:n}") leads to the vector c("ax^0", "bx^1", "cx^2").

The operation ' + 'c then concatenates (or collapses) that vector with ' + '. This value is then appended to the previous string.

We could refine by adding a cleaning operation in which we replace "x^0" and "^1" by the empty string. Let's do it:

string_magic("poly({n}): {' + 'c, 'x\\^0|\\^1'r ! {letters[1 + 0:n]}x^{0:n}}") leads to "poly(2): a + bx + cx^2", what we wanted.

You can try to write a function to express the polynomial as before: although it is a simple task, my guess is that it will require more typing.

Operations

General syntax:

As seen in the previous sections, within a box (i.e. "{}"), multiple operations can be performed. We can do so by stacking the operations codes and in a comma separated enumeration. Operations can have arguments, and operations can also have options. The general syntax, with argument and options, is:

{'arg1'op1.optionA.optionB, arg2 op2.optionC, arg3op3, 51op4 ? x}

The argument can appear in four forms: a) inside single or double quotes just before the operation name (arg1 above), b) verbatim, separated with a space, just before the operation name (arg2 above), c) inside bactick quotes the argument is evaluated from the environment (arg3 above), or d) when the argument is an integer it can be juxtaposed to the opeation name (like in op4 above).

The options are always dot separated and attached to the operation name, they are specific to each operation.

Both the operation name and the option names are partially matched.

Basic string operations

This section describes some of the most common string operations: extracting, replacing, collapsing, splitting, etc. These functions accept generic flags ("ignore", "fixed", "word") in their patterns (syntax: "flags/pattern"). Please see the dedicated section for more information on flags.

  • s, split, S, Split: splits the string according to a pattern. The operations have different defaults: ' ' for s and 'split', and ',[ \t\n]*' for S and 'Split' (i.e. comma separation). Ex.1: string_magic("{S ! romeo, juliet}") leads to the vector c("romeo", "juliet"). Ex.2: string_magic("{'f/+'s, '-'c ! 5 + 2} = 3") leads to "5 - 2 = 3" (note the flag "fixed" in s's pattern).

  • c, C: to concatenate multiple strings into a single one. The two operations are identical, only their default change. c: default is ' ', C: default is ', | and '. The syntax of the argument is 's1' or 's1|s2'. s1 is the string used to concatenate (think paste(x, collapse = s1)). In arguments of the form 's1|s2', s2 will be used to concatenate the last two elements. Ex.1: x = 1:4; string_magic("Et {' et 'c ? x}!") leads to "Et 1 et 2 et 3 et 4!". Ex.2: string_magic("Choose: {', | or 'c ? 2:4}?") leads to "Choose: 2, 3 or 4?".

  • x, X: extracts patterns from a string. Both have the same default: '[[:alnum:]]+'. x extracts the first match while X extracts all the matches. Ex.1: x = c("6 feet under", "mahogany") ; string_magic("{'\\w{3}'x ? x}") leads to the vector c("fee", "mah"). Ex2.: x = c("6 feet under", "mahogany") ; string_magic("{'\\w{3}'X ? x}") leads to the vector c("fee", "und", "mah", "oga").

  • extract: extracts multiple patterns from a string, this is an alias to the operation X described above. Use the option "first" to extract only the first match for each string (behavior becomes like x). Ex: x = c("margo: 32, 1m75", "luke doe: 27, 1m71") ; string_magic("{'^\\w+'extract ? x} is {'\\d+'extract.first ? x}") leads to c("margo is 32", "luke is 27").

  • r, R: replacement within a string. The two operations are identical and have no default. The syntax is 'old' or 'old => new' with 'old' the pattern to find and new the replacement. If new is missing, it is considered the empty string. This operation also accepts the flag "total" which instruct to replace the fulll string in case the pattern is found. Ex.1: string_magic("{'e'r ! Where is the letter e?}") leads to "Whr is th lttr ?". Ex.2: string_magic("{'(?<!\\b)e => a'R ! Where is the letter e?}") leads to "Whara is tha lattar e?". Ex.3: string_magic("{'t/e => here'r ! Where is the letter e?}") leads to "here".

  • clean: replacement with a string. Similar to the operation r, except that here the comma is a pattern separator, see detailed explanations in string_clean(). Ex: string_magic("{'f/[, ]'clean ! x[a]}") leads to "xa".

  • get: restricts the string only to values respecting a pattern. This operation has no default. Accepts the options "equal" and "in". By default it uses the same syntax as string_get() so that you can use regex flags and include logical operations with ' & ' and ' | ' to detect patterns. If the option "equal" is used, a simple string equality with the argument is tested (hence no flags are accepted). If the option "in" is used, the argument is first split with respect to commas and then set inclusion is tested. Example: x = row.names(mtcars) ; string_magic("Mercedes models: {'Merc & [[:alpha:]]$'get, '^.+ 'r, C ? x}") leads to "Mercedes models: 240D, 280C, 450SE, 450SL and 450SLC".

  • is: detects if a pattern is present in a string, returns a logical vector. This operation has no default. Accepts the options "equal" and "in". By default it uses the same syntax as string_is() so that you can use regex flags and include logical operations with ' & ' and ' | ' to detect patterns. If the option "equal" is used, a simple string equality with the argument is tested (hence no flags are accepted). If the option "in" is used, the argument is first split with respect to commas and then set inclusion is tested. Mostly useful as the final operation in a string_ops() call. Example: x = c("Mark", "Lucas") ; string_magic("Mark? {'i/mark'is, C ? x}") leads to "Mark? TRUE and FALSE".

  • which: returns the index of string containing a specified pattern. With no default, can be applied to a logical vector directly. By default it uses the same syntax as string_which() so that you can use regex flags and include logical operations with ' & ' and ' | ' to detect patterns. If the option "equal" is used, a simple string equality with the argument is tested (hence no flags are accepted). If the option "in" is used, the argument is first split with respect to commas and then set inclusion is tested. Mostly useful as the final operation in a string_ops() call. Ex.1: x = c("Mark", "Lucas") ; string_magic("Mark is number {'i/mark'which ? x}.") leads to "Mark is number 1.".

Operations changing the length or the order

  • first: keeps only the first n elements. Example: string_magic("First 3 numbers: {3 first, C ? mtcars$mpg}.") leads to "First 3 numbers: 21, 21 and 22.8.". Negative numbers as argument remove the first n values. You can add a second argument in the form 'n1|n2'first in which case the first n1 and last n2 values are kept; n1 and n2 must be positive numbers.

  • K, Ko, KO: keeps only the first n elements; has more options than first. The syntax is 'n'K, 'n|s'K, 'n||s'K. The values Ko and KO only accept the two first syntax (with n only). n provides the number of elements to keep. If s is provided and the number of elements are greater than n, then in 'n|s' the string s is added at the end, and if 'n||s' the string s replaces the nth element. The string s accepts specials values:

    • :n: or :N: which gives the total number of items in digits or letters (N)

    • :rest: or :REST: which gives the number of elements that have been truncated in digits or letters (REST) Ex: string_magic("{'3|:rest: others'K ? 1:200}") leads to the vector c("1", "2", "3", "197 others").

    • The operator 'n'Ko is like 'n||:rest: others'K and 'n'KO is like 'n||:REST: others'K.

  • last: keeps only the last n elements. Example: string_magic("Last 3 numbers: {3 last, C ? mtcars$mpg}.") leads to "Last 3 numbers: 19.7, 15 and 21.4.". Negative numbers as argument remove the last n values.

  • sort: sorts the vector in increasing order. Accepts optional arguments and the option "num". Example: x = c("sort", "me") ; string_magic("{sort, c ? x}") leads to "me sort". If an argument is provided, it must be a regex pattern that will be applied to the vector using string_clean(). The sorting will be applied to the modified version of the vector and the original vector will be ordered according to this sorting. Ex: x = c("Jon Snow", "Khal Drogo"); string_magic("{'.+ 'sort, C?x}") leads to "Khal Drogo and Jon Snow". The option "num" sorts over a numeric version (with silent conversion) of the vector and reorders the original vector accordingly. Values which could not be converted are last. Important note: the sorting operation is applied before any character conversion. If previous operations were applied, it is likely that numeric data were transformed to character. Note the difference: x = c(20, 100, 10); string_magic("{sort, ' + 'c ? x}") leads to "10 + 20 + 100" while string_magic("{n, sort, ' + 'c ? x}") leads to "10 + 100 + 20" because the operation "n" first transformed the numeric vector into character.

  • dsort: sorts the vector in decreasing order. It accepts an optional argument and the option "num". Example: string_magic("5 = {dsort, ' + 'c ? 2:3}") leads to "5 = 3 + 2". See the operation "sort" for a description of the argument and the option.

  • rev: reverses the vector. Example: string_magic("{rev, ''c ? 1:3}") leads to "321".

  • unik: makes the string vector unique. Example: string_magic("Iris species: {unik, C ? iris$Species}.") leads to "Iris species: setosa, versicolor and virginica.".

  • each: repeats each element of the vector n times. Option "c" then collapses the full vector with the empty string as a separator. Ex.1: string_magic("{/x, y}{2 each ? 1:2}") leads to the vector c("x1", "y1", "x2", "y2"). Ex.2: string_magic("Large number: 1{5 each.c ! 0}") leads to "Large number: 100000".

  • times: repeats the vector sequence n times. Option "c" then collapses the full vector with the empty string as a separator. Example: string_magic("What{6 times.c ! ?}") leads to "What??????".

  • rm: removes elements from the vector. Options: "empty", "blank", "noalpha", "noalnum", "all". The optional argument represents the pattern used to detect strings to be deleted. Ex.1: x = c("Luke", "Charles"); string_magic("{'i/lu'rm ? x}") leads to "charles". By default it removes empty strings. Option "blank" removes strings containing only blank characters (spaces, tab, newline). Option "noalpha" removes strings not containing letters. Option "noalnum" removes strings not containing alpha numeric characters. Option "all" removes all strings (useful in conditions, see the dedicated section). If an argument is provided, only the options "empty" and "blank" are available. Ex.2: x = c("I want to enter.", "Age?", "21"); string_magic("Nightclub conversation: {rm.noalpha, c ! - {x}}") leads to "Nightclub conversation: - I want to enter. - Age?"

  • nuke: removes all elements, equivalent to rm.all but possibly more explicit (not sure). Useful in conditions, see the dedicated section. Example: x = c(5, 7, 453, 647); string_magic("Small numbers only: {if(.>20 ; nuke), C ? x}") leads to "Small numbers only: 5 and 7";

  • insert: inserts a new element to the vector. Options: "right" and "both". Option "right" adds the new element to the right. Option "both" inserts the new element on the two sides of the vector. Example: string_magic("{'3'insert.right, ' + 'c ? 1:2}") leads to "1 + 2 + 3".

  • dp or deparse: Deparses an object and keeps only the first characters of the deparsed string. Accepts a number as argument. In that case only the first n characters are kept. Accepts option long: in that case all the lines of the deparsed object are first collapsed. Example: fml = y ~ x1 + x2; string_magic("The estimated model is {dp ? fml}.")

Formatting operations

  • lower: lower cases the full string.

  • upper: upper cases the full string. Options: "first" and "sentence". Option "first" upper cases only the first character. Option "sentence" upper cases the first letter after punctuation. Ex: x = "hi. how are you? fine." ; string_magic("{upper.sentence ? x}") leads to "Hi. How are you? Fine.".

  • title: applies a title case to the string. Options: "force" and "ignore". Option "force" first puts everything to lowercase before applying the title case. Option "ignore" ignores a few small prepositions ("a", "the", "of", etc). Ex: x = "bryan is in the KITCHEN" ; string_magic("{title.force.ignore ? x}") leads to "Bryan Is in the Kitchen".

  • ws: normalizes whitespaces (WS). It trims the whitespaces on the edges and transforms any succession of whitespaces into a single one. Can also be used to further clean the string with its options. Options: "punct", "digit", "isolated". Option "punct" cleans the punctuation. Option "digit" cleans digits. Option "isolated" cleans isolated letters. WS normalization always come after any of these options. Important note: punctuation (or digits) are replaced with WS and not the empty string. This means that string_magic("ws.punct ! Meg's car") will become "Meg s car".

  • trimws: trims the white spaces on both ends of the strings.

  • q, Q, bq: to add quotes to the strings. q: single quotes, Q: double quotes, bq: back quotes. x = c("Mark", "Pam"); string_magic("Hello {q, C ? x}!") leads to "Hello 'Mark' and 'Pam'!".

  • format, Format: applies the base R's function base::format() to the string. By default, the values are left aligned, even numbers (differently from base::format()'s behavior). The upper case command (Format) applies right alignment. Options: "0", "zero", "right", "center". Options "0" or "zero" fills the blanks with 0s: useful to format numbers. Option "right" right aligns, and "center" centers the strings. Ex: x = c(1, 12345); string_magic("left: {format.0, q, C ? x}, right: {Format, q, C ? x}") leads to "left: '000001' and '12,345', right: ' 1' and '12,345'".

  • %: applies base::sprintf() formatting. The syntax is 'arg'% with arg an sprintf formatting, or directly the sprint formatting, e.g. % 5s. Example: string_magic("pi = {%.3f ? pi}") leads to "pi = 3.142".

  • stopwords: removes basic English stopwords (the snowball list is used). The stopwords are replaced with an empty space but the left and right WS are untouched. So WS normalization may be needed (see operation ws). x = c("He is tall", "He isn't young"); string_magic("Is he {stop, ws, C ? x}?") leads to "Is he tall and young?".

  • ascii: turns all letters into ASCII with transliteration. Failed translations are transformed into question marks. Options: "silent", "utf8". By default, if some conversion fails a warning is prompted. Option "silent" disables the warning in case of failed conversion. The conversion is done with base::iconv(), option "utf8" indicates that the source endocing is UTF-8, can be useful in some cases.

  • n: formats integers by adding a comma to separate thousands. Options: "letter", "upper", "0", "zero". The option "letter" writes the number in letters (large numbers keep their numeric format). The option "upper" is like the option "letter" but uppercases the first letter. Options "0" or "zero" left pads numeric vectors with 0s. Ex.1: x = 5; string_magic("He's {N ? x} years old.") leads to "He's five years old.". Ex.2: x = c(5, 12, 52123); string_magic("She owes {n.0, '$'paste, C ? x}.") leads to "She owes $5, $12 and $52,123.".

  • N: same as n but automatically adds the option "letter".

  • nth: when applied to a number, these operators write them as a rank. Options: "letter", "upper", "compact". Ex.1: n = c(3, 7); string_magic("They finished {nth, enum ? n}!") leads to "They finished 3rd and 7th!". Option "letter" tries to write the numbers in letters, but note that it stops at 20. Option "upper" is the same as "letter" but uppercases the first letter. Option "compact" aggregates consecutive sequences in the form "start_n_th to end_n_th". Ex.2: string_magic("They arrived {nth.compact ? 5:20}.") leads to "They arrived 5th to 20th.". Nth: same as nth, but automatically adds the option "letter". Example: n = c(3, 7); string_magic("They finished {Nth, enum ? n}!") leads to "They finished third and seventh!".

  • ntimes: write numbers in the form n times. Options: "letter", "upper". Option "letter" writes the number in letters (up to 100). Option "upper" does the same as "letter" and uppercases the first letter. Example: string_magic("They lost {C ! {ntimes ? c(1, 12)} against {S!Real, Barcelona}}.") leads to "They lost once against Real and 12 times against Barcelona.".

  • Ntimes: same as ntimes but automatically adds the option "letter". Example: x = 5; string_magic("This paper was rejected {Ntimes ? x}...") leads to "This paper was rejected five times...".

  • firstchar, lastchar: to select the first/last characters of each element. Ex: string_magic("{19 firstchar, 9 lastchar ! This is a very long sentence}") leads to "very long". Negative numbers remove the first/last characters.

  • k: to keep only the first n characters (like firstchar but with more options). The argument can be of the form 'n'k, 'n|s'k or 'n||s'k with n a number and s a string. n provides the number of characters to keep. Optionnaly, only for strings whose length is greater than n, after truncation, the string s can be appended at the end. The difference between 'n|s' and 'n||s' is that in the second case the strings will always be of maximum size n, while in the first case they can be of length n + nchar(s). Ex: string_magic("{4k ! long sentence}") leads to "long", string_magic("{'4|..'k ! long sentence}") leads to "long..", string_magic("{'4||..'k ! long sentence}") leads to "lo..".

  • fill, align (alias), width (alias): fills the character strings up to a size in order to fit a given width. Options: "right", "center". Accepts arguments of the form 'n' or 'n|s', with n a number and s a symbol. Default is left-alignment of the strings. Option "right" right aligns and "center" centers the strings. When using 'n|s', the symbol s is used for the filling. By default if no argument is provided, the maximum size of the character string is used. See help for string_fill() for more information. Ex.1: string_magic("Numbers: {'5|0'fill.right, C ? c(1, 55)}") leads to "Numbers: 00001 and 00055".

  • paste, append: pastes some character to all elements of the string. This operation has no default. Options: "both", "right", "front", "back", "delete". By default, a string is pasted on the left. Option "right" pastes on the right and "both" pastes on both sides. Option "front" only pastes on the first element while option "back" only pastes on the last element. Option "delete" first replaces all elements with the empty string. Example: string_magic("6 = {'|'paste.both, ' + 'c ? -3:-1}") leads to "6 = |-3| + |-2| + |-1|". The argument can be of the form s or s1|s2. If of the second form, this is equivalent to chaining two paste operations, once on the left and once on the right: 's1'paste, 's2'paste.right.

  • join: joins lines ending with a double backslash. Ex: x = "the sun \\\n is shining"; string_magic("{join ? x}") leads to "the sun is shining".

  • escape: adds backslashes in front of specific characters. Options "nl", "tab". Option "nl" escapes the newlines (\n), leading them to be displayed as "\\\\n". Option "tab" does the same for tabs ("\t"). This is useful to make the value free of space formatters. The default behavior is to escape both newlines and tabs.

Other operations

  • num: converts to numeric. Options: "warn", "soft", "rm", "clear". By default, the conversion is performed silently and elements that failed to convert are turned into NA. Option "warns" displays a warning if the conversion to numeric fails. Option "soft" does not convert if the conversion of at least one element fails. Option "rm" converts and removes the elements that could not be converted. Option "clear" turns failed conversions into the empty string, and hence lead to a character vector. Example: x = c(5, "six"); string_magic("Compare {num, C, q ? x} with {num.rm, C, q ? x}.") leads to "Compare '5 and NA' with '5'.", and string_magic("Compare {num.soft, C, q ? x} with {clear, C, q ? x}.") leads to "Compare '5 and six' with '5 and '.".

  • enum: enumerates the elements. It creates a single string containing the comma separated list of elements. If there are more than 7 elements, only the first 6 are shown and the number of items left is written. For example string_magic("enum ? 1:5") leads to "1, 2, 3, 4, and 5". You can add the following options by appending the letter to enum after a dot:

    • q, Q, or bq: to quote the elements

    • or, nor: to finish with an 'or' (or 'nor') instead of an 'and'

    • comma: to finish the enumeration with ", " instead of ", and".

    • i, I, a, A, 1: to enumerate with this prefix, like in: i) one, and ii) two

    • a number: to tell the number of items to display Ex.1: x = c("Marv", "Nancy"); string_magic("The main characters are {enum ? x}.") leads to "The main characters are Marv and Nancy.". Ex.2: x = c("orange", "milk", "rice"); string_magic("Shopping list: {enum.i.q ? x}.") leads to "Shopping list: i) 'orange', ii) 'milk', and iii) 'rice'."

  • len: gives the length of the vector. Options "letter", "upper", "num". Option "letter" writes the length in words (up to 100). Option "upper" is the same as letter but uppercases the first letter. By default, commas are added to separate thousands. Use uption "num" to preserve a regular numeric format. Example: string_magic("Size = {len ? 1:5000}") leads to "Size = 5,000".

  • swidth: stands for screen width. Formats the string to fit a given width by cutting at word boundaries and adding newlines appropriately. Accepts arguments of the form 'n' or 'n|s', with n a number and s a string. An argument of the form 'n|s' will add s at the beginning of each line. Further, by default a trailing white space is added to s; to remove this behavior, add an underscore at the end of it. The argument n is either an integer giving the target character width (minimum is 15), or it can be a fraction expressing the target size as a fraction of the current screen. Finally it can be an expression that uses the variable .sw which will capture the value of the current screen width. Ex.1: string_magic("{15 swidth ! this is a long sentence}") leads to "this is a long\nsentence". Ex.2: string_magic("{15 swidth.#> ! this is a long sentence}") leads to "#> this is a long\n#> sentence".

  • difftime: displays a formatted time difference. Option "silent" does not report a warning if the operation fails. It accepts either objects of class POSIXt or difftime. Example: x = Sys.time() ; Sys.sleep(0.5) ; string_magic("Time: {difftime ? x}") leads to something like "Time: 514ms".

Group-wise operations

In string_magic, the splitting operation s (or S) keeps a memory of the strings that were split. Use the tilde operator, of the form ~(op1, op2), to apply operations group-wise, to each of the split strings.

Better with an example. x = c("Oreste, Hermione", "Hermione, Pyrrhus", "Pyrrhus, Andromaque") ; string_magic("Troubles ahead: {S, ~(' loves 'c), C ? x}.") leads to "Troubles ahead: Oreste loves Hermione, Hermione loves Pyrrhus and Pyrrhus loves Andromaque.".

Almost all operations can be applied group-wise (although only operations changing the order or the length of the strings really matter).

Conditional operations

There are two operators to apply operations conditionally: if and vif, the latter standing for verbatim if.

The syntax of if is if(cond ; ops_true ; ops_false) with cond a condition (i.e. logical operation) on the value being interpolated, ops_true a comma-separated sequence of operations if the condition is TRUE and ops_false an optional a sequence of operations if the condition is FALSE.

Ex.1: Let's take a sentence, delete words of less than 4 characters, and trim words of 7+ characters. x = "Songe Cephise a cette nuit cruelle qui fut pour tout un peuple une nuit eternelle" string_magic("{' 's, if(.nchar<=4 ; nuke ; '7|..'k), c ? x}"). Let's break it down. First the sentence is split w.r.t. spaces, leading to a vector of words. Then we use the special variable .nchar in if's condition to refer to the number of characters of the current vector (the words). The words with less than 4 characters are nuked (i.e. removed), and the other words are trimmed at 7 characters. Finally the modified vector of words is collapsed with the function c, leading to the result.

The condition cond accepts the following special values: . (the dot), .nchar, .C, .len, .N. The dot, ., refers to the current vector. .nchar represent the number of characters of the current vector (equivalent to nchar(.)). .C is an alias to .nchar. .len represent the length of the current vector (equivalent to length(.)). .N is an alias to .len.

If a condition leads to a result of length 1, then the operations are applied to the full string vector and not element-wise (as was the case in Ex.1). Contrary to element-wise conditions for which operations modifying the length of the vectors are forbidden (apart from nuking), such operations are fine in full-string conditions.

Ex.2: x = string_magic("x{1:10}"); string_magic("y = {if(.N>4 ; 3 first, '...'insert.right), ' + 'c ? x}") leads to "y = x1 + x2 + x3 + ...". the same opration applied to x = string_magic("x{1:4}") leads to "y = x1 + x2 + x3 + x4".

For vif, the syntax is vif(cond ; verb_true ; verb_false) with verb_true a verbatim value with which the vector will be replaced if the condition is TRUE. This is similar for verb_false. The condition works as in if.

Ex.3: x = c(1, 25, 12, 6) ; string_magic("Values: {vif(.<10 ; <10), C ? x}") leads to "Values: <10, 25, 12 and <10". As we can see values lower than 10 are replaced with "<10" while other values are not modified.

Ex.4: x = string_magic("x{1:10}"); string_magic("y = {vif(.N>4 ; {S!{x[1]}, ..., {last?x}}), ' + 'c ? x}") leads to "y = x1 + ... + x10". Let's break it down. If the length of the vector is greater than 4 (here it's 10), then the full string is replaced with "{S!{x[1]}, ..., {last?x}}". Interpolation applies to such string. Hence the split operation S breaks the string w.r.t. the commas (default behavior), leading to the vector c("{x[1]}", "...", "{last?x}"). Since the string contains curly brackets, interpolation is applied again. This leads to the vector c("x1", "...", "x10"). Finally, this vector is collapsed with ' + ' leading to the final string. Note that there are many ways to get to the same result. Here is another example: string_magic("y = {vif(.N>4 ; {x[1]} + ... + {last?x} ; {' + 'c ? x}) ? x}").

The vif condition allows the use of '.' to refer to the current value in verb_true and verb_false, as illustrated by the last example:

Ex.5: string_magic("{4 last, vif(. %% 2 ; x{.} ; y{rev?.}), C ? 1:11}") leads to "y10, x9, y8 and x11".

Special interpolation

if-else:

Using an ampersand ("&") as the first character of an interpolation leads to an if-else operation. Using two ampersands ("&&") leads to a slightly different operation described at the end of this section.

The syntax is as follows: {&cond ; verb_true ; verb_false} with cond a condition (i.e. logical operation) on the value being interpolated, verb_true a verbatim value with which the vector will be replaced if the condition is TRUE and verb_false an optional verbatim value with which the vector will be replaced if the condition is FALSE. If not provided, verb_false is considered to be the empty string unless the operator is the double ampersand described at the end of this section.

Note that in cond, you can use the function len, an alias to length.

Ex.1: x = 1:5; string_magic("x is {&len(x)<10 ; short ; {`log10(.N)-1`times, ''c ! very }long}") leads to "x is short". With x = 1:50, it leads to "x is long", and to "x is very very long" if x = 1:5000.

If a condition leads to a result of length 1, the full string is replaced by the verbatim expression. Further, this expression will be interpolated if requested. This was the case in Ex.1 where verb_false was interpolated.

If the condition's length is greater than 1, then each logical values equal to TRUE is replaced by verb_true, and FALSE or NA values are replaced with verb_false. Note, importantly, that no interpolation is perfomed in that case.

Ex.2: x = 1:3 ; string_magic("x is {&x == 2 ; two ; not two}") leads to the vector c("x is not two", "x is two", "x is not two").

In that example, when x is odd, it is replaced with "odd", and when even it is replaced with the elements of y.

Using the two ampersand operator ("&&") is like the simple ampersand version but the default for verb_false is the variable used in the condition itself. So the syntax is {&&cond ; verb_true} and it does not accept verb_false.

Ex.3: i = 3 ; string_magic("i = {&&i == 3 ; three}") leads to "i = three", and to "i = 5" if i = 5.

Pluralization:

There is advanced support for pluralization which greatly facilitates the writing of messages in natural language.

There are two ways to pluralize: over length or over value. To trigger a "pluralization" interpolation use as first character:

  • $ to pluralize over the length of a variable (see Ex.2)

  • # to pluralize over the value of a variable (see Ex.1)

Ex.1: x = 5; string_magic("I bought {N?x} book{#s}.") leads to "I bought five books.". If x = 1, this leads to "I bought one book.".

The syntax is {#plural_ops ? variable} or {#plural_ops} where plural_ops are specific pluralization operations which will be described below. The pluralization is perfomed always with respect to the value of a variable. You can either add the variable explicitly ({#plural_ops ? variable}) or refer to it implicitly ({#plural_ops}). If implicit, then the algorithm will look at the previous variable that was interpolated and pluralize over it. This is exaclty what happens in Ex.1 where x was interpolated in {N?x} and plural operation s in {#s} then applied to x. It was equivalent to have {#s ? x}. If a variable wasn't interpolated before, then the next interpolated variable will be used (see Ex.2). If no variable is interpolated at all, an error is thrown.

Ex.2: x = c("J.", "M."); string_magic("My BFF{$s, are} {C?x}!") leads to "My BFFs are J. and M.!". If "x = "S.", this leads to "My BFF is S.!".

Pluralizing accepts the following operations:

  • s, es: adds an "s" (or "es") if it is plural (> 1), nothing otherwise. Accepts the option 0 or zero which treats a 0-length or a 0-value as plural.

  • y or ies: adds an 'y' if singular and 'ies' if plural (>1). Accepts the option 0 or zero which treats a 0-length or a 0-value as plural.

  • enum: enumerates the elements (see help for the regular operation enum)

  • n, N, len, Len: add the number of elements ("len") or the value ("n") of the variable as a formatted number or in letters (upper case versions). Accepts the options letter (to write in letter) and upper (to uppercase the first letter).

  • nth, ntimes: writes the value of the variable as an order (nth) or a frequence (ntimes). Accepts the option letter to write the numbers in letters (uppercase version of the operator does the same).

  • is, or any verb: conjugates the verb appropriately

You can chain operations, in that case a whitespace is automatically added between them.

Ex.3: x = c(7, 3, 18); string_magic("The winning number{$s, is, enum ? sort(x)}.") leads to "The winning numbers are 3, 7 and 18.". With x = 7 this leads to "The winning number is 7.".

On top of the previous operations, there is a special operation allowing to add verbatim text depending on the situation. The syntax is as follows:

  • (s1;s2): adds verbatim 's1' if singular and 's2' if plural (>1)

  • (s1;s2;s3): adds verbatim 's1' if zero, 's2' if singular (=1) and 's3' if plural

  • (s1;;s3): adds verbatim 's1' if zero, 's3' if singular or plural (i.e. >=1)

These case-dependent verbatim values are interpolated (if appropriate). In these interpolations you need not refer explicitly to the variable for pluralization interpolations.

Ex.4: x = 3; string_magic("{#(Sorry, nothing found.;;{#N.upper} match{#es, were} found.)?x}") leads to "Three matches were found.". If "x = 1", this leads to "One match was found." and if "x = 0" this leads to "Sorry, nothing found.".

Escaping and special cases

The opening and closing brakets, {}, are special characters and cannot be used as regular text. To bypass their special meaning, you need to escape them with a double backslash.

Ex.1: string_magic("open = \\\\{, close = }") leads to "open = {, close = }". Ex.2: string_magic("many {5 times.c ! \\\\}}") leads to many }}}}}.

You only need to escape the special delimiters which the algorithm is currently looking for. As you can see, you don't need to escape the closing bracket in Ex.1 since no box was open. On the other hand, you need to escape it in Ex.2.

Alternatively, use the argument .delim to set custom delimiters.

Ex.3: string_magic("I {'can {write} {{what}} I want'}") leads to "I can {write} {{what}} I want".

Since {expr} evaluates expr, the stuff inside the box, you can pass a character string and it will stay untouched.

In the few operations expecting a semi-colon (if-else and pluralization), it can also be escaped with a double backslash.

In interpolations, the exclamation mark (!) signals a verbatim expression. But what if you use it to mean the logical operation not in an operation-free interpolation? In that case, you need a hack: use a question mark (?) first to indicate to the algorithm that you want to evaluate the expression.

Ex.4: string_magic("{!TRUE} is {?!TRUE}") leads to "TRUE is FALSE". The first expression is taken verbatim while the second is evaluated.

Generic regular expression flags

All stringmagic functions support generic flags in regular-expression patterns. The flags are useful to quickly give extra instructions, similarly to usual regular expression flags.

Here the syntax is "flag1, flag2/pattern". That is: flags are a comma separated list of flag-names separated from the pattern with a slash (/). Example: string_which(c("hello...", "world"), "fixed/.") returns 1. Here the flag "fixed" removes the regular expression meaning of "." which would have otherwise meant "any character". The no-flag verion string_which(c("hello...", "world"), ".") returns 1:2.

Alternatively, and this is recommended, you can collate the initials of the flags instead of using a comma separated list. For example: "if/dt[" will apply the flags "ignore" and "fixed" to the pattern "dt[".

The four flags always available are: "ignore", "fixed", "word" and "magic".

  • "ignore" instructs to ignore the case. Technically, it adds the perl-flag "(?i)" at the beginning of the pattern.

  • "fixed" removes the regular expression interpretation, so that the characters ".", "$", "^", "[" (among others) lose their special meaning and are treated for what they are: simple characters.

  • "word" adds word boundaries ("\\b" in regex language) to the pattern. Further, the comma (",") becomes a word separator. Technically, "word/one, two" is treated as "\b(one|two)\b". Example: string_clean("Am I ambushed?", "wi/am") leads to " I ambushed?" thanks to the flags "ignore" and "word".

  • "magic" allows to interpolate variables inside the pattern before regex interpretation. For example if letters = "aiou" then string_clean("My great goose!", "magic/[{letters}] => e") leads to "My greet geese!"

Examples


#
# BASIC USAGE ####
#

x = c("Romeo", "Juliet")

# {x} inserts x
string_magic("Hello {x}!")
#> [1] "Hello Romeo!"  "Hello Juliet!"

# elements in ... are collapsed with "" (default)
string_magic("Hello {x[1]}, ",
    "how is {x[2]} doing?")
#> [1] "Hello Romeo, how is Juliet doing?"

# Splitting a comma separated string
# The mechanism is explained later
string_vec("J. Mills, David, Agnes, Dr Strong")
#> [1] "J. Mills"  "David"     "Agnes"     "Dr Strong"

# Nota: this is equivalent to (explained later)
string_magic("{', *'S ! J. Mills, David, Agnes, Dr Strong}")
#> [1] "J. Mills"  "David"     "Agnes"     "Dr Strong"

#
# Applying low level operations to strings
#

# Two main syntax:

# A) expression evaluation
# {operation ? x}
#            | |
#            |  \-> the expression to be evaluated
#             \-> ? means that the expression will be evaluated

# B) verbatim
# {operation ! x}
#            | |
#            |  \-> the expression taken as verbatim (here 'x')
#             \-> ! means that the expression is taken as verbatim

# operation: usually 'arg'op with op an operation code.

# Example: splitting
x = "hello dear"
string_magic("{' 's ? x}")
#> [1] "hello" "dear" 
# x is split by ' '

string_magic("{' 's ! hello dear}")
#> [1] "hello" "dear" 
# 'hello dear' is split by ' '
# had we used ?, there would have been an error


# There are 50+ string operators
# Operators usually have a default value
# Operations can have options
# Operations can be chained by separating them with a comma

# Example: default of 's' is ' ' + chaining with collapse
string_magic("{s, ' my 'c ! hello dear}")
#> [1] "hello my dear"

#
# Nesting
#

# {operations ! s1{expr}s2}
#             |   |
#             |    \-> expr will be interpolated then added to the string
#              \-> nesting requires verbatim evaluation: '!'

string_magic("The variables are: {C ! x{1:4}}.")
#> [1] "The variables are: x1, x2, x3 and x4."

# This one is ugly but it shows triple nesting
string_magic("The variables are: {ws, C ! {2 times ! x{1:4}}{','s, 4 each !  ,_sq}}.")
#> [1] "The variables are: x1, x2, x3, x4, x1_sq, x2_sq, x3_sq and x4_sq."

#
# Splitting
#

# s: split with fixed pattern, default is ' '
string_magic("{s ! a b c}")
#> [1] "a" "b" "c"
string_magic("{' b 's !a b c}")
#> [1] "a" "c"

# S: same as 's' but default is ',[ \t\n]*'
string_magic("{S !a, b, c}")
#> [1] "a" "b" "c"
string_magic("{'[[:punct:] ]+'S ! a! b; c}")
#> [1] "a" "b" "c"

# add regex flags: e.g. fixed search
string_magic("{'f/.'s ! hi.there}")
#> [1] "hi"    "there"


#
# Collapsing
#

# c and C do the same, their default is different
# syntax: 's1|s2' with
# - s1 the string used for collapsing
# - s2 (optional) the string used for the last collapse

# c: default is ' '
string_magic("{c ? 1:3}")
#> [1] "1 2 3"

# C: default is ', | and '
string_magic("{C ? 1:3}")
#> [1] "1, 2 and 3"

string_magic("{', | or 'c ? 1:4}")
#> [1] "1, 2, 3 or 4"

#
# Extraction
#

# extract: to extract patterns (option first)
# x: alias to extract.first
# X: alias to extract
# syntax: 'pattern'x
# Default is '[[:alnum:]]+'

x = "This years is... 2020"
string_magic("{x ? x}") # similar to string_magic("{extract.first ? x}")
#> [1] "This"
string_magic("{X ? x}") # similar to string_magic("{extract ? x}")
#> [1] "This"  "years" "is"    "2020" 

string_magic("{'\\d+'x ? x}")
#> [1] "2020"

#
# STRING FORMATTING ####
#

#
# upper, lower, title

# upper case the first letter
string_magic("{upper.first ! julia mills}")
#> [1] "Julia mills"

# title case
string_magic("{title ! julia mills}")
#> [1] "Julia Mills"

# upper all letters
string_magic("{upper ! julia mills}")
#> [1] "JULIA MILLS"

# lower case
string_magic("{lower ! JULIA MILLS}")
#> [1] "julia mills"

#
# q, Q, bq: single, double, back quote

string_magic("{S, q, C ! Julia, David, Wilkins}")
#> [1] "'Julia', 'David' and 'Wilkins'"
string_magic("{S, Q, C ! Julia, David, Wilkins}")
#> [1] "\"Julia\", \"David\" and \"Wilkins\""
string_magic("{S, bq, C ! Julia, David, Wilkins}")
#> [1] "`Julia`, `David` and `Wilkins`"

#
# format, Format: formats the string to fit the same length

# format: the right side is filled with blanks
# Format: the left side is filled with blanks, the string is right aligned

score = c(-10, 2050)
nm = c("Wilkins", "David")
string_magic("Monopoly scores:\n{'\n'c ! - {format ? nm}: {Format ? score} US$}")
#> [1] "Monopoly scores:\n- Wilkins:   -10 US$\n-   David: 2,050 US$"

# OK that example may have been a bit too complex,
# let's make it simple:

string_magic("Scores: {format ? score}")
#> [1] "Scores: -10  " "Scores: 2,050"
string_magic("Names: {Format ? nm}")
#> [1] "Names: Wilkins" "Names:   David"

#
# ws: white space normalization

# ws: suppresses trimming white spaces + normalizes successive white spaces
# Add the following options in any order to:
# - punct: remove punctuation
# - digit: remove digits
# - isolated: remove isolated characters

string_magic("{ws ! The   white  spaces are now clean.  }")
#> [1] "The white spaces are now clean."

string_magic("{ws.punct ! I, really -- truly; love punctuation!!!}")
#> [1] "I really truly love punctuation"

string_magic("{ws.digit ! 1, 2, 12, a microphone check!}")
#> [1] ", , , a microphone check!"

string_magic("{ws.i ! 1, 2, 12, a microphone check!}")
#> [1] "1, 2, 12, microphone check!"

string_magic("{ws.d.i ! 1, 2, 12, a microphone check!}")
#> [1] "microphone check!"

string_magic("{ws.p.d.i ! 1, 2, 12, a microphone check!}")
#> [1] "microphone check"

#
# %: applies sprintf formatting

 # add the formatting as a regular argument
string_magic("pi = {'.2f'% ? pi}")
#> [1] "pi = 3.14"
# or right after the %
string_magic("pi = {%.2f ? pi}")
#> [1] "pi = 3.14"

#
# paste: appends text on each element
# Accepts the options: right, both, front and back
# It accepts the special values :1:, :i:, :I:, :a:, :A: to create enumerations

# adding '|' on both sides
string_magic("{'|'paste.both, ' + 'c ! x{1:4}}")
#> [1] "|x1| + |x2| + |x3| + |x4|"


# Enumerations
acad = string_vec("you like admin, you enjoy working on weekends, you really love emails")
string_magic("Main reasons to pursue an academic career:\n {':i:) 'paste, C ? acad}.")
#> [1] "Main reasons to pursue an academic career:\n i) you like admin, ii) you enjoy working on weekends and iii) you really love emails."

# You can also use the enum command
string_magic("Main reasons to pursue an academic career:\n {enum.i ? acad}.")
#> [1] "Main reasons to pursue an academic career:\n i) you like admin, ii) you enjoy working on weekends, and iii) you really love emails."

#
# stopwords: removes basic English stopwords
# the list is from the Snowball project:
#  http://snowball.tartarus.org/algorithms/english/stop.txt

string_magic("{stop, ws ! It is a tale told by an idiot, ",
                         "full of sound and fury, signifying nothing.}")
#> [1] "tale told idiot, full sound fury, signifying nothing."

#
# k: keeps the first n characters
# syntax: nk: keeps the first n characters
#         'n|s'k: same + adds 's' at the end of shortened strings
#         'n||s'k: same but 's' counts in the n characters kept

words = string_vec("short, constitutional")
string_magic("{5k ? words}")
#> [1] "short" "const"

string_magic("{'5|..'k ? words}")
#> [1] "short"   "const.."

string_magic("{'5||..'k ? words}")
#> [1] "short" "con.."

#
# K: keeps the first n elements
# syntax: nK: keeps the first n elements
#         'n|s'K: same + adds the element 's' at the end
#         'n||s'K: same but 's' counts in the n elements kept
#
# Special values :rest: and :REST:, give the number of items dropped

bx = string_vec("Pessac Leognan, Saint Emilion, Marguaux, Saint Julien, Pauillac")
string_magic("Bordeaux wines I like: {3K, ', 'C ? bx}.")
#> [1] "Bordeaux wines I like: Pessac Leognan, Saint Emilion, Marguaux."

string_magic("Bordeaux wines I like: {'3|etc..'K, ', 'C ? bx}.")
#> [1] "Bordeaux wines I like: Pessac Leognan, Saint Emilion, Marguaux, etc..."

string_magic("Bordeaux wines I like: {'3||etc..'K, ', 'C ? bx}.")
#> [1] "Bordeaux wines I like: Pessac Leognan, Saint Emilion, etc..."

string_magic("Bordeaux wines I like: {'3|and at least :REST: others'K, ', 'C ? bx}.")
#> [1] "Bordeaux wines I like: Pessac Leognan, Saint Emilion, Marguaux, and at least two others."

#
# Ko, KO: special operator which keeps the first n elements and adds "others"
# syntax: nKo
# KO gives the rest in letters

string_magic("Bordeaux wines I like: {4KO, C ? bx}.")
#> [1] "Bordeaux wines I like: Pessac Leognan, Saint Emilion, Marguaux and two others."

#
# r, R: string replacement 
# syntax: 's'R: deletes the content in 's' (replaces with the empty string)
#         's1 => s2'R replaces s1 into s2

string_magic("{'e'r, ws ! The letter e is deleted}")
#> [1] "Th lttr is dltd"

# adding a perl look-behind
string_magic("{'(?<! )e'r !The letter e is deleted}")
#> [1] "Th lttr e is dltd"

string_magic("{'e => a'r !The letter e becomes a}")
#> [1] "Tha lattar a bacomas a"

string_magic("{'([[:alpha:]]{3})[[:alpha:]]+ => \\1.'r ! Trimming the words}")
#> [1] "Tri. the wor."

# Alternative way with simple operations: split, shorten, collapse
string_magic("{s, '3|.'k, c ! Trimming the words}")
#> [1] "Tri. the wor."

#
# times, each
# They accept the option c to collapse with the empty string

string_magic("N{10 times.c ! o}!")
#> [1] "Noooooooooo!"

string_magic("{3 times.c ? 1:3}")
#> [1] "123123123"
string_magic("{3 each.c ? 1:3}")
#> [1] "111222333"

#
# erase: replaces the items by the empty string
# -> useful in conditions

string_magic("{erase ! I am going to be annihilated}")
#> [1] ""

#
# ELEMENT MANIPULATION ####
#

#
# rm: removes the elements
# Its (optional) argument is a regular expression giving which element to remove
# Many options: "empty", "blank", "noalpha", "noalnum", "all" 

x = c("Destroy", "All")
string_magic("{'A'rm ? x}")
#> [1] "Destroy"

string_magic("{rm.all ? x}")
#> character(0)

x = string_vec("1, 12, 123, 1234, 123456, 1234567")
# we delete elements whose number of characters is lower or equal to 3
# => see later section CONDITIONS
string_magic("{if(.nchar > 3 ; nuke) ? x}")
#> [1] "1"   "12"  "123"

#
# PLURALIZATION ####
#

# Two ways to enable pluralization:
# {$ command}: means the plural is decuced from the length of the variable
# {# command}: means the plural is decuced from the value of the variable

# Explanatory example
x = c("Eschyle", "Sophocle", "Euripide")
n = 37
string_magic("The author{$s, enum, have ? x} written {#N ? n} play{#s}.")
#> [1] "The authors Eschyle, Sophocle and Euripide have written thirty-seven plays."

x = "Laurent Berge"
n = 0
string_magic("The author{$s, enum, have ? x} written {#N ? n} play{#s}.")
#> [1] "The author Laurent Berge has written zero play."

# How does it work?
# First is {$s, enum, have ? x}.
# The commands `s`, `enum` and `have` are applied to `x` which must come after a `?`
#    => there the plural (whether an s is added and how to conjugate the verb have) depends
#       on the **length** of the vector `x`
#
# Second comes {#N ? n}.
# The double dollar sign means that the command `N` will be applied to the **value** n.
# The value must come after the `?`
#
# Third is {#s}.
# The object to which `s` should be applied is missing (there is no `? n`).
# The default is to apply the command to the previous object. In this case,
#  this is `n`.

# Another similar example illustrating that we need not express the object several times:
x = c("Eschyle", "Sophocle", "Euripide")
string_magic("The {Len ? x} classic author{$s, are, enum}.")
#> [1] "The three classic authors are Eschyle, Sophocle and Euripide."



#
# ARGUMENTS FROM THE ENVIRONMENT ####
#

# Arguments can be evaluated from the calling environment.
# Simply use backticks instead of quotes.

dollar = 6
reason = "glory"
string_magic("Why do you develop packages? For {`dollar`times.c ! $}?",
    "For money? No... for {upper,''s, c ? reason}!", .sep = "\n")
#> [1] "Why do you develop packages? For $$$$$$?\nFor money? No... for G L O R Y!"

#
# Alias generation
#

# Let's create a formula filler
# - we use .local_ops to create the ad hoc operation "add" which adds variables
# - we transform into a formula ex post

fml = string_magic_alias(.post = as.formula, .local_ops = list(add = "' + 'collapse"))

# example with mtcars
lhs = "mpg"
rhs = c("hp", "drat")
fml("{lhs} ~ {add?rhs} + am")
#> mpg ~ hp + drat + am
#> <environment: 0x0000024666e009d8>