Home

Awesome

bash berries

bash berries is a set of tiny bash scripts that can do some work for you if you are a Linux admin or a developer on Linux.

Not only scripts are being provided by this project, but also include files that help you to write our own bash scripts more quickly. All bash berries have been tested on the latest stable Ubuntu LTS and macOS releases. If you don't set any parameters for a script, a short help will be printed.

User website

https://jonelo.github.io/bashberries/

Install or update

bash <(curl -Ls https://bit.ly/update-bashberries) ~/bin

Install or update troubleshooting

Make sure that you have the unzip utility installed and that you can connect to the internet, double check proxy settings if applicable.

Overview of the bash berries

Script nameDescription
bigfilesDetermines the biggest files in a directory and it's subdirectories
deepgrepFinds text in files recursively
latlngDetermines both latitude and longitude of a location
linesExtracts a block of lines from a textfile
m3u8tomp4.shConverts all .m3u8 files in the current working dir to .mp4
pwnedHas your password been pwned?
update_jdkDownloads the latest JDK from the web, extracts it and creates a symlink
update_propertyUpdates the value of a key/value pair in a property file
update_bashberriesDownloads all bash scripts from the bashberries project on github
update_tzdatabaseUpdates the time zone database of your Java Runtime Environment

Overview of the include files

Include nameDescription
interaction.includeprovides functions for an user interaction
math.includeprovides mathematical functions
network.includeprovides specific network functions
permissions.includeprovides functions that are related to permissions
proxy.includeprovides proxy related functions
trim.includeprovides several trim functions
version.includeprovides version specific functions

The bash berries in detail

bigfiles

bigfiles v1.1.0, Copyright 2017 Johann N. Loefflmann

Determines the biggest files in a directory and it's subdirectories

Usage:
    bigfiles [-o] [-g greater] [-n max_files] [path]

Options:
    -o           print the owners of the biggest files.
    -g greater   a file is a big file if its file size is greater
                 than the greater value. You may append
                 k, M, G and T for kilo, Mega, Giga, and Tera.
                 If greater is omitted, greater is set to 0.

    -n max_files specifies the maximum number of big files.
                 If max_files is omitted or if max_files is set to 0,
                 all files will be printed that matches -g.

Parameters:
    path         specifies the directory to be traversed.
                 If path is omitted, this help will be printed.

Examples:
    bigfiles -g 1M .
                 all files greater than 1 MB in the current working directory
                 and below.

    bigfiles -o -n 25 -g 1G /
                 25 biggest files > 1 GB in the root directory and below
                 including a summary of the owners of those files.

deepgrep

deepgrep v1.0.0, Copyright 2018 Johann N. Loefflmann

Finds text in files recursively.

Usage:
    deepgrep [-f file filter] [path] <text>

Options:
    -f     file filter

Parameters:
    path   where to search; optional
    text   what to search

Examples:
    deepgrep -f *.mine "Gold"
           searches for "Gold" in all .mine files
           in the current folder and all subfolders

    deepgrep -f *.mine /big/mountain "Gold"
           searches for "Gold" in all *.mine files
           in the /big/mountain folder and all subfolders

latlng

latlng v1.0.0, Copyright 2017 Johann N. Loefflmann

Determines both latitude and longitude of a location.
The script uses the Google Maps web service.

Usage:
    latlng [-c][-i] [location]

Options:
    -c         output as one line separated by a comma
    -i         input in interactive mode

Parameters:
    location   the location as a string

Examples:
    latlng "Statue of Liberty"
               determines lat and lng of the Statue of Liberty
    latlng -ic
               reads input from the user in order to determine lat and lng

lines

lines v1.0.0, Copyright 2017 Johann N. Loefflmann

Extracts a block of lines from a textfile

Usage:
    lines [-i] [-b number] [-e number] [-H number] [-T number]
          [file [begin [end]]]

Options:
    -b number  If begin is a string and if it matches more than one line, you
               can specify a particular match number.
    -e number  If end is a string and if it matches more than one line, you
               can specify a particular match number.
    -i         Ignore case. Perform case insensitie matching. By default,
               the search algorithm is case sensitive.
    -H number  A positive number cuts the head of the output.
               A negative number extends the head of the output.
    -T number  A postivie number extends the tail of the output.
               A negative number cuts the tail of the output.

Parameters:
    file       Specifies the textfile that needs to be processed.
               If file is omitted, this usage will be printed.

    begin      Specifies the search string in order to find the "begin".
               If begin is a string, it searches for the first occurence
               in the file.  If begin is an integer, it specifies a line
               number (starting with 1).

    end        Specifies the search string in order to find the "end".
               If end is a string, it searches for the first occurence
               starting with the line that is specified by "begin".
               If end is an integer, it specifies a line number
               (starting with 1).

Examples:
    lines log.txt 20 40
               Prints line number 20 to line number 40 from the file called
               log.txt

    lines -T -1 verylong.log "^2017-08-06" "^2017-08-07"
               Prints lines from the log file called verylong.log, starting
               with the line that starts with "2017-08-06" and ending with
               the line that starts with "2017-08-07", but not printing out
               that last ending line

m3u8tomp4.sh

no options, no parameters. It just converts all .m3u8 files in the current
working directory to .mp4. It expects the latest ffmpeg binary in the script
dir. It exits if there is an error. In case of success, the .m3u8 will
be removed.

update_jdk

update_jdk v1.20.0, Copyright 2019-2020 Johann N. Loefflmann

Downloads the JRE/JDK from the web, extracts it and creates/updates a symlink
called <type>_latest.
The latest timezone database can be applied to the requested JRE/JDK as well
so that you have the most possible up to date JRE/JDK within a Java family
from your preferred source. And since the symlink always points to the
JRE/JDK you can update the JRE/JDK both fast and comfortable.
Both GNU/Linux and macOS are supported.

Usage:
    update_jdk [ [-h] |
            [-d] [-f] [-k] -s source [-t type] [-z] [-Z location] [path] ]

Options:
    -d      dry run. Don't download the JRE, JDK or tzupdater, just inform the
            user.

    -f      force. Even if we have the JRE, JDK or tzupdater already, update it
            again.

    -h      prints this help.

    -k      keep the downloaded .tar.gz resp. .zip, don't remove it at the end.

    -s      source. The URI should start with http or https and point to a
            .tar.gz file that contains the JRE/JDK binaries. You can find
            JRE/JDK tarballs for example at

            - adoptopenjdk.net
            - azul.com
            - bell-sw.com/java
            - java.com
            - jdk.java.net
            - www.oracle.com/java

    -t      type. The name of the symlink prefix, if not specified, jre is used.

    -v      version. Prints out the version of this script.

    -z      after the JRE or JDK has been downloaded and extracted, the
            latest tzdata will be applied to the JRE or JDK.
            The script expects the tzupdater.jar in the /Users/johann/IdeaProjects/bashberries/bin

    -Z      the timezone files if not from IANA.

Parameters:
    path    specifies the path where the JRE, JDK should be stored.
            It will be created if it doesn't exist.
            If omitted, .<type>/ will be used.

Examples:
    ./update_jdk -s "$ADDRESS"
            downloads the JRE tarball from "$ADDRESS", extracts it, and updates
            the JRE in ./jre/ and it creates a symlink called jre_latest there.
    ./update_jdk -s "$ADDRESS" -z myjres
            updates the JRE in myjres and it updates the symlink called
            jre_latest there. Additionally the timezone updater
            is being called so that the JRE's timezone database also gets updated.
    ./update_jdk -s "$ADDRESS" -t jdk /opt/java/
            updates the JDK in /opt/java/ and it updates a symlink
            called jdk_latest there.
    ./update_jdk -z -s "$ADDRESS" -t openjdk11
            downloads the JDK from "$ADDRESS",
            applies the latest timezone database from IANA to the JDK by calling
            the tzupdater tool. Symlink called openjdk11/openjdk11_latest
            will point to the latest and updated OpenJDK11 build.

update_property

update_property v1.2.0, Copyright 2017,2018 Johann N. Loefflmann

Updates the value of a key/value pair in a property file.
The script saves existing comments and also the order of the properties.

Usage:
    update_property [-d <delimiter>] [-e] [-f] [-q] [file key value]

Options:
    -a      keeps the existing value and appends the new value.
    -d      delimiter, delimits the key and the value.
            If omitted the equal sign is assumed.
    -e      echo the updated line of the file.
    -f      force to append the key/value pair to the file even if the key is
            not in the property file yet.
    -p      keeps the existing value and prepends the new value.
    -q      set quotes around the value when writing the value.

Parameters:
    file    specifies the file that needs to be updated.

    key     specifies the key in the property file.

    value   specifies the value for the key.

Examples:
    update_property -f -q app.conf mykey "new value"
            updates the key called "mykey" with the value called "new value"
            with quotes around the value in the app.conf property file, and
            creates the key/value pair if the key does not exist.
    update_property -d ' ' -e /etc/openvpn/vpn.conf remote "my-server-1 1194"
            updates the key called "remote" in the property file that has
            a blank as the delimiter, it also echoes the modified line.

update_bashberries

update_bashberries v1.2.0, Copyright 2017-2018 Johann N. Loefflmann

Downloads the latest bash scripts from the bashberries project on github
and updates any existing scripts in the directory that has been specified.

Usage:
    update_bashberries [-n] <directory>

Options:
    -n               don't check for a new update_bashberries script

Parameter:
    directory        the directory where the scripts should be stored

Examples:
    ./update_bashberries .
                     updates the bashberries in the current working directory
    bash <(curl -Ls http://bit.ly/update-bashberries) ~/bin
                     updates the bashberries in ~/bin with just this line

update_tzdatabase

update_tzdatabase v1.0.2, Copyright 2017-2018 Johann N. Loefflmann

Downloads the latest timezone data from iana.org, calculates the necessary
sha256 digest by calling jacksum, and updates the timezone database of
your Java Runtime Environment by calling tzupdater.jar

Usage:
    update_tzdatabase [ [-h] |
                        [-j java-binary] [-s jacksum.jar] [-t tzupdater.jar] ]

Options:
    -h               prints this help.
    -j java          location of the java binary.
                     If omitted, default java is used.
    -s jacksum.jar   location of the jacksum.jar file.
                     If omitted, jacksum.jar is expected in the script dir.
    -t tzupdater.jar location of the tzupdater.jar file.
                     If omitted, tzupdater.jar is expected in the script dir.

Examples:
    update_tzdatabase
                     updates the tzdatabase of the default JRE.
    sudo ./update_tzdatabase -j \$(type -P java)
                     updates the tzdatabase of the default JRE using root
                     permissions.