Jeroen Janssens

Ritchie Vink (the creator of Polars) deliberately decided not to write a book so that he (and his team) can focus full time on Polars itself. Thijs Nieuwdorp and I are currently working on the O'Reilly book "Python Polars: The Definitive Guide" [1]. It'll be a while before it gets released, but the Early Release version on the O'Reilly platform gets updated regularly. We also post draft chapters on the Polars Discord server [2]. The Discord server is also a great place to ask questions and interact with the Polars team. [1] More information about the book: https://jeroenjanssens.com/pp/ [2] Polars Discord server: https://discord.gg/fngBqDry

I usually recommend Data Science At The Command Line https://jeroenjanssens.com/dsatcl/ Not because it explains bash well, but because it fits with my data science/bioinformatics niche. It's all about these funky sort/uniq/rev/cut/uniq/awk/wc/sed patterns I use everyday fiddling with csv files.

it tab completes more than bash does. switches, parameters, servers defined in your .ssh/config file etc. it's really impressive. coupled with the jump/mark script[1] it's amazing. mark . marks the current directory in a folder full of symlinks. jump <tab> expands to a list of your favorite folders. super simple and extremely low overhead. [1] http://jeroenjanssens.com/2013/08/16/quickly-navigate-your-filesystem-…

> But with time I am wondering if such a thing even exists Check out "data science at the command line": https://jeroenjanssens.com/dsatcl/

For field extraction (like the first example: `awk -F, ' {print $1}'`), you can also use `cut -d, -f1` GNU datamash (https://www.gnu.org/software/datamash/) provides features like groupby, statistical operations, etc. See also this free ebook: Data Science at the Command Line (https://jeroenjanssens.com/dsatcl/)

So actually the main reason I'm interested in ipython-style notebooks for my terminal shell needs is the benefit of having... graphs! and pictures! and other graphical things in a terminal shell setting. I'm willing to put up with inconveniences you speak of if I can get the graphical things working well. People have experimented with it, it seems: http://jeroenjanssens.com/2015/02/19/ibash-notebook.html I'll look more into it now.

iPython Notebook makes for a nice terminal emulator: http://jeroenjanssens.com/2015/02/19/ibash-notebook.html (inline images!). It lacks readline support, though, and does not implement all VT100 control characters.

7 command-line tools for data science http://jeroenjanssens.com/2013/09/19/seven-command-line-tools-for-data… Useful Unix commands for data science http://www.gregreda.com/2013/07/15/unix-commands-for-data-science/

More information on jump and mark available at: http://jeroenjanssens.com/2013/08/16/quickly-navigate-your-filesystem-… Basically there is a jump oh-my-zsh plugin, but be sure to add the auto-completion mentioned in this article too...

i also tried to use pop/pushd ...tried hard. and never got it integrated into the work flow. however this guy's method has saved me a lot of keystrokes (very handy if one has a few, frequently visited, yet deeply nested, directories): http://jeroenjanssens.com/2013/08/16/quickly-navigate-your-filesystem-…

There have been some posts on Hacker News describing this philosophy (see below, can't find the HN comment links unfortunately). Another advantage is that it encourages separating your policy from mechanism. For example, you can make your sampling rate or number of buckets a command line flag, and have all your parameters in the shell scripts, rather than having various constants strewn about the code. And obviously you can use each language where it's stronger. Python is better (and much faster) for the data cleaning part, whereas you might want to use ggplot in R. http://jeroenjanssens.com/2013/09/19/seven-command-line-tools-for-data… http://www.drbunsen.org/explorations-in-unix/ http://strata.oreilly.com/2011/04/data-hand-tools.html

jump just made it into oh-my-zsh: http://jeroenjanssens.com/2013/08/16/quickly-navigate-your-filesystem-…

I've also found this extremely useful. It lets you mark directories with a keyword and jump directly to them regardless of where you are. http://jeroenjanssens.com/2013/08/16/quickly-navigate-your-filesystem-…

I use jump commands: export MARKPATH=$HOME/.marks function jump { cd -P $MARKPATH/$1 2>/dev/null || echo "No such mark: $1" } function ju { cd -P $MARKPATH/$1 2>/dev/null || echo "No such mark: $1" } function mark { mkdir -p $MARKPATH; ln -s $(pwd) $MARKPATH/$1 } function unmark { rm -i $MARKPATH/$1 } function marks { ls -l $MARKPATH | sed 's/ / /g' | cut -d' ' -f9- | sed 's/ -/\t-/g' && echo } I think the original source is #http://jeroenjanssens.com/2013/08/16/quickly-navigate-your-filesystem-… Another neat trick is to set you .inputrc to vi mode with set editing-mode vi set keymap vi and then put this in your .bashrc bind -m vi-insert -x '"\C-h"':'"pushd . 1>/dev/null 2>/dev/null && cd ../ && echo -e ${LILA} $PWD && ls"' bind -m vi-insert -x '"\C-n"':'"popd 1>/dev/null 2>/dev/null && echo -e ${LILA} $PWD && ls"' bind -m vi-insert -x '"\C-b":"cd $HOME && echo -e ${LILA} $PWD && ls"' This enables you to go a directory up using ctrl-h and go back using ctrl-n.

I use code based on http://jeroenjanssens.com/2013/08/16/quickly-navigate-your-filesystem-… and the discussion thread https://news.ycombinator.com/item?id=6229001 - no need for Python or something extra to install, similar semantics, just put this in .bash_profile: export MARKPATH=$HOME/.marks function j { cd -P "$MARKPATH/$1" 2>/dev/null || echo "No such mark: $1" } function mark { mkdir -p "$MARKPATH"; ln -s "$(pwd)" "$MARKPATH/$1" } function unmark { rm -i "$MARKPATH/$1" } function marks { \ls -l "$MARKPATH" | tail -n +2 | sed 's/ / /g' | cut -d' ' -f9- | awk -F ' -> ' '{printf "%-10s -> %s\n", $1, $2}' } function _jump { local cur=${COMP_WORDS[COMP_CWORD]} local marks=$(find $MARKPATH -type l | awk -F '/' '{print $NF}') COMPREPLY=($(compgen -W '${marks[@]}' -- "$cur")) return 0 } complete -o default -o nospace -F _jump j With multiple projects and codebases going on at once, it's an invaluable tool.