Gabe/techWebsite
1
0
Fork 0
Code Issues 9 Pull requests Projects 1 Releases Wiki Activity

WIP on cli renassance.

Browse source
This commit is contained in:
Gabe Venberg 2024-03-14 13:03:31 -05:00
parent 7912b0fd37
commit 11424579e4
2 changed files with 173 additions and 70 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

212
content/posts/clirenaissance.md
View file

@ -4,58 +4,80 @@ date = 2024-03-04T12:20:02-06:00
draft = true draft = true
+++ +++
<!-- <!--
btop, 2021, c++ tool,link,year,language
bat, 2018, rust ls,,1961,c
helix, 2020, rust cat,,1971,c
zoxide, 2020, rust cd,,1971,c
starship, 2019, rust cp,,1971,c
difftastic, 2018, rust man,,1971,c
git-delta, 2019, rust rm,,1971,c
nushell, 2018, rust grep,,1973,c
hyperfine, 2018, rust diff,,1974,c
sd, 2018, rust sed,,1974,c
tre, 2019, rust bc,,1975,c
typst, 2019, rust make,,1976,c
yazi, 2024, rust vi,,1976,c
fd, 2017, rust awk,,1985,c
ripgrep, 2016, rust screen,,1987,c
ast-grep, 2022, rust vim,https://www.vim.org/,1991,c
pueue, 2015, rust midnight commander,,1994,c
diskonaut, 2020, rust ssh,,1995,c
broot, 2018, rust fossil,https://fossil-scm.org/home/doc/trunk/www/index.wiki,2006,c
just, 2016, rust tmux,https://github.com/tmux/tmux,2007,c
zellij, 2020, rust git,https://git-scm.com/,2008,c
scc, 2018, go go 1.0,https://go.dev/,2012,go
fzf, 2013, go fzf,https://github.com/junegunn/fzf,2013,go
lazygit, 2018, go eza/exa,https://github.com/eza-community/eza,2014,rust
grex, 2019, rust neovim,https://neovim.io/,2015,c
micro, 2016, go pueue,https://github.com/Nukesor/pueue,2015,rust
oh-my-posh, 2019, go rust 1.0,https://www.rust-lang.org/,2015,rust
nnn, 2016, c just,https://github.com/casey/just,2016,rust
qalculate, 2016, c++ micro,https://micro-editor.github.io/,2016,go
eza/exa, 2014, rust nnn,https://github.com/jarun/nnn,2016,c
lsd, 2018, rust ripgrep,https://github.com/BurntSushi/ripgrep,2016,rust
neovim, 2015, c fd,https://github.com/sharkdp/fd,2017,rust
bat,https://github.com/sharkdp/bat,2018,rust
cat, cd, rm, cp, man was included in the first version of unix, in 1971 broot,https://dystroy.org/broot/,2018,rust
ls specifically can trace its history to 1961 (https://tldp.org/LDP/LG/issue48/fischer.html) difftastic,https://difftastic.wilfred.me.uk/,2018,rust
vi was made in 1976 hyperfine,https://github.com/sharkdp/hyperfine,2018,rust
sed in 1974 lazygit,https://github.com/jesseduffield/lazygit,2018,go
awk in 1985 lsd,https://github.com/lsd-rs/lsd,2018,rust
grep in 1973 nushell,https://www.nushell.sh/,2018,rust
bc in 1975 scc,https://github.com/boyter/scc,2018,go
diff in 1974 sd,https://github.com/chmln/sd,2018,rust
make in 1976 git-delta,https://github.com/dandavison/delta,2019,rust
vim in 1991 grex,https://github.com/pemistahl/grex,2019,rust
ssh in 1995 starship,https://starship.rs/,2019,rust
midnight commander in 1994 tre,https://github.com/dduan/tre,2019,rust
screen in 1987 typst,https://typst.app/,2019,rust
tmux in 2007 diskonaut,https://github.com/imsnif/diskonaut,2020,rust
rust 1.0 in 2015 helix,https://helix-editor.com/,2020,rust
pijul,https://pijul.org/,2020,rust
zellij,https://zellij.dev/,2020,rust
zoxide,https://github.com/ajeetdsouza/zoxide,2020,rust
btop,https://github.com/aristocratos/btop,2021,c++
ast-grep,https://github.com/ast-grep/ast-grep,2022,rust
yazi,https://github.com/sxyazi/yazi,2024,rust
--> -->
Id like to talk about a trend Ive seen these past few years, where people are rewriting core CLI tools, <!--
why I think this trend is a good thing, and why I think this trend might be happening. open tmp.csv |
sort-by year tool |
update tool {|i| if ($i.link != "") {$"[($i.tool)]\(($i.link)\)"} else {$i.tool}} |
select tool year language |
to md |
xsel -bi
-->
<!--
ls specifically can trace its history to 1961
-->
Take a look at this [table](#appendix-the-tools) at the bottom of the page. Ill
wait. Notice the relative scarcity between ~1995 and ~2015? Id like to talk
about a trend Ive seen these past few years, where people are rewriting and
rethinking staples of the CLI, why I think this trend is a good thing, and why I
think this trend might be happening.
## History ## History
@ -86,20 +108,38 @@ the way that error messages can teach,
the value of a good out of the box experience, the value of a good out of the box experience,
and the value of documentation that is easy to find and digest. and the value of documentation that is easy to find and digest.
## The new tools ## Exploration of the solution space
These changes to the environment surrounding CLI apps has, in recent years, These changes to the environment surrounding CLI apps has in recent years,
led to a resurgence in development of command line utilities. led to a resurgence in development of command line utilities.
Instead of just developing tools that dont exist, Instead of just developing completely new tools,
Ive noticed that people are rethinking and reinventing tools that have existed since the early days of Unix. Ive noticed that people are rethinking and reinventing tools that have existed since the early days of Unix.
## Exploration of the design space
## The lessons learned from the past ## The lessons learned from the past
A large amount of the innovation in the area, I think, can be attributed to
lessons that have been learned in 50 years of using software; sharp edges we
have repeatedly cut ourselves on, unintuitive interfaces that repeatedly trip us
up, and growing frustration at the limitations that maintaining decades of
backwards compatibility imposes on our tools.
These lessons have been gathering in the collective conciousness, through
cheatsheets, guides, and FAQs; resources to guide us through esoteric error
messages, complex configurations, and dozens upon dozens of flags.
Id like to go over a couple of the more prominent lessons that I feel terminal
tools have learned in the past several decades.
### A good out of the box experience ### A good out of the box experience
While configurability is great, one should not need to learn a new configuration
language and dozens or hundreds of options to get a usable piece of software.
Configuration should be for customization, not setup.
One of the earliest examples of this principle may be the fish shell.
Both zsh and
<!-- look at helix compared to (neo)vim--> <!-- look at helix compared to (neo)vim-->
<!-- look at zsh compared to fish?-->
### Friendly error messages ### Friendly error messages
@ -127,3 +167,65 @@ Ive noticed that people are rethinking and reinventing tools that have existed s
<!-- rusts clap and gos cobra--> <!-- rusts clap and gos cobra-->
## Appendix: the tools
This is an extremely unscientific table of command line tools that I have tried,
have used, or currently use. It is assuredly incomplete, but *should* be broadly
representative. The date data has been gathered from the first git commit where
available, wikipedia otherwise, and sorting is by year first, then alphabetical.
|tool|year|language|
|-|-|-|
|ls|1961|c|
|cat|1971|c|
|cd|1971|c|
|cp|1971|c|
|man|1971|c|
|rm|1971|c|
|grep|1973|c|
|diff|1974|c|
|sed|1974|c|
|bc|1975|c|
|make|1976|c|
|vi|1976|c|
|awk|1985|c|
|screen|1987|c|
|[vim](https://www.vim.org/)|1991|c|
|midnight commander|1994|c|
|ssh|1995|c|
|[fossil](https://fossil-scm.org/home/doc/trunk/www/index.wiki)|2006|c|
|[tmux](https://github.com/tmux/tmux)|2007|c|
|[git](https://git-scm.com/)|2008|c|
|[go 1.0](https://go.dev/)|2012|go|
|[fzf](https://github.com/junegunn/fzf)|2013|go|
|[eza/exa](https://github.com/eza-community/eza)|2014|rust|
|[neovim](https://neovim.io/)|2015|c|
|[pueue](https://github.com/Nukesor/pueue)|2015|rust|
|[rust 1.0](https://www.rust-lang.org/)|2015|rust|
|[just](https://github.com/casey/just)|2016|rust|
|[micro](https://micro-editor.github.io/)|2016|go|
|[nnn](https://github.com/jarun/nnn)|2016|c|
|[ripgrep](https://github.com/BurntSushi/ripgrep)|2016|rust|
|[fd](https://github.com/sharkdp/fd)|2017|rust|
|[bat](https://github.com/sharkdp/bat)|2018|rust|
|[broot](https://dystroy.org/broot/)|2018|rust|
|[difftastic](https://difftastic.wilfred.me.uk/)|2018|rust|
|[hyperfine](https://github.com/sharkdp/hyperfine)|2018|rust|
|[lazygit](https://github.com/jesseduffield/lazygit)|2018|go|
|[lsd](https://github.com/lsd-rs/lsd)|2018|rust|
|[nushell](https://www.nushell.sh/)|2018|rust|
|[scc](https://github.com/boyter/scc)|2018|go|
|[sd](https://github.com/chmln/sd)|2018|rust|
|[git-delta](https://github.com/dandavison/delta)|2019|rust|
|[grex](https://github.com/pemistahl/grex)|2019|rust|
|[starship](https://starship.rs/)|2019|rust|
|[tre](https://github.com/dduan/tre)|2019|rust|
|[typst](https://typst.app/)|2019|rust|
|[diskonaut](https://github.com/imsnif/diskonaut)|2020|rust|
|[helix](https://helix-editor.com/)|2020|rust|
|[pijul](https://pijul.org/)|2020|rust|
|[zellij](https://zellij.dev/)|2020|rust|
|[zoxide](https://github.com/ajeetdsouza/zoxide)|2020|rust|
|[btop](https://github.com/aristocratos/btop)|2021|c++|
|[ast-grep](https://github.com/ast-grep/ast-grep)|2022|rust|
|[yazi](https://github.com/sxyazi/yazi)|2024|rust|

31
content/posts/nushell.md
View file

@ -3,24 +3,24 @@ title = "Nushell first impressions"
date = 2024-03-01T11:34:04-06:00 date = 2024-03-01T11:34:04-06:00
+++ +++
Ive been trying out a bunch of new shell utilities lately, Ive been experimenting with the tools I use on a regular basis lately -- switching
switching up my shell, terminal multiplexer, and even experimenting with my editor. up my shell, terminal multiplexer, and even trying out other editors. Today,
Today, Id like to focus on my experiments with my shell. Id like to focus on my experiments with my shell.
## My old setup ## My old setup
Before this, I had been using a minimal zsh setup for a long time, Before this, I had been using a minimal zsh setup for a long time,
with only built in features and a handmade prompt. with only built in features and a handmade prompt.
Zsh is a good shell, probably one of the best posix shells out there, Zsh is a good shell, probably one of the best POSIX shells out there,
and I still use it when a posix shell is needed. and I still use it when a POSIX shell is needed.
However, I got tired of the endless footguns that posix shell scripting imposes, However, I got tired of the endless footguns that POSIX shell scripting imposes,
easy to make errors around quoting, word splitting, and escaping, easy to make errors around quoting, word splitting, and escaping,
the sort of thing that makes [shellcheck](https://www.shellcheck.net/) necessary. the sort of thing that makes [shellcheck](https://www.shellcheck.net/) necessary.
I played around with fish for a few days, I played around with fish for a few days,
but it had many of the same fundamental design choices, mainly, being 'stringly typed', but it had many of the same fundamental design choices, mainly, being 'stringly typed',
that made posix shells such a displeasure to work with. that made POSIX shells such a displeasure to work with.
## A Nu shell ## A Nu shell
@ -95,7 +95,7 @@ explanatory comments.
## Parsing non-nu tools ## Parsing non-nu tools
But what if our tool/text file isnt in a format nushell understands? But what if our tool/text file isnt in a format nushell understands?
Thankfully, for most formats, parsing is relatively straightforward. Thankfully, for most formats parsing is relatively straightforward.
Lets take this NGINX server log, for example (not a log of real traffic, just a Lets take this NGINX server log, for example (not a log of real traffic, just a
sample log I found) sample log I found)
@ -108,8 +108,7 @@ sample log I found)
{{</highlight>}} {{</highlight>}}
We can parse it into a nu table like so (each line has a comment explaining what We can parse it into a nu table like so:
it does, for those unfamiliar with the nushell language):
{{<highlight sh>}} {{<highlight sh>}}
open access.log | open access.log |
@ -122,9 +121,10 @@ update time {into datetime -f '%d/%b/%Y:%T %z'} |
# parse into proper integer # parse into proper integer
update bytes_sent {into int} update bytes_sent {into int}
{{</highlight>}} {{</highlight>}}
(each line has a comment explaining what it does, for those unfamiliar with the nushell language)
Now that we have it in nushell tables, we can bring all of nushells tools to Now that we have it in nushell tables, we can bring all of nushells tools to
bear on the data. We could, for example, plot a histogram of the most common bear on the data. For example, we could plot a histogram of the most common
ips, just by piping the whole thing into `histogram ip`. We could easily ips, just by piping the whole thing into `histogram ip`. We could easily
calculate the average bytes sent per request. We could group the records by the calculate the average bytes sent per request. We could group the records by the
day or hour they happened, and analyze each of those groups independently. And day or hour they happened, and analyze each of those groups independently. And
@ -135,7 +135,7 @@ While it would be a pretty long one liner if we decided to put it in a single
line, its still quite easy and straightforward to write. line, its still quite easy and straightforward to write.
Most log formats and command outputs are similarly straightforward. Most log formats and command outputs are similarly straightforward.
## Defining custom commands, with built in arg parsing ## Defining custom commands, with built-in arg parsing
Nushell has a feature called Custom Commands, which fill the same purpose as Nushell has a feature called Custom Commands, which fill the same purpose as
functions in other shells/programming languages, but are a bit more featurefull functions in other shells/programming languages, but are a bit more featurefull
@ -278,7 +278,7 @@ echo "$i / 1000" | bc
done done
{{</highlight>}} {{</highlight>}}
This gets the sizes of all the files in kib. But what if we typo something? This gets the sizes of all the files in KiB. But what if we typo something?
{{<highlight sh "linenos=false">}} {{<highlight sh "linenos=false">}}
$ for i in $(ls -l | tr -s " " | cut --fields=6 --delimiter=" "); do $ for i in $(ls -l | tr -s " " | cut --fields=6 --delimiter=" "); do
@ -367,8 +367,9 @@ to make 'scripts' that are integrated with the rest of nushell.
## So, overall, is it worth it? ## So, overall, is it worth it?
Nushell is certainly an interesting project, and I will almost certainly be Nushell is certainly an promising project, and I will almost certainly be
continuing to use it as my daily shell. It cant do everything, but dropping into continuing to use it as my daily shell. It cant do everything, but dropping into
zsh for a task or two every once in a while isnt that big a deal for me, and zsh for a task or two every once in a while isnt that big a deal for me, and
having access to such a powerful shell by default has made other tasks much having access to such a powerful shell by default has made other tasks much
easier for me. easier for me. If you regularly use pipelines in your default shell, consider
giving Nushell a try.