Differences

This shows you the differences between two versions of the page.

--- linux [2021/03/16 19:28] – roger
+++ linux [2024/11/17 12:59] (current) – external edit 127.0.0.1
@@ Line 79: / Line 79: @@
 ===== Download an entire website using wget =====
-<code bash>wget --mirror --convert-links --page-requisites ----no-parent https://example-domain.com</code>
+More: https://gist.github.com/mikecrittenden/fe02c59fed1aeebd0a9697cf7e9f5c0c
+<code bash>
+wget \
+     --mirror \ # Makes (among other things) the download recursive.
+     --page-requisites \ # Get all assets/elements (CSS/JS/images).
+     --adjust-extension \ # Save files with .html on the end.
+     --span-hosts \ # Include necessary assets from offsite as well.
+     --convert-links \ # Update links to still work in the static version.
+     --restrict-file-names=windows \ # Modify filenames to work in Windows as well.
+     --domains yoursite.com \ # Do not follow links outside this domain.
+     --no-parent \ # Don't follow links outside the directory you pass in.
+         yoursite.com/whatever/path # The URL to download
+</code>
+===== Create a X.509 sha256 self signed certificate =====
+<code bash>
+openssl req \
+  -x509 \
+  -newkey rsa:4096 \
+  -sha256 \
+  -keyout mykeyname.key \
+  -out mycertname.pem \
+  -days 365
+  -nodes # only if you need no password
+</code>
+===== Find =====
+==== Find a specific file in the specified folder ====
+You can use:
+<code bash>
+find mypath -type f -name "myfile.extension"
+</code>
+  * ''mypath'': a path in the OS to perform the search.
+  * ''-type'': type of file to look for. Most common is ''f'', which means "Regular file".
+  * ''-name'': the name of the file you are looking for. You can also use wildcards, for example: ''*.json'' to find all the JSON files in the current directory.
+===== xargs =====
+''xargs'' is used to create new commands from the output of another command. For example, if I'm performing a ''find'' command, I could use ''xargs'' to issue a new command for each line of the output of ''find''.
+<code bash>
+find . -type f -name \"*.json\" | xargs --verbose -I % sh -c 'cat % | jq -c || exit 255'
+</code>
+What's happening?
+  * First, we are performing a [[linux#find|find]] command. The output is going to look like this:
+<code bash>
+./folder/this_is_a_json.json
+./another.json
+</code>
+  * Then, we pipe the output of the find command to ''xargs''. The ''-I %'' means "replace string", so ''xargs'' is going to replace any ''%'' it finds with the value of the current line it is processing.
+  * ''xargs'' is going to run ''sh -c "cat % | jq -c || exit 255"'' (remember its going to replace ''%'' with the value of the current line it is processing) on each of the lines resulting from the ''find'' command. ''jq'' is a program that is used to format JSON. If ''jq'' fails (eg, the JSON is malformed), it's going to return ''exit 255'', to stop the execution of ''xargs''.
+This command in particular is very usefull to check if all the JSON files in a repository are well formated in a CI/CD step.
+===== ncdu =====
+Ncdu is a disk usage analyzer with an ncurses interface. It is designed to find space hogs on a remote server where you don’t have an entire graphical setup available, but it is a useful tool even on regular desktop systems. Ncdu aims to be fast, simple and easy to use, and should be able to run in any minimal POSIX-like environment with ncurses installed.
+Usage:
+<code bash>
+ncdu -x /
+</code>
+Where ''/'' is the filesystem you want to check
+===== awk =====
+==== Print the first column of a string ====
+<code bash>
+echo "This is a string" | awk '{print ($1)}'
+# Output: "This"
+</code>
+==== Print a full string in lowercase or uppercase ====
+<code bash>
+echo "This Is A CaPiTaLiZeD String" | awk '{print tolower($0)}'
+# Output: "this is a capitalized string"
+echo "This Is A CaPiTaLiZeD String" | awk '{print toupper($0)}'
+# Output: "THIS IS A CAPITALIZED STRING"
+</code>