Useful awk command examples

Awk is a highly versatile command-line tool commonly used for processing and analyzing text files in Unix-like operating systems. It excels at scanning lines of text, splitting them into fields, pattern matching, and performing custom actions based on these matches. For beginners and experienced users alike, mastering awk commands can significantly speed up text manipulation tasks that would otherwise require lengthy scripts or manual editing. This collection of awk commands covers a wide array of typical use cases. For instance, printing specific fields such as the second and third columns (awk '{print $2, $3}' my.txt) helps extract relevant data quickly. Changing field separators (awk -F"," '{print $2, $3}' my.csv) makes awk flexible to handle CSV or other structured text formats. Filtering lines based on conditions such as numeric comparisons or matching patterns ('awk '$2 > 100'' or 'awk '/error/' my.txt') enables selective data processing. Awk can also perform arithmetic operations and aggregations, such as summing columns or calculating averages, directly during the text scan (e.g., awk '{sum=$1+$2; print sum}' or computing averages with conditions). Adding line numbers (awk '{print NR, $0}') or printing the number of fields per line (awk '{print NF}') are simple yet powerful ways to add structure or debug data. For advanced needs, awk supports defining functions (awk 'function sq(x) {return x*x} {print sq($2)}'), string manipulations like substrings, and case conversions (awk '{print toupper($2)}'). It can also help in log file analysis by filtering lines where the first field matches specific keywords ('awk '$1 == "ERR" {print $2}' my.log) or patterns ('awk '$1 ~ /^[0-9]+$/' my.log). Additionally, awk is useful in removing duplicate lines based on a field ('awk 'seen[$1]++' my.txt) and formatting output for readability (awk '{print "Name:", $1, "Age:", $2}'). This flexibility makes awk a must-have tool for system administrators, developers, and data analysts dealing with text streams or files. In short, by learning these practical awk commands, users gain the ability to rapidly process logs, generate reports, parse CSV files, and automate repetitive text tasks, improving productivity and enabling powerful one-liner shell workflows. Online resources such as the Linux infographics collection available at study-notes.org provide valuable visual guides and cheat sheets to reinforce awk command usage and boost skills in Linux shell programming.