Useful pv command examples

You know those times when you're copying a huge file, compressing a massive directory, or pushing data over SCP, and you just stare at a blinking cursor, wondering if it's still working or how long it will take? That's where the pv command, or Pipe Viewer, steps in as an absolute lifesaver on Linux! I can't tell you how many times it's given me peace of mind by showing exactly what's happening. My first encounter with pv was during a large file transfer. I was using cp for a multi-gigabyte file, and it felt like forever. Then a colleague showed me how to pipe my command through pv, and suddenly, I had a real-time progress bar, transfer speed, and even an estimated time of arrival right in my terminal. It totally transformed my workflow, making monitoring file copying a breeze. Let's dive into some practical ways I use pv regularly. For simple file copying, instead of cp source dest, I'd use something like cat source | pv -pteb > dest. The -pteb flags are my go-to: p for progress bar, t for ETA, e for elapsed time, and b for bytes transferred. It’s perfect for watching large files move. When I'm dealing with compression or decompression of archives, pv integrates seamlessly. For example, to compress a large directory with tar and see the progress: tar -czf - my_large_dir | pv -pteb > my_archive.tar.gz. And for decompressing: pv my_archive.tar.gz | tar -xzf -. This is incredibly useful for large backups or moving project files, giving me constant feedback on tarball operations. Another scenario where pv shines is with SCP transfers. While scp itself doesn't offer a progress bar by default (unless you use the -p flag which isn't always the full pv experience), you can get creative. For instance, to push a file: pv my_local_file | ssh user@remote 'cat > /remote/path/my_local_file'. This gives you that crucial visualizing data transfer progress. For pulling, it's similar: ssh user@remote 'cat /remote/path/remote_file' | pv -pteb > my_local_file. I also find pv indispensable for disk backups using dd. Imagine cloning a disk or creating an image without any feedback! With pv, it's simple: dd if=/dev/sda | pv -pteb | dd of=/dev/sdb. This not only shows you the progress, speed, and ETA but also ensures you know if your dd command is actually doing something. Similarly, when merging files or processing large data streams, pv can be inserted into almost any pipeline to provide that valuable visual feedback. Beyond just basic monitoring, pv has other cool features. You can use -L to limit the transfer rate, which is super handy for not saturating your network during large SCP transfers or when writing to a slower device. For example, dd if=/dev/zero | pv -L 1m > /dev/null will show you data flowing at 1MB/s. It's a small command, but its impact on productivity and managing expectations during long-running operations is huge. Seriously, if you're working with Linux and haven't tried pv yet, you're missing out on a fundamental tool for visualizing and managing your data streams.