{"id":512,"date":"2012-10-07T12:16:14","date_gmt":"2012-10-07T11:16:14","guid":{"rendered":"http:\/\/www.nooblet.org\/blog\/?p=512"},"modified":"2013-01-10T04:29:16","modified_gmt":"2013-01-10T04:29:16","slug":"create-md5-checksum-files-for-each-sub-directory","status":"publish","type":"post","link":"https:\/\/www.nooblet.org\/blog\/2012\/create-md5-checksum-files-for-each-sub-directory\/","title":{"rendered":"Create md5 checksum files for each sub-directory"},"content":{"rendered":"

This bash script creates checksum files for each subdirectory and the files within.<\/p>\n

If the script is run, and there are no changes, then there is no output. This makes it safe to put into a cronjob without fear of getting spammed.<\/p>\n

Output can be forced with a “-d” flag.<\/p>\n

Requires “md5sum” package to compute checksums.<\/strong><\/p>\n

Syntax:
\nmd5-all-dir.sh [-d] <directory><\/code><\/p>\n

Download<\/strong>
\n

<\/symbol><\/symbol><\/symbol><\/symbol><\/symbol><\/symbol><\/symbol><\/symbol><\/symbol><\/symbol><\/svg><\/svg>  md5-all-dir.sh<\/a><\/strong> (4.1 KiB, 3,011 hits)
<\/div>
\n<\/p>\n

For example, say you have the following directory structure<\/p>\n

$ tree
\n.
\n\u251c\u2500\u2500 a
\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 1
\n\u251c\u2500\u2500 b
\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 1
\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 2
\n\u2514\u2500\u2500 c
\n \u251c\u2500\u2500 1
\n \u251c\u2500\u2500 2
\n \u2514\u2500\u2500 3<\/p>\n

3 directories, 6 files<\/code><\/p><\/blockquote>\n

This script will create a checksum file for directories “a”, “b” and “c”.<\/p>\n

$ md5-all-dir .\/
\n ! Looping .\/ ..
\n o .\/c
\n - newfile: 1
\n - newfile: 2
\n - newfile: 3
\n o .\/b
\n - newfile: 1
\n - newfile: 2
\n o .\/a
\n - newfile: 1<\/code><\/p><\/blockquote>\n

So now the directory structure is:<\/p>\n

$ tree
\n.
\n\u251c\u2500\u2500 a
\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 1
\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 a-checksums.md5
\n\u251c\u2500\u2500 b
\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 1
\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 2
\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 b-checksums.md5
\n\u2514\u2500\u2500 c
\n \u251c\u2500\u2500 1
\n \u251c\u2500\u2500 2
\n \u251c\u2500\u2500 3
\n \u2514\u2500\u2500 c-checksums.md5<\/p>\n

3 directories, 9 files<\/code><\/p><\/blockquote>\n

Each checksum file has the following structure:<\/p>\n

$ cat .\/c\/c-checksums.md5
\n; Checksum created on Thu Jan 10 04:26:40 GMT 2013
\n; by stalks@sith.nooblet.org (\/usr\/local\/bin\/md5-all-dir)
\n; for \/tmp\/test\/c<\/p>\n

; data 1349606635 1349606635 10240 e91ce12bd9ee7bdeca70774f7b5fbea4 1
\ne91ce12bd9ee7bdeca70774f7b5fbea4 *1
\n; data 1349606641 1349606641 10240 e266420d33efae6d9f7e5e8804c48ed6 2
\ne266420d33efae6d9f7e5e8804c48ed6 *2
\n; data 1349606642 1349606642 10240 18ce779ed5275775f80053de68753cb5 3
\n18ce779ed5275775f80053de68753cb5 *3<\/p>\n

; Time taken: 1 secs<\/code><\/p><\/blockquote>\n

The data line holds creation time, modified time, file size, md5sum and filename, and is used by the script to determine if any files have changed.<\/p>\n

If the script is run again, it will parse the checksum files and update for any missing\/modified\/new files.<\/p>\n

For example, if I add “a\/testfile”:<\/p>\n

$ touch .\/a\/testfile
\n$ md5-all-dir .\/
\n ! Looping .\/ ..
\n o .\/c
\n o .\/b
\n o .\/a
\n - newfile: testfile<\/code><\/p><\/blockquote>\n

Download<\/strong>
\n

<\/svg>  md5-all-dir.sh<\/a><\/strong> (4.1 KiB, 3,011 hits)
<\/div><\/p>\n","protected":false},"excerpt":{"rendered":"

This bash script creates checksum files for each subdirectory and the files within. If the script is run, and there are no changes, then there is no output. This makes it safe to put into a cronjob without fear of getting spammed. Output can be forced with a “-d” flag. Requires “md5sum” package to compute […]<\/p>\n","protected":false},"author":1,"featured_media":648,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[27,36,233,104],"class_list":["post-512","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-linux","tag-bash","tag-checksum","tag-linux","tag-md5"],"_links":{"self":[{"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/posts\/512","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/comments?post=512"}],"version-history":[{"count":2,"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/posts\/512\/revisions"}],"predecessor-version":[{"id":661,"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/posts\/512\/revisions\/661"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/media\/648"}],"wp:attachment":[{"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/media?parent=512"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/categories?post=512"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nooblet.org\/blog\/wp-json\/wp\/v2\/tags?post=512"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}