Mercurial > ec-dotfiles

annotate moefetch.sh @ 214:a6624fb9b317

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
major cleanup. tweaking. untested
author edhoprima@gmail.com <edhoprima@gmail.com>
date Thu, 02 Jul 2009 19:10:36 +0000
parents dd95cf01602c
children 710082ce6788
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
148
edhoprima
parents:
diff changeset
1 #!/bin/sh
edhoprima
parents:
diff changeset
2
edhoprima
parents:
diff changeset
3 # Copyright (c) 2009, edogawaconan <me@myconan.net>
edhoprima
parents:
diff changeset
4 #
edhoprima
parents:
diff changeset
5 # Permission to use, copy, modify, and/or distribute this software for any
edhoprima
parents:
diff changeset
6 # purpose with or without fee is hereby granted, provided that the above
edhoprima
parents:
diff changeset
7 # copyright notice and this permission notice appear in all copies.
edhoprima
parents:
diff changeset
8 #
edhoprima
parents:
diff changeset
9 # THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES
edhoprima
parents:
diff changeset
10 # WITH REGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF
edhoprima
parents:
diff changeset
11 # MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR
edhoprima
parents:
diff changeset
12 # ANY SPECIAL, DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
edhoprima
parents:
diff changeset
13 # WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN
edhoprima
parents:
diff changeset
14 # ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF
edhoprima
parents:
diff changeset
15 # OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
16 #
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
17 # Lots of bugs here. Use with care
148
edhoprima
parents:
diff changeset
18 # USE WITH CARE
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
19 #
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
20 # what it does: fetch every picture that has the specified TAGS.
148
edhoprima
parents:
diff changeset
21 # requirement: wget, libxslt, md5sum (or md5)
edhoprima
parents:
diff changeset
22
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
23 # program additional paths for: cut, sed, wc, MD5(sum), wget, xsltproc, grep
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
24 ADDITIONAL_PATH=
148
edhoprima
parents:
diff changeset
25
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
26 # custom md5 path with arguments, expected output: <32digit md5><space(s)><filename>
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
27 # Leave empty for "md5sum" (Linux, Solaris), "md5 -r" (*BSD)
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
28 MD5=
148
edhoprima
parents:
diff changeset
29
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
30 # default server address. Danbooru only! I do not take responsibility of stupidity.
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
31 DEFAULT_SITE="moe.imouto.org"
148
edhoprima
parents:
diff changeset
32
edhoprima
parents:
diff changeset
33 # base directory. make sure it's writeable. I do not take responsibility if you don't own the folder and files as no check is done for this one.
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
34 # Structure is ${BASE_DIR}/<TAGS>
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
35 # Absolute path only.
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
36 # Leave empty to use whatever folder you're running this at
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
37 BASE_DIR=
148
edhoprima
parents:
diff changeset
38
edhoprima
parents:
diff changeset
39 # not user modifiable from here
edhoprima
parents:
diff changeset
40
196
4d28f3a957ee cleanup~
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 195
diff changeset
41 SED_GET_FILENAME="s/.*\/\([^\/]*\)/\1/g"
4d28f3a957ee cleanup~
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 195
diff changeset
42 SED_IS_MD5_FILE="s/\([0-9a-f]\{32\}\..*\)//g"
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
43
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
44 ### TODO:
211
fbb93733098e update to 0.2
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 210
diff changeset
45 ### - sanity validator(?)
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
46 ### - unified repository to save bandwidth
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
47 ### - bug stomping
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
48 ### - sanity checking
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
49 ### WILL BE FOR 0.3
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
50
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
51 # useless welcome message. Also version
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
52 Msg_Welcome() {
212
da4c03c7377c fix: count folder doesn't work on empty folder (messed up when removing 'cd' usage)
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 211
diff changeset
53 MOEFETCHVERSION="0.2.1"
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
54 echo "moefetch ${MOEFETCHVERSION}
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
55 Copyright (c) 2009 edogawaconan <me@myconan.net>"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
56 }
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
57
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
58 # fatal error handler
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
59 Err_Fatal() {
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
60 echo "
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
61 Fatal error: ${1}"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
62 exit 1
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
63 }
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
64
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
65 # help message
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
66 Err_Help() {
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
67 echo "moefetch.sh COMMAND [-s SITE_URL] TAGS
174
0948e76a57a1 added help. Bump to 0.1-beta2
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 173
diff changeset
68
176
3d2ae9417273 even more improvement
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 175
diff changeset
69 COMMAND:
3d2ae9417273 even more improvement
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 175
diff changeset
70 (quick)fetch: do a complete update. Add prefix quick to skip file checking
3d2ae9417273 even more improvement
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 175
diff changeset
71 check: get list of new files, clean up local folder and print total new files
175
5b7a154dbd21 cosmetics fix for help message
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 174
diff changeset
72
177
4d7de9c3b98c whoops typo
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 176
diff changeset
73 -s SITE_URL: Specify URL of the Danbooru powered site you want to leech from. Default is ${DEFAULT_SITE}
175
5b7a154dbd21 cosmetics fix for help message
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 174
diff changeset
74
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
75 TAGS: Tags you want to download. Separated by spaces. Tag name follows standard Danbooru tagging scheme"
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
76 exit 2
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
77 }
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
78
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
79 # generate link by transforming xml
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
80 Generate_Link() {
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
81 echo "
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
82 Fetching xml file"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
83 TEMPNUM=1000
213
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
84 _i=1
195
652d9e268cee test migration to printf
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 194
diff changeset
85 > "${TEMP_PREFIX}-list"
213
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
86 while [ "${TEMPNUM}" -ge 1000 ]; do
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
87 wget "http://${SITE}/post/index.xml?tags=${TAGS}&offset=0&limit=1000&page=${_i}" -O "${TEMP_PREFIX}-xml" -e continue=off
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
88 printf "Processing XML file... "
213
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
89 # xslt evilry
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
90 > "${TEMP_PREFIX}-templist"
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
91 xsltproc - "${TEMP_PREFIX}-xml" <<EOF | sed 's/.*\(http.*\)\(\/[a-f0-9]\{32\}\).*\.\([^\.]*\)/\1\2.\3/g' | grep ^http > "${TEMP_PREFIX}-templist" 2>/dev/null
148
edhoprima
parents:
diff changeset
92 <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0">
edhoprima
parents:
diff changeset
93 <xsl:output method="xml" indent="yes"/>
edhoprima
parents:
diff changeset
94 <xsl:template match="post">
edhoprima
parents:
diff changeset
95 <xsl:value-of select="@file_url" />
edhoprima
parents:
diff changeset
96 </xsl:template>
edhoprima
parents:
diff changeset
97 </xsl:stylesheet>
edhoprima
parents:
diff changeset
98 EOF
213
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
99 TEMPNUM=$(echo $(wc -l < "${TEMP_PREFIX}-templist"))
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
100 _i=$((_i+1))
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
101 cat "${TEMP_PREFIX}-templist" >> "${TEMP_PREFIX}-list"
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
102 echo "${TEMPNUM} file(s) available"
213
dd95cf01602c working around limit
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 212
diff changeset
103 done
195
652d9e268cee test migration to printf
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 194
diff changeset
104 NUMFILES=$(echo $(wc -l < "${TEMP_PREFIX}-list"))
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
105 echo "${NUMFILES} file(s) available on server"
181
d3b7927bdb2b restructuring and add check if the xml is processed properly
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 180
diff changeset
106 [ "${NUMFILES}" -gt 0 ] || Err_Fatal "Error in processing list or no files can be found with specified tag(s) or site"
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
107 }
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
108
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
109 Is_NotMD5() {
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
110 echo "${*}" | sed -e 's/\([0-9a-f]\{32\}\..*\)//g'
148
edhoprima
parents:
diff changeset
111 }
edhoprima
parents:
diff changeset
112
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
113 Progress_Init() {
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
114 _last="-"
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
115 printf "${_last}"
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
116 }
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
117
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
118 Progress_Anim() {
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
119 case "${_last}" in
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
120 /) _last="-";;
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
121 -) _last=\\;;
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
122 \\) _last=\|;;
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
123 \|) _last="/";;
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
124 esac
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
125 printf "\b${_last}"
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
126 }
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
127
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
128 Progress_Done() { printf "\bdone\n"; }
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
129
200
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
130 # getting rid of ls (as per suggestion)
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
131 Count_Files() {
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
132 _i=0
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
133 for _f in "${*}/"* "${*}/".*; do
212
da4c03c7377c fix: count folder doesn't work on empty folder (messed up when removing 'cd' usage)
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 211
diff changeset
134 if [ "${_f}" != "${*}/"'*' ] || [ -e "${_f}" ]; then
200
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
135 _i=$((_i + 1))
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
136 fi
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
137 done
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
138 echo $((_i - 2))
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
139 }
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
140
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
141 # check tools availability
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
142 Check_Tools() {
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
143 # verify all programs required do indeed exist
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
144 #MD5
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
145 if [ ! "${MD5}" ]; then
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
146 case $(uname) in
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
147 *BSD) MD5="md5 -r";;
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
148 Linux|SunOS) MD5="md5sum";;
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
149 *) Fatal_Err "No known md5 tool for this platform. Please specify manually"
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
150 esac
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
151 fi
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
152 MD5_COMMAND=$(echo ${MD5} | cut -d' ' -f1)
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
153 # basic tools
203
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 202
diff changeset
154 COMMANDS="cut sed wc wget xsltproc xargs rm mkdir chown comm grep date ${MD5_COMMAND}"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
155 for COMMAND in ${COMMANDS}
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
156 do
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
157 [ "$(command -v "${COMMAND}")" ] || Err_Fatal "${COMMAND} doesn't exist in ${PATH}"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
158 done
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
159 }
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
160
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
161 # verify required folders exist and writeable
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
162 Check_Folders(){
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
163 [ -O "${BASE_DIR}" ] || Err_Fatal "You don't own ${BASE_DIR}. Please fix ${BASE_DIR}."
180
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 179
diff changeset
164 for FOLDER in temp trash deleted "${SITE_DIR}/${TARGET_DIR}"; do
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
165 if [ ! -d "${BASE_DIR}/${FOLDER}" ]; then
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
166 mkdir "${BASE_DIR}/${FOLDER}" || Err_Fatal "${FOLDER} folder creation failed"
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
167 fi
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
168 if [ ! -O "${BASE_DIR}/${FOLDER}" ]; then
167
78ac6fd03e3a more fix
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 166
diff changeset
169 echo "You don't own the ${BASE_DIR}/${FOLDER}, applying globally writeable permission on it"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
170 chmod -R u=rwX,g=rwX,o=rwX "${BASE_DIR}/${FOLDER}" || Err_Fatal "Error changing ownership. This shouldn't happen"
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
171 fi
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
172 done
200
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
173 [ "$(Count_Files "${BASE_DIR}/${SITE_DIR}/${TARGET_DIR}")" -eq 0 ] && ISNEW=1
201
30d2fb656029 scrapping grep -vf
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 200
diff changeset
174 for i in error ok list newlist templist; do
196
4d28f3a957ee cleanup~
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 195
diff changeset
175 touch "${TEMP_PREFIX}-${i}" || Fatal_Err "Error creating ${TEMP_PREFIX}-${i}. This shouldn't happen"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
176 done
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
177 #
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
178 }
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
179
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
180 # Do some cleanup
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
181 Cleanup_Repository() {
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
182 # current dir: ${BASE_DIR}/${SITE_DIR}/${TARGET_DIR}
207
17d816a63b4c final progress version
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 206
diff changeset
183 printf "Cleaning up repository folder... "
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
184 Progress_Init
191
a4ceb952b05a more noclean support code
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 190
diff changeset
185 TRASH_DIR=$(date -u "+${SITE_DIR}-${TARGET_DIR}-%Y%m%d-%H.%M")
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
186 TRASHES=
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
187 mkdir -p "${BASE_DIR}/trash/${TRASH_DIR}" || Err_Fatal "Unable to create trash folder"
190
1061a214a1f1 thanks to folks at #bash!
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 189
diff changeset
188 for TRASH in "${BASE_DIR}/${SITE_DIR}/${TARGET_DIR}/"*
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
189 do
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
190 ISTRASH=
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
191 if [ -d "${TRASH}" ]; then
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
192 ISTRASH=1
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
193 else
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
194 if [ "$(Is_NotMD5 "$(basename "${TRASH}")")" ]; then
191
a4ceb952b05a more noclean support code
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 190
diff changeset
195 ISTRASH=1
a4ceb952b05a more noclean support code
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 190
diff changeset
196 else
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
197 [ "$(grep "$(basename "${TRASH}")" "${TEMP_PREFIX}-list")" ] || ISTRASH=1
191
a4ceb952b05a more noclean support code
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 190
diff changeset
198 fi
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
199 fi
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
200 if [ "${ISTRASH}" ]; then
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
201 mv -f "${TRASH}" "${BASE_DIR}/trash/${TRASH_DIR}" || Err_Fatal "Error deleting files"
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
202 TRASHES="${TRASHES}
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
203 $(basename "${TRASH}")"
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
204 fi
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
205 Progress_Anim
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
206 done
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
207 rmdir "${BASE_DIR}/trash/${TRASH_DIR}" 2>/dev/null
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
208 Progress_Done
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
209 echo "These files have been moved to ${BASE_DIR}/trash/${TRASH_DIR}:
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
210 ${TRASHES}"
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
211 }
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
212
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
213 # check files correctness
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
214 Check_Files() {
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
215 if test ! -n "${ISNEW}"; then
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
216 test -z "${NOCLEAN}" && Cleanup_Repository
207
17d816a63b4c final progress version
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 206
diff changeset
217 printf "Checking for errors... "
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
218 Progress_Init
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
219 files_error="These files do not match its md5:"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
220 files_notdanbooru="These files are not checked:"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
221 has_err_filename=
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
222 has_err_md5=
196
4d28f3a957ee cleanup~
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 195
diff changeset
223 > "${TEMP_PREFIX}-error"
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
224 > "${TEMP_PREFIX}-ok"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
225 for file in "${BASE_DIR}/${SITE_DIR}/${TARGET_DIR}/"*
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
226 do
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
227 if test -n "$(Is_NotMD5 "$(basename "${file}")")" || test -d "${file}"; then
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
228 files_notdanbooru="${files_notdanbooru}
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
229 $(basename "${file}")"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
230 has_err_filename=1
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
231 else
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
232 if test "$(${MD5} "${file}" | cut -d ' ' -f1 -)" = "$(basename "${file}" | cut -d '.' -f1)"; then
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
233 echo "$(basename "${file}")" >> "${TEMP_PREFIX}-ok"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
234 else
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
235 rm "${file}" || Err_Fatal "Error removing ${file}"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
236 echo "$(basename "${file}")" >> "${TEMP_PREFIX}-error"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
237 files_error="${files_error}
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
238 $(basename "${file}")"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
239 has_err_md5=1
187
efd957294c8c refactoring. cleanup. etc.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 186
diff changeset
240 fi
148
edhoprima
parents:
diff changeset
241 fi
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
242 Progress_Anim
148
edhoprima
parents:
diff changeset
243 done
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
244 Progress_Done
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
245 if test ! -n "${has_err_md5}" && test ! -n "${has_err_filename}"; then
203
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 202
diff changeset
246 echo "All files OK"
170
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 169
diff changeset
247 else
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
248 if test ! -n "${has_err_md5}"; then
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
249 echo "${files_error}"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
250 echo "$(echo $(wc -l < "${TEMP_PREFIX}-error")) file(s) removed"
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
251 fi
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
252 test -n "${has_err_filename}" && echo "${files_notdanbooru}"
170
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 169
diff changeset
253 fi
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
254 echo "$(echo $(wc -l < "${TEMP_PREFIX}-ok")) file(s) available locally"
148
edhoprima
parents:
diff changeset
255
207
17d816a63b4c final progress version
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 206
diff changeset
256 printf "Generating list of new files... "
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
257 Progress_Init
201
30d2fb656029 scrapping grep -vf
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 200
diff changeset
258 cat "${TEMP_PREFIX}-list" > "${TEMP_PREFIX}-templist"
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
259 while read -r is_ok; do
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
260 grep -v "${is_ok}" "${TEMP_PREFIX}-templist" > "${TEMP_PREFIX}-newlist"
203
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 202
diff changeset
261 cat "${TEMP_PREFIX}-newlist" > "${TEMP_PREFIX}-templist"
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
262 Progress_Anim
203
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 202
diff changeset
263 done < "${TEMP_PREFIX}-ok"
205
2e866999c042 now with useless animation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 204
diff changeset
264 Progress_Done
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
265 echo "$(echo $(wc -l < "${TEMP_PREFIX}-newlist")) file(s) to be downloaded"
148
edhoprima
parents:
diff changeset
266 else
214
a6624fb9b317 major cleanup. tweaking.
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 213
diff changeset
267 if test -n "${ISQUICK}"; then
207
17d816a63b4c final progress version
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 206
diff changeset
268 echo "Quick mode selected. Skipping check"
152
67df02877319 added quickfetch for skipping file checking
edhoprima
parents: 151
diff changeset
269 else
67df02877319 added quickfetch for skipping file checking
edhoprima
parents: 151
diff changeset
270 echo "Empty local repository"
67df02877319 added quickfetch for skipping file checking
edhoprima
parents: 151
diff changeset
271 fi
200
8efa600ebfdb purge ls
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 199
diff changeset
272 cat "${TEMP_PREFIX}-list" > "${TEMP_PREFIX}-newlist"
148
edhoprima
parents:
diff changeset
273 fi
edhoprima
parents:
diff changeset
274 }
edhoprima
parents:
diff changeset
275
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
276 # start downloading the images
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
277 Fetch_Images() {
196
4d28f3a957ee cleanup~
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 195
diff changeset
278 if [ "$(echo $(wc -l < "${TEMP_PREFIX}-newlist"))" -eq 0 ]; then
148
edhoprima
parents:
diff changeset
279 echo "No new file"
edhoprima
parents:
diff changeset
280 else
207
17d816a63b4c final progress version
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 206
diff changeset
281 printf "Starting wget... "
160
68227a30d0b3 forgot to fix Fetch_Images to reflect new folder naming scheme
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 159
diff changeset
282 cd "${BASE_DIR}/${SITE_DIR}/${TARGET_DIR}"
196
4d28f3a957ee cleanup~
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 195
diff changeset
283 wget -e continue=on -bi "${TEMP_PREFIX}-newlist" -o "${TEMP_PREFIX}.log"
148
edhoprima
parents:
diff changeset
284 fi
edhoprima
parents:
diff changeset
285 }
edhoprima
parents:
diff changeset
286
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
287 # initialize base variables and initial command check
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
288 Init(){
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
289 # path initialization
181
d3b7927bdb2b restructuring and add check if the xml is processed properly
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 180
diff changeset
290 [ "${ADDITIONAL_PATH}" ] && PATH="${ADDITIONAL_PATH}:${PATH}"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
291 export PATH
158
cba73f6a96bb grep check. OpenSolaris' default grep doesn't support -f
edhoprima
parents: 157
diff changeset
292
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
293 # misc variables
166
cc60e8cf7793 dunno :<
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 165
diff changeset
294 ISQUICK=
cc60e8cf7793 dunno :<
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 165
diff changeset
295 ISNEW=
158
cba73f6a96bb grep check. OpenSolaris' default grep doesn't support -f
edhoprima
parents: 157
diff changeset
296
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
297 [ $# -lt 2 ] && Err_Help
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
298 case "$1" in
174
0948e76a57a1 added help. Bump to 0.1-beta2
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 173
diff changeset
299 check|fetch|quickfetch)
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
300 echo "Starting..."
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
301 JOB="$1"
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
302 ;;
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
303 *)
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
304 Err_Help
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
305 ;;
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
306 esac
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
307 shift
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
308 SITE=
185
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
309 TAGS=
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
310 while [ "${1}" ]; do
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
311 case "$1" in
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
312 -s|--site)
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
313 shift
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
314 SITE="$1"
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
315 ;;
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
316 -nc|--noclean)
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
317 NOCLEAN=1
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
318 ;;
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
319 *)
186
197266fefbb4 aesthetics
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 185
diff changeset
320 if [ "${TAGS}" ]; then
197266fefbb4 aesthetics
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 185
diff changeset
321 TAGS="$1 ${TAGS}"
197266fefbb4 aesthetics
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 185
diff changeset
322 else
197266fefbb4 aesthetics
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 185
diff changeset
323 TAGS="$1"
197266fefbb4 aesthetics
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 185
diff changeset
324 fi
185
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
325 ;;
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
326 esac
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
327 shift
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
328 done
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
329 [ "${SITE}" ] || SITE="${DEFAULT_SITE}"
6d926d4b3c5a initial clean system support
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 184
diff changeset
330 [ "${TAGS}" ] || Err_Fatal "No tag specified"
181
d3b7927bdb2b restructuring and add check if the xml is processed properly
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 180
diff changeset
331 # Get base folder - default, current folder or fallback to ${HOME}
d3b7927bdb2b restructuring and add check if the xml is processed properly
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 180
diff changeset
332 [ "${BASE_DIR}" ] || BASE_DIR="${PWD}"
d3b7927bdb2b restructuring and add check if the xml is processed properly
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 180
diff changeset
333 [ "${BASE_DIR}" ] || BASE_DIR="{$HOME}"
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
334 [ "$(echo "${BASE_DIR}" | cut -c1 | grep \/)" ] || BASE_DIR="/${BASE_DIR}"
181
d3b7927bdb2b restructuring and add check if the xml is processed properly
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 180
diff changeset
335
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
336 echo "Tags: ${TAGS}"
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
337 # slash is not wanted for folder name
193
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
338 TARGET_DIR=$(echo "${TAGS}" | sed -e 's/\//_/g')
ac6533a8fb51 - Documentation
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 192
diff changeset
339 SITE_DIR=$(echo "${SITE}" | sed -e 's/\/$//g;s/\//_/g')
195
652d9e268cee test migration to printf
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 194
diff changeset
340 TEMP_PREFIX="${BASE_DIR}/temp/${SITE_DIR}-${TARGET_DIR}"
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
341 }
148
edhoprima
parents:
diff changeset
342
181
d3b7927bdb2b restructuring and add check if the xml is processed properly
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 180
diff changeset
343 # initialization
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
344 Msg_Welcome
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
345 Init "$@"
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
346 Check_Tools
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
347 Check_Folders
158
cba73f6a96bb grep check. OpenSolaris' default grep doesn't support -f
edhoprima
parents: 157
diff changeset
348
148
edhoprima
parents:
diff changeset
349
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
350 # let's do the job!
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
351 case "${JOB}" in
174
0948e76a57a1 added help. Bump to 0.1-beta2
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 173
diff changeset
352 check)
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
353 Generate_Link
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
354 Check_Files
148
edhoprima
parents:
diff changeset
355 ;;
159
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
356 fetch)
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
357 Generate_Link
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
358 Check_Files
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
359 Fetch_Images
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
360 ;;
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
361 quickfetch)
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
362 ISNEW=1
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
363 ISQUICK=1
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
364 Generate_Link
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
365 Check_Files
75fe19903b74 Major cleanup
edhoprima@gmail.com <edhoprima@gmail.com>
parents: 158
diff changeset
366 Fetch_Images
148
edhoprima
parents:
diff changeset
367 ;;
edhoprima
parents:
diff changeset
368 esac