綾小路龍之介の素人思考

[wget] ftpからミラーリングダウンロード

wgetを使ってftpからミラーリングでダウンロードする。

以下のようにする。指定したディレクトリに含まれる内容がダウンロードされる。ドメイン以下のディレクトリは自動的に作成される。

$ wget --mirror 'ftp://free.nchc.org.tw/linuxmint/isos/stable/13/'
--2012-07-03 09:54:46--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/
           => “free.nchc.org.tw/linuxmint/isos/stable/13/.listing”
Resolving free.nchc.org.tw... 211.73.64.9
Connecting to free.nchc.org.tw|211.73.64.9|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD (1) /linuxmint/isos/stable/13 ... done.
==> PASV ... done.    ==> LIST ... done.

    [ <=>                                                           ] 1,208       --.-K/s   in 0.001s

2012-07-03 09:54:47 (1.93 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/.listing” saved [1208]

The sizes do not match (local 44923967) -- retrieving.

--2012-07-03 09:54:47--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-32bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-32bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-32bit.iso ... done.
Length: 856686592 (817M)

100%[===============================================================>] 856,686,592 1.90M/s   in 12m 20s

2012-07-03 10:07:07 (1.10 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-32bit.iso” saved [856686592]

--2012-07-03 10:07:07--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-64bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-64bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-64bit.iso ... done.
Length: 839909376 (801M)

100%[===============================================================>] 839,909,376  909K/s   in 11m 32s

2012-07-03 10:18:39 (1.16 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-64bit.iso” saved [839909376]

--2012-07-03 10:18:39--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-nocodecs-32bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-nocodecs-32bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-nocodecs-32bit.iso ... done.
Length: 821035008 (783M)

100%[===============================================================>] 821,035,008 10.1M/s   in 87s

2012-07-03 10:20:06 (9.02 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-nocodecs-32bit.iso” saved [821035008]

--2012-07-03 10:20:06--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-nocodecs-64bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-nocodecs-64bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-nocodecs-64bit.iso ... done.
Length: 826277888 (788M)

100%[===============================================================>] 826,277,888  709K/s   in 11m 17s

2012-07-03 10:31:23 (1.16 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-nocodecs-64bit.iso” saved [826277888]

--2012-07-03 10:31:23--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-oem-64bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-oem-64bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-oem-64bit.iso ... done.
Length: 838860800 (800M)

100%[===============================================================>] 838,860,800 10.2M/s   in 94s

2012-07-03 10:32:57 (8.48 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-cinnamon-dvd-oem-64bit.iso” saved [838860800]

--2012-07-03 10:32:57--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-32bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-32bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-32bit.iso ... done.
Length: 941621248 (898M)

100%[===============================================================>] 941,621,248 6.97M/s   in 1m 53s

2012-07-03 10:34:51 (7.92 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-32bit.iso” saved [941621248]

--2012-07-03 10:34:51--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-64bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-64bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-64bit.iso ... done.
Length: 927989760 (885M)

100%[===============================================================>] 927,989,760 4.63M/s   in 2m 10s

2012-07-03 10:37:01 (6.81 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-64bit.iso” saved [927989760]

--2012-07-03 10:37:01--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-nocodecs-32bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-nocodecs-32bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-nocodecs-32bit.iso ... done.
Length: 905969664 (864M)

100%[===============================================================>] 905,969,664 1.21M/s   in 12m 20s

2012-07-03 10:49:22 (1.17 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-nocodecs-32bit.iso” saved [905969664]

--2012-07-03 10:49:22--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-nocodecs-64bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-nocodecs-64bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-nocodecs-64bit.iso ... done.
Length: 914358272 (872M)

100%[===============================================================>] 914,358,272  789K/s   in 11m 32s

2012-07-03 11:00:54 (1.26 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-nocodecs-64bit.iso” saved [914358272]

--2012-07-03 11:00:54--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-oem-64bit.iso
           => “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-oem-64bit.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-oem-64bit.iso ... done.
Length: 927989760 (885M)

100%[===============================================================>] 927,989,760 8.33M/s   in 1m 53s

2012-07-03 11:02:48 (7.81 MB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/linuxmint-13-mate-dvd-oem-64bit.iso” saved [927989760]

--2012-07-03 11:02:48--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/md5sum.txt
           => “free.nchc.org.tw/linuxmint/isos/stable/13/md5sum.txt”
==> CWD not required.
==> PASV ... done.    ==> RETR md5sum.txt ... done.
Length: 724

100%[==============================================================>] 724         --.-K/s   in 0.01s

2012-07-03 11:02:48 (47.4 KB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/md5sum.txt” saved [724]

--2012-07-03 11:02:48--  ftp://free.nchc.org.tw/linuxmint/isos/stable/13/sha256sum.txt
           => “free.nchc.org.tw/linuxmint/isos/stable/13/sha256sum.txt”
==> CWD not required.
==> PASV ... done.    ==> RETR sha256sum.txt ... done.
Length: 1044 (1.0K)

100%[==============================================================>] 1,044       --.-K/s   in 0.02s

2012-07-03 11:02:48 (66.2 KB/s) - “free.nchc.org.tw/linuxmint/isos/stable/13/sha256sum.txt” saved [1044]

FINISHED --2012-07-03 11:02:48--
Downloaded: 13 files, 8.2G in 1h 7m 59s (2.06 MB/s)

*を使ったワイルドカード指定も出来る。

# wget -m 'ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/*-13-*'
--2012-07-03 20:27:58--  ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/*-13-*
           => “ftp.riken.go.jp/Linux/simosnet-livecd/mint/.listing”
Resolving ftp.riken.go.jp... 134.160.38.1
Connecting to ftp.riken.go.jp|134.160.38.1|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD (1) /Linux/simosnet-livecd/mint ... done.
==> PASV ... done.    ==> LIST ... done.

    [ <=>                                                                                                                ] 8,965       --.-K/s   in 0s

2012-07-03 20:27:59 (247 MB/s) - “ftp.riken.go.jp/Linux/simosnet-livecd/mint/.listing” saved [8965]

--2012-07-03 20:27:59--  ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso
           => “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso ... done.
Length: 1130788864 (1.1G)

100%[=================================================================================================================>] 1,130,788,864 1.44M/s   in 8m 44s

2012-07-03 20:36:42 (2.06 MB/s) - “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso” saved [1130788864]

--2012-07-03 20:36:42--  ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.md5
           => “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.md5”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.md5 ... done.
Length: 86

100%[===================================================================================================================>] 86           542B/s   in 0.2s

2012-07-03 20:36:43 (542 B/s) - “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.md5” saved [86]

--2012-07-03 20:36:43--  ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.torrent
           => “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.torrent”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.torrent ... done.
Length: 21852 (21K)

100%[===================================================================================================================>] 21,852      90.6K/s   in 0.2s

2012-07-03 20:36:44 (90.6 KB/s) - “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-cinnamon-dvd-nocodecs-32bit-lcr-jp.iso.torrent” saved [21852]

--2012-07-03 20:36:44--  ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso
           => “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso ... done.
Length: 1210570752 (1.1G)

100%[=================================================================================================================>] 1,210,570,752 3.00M/s   in 7m 37s

2012-07-03 20:44:21 (2.53 MB/s) - “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso” saved [1210570752]

--2012-07-03 20:44:21--  ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.md5
           => “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.md5”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.md5 ... done.
Length: 82

100%[===================================================================================================================>] 82          --.-K/s   in 0.05s

2012-07-03 20:44:21 (1.68 KB/s) - “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.md5” saved [82]

--2012-07-03 20:44:21--  ftp://ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.torrent
           => “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.torrent”
==> CWD not required.
==> PASV ... done.    ==> RETR linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.torrent ... done.
Length: 23368 (23K)

100%[===================================================================================================================>] 23,368      --.-K/s   in 0.08s

2012-07-03 20:44:21 (280 KB/s) - “ftp.riken.go.jp/Linux/simosnet-livecd/mint/linuxmint-13-mate-dvd-nocodecs-32bit-lcr-jp.iso.torrent” saved [23368]

FINISHED --2012-07-03 20:44:21--
Downloaded: 7 files, 2.2G in 16m 21s (2.28 MB/s)

リファレンス

  1. GNU Wget 1.9 Manual: 例
  2. ftp mirror で 再帰取得ができない - 堕落した人生を目指す日記
  3. Wget Manual - Examples

ソーシャルブックマーク

  1. はてなブックマーク
  2. Google Bookmarks
  3. del.icio.us

ChangeLog

  1. Posted: 2010-06-11T11:08:35+09:00
  2. Modified: 2010-06-11T11:08:35+09:00
  3. Generated: 2017-05-14T23:09:18+09:00