使用 AzCopy 将本地数据迁移到云存储空间
-
azcopy login
- 创建存储账号
./azcopy login --tenant-id 40242385-c249-4746-95dc-4a0b64d49dc5- 这里的—tenant-id 在下面的地方查看：目录 ID；需要拥有Storage Blob Data Owner 的权限
- 账号下可能会有很多目录（tenant），所以在 login 的时候带上 —tenant-id
-
使用 azcopy copy 上传
azcopy copy 20230509_144654178_iOS.jpg https://eastorageaccountpg.blob.core.windows.net/private-pg修改文件名和 endpoint 即可。
如果使用 az 命令也可以打到效果
az storage blob upload -f 20230509_144654178_iOS.jpg -c blog-pg -n 20230509_144654178_iOS.jpg
AzCopy Sync 使用
1. azcopy sync，Client local Dir → EU：Blob/container/dir
- Client未登录 Azure
- blob 的 container 生成共享访问令牌，注意权限选择
Client 执行 azcopy sync 命令with SAS
root@ubuntu0:~# azcopy sync "./blog/" "https://eustoragesacc0.blob.core.windows.net/eucontainer?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D"
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job e08f5117-f8b7-314d-5aa3-3f22b0fdf82b has started
Log file is located at: /root/.azcopy/e08f5117-f8b7-314d-5aa3-3f22b0fdf82b.log
100.0 %, 2 Done, 0 Failed, 0 Pending, 2 Total, 2-sec Throughput (Mb/s): 0.6465
Job e08f5117-f8b7-314d-5aa3-3f22b0fdf82b Summary
Files Scanned at Source: 2
Files Scanned at Destination: 0
Elapsed Time (Minutes): 0.0667
Number of Copy Transfers for Files: 2
Number of Copy Transfers for Folder Properties: 0
Total Number Of Copy Transfers: 2
Number of Copy Transfers Completed: 2
Number of Copy Transfers Failed: 0
Number of Deletions at Destination: 0
Total Number of Bytes Transferred: 423810
Total Number of Bytes Enumerated: 423810
Final Job Status: Completed
查看 Blob 情况
-
EA：blob/container/dir → EU：blob/container/dir
-
ea 源生成 SAS，注意权限
-
Client 执行 azcopy sync 命令with SAS
root@ubuntu0:~# azcopy sync "https://eastorageacc0.blob.core.windows.net/eacontainer/sync/?sp=rle&st=2023-07-21T12:42:42Z&se=2023-07-21T20:42:42Z&spr=https&sv=2022-11-02&sr=c&sig=%2FZzdp1B5dpZzTGT3PlwhssFKnipWkgp%2BBpOIqo9t1mY%3D" "https://eustoragesacc0.blob.core.windows.net/eucontainer/sync/?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D" INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support Job 747202e5-1afc-b846-4388-9e2e4eee6c58 has started Log file is located at: /root/.azcopy/747202e5-1afc-b846-4388-9e2e4eee6c58.log 100.0 %, 3 Done, 0 Failed, 0 Pending, 3 Total, 2-sec Throughput (Mb/s): 0 Job 747202e5-1afc-b846-4388-9e2e4eee6c58 Summary Files Scanned at Source: 3 Files Scanned at Destination: 0 Elapsed Time (Minutes): 0.1 Number of Copy Transfers for Files: 3 Number of Copy Transfers for Folder Properties: 0 Total Number Of Copy Transfers: 3 Number of Copy Transfers Completed: 3 Number of Copy Transfers Failed: 0 Number of Deletions at Destination: 0 Total Number of Bytes Transferred: 847620 Total Number of Bytes Enumerated: 847620 Final Job Status: Completed -
查看 Blob 情况
-
-
AzCopy copy 示例文章来源：https://www.toymoban.com/news/detail-674420.html
azcopy copy "https://eascc20230728.blob.core.windows.net/local/1.txt?sp=racwli&st=2023-07-31T03:54:41Z&se=2023-08-31T11:54:41Z&spr=https&sv=2022-11-02&sr=c&sig=hRxFYgG3chofx1WUwlb0ji5wPuI%2BgA31DxUNZlPjAW4%3D" ./1.txt- 加上 token 要使用“”
- https://eascc20230728.blob.core.windows.net/local/1.txt 具体的 blob 还是目录要指定清楚
Blob bw Regions test
| 序号 | 说明 | 测试 1 | 测试 2 | 测试 3 | 平均值 |
|---|---|---|---|---|---|
| 1 | EA client → SA Container | 0.2334 | 0.2334 | ||
| 2 | SA Container → EU client | 1.0263 | 1.2675 | 1.0148 | 1.10286667 |
| 3 | SA Container → EU client @ peer created | 1.1209 | 1.2449 | 1.1483 | 1.17136667 |
| 4 | SA Container → EU Container | 4.1681 | 4.335 | 4.6351 | 4.3794 |
| 2 Hours Later | 1.4338 | 1.8673 | 1.65055 | ||
| 5 | EU Contaner → SA Container | 1.0003 | 0.9336 | 0.96695 | |
| 6 | EU client → EU Container | 0.767 | 0.7669 | 0.767 | 0.76696667 |
| 7 | EU Container → EU Client, VM disk iops limited | 0.8814 | 0.8814 | ||
| 8 | EA client →EU Container | 0.5335 | 0.7002 | 0.61685 | |
| 9 | EU container → EA container | 0.4001 | 0.4001 |
结论：
1. Client 跨Region 获取 Container 中文件，在 Blog 选择微软内网优先的情况下，Region间是否使用 Peer 对等对传输效率基本无影响；
2. Container 的文件直接跨 Region 传输效率与选择的 Region以及时机/方向 有关，一段时间保持稳定；
3. 同 Region 传输效率高；文章来源地址https://www.toymoban.com/news/detail-674420.html
原始数据
1. EA client → SA Container
root@ubuntu0:/home/zyi# azcopy copy 1.zip https://sastorageac0.blob.core.windows.net/sacontainer
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job f631ebf2-8060-6b47-7164-58044ee0c43c has started
Log file is located at: /root/.azcopy/f631ebf2-8060-6b47-7164-58044ee0c43c.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job f631ebf2-8060-6b47-7164-58044ee0c43c summary
Elapsed Time (Minutes): 0.2334
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
2. SA Container → EU client
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job bf9d0ff0-6066-2140-4cb9-8716e4272028 has started
Log file is located at: /root/.azcopy/bf9d0ff0-6066-2140-4cb9-8716e4272028.log
0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):6.2 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):11.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)15.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)20.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)24.6 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)29.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)33.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)38.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)42.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)46.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)51.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)55.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)59.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)64.4 %, 0 68.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1710.624 (Disk may be l73.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1845.0545 (77.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1440.6049 82.5 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job bf9d0ff0-6066-2140-4cb9-8716e4272028 summary
Elapsed Time (Minutes): 1.0263
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#download 2
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 732e37c9-9e99-364a-4a4e-fa7484fac927 has started
Log file is located at: /root/.azcopy/732e37c9-9e99-364a-4a4e-fa7484fac927.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 732e37c9-9e99-364a-4a4e-fa7484fac927 summary
Elapsed Time (Minutes): 1.2675
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#download 3
^[[Aroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 05c9210a-e503-c046-6f9b-853d6c9a3c4e has started
Log file is located at: /root/.azcopy/05c9210a-e503-c046-6f9b-853d6c9a3c4e.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 05c9210a-e503-c046-6f9b-853d6c9a3c4e summary
Elapsed Time (Minutes): 1.0148
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
3. SA Container → EU client @ peer created
```powershell
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f has started
Log file is located at: /root/.azcopy/b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f summary
Elapsed Time (Minutes): 1.1209
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#2
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job b646e5c1-af07-6c41-7a0c-641ecfd5d1cd has started
Log file is located at: /root/.azcopy/b646e5c1-af07-6c41-7a0c-641ecfd5d1cd.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job b646e5c1-af07-6c41-7a0c-641ecfd5d1cd summary
Elapsed Time (Minutes): 1.2449
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 30f70c4e-fdd1-9a4b-6e89-c5e7406970de has started
Log file is located at: /root/.azcopy/30f70c4e-fdd1-9a4b-6e89-c5e7406970de.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 30f70c4e-fdd1-9a4b-6e89-c5e7406970de summary
Elapsed Time (Minutes): 1.1483
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
1. SA Container → EU Container
```powershell
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 9168f92f-2da4-6742-6862-8e5696b52a41 has started
Log file is located at: /root/.azcopy/9168f92f-2da4-6742-6862-8e5696b52a41.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 9168f92f-2da4-6742-6862-8e5696b52a41 summary
Elapsed Time (Minutes): 4.1681
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 7cca86e8-11b6-164d-7b33-887d9cf10183 has started
Log file is located at: /root/.azcopy/7cca86e8-11b6-164d-7b33-887d9cf10183.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 7cca86e8-11b6-164d-7b33-887d9cf10183 summary
Elapsed Time (Minutes): 4.335
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#3
root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job c4366598-5822-b946-45b9-6ee9d6f6df15 has started
Log file is located at: /root/.azcopy/c4366598-5822-b946-45b9-6ee9d6f6df15.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job c4366598-5822-b946-45b9-6ee9d6f6df15 summary
Elapsed Time (Minutes): 4.6351
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#4
root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 15fe8cca-78c3-3d40-4a55-e90d11495258 has started
Log file is located at: /root/.azcopy/15fe8cca-78c3-3d40-4a55-e90d11495258.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 15fe8cca-78c3-3d40-4a55-e90d11495258 summary
Elapsed Time (Minutes): 1.4338
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#5
root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 2ac14c6f-f943-9c4b-7477-6947fd59ab31 has started
Log file is located at: /root/.azcopy/2ac14c6f-f943-9c4b-7477-6947fd59ab31.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 2ac14c6f-f943-9c4b-7477-6947fd59ab31 summary
Elapsed Time (Minutes): 1.8673
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
2. EU Contaner → SA Container
```powershell
root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainer
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 8b6f339f-e23b-2f4e-755c-8bd336942b40 has started
Log file is located at: /root/.azcopy/8b6f339f-e23b-2f4e-755c-8bd336942b40.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 8b6f339f-e23b-2f4e-755c-8bd336942b40 summary
Elapsed Time (Minutes): 1.0003
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#2
root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 0c1039f0-7a9f-0e44-6a42-079c03708fb8 has started
Log file is located at: /root/.azcopy/0c1039f0-7a9f-0e44-6a42-079c03708fb8.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 0c1039f0-7a9f-0e44-6a42-079c03708fb8 summary
Elapsed Time (Minutes): 0.9336
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
1. EU client → EU Container
```powershell
root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job d3bdc10a-4142-8b41-7f9a-752c840c5f36 has started
Log file is located at: /root/.azcopy/d3bdc10a-4142-8b41-7f9a-752c840c5f36.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 623.3303
Job d3bdc10a-4142-8b41-7f9a-752c840c5f36 summary
Elapsed Time (Minutes): 0.767
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#2
root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 3018151c-c777-ca42-4054-7f980de47650 has started
Log file is located at: /root/.azcopy/3018151c-c777-ca42-4054-7f980de47650.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 598.946
Job 3018151c-c777-ca42-4054-7f980de47650 summary
Elapsed Time (Minutes): 0.7669
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#3
root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 has started
Log file is located at: /root/.azcopy/33cf320d-94a5-aa48-5a35-b94d34cf5cc1.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 579.6335
Job 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 summary
Elapsed Time (Minutes): 0.767
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
2. EU Container → EU Client, VM disk iops limited
```powershell
root@eu-ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 10.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 038b5c4a-7376-094d-4e7c-c958e15378f8 has started
Log file is located at: /root/.azcopy/038b5c4a-7376-094d-4e7c-c958e15378f8.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 038b5c4a-7376-094d-4e7c-c958e15378f8 summary
Elapsed Time (Minutes): 0.8814
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
1. EA client →EU Container
```powershell
root@ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job e197a453-cd7d-9042-53bc-de6c0e26246c has started
Log file is located at: /root/.azcopy/e197a453-cd7d-9042-53bc-de6c0e26246c.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job e197a453-cd7d-9042-53bc-de6c0e26246c summary
Elapsed Time (Minutes): 0.5335
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
#2
root@ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zip
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 6b1b50a2-3c6c-9c45-5165-085514255e76 has started
Log file is located at: /root/.azcopy/6b1b50a2-3c6c-9c45-5165-085514255e76.log
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 6b1b50a2-3c6c-9c45-5165-085514255e76 summary
Elapsed Time (Minutes): 0.7002
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
2. EU container → EA container
```powershell
root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://eastorageaccountpg.blob.core.windows.net/blog-pg
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to destination using Azure AD
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
Job 04a69131-382f-3741-4263-c81b6e28c27e has started
Log file is located at: /root/.azcopy/04a69131-382f-3741-4263-c81b6e28c27e.log
INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,
Job 04a69131-382f-3741-4263-c81b6e28c27e summary
Elapsed Time (Minutes): 0.4001
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred: 10519930170
Final Job Status: Completed
```
到了这里，关于Azure - AzCopy学习的文章就介绍完了。如果您还想了解更多内容，请在右上角搜索TOY模板网以前的文章或继续浏览下面的相关文章，希望大家以后多多支持TOY模板网！
![[Azure] databricks通过服务主体(service principals)和azure key vaults访问Blob storage](https://imgs.yssmx.com/Uploads/2024/04/856304-1.png)
