I’ve recently needed to download data related to Google, on the order of tens of terabytes. Does anyone have any hardware recommendations?
Unlimited data before CCS
Launch a GCP instance; it should be able to transfer directly over Google’s internal network.
Where should I download from? For something like this, a US or European phone with unlimited data should be fine, right?
CCS machines used to have unlimited bandwidth, but now it’s 40 TB per month.
For details, you can refer to my previous posts.
I have a lot of unused data; if the destination isn’t domestic, I can help you move it.
Haichuang 10% off coupon code 85ZF6GK2RUAM
HytronVPS - Cloud VPS Hosting AFF
Is using GCP expensive? I don’t have a Visa card, so it seems I can’t sign up.
Thank you very much, but when it comes to downloading Google’s data locally, I’ll take care of it myself.
Then just buy servers from Europe or the US. By the way, the GCP channel mentioned above won’t work unless you have a one-time-use account and use a virtual card to run up charges; GCP charges for uploads, while uploading to your local storage is charged normally.
Also, it’s best to use v6, because high traffic gets blocked easily; no protocol can fully avoid it, especially with the current crackdown.
I previously moved about 20 TB of data; the method was to upload from a VPS to Mobile Cloud Drive (I was using Mobile at the time) and 115 Cloud Drive, then download back locally later, which helps avoid IP bans.
I just suddenly thought of downloading via a reverse proxy; this might avoid getting blocked, since in theory it isn’t considered bypassing the firewall.
Thank you very much. I’ll first look into the methods you mentioned, and if there’s anything I don’t understand, I’ll ask you for help.
Right now this only has HK servers, you know. I’m not sure if they’ll add other regions in the future, like Singapore, Japan, and Korea.
(Many LXC servers are very cheap and offer plenty of bandwidth.)
[quote=“青衫入雨, post:13, topic:85105, username:mry”]
LXC
[/quo Okay, thank you
(Here we think that you could try using the “VLESS+Vision+Raw+Reality” combination, and set the Reality target to onedrive.live.com (OneDrive cloud storage), oss-us-west-1.aliyuncs.com (Alibaba Cloud overseas object storage) or r2.cloudflarestorage.com (Cloudflare R2 object storage), etc., which are suitable for high-traffic use-case file-hosting platforms.)
Not necessary; the reasons are as follows
- High-traffic machines themselves are not optimized for Mainland China; there isn’t much difference between v6 and v4, and v6 hardly cares about circumvention; Shadowsocks can be run as-is
- Reality stealing targets require TLS 1.3 and HTTP/2; it’s uncertain whether the above can be satisfied; even if they can be satisfied, it’s actually quite unusual. Your VPS IP isn’t theirs; an IP like OneDrive’s would inevitably be in Azure; with high traffic, it will be detected and flagged
- Downloading files from foreign websites is not inherently unreasonable; there’s no need to use illegal means like circumventing the firewall. You set up an openlist, add Google Drive, then enable reverse proxy; in the eyes of the Great Firewall, you’re just downloading tens of terabytes of files from a foreign cloud drive
netcup, it seems to be 2 TB per day, refreshed daily, basically no different from unlimited bandwidth.
例如使用GitHub被Q住了,还有大模型下载被Q住了,这种怎么弄