Large Data Transfer

Large Data Transfers are important in cloud rendering, whether using decentralized or centralized systems, due to the large file sizes involved in 3D rendering for animations, motion graphics, VFX, product and architectural visualizations, and other high-resolution media. Fast and efficient data transfer ensures smooth workflows between Creators and third-party services like Pictor Network, reducing delays in uploading 3D projects, processing them, and downloading final renders. Without high-speed data transfer, the rendering process can experience bottlenecks, leading to increased time and cost for projects. Additionally, ensuring data security and integrity during transfer is essential to protect creative content and prevent data loss.

Pictor Network has developed a unique file transfer protocol with six key features to tackle this challenge.

1. File Fragmentation

Pictor breaks large files into smaller pieces based on the Creator’s network speed while ensuring that the bandwidth is always fully utilized during data transfers.

  • Dynamic Segmentation: Pictor divides the Creator’s file into smaller parts (segments) based on the current network speed. For a slower network, the 1GB file might be divided into small segments of 100 KB each. As the network conditions improve, larger segments like 200 KB or 500 KB will be used.
  • Full Bandwidth Utilization: Regardless of the network condition, Pictor dynamically adjusts the segment sizes to use the available bandwidth fully. This ensures no bandwidth is wasted, maximizing transfer speeds.

2. File Compression

When a folder has many files, like 1,000 files adding up to 1 GB, transferring them one by one can take a long time. Pictor compresses these files into a single file before breaking it up for transfer. This makes the upload process faster and more efficient.

3. Pause/Resume Upload

If your internet connection drops while uploading, Pictor lets you continue where you left off instead of starting over. For example, if 80% of a file is uploaded, and the connection is lost, you can resume the remaining 20% when the connection is restored.

You can also pause uploads and resume them at any time, thanks to the numbering system that tracks the status of uploaded segments.

4. Selective Upload

Modifications are necessary during the course of project work. If you only make changes to some files in a folder, Pictor will upload only the updated files, not the entire folder. This ensures that unchanged files are not redundantly uploaded, saving both time and bandwidth.

5. Optimal File Routes

Pictor tests multiple network paths to find the fastest route for file transfer. It sends small test files (1 KB) through different routes and chooses the quickest one to transfer the project data. This feature ensures that the files are transferred as efficiently as possible.

6. Peer-to-Peer Transfer

Pictor uses Peer-to-Peer (P2P) transfer, allowing different computers (Workers) in the network to share files directly with each other. This avoids using a central server, speeding up transfers, and making better use of the network resources available.

In summary, Pictor Network’s advanced data transfer solution offers a seamless, efficient, and secure approach to handling large files. These combined six features make Pictor an ideal network for managing large-scale data transfers in cloud rendering and other resource-intensive tasks.

How can we help?