AWS Builder Center
Building Oppaku-Chunker: A File-Splitting Tool That Solved My 70GB Storage Crisis

Building Oppaku-Chunker: A File-Splitting Tool That Solved My 70GB Storage Crisis

How I built a file-chunking tool using C# and .NET streams to split and merge large files/folders without needing double the storage space, solving a real-world problem I faced with limited laptop storage.

Hi everyone! 👋
I'm a Full Stack Web Developer (Node, Rails, Express, React, Next.js) and a student at Nutech University. Today, I want to share a project I built called Oppaku-Chunker, A file-splitting tool that solved a frustrating real-world problem.

The Problem

I had a 70GB file that I needed to transfer from my laptop to my PC using a USB drive. Here was the catch:
  • My laptop had very little free storage left.
  • To split the file into parts (like  .part1 ,  .part2 ), most tools require double the space—70GB for the original + 70GB for the parts = 140GB total.
  • I didn't have that space.

The Solution: Oppaku-Chunker

I built a tool using C# and .NET that uses file-streaming to split files into chunks without needing extra storage space. Instead of creating all parts at once, it streams the file and writes specific parts sequentially. So you only need enough space for the part you're currently writing.
Why C# and .NET?
  • .NET streams are powerful for handling large files efficiently.
  • It's cross-platform (works on Windows, Linux, and macOS).
  • Performance is excellent for I/O-heavy operations.
Key Features:
  • Stream-based processing: No need to duplicate the entire file.
  • Folder support: Splits entire folders efficiently. After merging, it restores the original folder structure.
  • Hash verification: After merging, it checks file hashes to ensure data integrity, so you know nothing got corrupted.
  • Cross-platform: Built with .NET, so it runs on Windows, Linux, and macOS.

How It Works (Briefly)

  1. Splitting: You select a file or folder, choose part size, and the tool streams it into smaller chunks.
  1. Transferring: You copy the chunks to your USB drive.
  1. Merging: On the target PC, the tool merges all parts back into the original file/folder.
  1. Verification: It checks the hash to confirm everything is intact.

Current Status: Work in Progress 🚧

I built the initial version to solve my own problem, and I'm constantly updating it as I find new improvements. It's not perfect yet. There's always room to grow!
Some areas I'm actively working on:
  • Better error handling
  • Faster streaming performance
  • More intuitive CLI commands
  • Better progress feedback during large operations

How You Can Support 🙌

If this idea resonates with you or solves a problem you've faced, I'd be genuinely happy if you supported it! Here's how:
  • ⭐ Star the repo on GitHub to show your interest
  • 🐛 Report bugs or suggest features via issues
  • 💬 Comment below with your ideas for improvement
  • 🔧 Contribute code if you'd like to help build it further

The Repo

You can check out the code here: https:// github.com/ali38958/Oppaku-Chunker 
(Note: If the link doesn't work, my repo might be private or the URL needs updating—let me know in the comments!)

What I Learned

  • .NET streams are incredibly powerful for handling large data without memory issues.
  • Real-world problems are the best motivation to learn.
  • Community feedback (that's where you come in!) can help improve the tool.

Final Thoughts

I know there are improvements to make, and I'm excited to see where this project goes with community input. Whether it's a small suggestion or a major contribution, every bit of support helps.
Thanks for reading, and happy building! 🚀
Any opinions in this article are those of the individual author and may not reflect the opinions of AWS.
Enjoyed reading this content? Let the author know!

Your likes, comments, shares, and saves help creators reach more builders.

Loading recommendations

Loading article