File Upload with Multer in Node.js and Express


File Upload with Multer in Node.js and Express

File upload is a common operation for any applications. In Node.js, with the Express web framework and the Multer library, adding file upload feature to your app is very easy. In this tutorial, we are going to learn how to upload files on the server with the help of Multer and Express in Node.js. The goal is to make you comfortable in building apps that can easily handle any file uploads. At the end of this blog, you will be able to integrate the file uploads in your own apps.

We will be covering the following topics:

  • What is Multer?
  • Project Setup
  • Install the dependencies
  • Testing Our API Using Postman
  • Adding Multer
  • DiskStorage
  • Other Options in Upload
  • Uploading Multiple Files


What is Multer?

Multer is a node.js middleware for handling multipart/form-data, which is primarily used for uploading files. It is written on top of the

busyboy

, for maximum efficiency

.

By this, you can understand that multer is used to handle


multipart/form-data


.



What is Multipart Data?



In general, when a “form” is submitted, browsers use “

application-xx-www-form-urlencoded

” content-type. This type contains only a list of keys and values and therefore are not capable of uploading files. Whereas, when you configure your form to use “

multipart/form-data

” content-type, browsers will create a “multipart” message where each part will contain a field of the form. A multipart message will consist of text input and file input. This way using multipart/form-data you can upload files.

Multer adds a body object and a file or files object to the request object. The body object contains the values of the text fields of the form, the file or files object contains the files uploaded via the form.

Multer will not process any form which is not multipart (

multipart/form-data).


Project Setup

Create a directory for the project and give it any name. We will call it


MulterApp.



Now, let’s start by first defining the


package.json


file to store our app’s configuration. To create one, navigate to the MulterApp directory in terminal, and write the following command:

// In command prompt or terminal
npm init

Answer a few questions (app name, git repo, etc…) and you’ll be ready to roll.


Install the dependencies

Here, the only two dependencies are


express


and


multer


. So we will install it one by one via npm(Node Package Manager).

// installing express module 
npm install express --save

We are now ready to write some code. Create a file with any name of your choice, we will call it


app.js


. Load the express module using


require()


method and then set up a basic express server by writing the following code in


app.js


.

// load express
const express = require('express');
const app = express();
app.get(‘/’, (req, res) => {  
   res.send(‘hello world’);
});
app.listen(3000, () => { 
    console.log('Started on port 3000');
});

Now run the code by writing the following command in the terminal:

node app.js

After this, open the browser and type


http://localhost:3000


.

You should see


“Hello World”


printing to the document window. We have set up the basic server.


Testing Our API Using Postman

Postman is an essential and fantastic tool if you are building rest API. We will use Postman to test our routes. As we are not using any form tag or frontend therefore we will make requests and specify our form data from Postman only. So, make sure that you have Postman installed. Now let’s add


multer


to our project.

Adding Multer

Before using multer, we have to install it using npm.

// installing multer module  
npm install multer --save

In this project, we will store the uploaded files in a folder for simplicity. Usually we store the files in the Amazon S3 bucket.

We will now load


multer


in the


app.js


file using the


require()


method. The following code will go in the


app.js


file.

const multer = require('multer');
const upload = multer({dest:'uploads/'}).single("demo_image");

Here, we have called the


multer()


method. It




accepts an options object, with


dest


property, which tells Multer where to upload the files. If you omit this object, the files will be kept in memory and never written to disk.

Once this is done, We will now create our


post


route. We will make a POST request to the URL [


localhost:port/image


]. For that, we will first have to listen to that endpoint and we will do that by using the


post()


method.

Here we are making a


post


request because, in the actual scenario also, It will be a post request only, as the

form tag

will going to post this data to a specific URL(by specifying method=”POST” and action=”/image” in form tag).

The following code will go in app.js:

app.post("/image", (req, res) => {
   upload(req, res, (err) => {
    if(err) {
      res.status(400).send("Something went wrong!");
    }
    res.send(req.file);
  });
});


Multer supports uploading a single file as well as multiple files. In this case, we have used


multer({..}).single()


which is used for uploading a single file. As I have mentioned before that the multer adds a file object to the request. The file object contains metadata related to the file.

Now we will be using Postman to test this endpoint.

Here note that the


key name


or the


field name


that you are providing in form data should be the same as the one provided in the


multer({..}).single()


(here name is demo_image).

Now see your file structure again, notice that


uploads


folder is created in the location provided in


dest


option(in our case in the project directory). If you want more controls over the uploads we will use the


storage


option instead of


dest


.


DiskStorage

The disk storage engine gives you full control over storing files to disk. We will create a storage object using the


diskStorage


() method.

The following code will go in


app.js


:

var storage = multer.diskStorage({   
   destination: function(req, file, cb) { 
      cb(null, './uploads');    
   }, 
   filename: function (req, file, cb) { 
      cb(null , file.originalname);   
   }
});

Here, there are two properties,


destination


, and


filename


. They both are functions.



destination –


It can also be given as a string (e.g. ‘./uploads’). If no destination is given, the operating system’s default directory for temporary files is used. It is


mandatory


to create a directory when you are using

destination

as a function. Otherwise, if you are using


destination


as a string, multer will make sure that the directory is created for you.



filename –


It is used to determine what the file should be named inside the folder. If you don’t provide any filename, each file will be given a random name without any file extension. It is your responsibility to provide a function that should return a complete filename with a file extension. Both these functions take 3 arguments – the request object, the file object and a callback function (here, cb is callback function). The 2 arguments to

cb

are:



  • null


    – as we don’t want to show any error.


  • file.originalname


    – here, we have used the same name of the file as they were uploaded. You can use any name of your choice.

Now let’s modify the variable a little bit.

// In app.js 
var upload = multer({ storage: storage }).single("demo_image");

Again test this in Postman. You will find the same output but now check the image in the


uploads


folder. You will find the same filename as you uploaded, with the proper extension.

Other Options in Upload



  1. limits


    – You can also put a limit on the size of the file that is being uploaded with the help of using

    limits.

The following code will go inside the


multer()


.

// inside multer({}), file upto only 1MB can be uploaded
const upload = multer({
       storage: storage,
       limits : {fileSize : 1000000}
});

Here, fileSize is in bytes. (1000000 bytes = 1MB)

2.


fileFilter –


Set this to a function to control which files should be uploaded and which should be skipped. The function should look like this:

// this code goes inside the object passed to multer()
function fileFilter (req, file, cb) {  
   // The function should call `cb` with a boolean  
   // to indicate if the file should be accepted  

   // To reject this file pass `false`, like so:   
   cb(null, false);
   // To accept the file pass `true`, like so:   
   cb(null, true);   
   // You can always pass an error if something goes wrong:   
   cb(new Error('I don\'t have a clue!')); 
}

For Example, if we only want the user to upload the image file (jpeg, jpg, png, gif).

Then the code will look like this and will go in app.js:

// this code goes inside the object passed to multer()
function fileFilter (req, file, cb) {    
  // Allowed ext
   const filetypes = /jpeg|jpg|png|gif/;

 // Check ext
  const extname =  filetypes.test(path.extname(file.originalname).toLowerCase());
 // Check mime
 const mimetype = filetypes.test(file.mimetype);

 if(mimetype && extname){
     return cb(null,true);
 } else {
     cb('Error: Images Only!');
 }
}

Uploading Multiple Files

We can upload multiple files as well. In this case, multer gives us another function called .

arrays(fieldname[, max_count])

that accepts an array of files, all with the name


fieldname


. It generates an error if more than


max_count


files are uploaded. The array of files will be stored in req.files.

The following code will go in app.js

// uploading multiple images together
app.post("/images", upload.array("demo_images", 4), (req, res) =>{
  try {
    res.send(req.files);
  } catch (error) {
    console.log(error);
    res.send(400);
  }
});

Go to Postman, enter the specified URL, select multiple files and then press Enter.


Closing Notes

Now, we know how to integrate file uploads using multer in any application. Go ahead! make your own application with complete frontend and integrate the file uploads by using the above-acquired knowledge.

Keep Learning 🙂


Team AfterAcademy!!