Is there any way in sharepoint to display only the document libraries of that particular site in the home.apx page?

Solution 1: Use Highlighted content web part:

You can use Highlighted content web part for such scenarios and query your SharePoint site like ContentClass:"STS_List_DocumentLibrary" to get the list of document libraries in your site.

Use the Highlighted content web part

Solution 2: Create your own SPFx webpart:

You can create a custom SPFx webpart and use SharePoint REST API or Search API to get the document libraries in your site. Something like below:

<your_site_url>/_api/web/lists?$select=Title,ServerRelativeUrl&$filter=BaseTemplate eq 101 and hidden eq false

OR

<your_site_url>/_api/Web/lists?$select=Title,ServerRelativeUrl&$filter=BaseTemplate eq 101 and Title ne 'Site Assets' and Title ne 'Style Library'

References:

1. Overview of the SharePoint Framework
2. How can I list all document libraries under a site using REST API?

1.Use document library web part to show all the document libraries in the homepage.

2.Use quick links web part to list of all the document libraries in the homepage.