tree 68ec27e483d33bb52badb662b3312282616d3a72
parent 1258407c672bb26f00f279b732072e6fd5abf51e
author RickyMa <rickyma@tencent.com> 1708684041 +0800
committer GitHub <noreply@github.com> 1708684041 +0800
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsFcBAABCAAQBQJl2HMJCRC1aQ7uu5UhlAAAI4kQAD9orIRbn/F009mtX0BuhRy+
 8ha3nzplhiYK1GKaNMiWwnXKAeqkNqyYH5/YKEbt7xwf3hwh9wLNCYnJNH1U/COA
 RPsAtKFKhJchqSYYIkPv3vC/ngL1CUFHMDM48JeMtK5WZx91Z1HRhe1idF1EY64f
 pJ4FBrwGeZGGw73tiCQbCE9Fu9e5SSIAivf7P+IF97O5OKdTrCLm2I/eaAwcWfdM
 KntkKD/62RgF4hqNNeEo2PW/sTNe7XqobB6iwxJnF2ZBJ+ctbuzJ1DQVZVW1m3N+
 pYqFCwjvtX/gjdgVQYgvkeDwDdsEb6a1SusORrk+hQ4YrlcncxBzHcRHZj2vS8aF
 2/IJV//fC8ZYJGh5UGNB8QUMP4iLMxjaCPrXm8hWPPwfoZ2jBVrf7CZGIT8jF68/
 8jOFgRfeTPwZOGm8VFOVzxD8VB6cc+83a4FNOEMCCDCnV1EHSX6maGjUh1ViywXo
 OZpgu9eNFRmTykJq/SpZ2v88hHXo6TtiFI/gk1Rb7CJETfG4TgLAny4EyvWA/uRj
 fGq37M2jES68rOB7f9xCaIx4lYkHYp3wlV4NsZWBJTObYzTOhefpCJv8QYokhK89
 DJZ/Pxg5W7BbK29zqI+LWq9mUT9EdTJOs6TfaVppH/CcahhlHfIgwvwNGkmwTh2I
 1e6q1QTuYKaQe6sT6z1x
 =ZuZa
 -----END PGP SIGNATURE-----
 

[#1472][part-5] Use UnpooledByteBufAllocator to fix inaccurate usedMemory issue causing OOM (#1534)

### What changes were proposed in this pull request?

When we use `UnpooledByteBufAllocator` to allocate off-heap `ByteBuf`, Netty directly requests off-heap memory from the operating system instead of allocating it according to `pageSize` and `chunkSize`. This way, we can obtain the exact `ByteBuf` size during the pre-allocation of memory, avoiding distortion of metrics such as `usedMemory`. 

Moreover, we have restored the code submission of the PR [#1521](https://github.com/apache/incubator-uniffle/pull/1521). We ensure that there is sufficient direct memory for the Netty server during decoding `sendShuffleDataRequest` by taking into account the `encodedLength` of `ByteBuf` in advance during the pre-allocation of memory, thus avoiding OOM during decoding `sendShuffleDataRequest`. 

Since we are not using `PooledByteBufAllocator`, the PR [#1524](https://github.com/apache/incubator-uniffle/pull/1524) is no longer needed.

### Why are the changes needed?

A sub PR for: https://github.com/apache/incubator-uniffle/pull/1519

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Existing UTs.