Performance comparison between ed25519 vs AES

You're comparing a signature scheme (ed25519) for integrity / authenticity with an encryption scheme (hybrid RSA / AES) giving you confidentiality. As such, the comparison makes very little sense.

If you want to speed up encryption then you could replace RSA encryption of the key with ECIES, for instance using X25519 as key agreement scheme for Curve25519. You would still need the AES encryption as ECIES is really just Diffie-Hellman key agreement: the actual encryption still needs to be performed using a symmetric cipher. You can choose any symmetric cipher for that, but on most modern computers AES is pretty fast. There are however stream ciphers such as ChaCha20 that are extremely fast where hardware AES acceleration is not available.

Obviously then, the above scheme will only remove the slowdown of the RSA (un)wrapping of the AES key. No asymmetric scheme is likely to be faster than AES.

If you go for the curve with stream cipher approach you might as well use one of the NaCL compatible libraries. Another advantage of doing that is that you will get a lot of low level security and performance for free (assuming you manage to choose a secure & fast implementation).