Introduction
In the last two posts of this series, we enhanced GraphicsMagick (GM hereafter) to support interactive or batch mode, and we developed the Java library, gm4java, to integrate with GM. Now it’s time to give it a run!
Application
This is the same web application that we tested the performance of sole im4java implementation. And we also use identical test environment and test setup for an apple to apple comparison. For the completeness, I’ll repeat the test application, environment and setup here.
The web application dynamically resize the source images that is 700x700 or less to a smaller dimension. An HTTP request come in with the individual image and the target size specified, the web application locates the source image and resize it to the target size, then streams the image back to the requester, typically a browser.
The application still use the same GM’s convert command, “convert <source> –scale <width>x<height> <target>”, to scale down an image. The difference this time is that, instead of completely depending on im4java, we use gm4java to start 32 GM processes in interactive mode, they are pooled by gm4java to executed the convert commands coming in. That effectively eliminates the overhead of starting, and then shutting down, a new GM process for every request.
In order to avoid problems caused by any potential memory leak, each GM process was recycled after 1000 execution of commands. (Info: we have also tested with recycling disabled, that improved the performance by 1-2% and we also did not observe any memory leakage. But in the end we decided to keep the recycling enabled)
Test Environment
We also use exact same test environment that we tested the im4java integration. Again, repeated below:
Hardware
RAM: 32GB
CPU: 32 cores - 4 AMD Opteron(TM) Processor 6274 (8 cores)
Test Tool
JMeter is used to execute the test. The machine runs the JMeter has identical hardware as the test machine. There is high speed network connection between them and we have confirmed that there is no other factor being bottleneck.
Test Setup
We used 200K unique sample image and each image are being request twice, one converts to 260x420 and another converts to 114x166.
On thread group is used to run multiple threads in parallel. Each thread represent one concurrent user. We run the test multiple times, with different number of concurrent users. Each thread will request image one after another, there is no delay whatsoever.
We measure the throughput in terms of total number of images resized within a second by the server.
Test Result
Table below listed the total throughput under different load, side by side with the test result from our im4java implementation test.
| Concurrent users | Total Throughput (images/second) | |
|---|---|---|
| im4java | gm4java | |
| 50 | 278 | Didn’t test |
| 500 | 109 | 1447 |
| 5000 | 19 | 1490 |
| 20000 | 4 | 1452 |
The throughput is significantly higher comparing to the im4java implementation, and it stays high under high load as expected.
Disclaimer:this is NOT an comparison between im4java and gm4java, it is a comparison between the traditional integration mechanism im4java uses to integrate with GM, and the new interactive mechanism that is implemented by gm4java. gm4java does not compete with im4java, rather they complement each other.
Conclusion
The test result proves that using gm4java and GM’s new interactive/batch mode feature can provide a reliable and scalable mean to integrate Java and GM. We have successfully implemented our proposed solution, and concluded that is the solution we need.
Other Posts in the “Integrate Java and GraphicsMagick” Series
- Conception
- im4java Performance
- Interactive or Batch Mode
- gm4java
- gm4java Performance
