-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MySQL Performance Degredation #2845
Comments
Do you tried to revert the modifications of config file to check if it change something? Which Mysql version was installed for Round 14? |
@raziel057 Thanks for checking in here. The config file has been the same for quite some time. The only difference was what mysql-server version was available in apt. It was only a patch version update from We've moved to |
If you have the same result (degradation compared to Round 14) by reverting the Mysql version, we can estimate the problem doesn't comes from Mysql no? Maybe related to the server itself? It's a bit difficult to help... |
@raziel057 It's a bit difficult to solve too. If it were related to the DB server itself you would likely see the degradation across the board. MongoDB, PostgreSQL are both fine. It's quite the mystery. Nonetheless, we're moving forward with MySQL 5.7 and will work on tweaking the conf. Some spot tests actually show an uptick in the Updates test. We'll be releasing numbers (assuming the current run finishes without issue) around Monday. |
@nbrady-techempower @raziel057 Some frameworks with impressive boost in the
Some frameworks with quite serious loses in the
You can see that all major languages and frameworks get the gain. The heavy updates case is roughly on par with PostgreSQL results - just check some of the frameworks that are using both databases. Seems like a big achievement for the MySQL development team. Data taken from here: https://www.techempower.com/benchmarks/previews/round15/r14-vs-r15p1.html IMO I've found a clue about for the lower performance in the other cases. Open http://tfb-logs.techempower.com/round-15/preview-1/dropwizard/out.txt and scroll to the end:
It seems something have changed in the interaction between the JDBC driver at least and the MySQL server - the connections are using |
@zloster I saw the same thing in some of the other frameworks. This seems like the issue. I will look in to updating the connection strings this week or pinging the fw contributors. Thanks for posting such detail! |
@zloster @nbrady-techempower Wicket is using FrameworkBenchmarks/frameworks/Java/wicket/src/main/java/hellowicket/WicketApplication.java Line 82 in 7f5bbb8
|
@martin-g yes, I imagine this isn't the only reason. Also has a new config file. |
@nbrady-techempower There is a typo in your mention of @martin-g
All of the above conditions at the same time. Wicket results doesn't meet the above criteria. |
Thank you, @zloster ! I am watching this project so even without mentioning me I still read all (JVM related) discussions ;-) |
Maybe, query_cache is disabled by default from MySQL 5.6. |
https://dev.mysql.com/doc/refman/5.6/en/server-system-variables.html#sysvar_query_cache_type It seems @methane have nailed it. I haven't done extensive research but from a quick look it seems the reasoning is exactly what methane mentioned - very bad effects on concurrent update workload (on big machines). More details here: |
MySQL 5.7 is slower too by this other benchmark: https://mariadb.org/maria-10-1-mysql-5-7-commodity-hardware/ Also send #3261 to disable performance schema |
As we work on getting you guys some preview data for Round 15, we've noticed a significant performance decrease for MySQL. After monitoring the Database server, there have been no real changes between Round 14 and Round 15. We've made a few slight modifications to the conf file which you can see here: https://github.com/TechEmpower/FrameworkBenchmarks/blob/master/toolset/setup/linux/databases/mysql/my.cnf
Another change was the currently supported version of MySQL Server in the
apt
repository is now5.5.55
https://dev.mysql.com/doc/relnotes/mysql/5.5/en/news-5-5-55.htmlMost frameworks that have MySQL tests are seeing a whopping 20% to 50% decrease in RPS from Round 14 final.
The text was updated successfully, but these errors were encountered: