SPARQL Query Benchmarker is an API and command line utility that can be used to run configurable automated benchmarks with detailed performance reporting on an arbitrary SPARQL endpoint.
This tool was developed while working for YarcData™ (a Cray Inc. company) and was open sourced in July 2012. I presented this tool at SemTech 2012 with slides available on SlideShare.
In 2014 it received a significant rewrite to make it a flexible automated SPARQL testing framework and this work was presented at SemTech 2014 with slides available on SlideShare.
Source Code for the benchmarker may be obtained from the GitHub repository.