While Digital Watermarking has received much attention within the
academic community and private sector in recent years, it is still a
relatively young technology. As such there are few widely accepted
tools/metrics that can be used to validate the performance claims being
asserted by members of the research community. This lack of a
universally adopted set of metrics/methods has hindered research and
created confusion within the general public.
With the increased adoption of the technology into commercial and
military applications, not only are reliable metrics needed, but also
the ability to ascertain the applicability of certain techniques to
specific applications. To meet these goals we are developing a web-based
system that will allow users to evaluate the performance of watermarking
techniques. This system will consist of:
- Internationally recognized watermarking benchmarks
- Reference software, which allows one to “calibrate” new results: this
includes both watermark embedding methods and watermark detectors
- Attack scenarios
- Perceptual models
- Databases of a large number of images
The ultimate goal of this work is to develop a platform that one can
use to test the performance of watermarking methods and obtain fair,
reproducible, comparisons of the results. We feel that this work will
greatly stimulate new research in watermarking and data hiding by
allowing one to demonstrate how new techniques are moving forward the
state of the art. We call our system the Watermarking Evaluation Testbed
or WET.
Reference:
H. C. Kim, H. Ogunley, O. Guitart and E. J. Delp, "The Watermark Evaluation Testbed,"
Proceedings of the SPIE International Conference on Security and Watermarking of Multimedia Contents, P. W. Wong and E. J. Delp, Eds., January 2004. PDF file
H. C. Kim, E. T. Lin, O. Guitart and E. J. Delp, "Further Progress in Watermark Evaluation Testbed (WET),"
Proceedings of the SPIE International Conference on Security and Watermarking of Multimedia Contents, P. W. Wong and E. J. Delp, Eds., January 2005. PDF file
O. Guitart, H. C. Kim, and E. J. Delp, "The Watermark Evaluation Testbed (WET): New Functionalities,"
Proceedings of the SPIE International Conference on Security and Watermarking of Multimedia Contents, P. W. Wong and E. J. Delp, Eds., January 2006. PDF file
H. C. Kim, and E. J. Delp, "A Reliability Engineering Approach to Digital Watermark Evaluation,"
Proceedings of the SPIE International Conference on Security and Watermarking of Multimedia Contents, P. W. Wong and E. J. Delp, Eds., January 2006. PDF file