论文标题

通过变质测试测试海洋软件

Testing Ocean Software with Metamorphic Testing

论文作者

Luu, Quang-Hung, Liu, Huai, Chen, Tsong Yueh, Vu, Hai L.

论文摘要

前进的海洋科学对世界的发展有重大影响,从为船只运行安全导航到维持健康多样的海洋生态系统。各种海洋软件系统已被广泛用于不同的目的,例如,预测跨海岸线的小时海平面海拔,模拟大型海洋循环,并将其整合到地球系统模型中以进行天气预测和气候预测。无论其重要性如何,保证海洋软件和建模系统的可信度是一个长期的挑战。海洋软件的测试遭受了所谓的甲骨文问题的损失,这是指缺乏测试甲骨文,这主要是由于多个物理变量的非线性相互作用以及计算中的高复杂性。在海洋中,观察到的潮汐信号被非确定性的物理变量扭曲,阻碍了我们知道时间表中存在的“真实”天文潮汐成分。在本文中,我们介绍了如何基于变质测试(MT)测试潮汐分析和预测(TAP)软件,这是甲骨文问题的一种简单但有效的测试方法。特别是,我们从天文浪潮的周期性属性中构建了变质关系,然后使用它们成功地检测出开源TAP软件中的现实缺陷。我们还进行了一系列实验,以进一步证明MT在TAP软件测试中的适用性和有效性。我们的研究不仅证明了MT在测试更复杂的海洋软件和建模系统中的潜力,而且可以扩展以评估和提高更广泛的科学模拟软件系统的质量。

Advancing ocean science has a significant impact to the development of the world, from operating a safe navigation for vessels to maintaining a healthy and diverse ocean ecosystem. Various ocean software systems have been extensively adopted for different purposes, for instance, predicting hourly sea level elevation across shorelines, simulating large-scale ocean circulations, as well as integrating into Earth system models for weather forecasts and climate projections. Regardless of their significance, guaranteeing the trustworthiness of ocean software and modelling systems is a long-standing challenge. The testing of ocean software suffers a lot from the so-called oracle problem, which refers to the absence of test oracles mainly due to the nonlinear interactions of multiple physical variables and the high complexity in computation. In the ocean, observed tidal signals are distorted by non-deterministic physical variables, hindering us from knowing the "true" astronomical tidal constituents existing in the timeseries. In this paper, we present how to test tidal analysis and prediction (TAP) software based on metamorphic testing (MT), a simple yet effective testing approach to the oracle problem. In particular, we construct metamorphic relations from the periodic property of astronomical tide, and then use them to successfully detect a real-life defect in an open-source TAP software. We also conduct a series of experiments to further demonstrate the applicability and effectiveness of MT in the testing of TAP software. Our study not only justifies the potential of MT in testing more complex ocean software and modelling systems, but also can be expanded to assess and improve the quality of a broader range of scientific simulation software systems.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源