论文标题

时间戳令牌:用于数据处理系统的更好的协调原始

Timestamp tokens: a better coordination primitive for data-processing systems

论文作者

Lattuada, Andrea, McSherry, Frank

论文摘要

分布式数据处理系统通过模型进行了进步,这些模型在计算中揭示了越来越多的并发机会。这些日益复杂的模型的调度已成为改善吞吐量和减少延迟的瓶颈。 我们提出了一个针对数据流系统的新协调原始的时间戳令牌,该系统将计算和主机系统之间共享的信息量最小化,而无需交出有关并发的精确度。现在有几个项目使用了时间戳令牌,并且能够探索在其他平台中无法轻易表达的计算习惯。重要的是,这些项目不需要设计和实施整个系统来支持其研究。

Distributed data processing systems have advanced through models that expose more and more opportunities for concurrency within a computation. The scheduling of these increasingly sophisticated models has become the bottleneck for improved throughput and reduced latency. We present a new coordination primitive for dataflow systems, the timestamp token, which minimizes the volume of information shared between the computation and host system, without surrendering precision about concurrency. Several projects have now used timestamp tokens, and were able to explore computational idioms that could not be expressed easily, if at all, in other platforms. Importantly, these projects did not need to design and implement whole systems to support their research.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源