QueueLinker: A Framework for Parallel Distributed Data-Stream Processing

TL;DR: This research started as part of a big project led by Prof. Yamana, and the completion of this research would have been a far more difficult task without his help.

Abstract: Acknowledgements Firstly, I would like to express my immense gratitude toward my supervisor, Prof. research started as part of a big project led by him. Without the help and guidance of Prof. Yamana, the completion of this research would have been a far more difficult task. The state-of-the-art computer resources in our laboratory, which were essential for carrying out my research, are a result of his dedicated efforts. Prof. Yamana also encouraged me to give many conference presentations and conduct a variety of academic activities, and these gave me the opportunity to harness my skills and create personal connections. I would also like to express my gratitude to Prof. Y Yoichi Muraoka and Prof. University. I received a great deal of advice for this doctor thesis from them. Their deep knowledge of operating systems and parallel distributed computing led to enlightening discussions that helped me to better understand my subject. In addition, international conferences and business trips with them provided many valuable experiences of foreign societies. Dr. A Andrew Sohn, associate professor at the New Jersey Institute of Technology, gave much-appreciated advice for my research. In addition to him, my research career has been supported by many people outside Waseda University. Dr. H Hideyuki Kawashima, assistant professor at Tsukuba University, gave me a great deal of support and many academic opportunities. Drinking parties with him are always interesting. Science and Technology, provided many opportunities for my research career. A big project on distributed computing with him deeply affected my research. This experience with actual products provided me with great experience that could not have been achieved in my university. Moreover, the intern experience gave me an understanding of the importance of database systems. Here, I would also like to thank all of the members of Prof. Yamana's laboratory. ii In particular, I would like to thank Mr. K have graduated from the laboratory, and Mr. K Kou Satoh, who is currently my junior colleague. It would not have been possible to develop the Web crawler without their help. In addition, Mr. H Hiroaki Asai provided me with valuable Web data, including the Twitter streams that were indispensable in developing and testing my framework. Mr. Yusuke Yamamoto helped my research and managed the large number of servers. Mr. H Hiromasa Takei has a deep knowledge of mathematics, and discussions with him provided many interesting research ideas. I would also like to …