TL;DR: Wu et al. as discussed by the authors explored self-supervised learning on user-item graph, so as to improve the accuracy and robustness of graph convolutional networks for recommendation.
Abstract: Representation learning on user-item graph for recommendation has evolved from using single ID or interaction history to exploiting higher-order neighbors. This leads to the success of graph convolution networks (GCNs) for recommendation such as PinSage and LightGCN. Despite effectiveness, we argue that they suffer from two limitations: (1) high-degree nodes exert larger impact on the representation learning, deteriorating the recommendations of low-degree (long-tail) items; and (2) representations are vulnerable to noisy interactions, as the neighborhood aggregation scheme further enlarges the impact of observed edges. In this work, we explore self-supervised learning on user-item graph, so as to improve the accuracy and robustness of GCNs for recommendation. The idea is to supplement the classical supervised task of recommendation with an auxiliary self-supervised task, which reinforces node representation learning via self-discrimination. Specifically, we generate multiple views of a node, maximizing the agreement between different views of the same node compared to that of other nodes. We devise three operators to generate the views --- node dropout, edge dropout, and random walk --- that change the graph structure in different manners. We term this new learning paradigm asSelf-supervised Graph Learning (SGL), implementing it on the state-of-the-art model LightGCN. Through theoretical analyses, we find that SGL has the ability of automatically mining hard negatives. Empirical studies on three benchmark datasets demonstrate the effectiveness of SGL, which improves the recommendation accuracy, especially on long-tail items, and the robustness against interaction noises. Our implementations are available at \urlhttps://github.com/wujcan/SGL.
TL;DR: This paper proposes a novel graph contrastive representation learning method with adaptive augmentation that incorporates various priors for topological and semantic aspects of the graph that consistently outperforms existing state-of-the-art baselines and even surpasses some supervised counterparts.
Abstract: Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the agreement of representations in the two views. Despite the prosperous development of graph CL methods, the design of graph augmentation schemes—a crucial component in CL—remains rarely explored. We argue that the data augmentation schemes should preserve intrinsic structures and attributes of graphs, which will force the model to learn representations that are insensitive to perturbation on unimportant nodes and edges. However, most existing methods adopt uniform data augmentation schemes, like uniformly dropping edges and uniformly shuffling features, leading to suboptimal performance. In this paper, we propose a novel graph contrastive representation learning method with adaptive augmentation that incorporates various priors for topological and semantic aspects of the graph. Specifically, on the topology level, we design augmentation schemes based on node centrality measures to highlight important connective structures. On the node attribute level, we corrupt node features by adding more noise to unimportant node features, to enforce the model to recognize underlying semantic information. We perform extensive experiments of node classification on a variety of real-world datasets. Experimental results demonstrate that our proposed method consistently outperforms existing state-of-the-art baselines and even surpasses some supervised counterparts, which validates the effectiveness of the proposed contrastive framework with adaptive augmentation.
TL;DR: In this paper, an integrated space-to-ground quantum communication network that combines a large-scale fibre network of more than 700 QKD links and two high-speed satellite-toground free-space QKDs is presented.
Abstract: Quantum key distribution (QKD)1,2 has the potential to enable secure communication and information transfer3. In the laboratory, the feasibility of point-to-point QKD is evident from the early proof-of-concept demonstration in the laboratory over 32 centimetres4; this distance was later extended to the 100-kilometre scale5,6 with decoy-state QKD and more recently to the 500-kilometre scale7-10 with measurement-device-independent QKD. Several small-scale QKD networks have also been tested outside the laboratory11-14. However, a global QKD network requires a practically (not just theoretically) secure and reliable QKD network that can be used by a large number of users distributed over a wide area15. Quantum repeaters16,17 could in principle provide a viable option for such a global network, but they cannot be deployed using current technology18. Here we demonstrate an integrated space-to-ground quantum communication network that combines a large-scale fibre network of more than 700 fibre QKD links and two high-speed satellite-to-ground free-space QKD links. Using a trusted relay structure, the fibre network on the ground covers more than 2,000 kilometres, provides practical security against the imperfections of realistic devices, and maintains long-term reliability and stability. The satellite-to-ground QKD achieves an average secret-key rate of 47.8 kilobits per second for a typical satellite pass-more than 40 times higher than achieved previously. Moreover, its channel loss is comparable to that between a geostationary satellite and the ground, making the construction of more versatile and ultralong quantum links via geosynchronous satellites feasible. Finally, by integrating the fibre and free-space QKD links, the QKD network is extended to a remote node more than 2,600 kilometres away, enabling any user in the network to communicate with any other, up to a total distance of 4,600 kilometres.
TL;DR: In this article, a three-node entanglement-based quantum network is presented, which combines remote quantum nodes based on diamond communication qubits into a scalable phase-stabilized architecture, supplemented with a robust memory qubit and local quantum logic.
Abstract: The distribution of entangled states across the nodes of a future quantum internet will unlock fundamentally new technologies. Here, we report on the realization of a three-node entanglement-based quantum network. We combine remote quantum nodes based on diamond communication qubits into a scalable phase-stabilized architecture, supplemented with a robust memory qubit and local quantum logic. In addition, we achieve real-time communication and feed-forward gate operations across the network. We demonstrate two quantum network protocols without postselection: the distribution of genuine multipartite entangled states across the three nodes and entanglement swapping through an intermediary node. Our work establishes a key platform for exploring, testing, and developing multinode quantum network protocols and a quantum network control stack.
TL;DR: The Butterfly Optimization Algorithm (BOA) is employed to choose an optimal cluster head from a group of nodes and the outputs of the proposed methodology are compared with traditional approaches LEACH, DEEC and compared with some existing methods.
Abstract: Wireless Sensor Networks (WSNs) consist of a large number of spatially distributed sensor nodes connected through the wireless medium to monitor and record the physical information from the environment. The nodes of WSN are battery powered, so after a certain period it loose entire energy. This energy constraint affects the lifetime of the network. The objective of this study is to minimize the overall energy consumption and to maximize the network lifetime. At present, clustering and routing algorithms are widely used in WSNs to enhance the network lifetime. In this study, the Butterfly Optimization Algorithm (BOA) is employed to choose an optimal cluster head from a group of nodes. The cluster head selection is optimized by the residual energy of the nodes, distance to the neighbors, distance to the base station, node degree and node centrality. The route between the cluster head and the base station is identified by using Ant Colony Optimization (ACO), it selects the optimal route based on the distance, residual energy and node degree. The performance measures of this proposed methodology are analyzed in terms of alive nodes, dead nodes, energy consumption and data packets received by the BS. The outputs of the proposed methodology are compared with traditional approaches LEACH, DEEC and compared with some existing methods FUCHAR, CRHS, BERA, CPSO, ALOC and FLION. For example, the alive nodes of the proposed methodology are 200 at 1500 iterations which is higher compared to the CRHS and BERA methods.
TL;DR: In this article, a network embedding algorithm that captures information about a node from the local distribution over node attributes around it, as observed over random walks following an approach similar to Skip-gram is presented.
Abstract: We present network embedding algorithms that capture information about a node from the local distribution over node attributes around it, as observed over random walks following an approach similar to Skip-gram. Observations from neighborhoods of different sizes are either pooled (AE) or encoded distinctly in a multi-scale approach (MUSAE). Capturing attribute-neighborhood relationships over multiple scales is useful for a diverse range of applications, including latent feature identification across disconnected networks with similar attributes. We prove theoretically that matrices of node-feature pointwise mutual information are implicitly factorized by the embeddings. Experiments show that our algorithms are robust, computationally efficient and outperform comparable models on social networks and web graphs.
TL;DR: An optimal double-layer PBFT is proposed and it is proved that when the nodes are evenly distributed within the sub-groups in the second layer, the communication complexity is minimized and the security threshold is analyzed based on faulty probability determined (FPD) and faulty number determined models, respectively.
Abstract: Practical Byzantine Fault Tolerance (PBFT) consensus mechanism shows a great potential to break the performance bottleneck of the Proof-of-Work (PoW)-based blockchain systems, which typically support only dozens of transactions per second and require minutes to hours for transaction confirmation. However, due to frequent inter-node communications, PBFT mechanism has a poor node scalability and thus it is typically adopted in small networks. To enable PBFT in large systems such as massive Internet of Things (IoT) ecosystems and blockchain, in this article, a scalable multi-layer PBFT-based consensus mechanism is proposed by hierarchically grouping nodes into different layers and limiting the communication within the group. We first propose an optimal double-layer PBFT and show that the communication complexity is significantly reduced. Specifically, we prove that when the nodes are evenly distributed within the sub-groups in the second layer, the communication complexity is minimized. The security threshold is analyzed based on faulty probability determined (FPD) and faulty number determined (FND) models, respectively. We also provide a practical protocol for the proposed double-layer PBFT system. Finally, the results are extended to arbitrary-layer PBFT systems with communication complexity and security analysis. Simulation results verify the effectiveness of the analytical results.
TL;DR: This work combines remote quantum nodes based on diamond communication qubits into a scalable phase-stabilized architecture, supplemented with a robust memory qubit and local quantum logic and achieves real-time communication and feed-forward gate operations across the network.
Abstract: We report on the realization of a three-node entanglement-based quantum network. We combine remote quantum nodes based on diamond communication qubits into a scalable phase-stabilized architecture, supplemented with a robust memory qubit and local quantum logic. Also, we achieve real-time communication and feed-forward gate operations across the network. We demonstrate two key quantum network protocols without post-selection: the distribution of genuine multipartite entangled states across the three nodes and entanglement swapping through an intermediary node. Finally, we will discuss the most recent experiments using the network as a platform for exploring, testing, and developing multi-node quantum network protocols and a quantum network control stack.
TL;DR: “push–pull” is the first class of algorithms for distributed optimization over directed graphs for strongly convex and smooth objective functions over a network and outperform other existing linearly convergent schemes, especially for ill-conditioned problems and networks that are not well balanced.
Abstract: In this article, we focus on solving a distributed convex optimization problem in a network, where each agent has its own convex cost function and the goal is to minimize the sum of the agents’ cost functions while obeying the network connectivity structure. In order to minimize the sum of the cost functions, we consider new distributed gradient-based methods where each node maintains two estimates, namely an estimate of the optimal decision variable and an estimate of the gradient for the average of the agents’ objective functions. From the viewpoint of an agent, the information about the gradients is pushed to the neighbors, whereas the information about the decision variable is pulled from the neighbors, hence giving the name “push–pull gradient methods.” The methods utilize two different graphs for the information exchange among agents and, as such, unify the algorithms with different types of distributed architecture, including decentralized (peer to peer), centralized (master–slave), and semicentralized (leader–follower) architectures. We show that the proposed algorithms and their many variants converge linearly for strongly convex and smooth objective functions over a network (possibly with unidirectional data links) in both synchronous and asynchronous random-gossip settings. In particular, under the random-gossip setting, “push–pull” is the first class of algorithms for distributed optimization over directed graphs. Moreover, we numerically evaluate our proposed algorithms in both scenarios, and show that they outperform other existing linearly convergent schemes, especially for ill-conditioned problems and networks that are not well balanced.
TL;DR: In this article, a contrastive self-supervised learning framework for anomaly detection on attributed networks is proposed, which exploits the local information from network data by sampling a novel type of contrastive instance pair, which can capture the relationship between each node and its neighboring substructure.
Abstract: Anomaly detection on attributed networks attracts considerable research interests due to wide applications of attributed networks in modeling a wide range of complex systems. Recently, the deep learning-based anomaly detection methods have shown promising results over shallow approaches, especially on networks with high-dimensional attributes and complex structures. However, existing approaches, which employ graph autoencoder as their backbone, do not fully exploit the rich information of the network, resulting in suboptimal performance. Furthermore, these methods do not directly target anomaly detection in their learning objective and fail to scale to large networks due to the full graph training mechanism. To overcome these limitations, in this article, we present a novel Contrastive self-supervised Learning framework for Anomaly detection on attributed networks (CoLA for abbreviation). Our framework fully exploits the local information from network data by sampling a novel type of contrastive instance pair, which can capture the relationship between each node and its neighboring substructure in an unsupervised way. Meanwhile, a well-designed graph neural network (GNN)-based contrastive learning model is proposed to learn informative embedding from high-dimensional attributes and local structure and measure the agreement of each instance pairs with its outputted scores. The multiround predicted scores by the contrastive learning model are further used to evaluate the abnormality of each node with statistical estimation. In this way, the learning model is trained by a specific anomaly detection-aware target. Furthermore, since the input of the GNN module is batches of instance pairs instead of the full network, our framework can adapt to large networks flexibly. Experimental results show that our proposed framework outperforms the state-of-the-art baseline methods on all seven benchmark data sets.
TL;DR: A multibeam satellite IIoT in Ka-band is proposed to realize wide-area coverage and long-distance transmissions, which uses nonorthogonal multiple access (NOMA) for each beam to improve transmission rate.
Abstract: The traditional ground industrial Internet of Things (IIoT) cannot supply wireless interconnections anywhere due to its small-scale communication coverage. In this article, a multibeam satellite IIoT in Ka-band is proposed to realize wide-area coverage and long-distance transmissions, which uses nonorthogonal multiple access (NOMA) for each beam to improve transmission rate. To guarantee Quality of Service (QoS) for the satellite IIoT, the beam power is optimized to match the theoretical transmission rate with the service rate. The NOMA transmission rate for each beam is maximized by optimizing the power allocation proportion of each node subject to the constraints of the total power for the beam and the minimal transmission rate for each node within the beam. Satellite-ground integrated IIoT is proposed to use the ground cellular network to supplement the satellite coverage in the blocked areas. The power allocation and network selection for the integrated IIoT are proposed to decrease the transmission cost. Simulation results are provided to validate the superiority of employing NOMA in the satellite IIoT and show higher transmission performance for the QoS-guarantee resource allocation.
TL;DR: In this paper, the authors propose a novel framework, GraphSMOTE, in which an embedding space is constructed to encode the similarity among the nodes, and an edge generator is trained simultaneously to model the relation information, and provide it for new samples.
Abstract: Node classification is an important research topic in graph learning. Graph neural networks (GNNs) have achieved state-of-the-art performance of node classification. However, existing GNNs address the problem where node samples for different classes are balanced; while for many real-world scenarios, some classes may have much fewer instances than others. Directly training a GNN classifier in this case would under-represent samples from those minority classes and result in sub-optimal performance. Therefore, it is very important to develop GNNs for imbalanced node classification. However, the work on this is rather limited. Hence, we seek to extend previous imbalanced learning techniques for i.i.d data to the imbalanced node classification task to facilitate GNN classifiers. In particular, we choose to adopt synthetic minority over-sampling algorithms, as they are found to be the most effective and stable. This task is non-trivial, as previous synthetic minority over-sampling algorithms fail to provide relation information for newly synthesized samples, which is vital for learning on graphs. Moreover, node attributes are high-dimensional. Directly over-sampling in the original input domain could generates out-of-domain samples, which may impair the accuracy of the classifier. We propose a novel framework, GraphSMOTE, in which an embedding space is constructed to encode the similarity among the nodes. New samples are synthesize in this space to assure genuineness. In addition, an edge generator is trained simultaneously to model the relation information, and provide it for those new samples. This framework is general and can be easily extended into different variations. The proposed framework is evaluated using three different datasets, and it outperforms all baselines with a large margin.
TL;DR: Wang et al. as mentioned in this paper proposed a novel traffic prediction framework, named Dynamic Graph Convolutional Recurrent Network (DGCRN), where hyper-networks are designed to leverage and extract dynamic characteristics from node attributes, while the parameters of dynamic filters are generated at each time step.
Abstract: Traffic prediction is the cornerstone of an intelligent transportation system. Accurate traffic forecasting is essential for the applications of smart cities, i.e., intelligent traffic management and urban planning. Although various methods are proposed for spatio-temporal modeling, they ignore the dynamic characteristics of correlations among locations on road networks. Meanwhile, most Recurrent Neural Network (RNN) based works are not efficient enough due to their recurrent operations. Additionally, there is a severe lack of fair comparison among different methods on the same datasets. To address the above challenges, in this paper, we propose a novel traffic prediction framework, named Dynamic Graph Convolutional Recurrent Network (DGCRN). In DGCRN, hyper-networks are designed to leverage and extract dynamic characteristics from node attributes, while the parameters of dynamic filters are generated at each time step. We filter the node embeddings and then use them to generate a dynamic graph, which is integrated with a pre-defined static graph. As far as we know, we are the first to employ a generation method to model fine topology of dynamic graph at each time step. Further, to enhance efficiency and performance, we employ a training strategy for DGCRN by restricting the iteration number of decoder during forward and backward propagation. Finally, a reproducible standardized benchmark and a brand new representative traffic dataset are opened for fair comparison and further research. Extensive experiments on three datasets demonstrate that our model outperforms 15 baselines consistently.
TL;DR: The offloading decision-making problem is formulated as a multi-players computation offloading sequential game, and the UAV-assisted Vehicular computation Cost Optimization (UVCO) algorithm is designed to solve this problem.
Abstract: Vehicular computation offloading is a well-received strategy to execute delay-sensitive and/or compute-intensive tasks of legacy vehicles. The response time of vehicular computation offloading can be shortened by using mobile edge computing that offers strong computing power, driving these computation tasks closer to end users. However, the quality of communication is hard to guarantee due to the obstruction of dense buildings or lack of infrastructure in some zones. Unmanned Aerial Vehicles (UAVs), therefore, have become one of the means to establish communication links for the two ends owing to its characteristics of ignoring terrain and flexible deployment. To make a sensible decision of computation offloading, nevertheless vehicles need to gather offloading-related global information, in which Software-Defined Networking (SDN) has shown its advances in data collection and centralized management. In this paper, thus, we propose an SDN-enabled UAV-assisted vehicular computation offloading optimization framework to minimize the system cost of vehicle computing tasks. In our framework, the UAV and the Mobile Edge Computing (MEC) server can work on behalf of the vehicle users to execute the delay-sensitive and compute-intensive tasks. The UAV, in a meanwhile, can also be deployed as a relay node to assist in forwarding computation tasks to the MEC server. We formulate the offloading decision-making problem as a multi-players computation offloading sequential game, and design the UAV-assisted Vehicular computation Cost Optimization (UVCO) algorithm to solve this problem. Simulation results demonstrate that our proposed algorithm can make the offloading decision to minimize the Average System Cost (ASC).
TL;DR: In this paper, an embedding space is constructed to encode the similarity among the nodes, and an edge generator is trained simultaneously to model the relation information, and provide it for those new samples.
Abstract: Node classification is an important research topic in graph learning. Graph neural networks (GNNs) have achieved state-of-the-art performance of node classification. However, existing GNNs address the problem where node samples for different classes are balanced; while for many real-world scenarios, some classes may have much fewer instances than others. Directly training a GNN classifier in this case would under-represent samples from those minority classes and result in sub-optimal performance. Therefore, it is very important to develop GNNs for imbalanced node classification. However, the work on this is rather limited. Hence, we seek to extend previous imbalanced learning techniques for i.i.d data to the imbalanced node classification task to facilitate GNN classifiers. In particular, we choose to adopt synthetic minority over-sampling algorithms, as they are found to be the most effective and stable. This task is non-trivial, as previous synthetic minority over-sampling algorithms fail to provide relation information for newly synthesized samples, which is vital for learning on graphs. Moreover, node attributes are high-dimensional. Directly over-sampling in the original input domain could generates out-of-domain samples, which may impair the accuracy of the classifier. We propose a novel framework, \method, in which an embedding space is constructed to encode the similarity among the nodes. New samples are synthesize in this space to assure genuineness. In addition, an edge generator is trained simultaneously to model the relation information, and provide it for those new samples. This framework is general and can be easily extended into different variations. The proposed framework is evaluated using three different datasets, and it outperforms all baselines with a large margin.
TL;DR: This thesis addresses variants of the SVNE problem with different bandwidth and reliability requirements for transport networks through extensive simulations and proposes a connectivity-aware VNE approach that ensures VN connectivity without bandwidth guarantee in the face of multiple link failures.
Abstract: Network Virtualization (NV) is an enabling technology for the future Internet and next-generation communication networks. A fundamental problem in NV is to map the virtual nodes and virtual links of a VN to physical nodes and paths, respectively, known as the Virtual Network Embedding (VNE) problem. A VNE that can survive physical resource failures is known as the survivable VNE (SVNE) problem, and has received significant attention recently. In this thesis, we address variants of the SVNE problem with different bandwidth and reliability requirements for transport networks. Specifically, the thesis includes four main contributions. First, a connectivity-aware VNE approach that ensures VN connectivity without bandwidth guarantee in the face of multiple link failures. Second, a joint spare capacity allocation and VNE scheme that provides bandwidth guarantee against link failures by augmenting VNs with necessary spare capacity. Third, a generalized recovery mechanism to re-embed the VNs that are impacted by a physical node failure. Fourth, a reliable VNE scheme with dedicated protection that allows tuning of available bandwidth of a VN during a physical link failure. We show the effectiveness of the proposed SVNE schemes through extensive simulations.
TL;DR: In this article, a review of underwater routing protocols for UWSNs is presented, which classify the existing protocols into three categories: energy-based, data-based and geographic information-based protocols.
Abstract: Underwater wireless sensor network (UWSN) is currently a hot research field in academia and industry with many underwater applications, such as ocean monitoring, seismic monitoring, environment monitoring, and seabed exploration. However, UWSNs suffer from various limitations and challenges: high ocean interference and noise, high propagation delay, narrow bandwidth, dynamic network topology, and limited battery energy of sensor nodes. The design of routing protocols is one of the solutions to address these issues. A routing protocol can efficiently transfer the data from the source node to the destination node in the network. This article presents a review of underwater routing protocols for UWSNs. We classify the existing underwater routing protocols into three categories: energy-based, data-based, and geographic information-based protocols. In this article, we summarize the underwater routing protocols proposed in recent years. The proposed protocols are described in detail and give advantages and disadvantages. Meanwhile, the performance of different underwater routing protocols is analyzed in detail. Besides, we also present the research challenges and future directions of underwater routing protocols, which can help the researcher better explore in the future.
TL;DR: Zhang et al. as discussed by the authors proposed an end-to-end scale-aware graph neural network (SAGNN) by reasoning the cross-scale relations among the support-query images for few-shot semantic segmentation.
Abstract: Few-shot semantic segmentation (FSS) aims to segment unseen class objects given very few densely-annotated support images from the same class. Existing FSS methods find the query object by using support prototypes or by directly relying on heuristic multi-scale feature fusion. However, they fail to fully leverage the high-order appearance relationships between multi-scale features among the support-query image pairs, thus leading to an inaccurate localization of the query objects. To tackle the above challenge, we propose an end-to-end scale-aware graph neural network (SAGNN) by reasoning the cross-scale relations among the support-query images for FSS. Specifically, a scale-aware graph is first built by taking support-induced multi-scale query features as nodes and, meanwhile, each edge is modeled as the pairwise interaction of its connected nodes. By progressive message passing over this graph, SAGNN is capable of capturing cross-scale relations and overcoming object variations (e.g., appearance, scale and location), and can thus learn more precise node embeddings. This in turn enables it to predict more accurate foreground objects. Moreover, to make full use of the location relations across scales for the query image, a novel self-node collaboration mechanism is proposed to enrich the current node, which endows SAGNN the ability of perceiving different resolutions of the same objects. Extensive experiments on PASCAL-5i and COCO-20i show that SAGNN achieves state-of-the-art results.
TL;DR: Wang et al. as discussed by the authors proposed two-branch graph convolution to mix the receptive field subgraphs for the paired nodes, which effectively regularizes popular graph neural networks for better generalization without increasing their time complexity.
Abstract: Mixup is an advanced data augmentation method for training neural network based image classifiers, which interpolates both features and labels of a pair of images to produce synthetic samples. However, devising the Mixup methods for graph learning is challenging due to the irregularity and connectivity of graph data. In this paper, we propose the Mixup methods for two fundamental tasks in graph learning: node and graph classification. To interpolate the irregular graph topology, we propose the two-branch graph convolution to mix the receptive field subgraphs for the paired nodes. Mixup on different node pairs can interfere with the mixed features for each other due to the connectivity between nodes. To block this interference, we propose the two-stage Mixup framework, which uses each node’s neighbors’ representations before Mixup for graph convolutions. For graph classification, we interpolate complex and diverse graphs in the semantic space. Qualitatively, our Mixup methods enable GNNs to learn more discriminative features and reduce over-fitting. Quantitative results show that our method yields consistent gains in terms of test accuracy and F1-micro scores on standard datasets, for both node and graph classification. Overall, our method effectively regularizes popular graph neural networks for better generalization without increasing their time complexity.
TL;DR: A Deep Fusion Clustering Network (DFCN) is proposed, in which an interdependency learning-based Structure and Attribute Information Fusion (SAIF) module is proposed to explicitly merge the representations learned by an autoencoder and a graph autoen coder for consensus representation learning.
Abstract: Deep clustering is a fundamental yet challenging task for data analysis. Recently we witness a strong tendency of combining autoencoder and graph neural networks to exploit structure information for clustering performance enhancement. However, we observe that existing literature 1) lacks a dynamic fusion mechanism to selectively integrate and refine the information of graph structure and node attributes for consensus representation learning; 2) fails to extract information from both sides for robust target distribution (i.e., “groundtruth” soft labels) generation. To tackle the above issues, we propose a Deep Fusion Clustering Network (DFCN). Specifically, in our network, an interdependency learning-based Structure and Attribute Information Fusion (SAIF) module is proposed to explicitly merge the representations learned by an autoencoder and a graph autoencoder for consensus representation learning. Also, a reliable target distribution generation measure and a triplet self-supervision strategy, which facilitate cross-modality information exploitation, are designed for network training. Extensive experiments on six benchmark datasets have demonstrated that the proposed DFCN consistently outperforms the state-of-the-art deep clustering methods.
TL;DR: A blockchain-based authentication and key agreement protocol is designed for the multi-TA network model, moving the computing load of TA down to the RSU to improve the efficiency of authentication.
TL;DR: This paper proposes a novel Attention-based Periodic-Temporal neural Network (APTN), an end-to-end solution for traffic foresting that captures spatial, short-term, and long-term periodical dependencies.
Abstract: Accurate traffic forecasting is important to enable intelligent transportation systems in a smart city. This problem is challenging due to the complicated spatial, short-term temporal and long-term periodical dependencies. Existing approaches have considered these factors in modeling. Most solutions apply CNN, or its extension Graph Convolution Networks (GCN) to model the spatial correlation. However, the convolution operator may not adequately model the non-Euclidean pair-wise correlations. In this paper, we propose a novel Attention-based Periodic-Temporal neural Network (APTN), an end-to-end solution for traffic foresting that captures spatial, short-term, and long-term periodical dependencies. APTN first uses an encoder attention mechanism to model both the spatial and periodical dependencies. Our model can capture these dependencies more easily because every node attends to all other nodes in the network, which brings regularization effect to the model and avoids overfitting between nodes. Then, a temporal attention is applied to select relevant encoder hidden states across all time steps. We evaluate our proposed model using real world traffic datasets and observe consistent improvements over state-of-the-art baselines.
TL;DR: In this paper, the authors analyze the access performance, data transmission path delay, energy consumption in the NB-IoT, and large-scale devices' access in the cellular narrowband IoT based on big data analysis technology.
Abstract: The purposes are to enable large-scale Internet of Things (IoT) devices to analyze data more effectively and provide high-efficiency, low-energy, and wide-coverage technical services for terminals The channel model and energy loss model analyze the devices’ access performance, data transmission path delay, energy consumption in the IoT, and large-scale devices’ access in the cellular narrowband IoT (NB-IoT) based on big data analysis technology are also discussed The results show that in the access success rate analysis, the access success rate is the highest with an access time ( ${T}$ ) of 5 s and a preamble resource number ( ${K}$ ) of 25 The restriction factor is inversely proportional to the access success rate In the node utilization analysis, different transmission node priorities result in different node utilization, and priority 2’s node utilization is better than that of priority 1 Moreover, local data makes data analysis and transmission faster The search time is prolonged, and the corresponding energy consumption is also higher without local data In the energy consumption analysis, with the 6-generation (6G) technology, different interference thresholds lead to the different energy efficiency of data transmission The larger the interference threshold, the higher the energy efficiency Therefore, the 6G-based big data analysis technology can significantly improve large-scale IoT devices’ access success rate and enable the system to meet the requirements of low energy consumption and high access success rate, significant for research on more devices’ access data analysis
TL;DR: A survey of dynamic network embedding can be found in this paper, where the authors inspect the data model, representation learning technique, evaluation and application of current related works and derive common patterns from them.
TL;DR: This paper presents a methodology of an energy-efficient clustering algorithm for collecting and transmitting data based on the Optimized Low-Energy Adaptive Clustering Hierarchy (LEACH) protocol, and the network’s lifetime is enhanced as it also maximizes the residual energy of nodes.
Abstract: A Flying Ad-hoc network constitutes many sensor nodes with limited processing speed and storage capacity as they institute a minor battery-driven device with a limited quantity of energy. One of the primary roles of the sensor node is to store and transmit the collected information to the base station (BS). Thus, the life span of the network is the main criterion for the efficient design of the FANETS Network, as sensor nodes always have limited resources. In this paper, we present a methodology of an energy-efficient clustering algorithm for collecting and transmitting data based on the Optimized Low-Energy Adaptive Clustering Hierarchy (LEACH) protocol. The selection of CH is grounded on the new optimized threshold function. In contrast, LEACH is a hierarchical routing protocol that randomly selects cluster head nodes in a loop and results in an increased cluster headcount, but also causes more rapid power consumption. Thus, we have to circumvent these limitations by improving the LEACH Protocol. Our proposed algorithm diminishes the energy usage for data transmission in the routing protocol, and the network’s lifetime is enhanced as it also maximizes the residual energy of nodes. The experimental results performed on MATLAB yield better performance than the existing LEACH and Centralized Low-Energy Adaptive Clustering Hierarchy Protocol in terms of energy efficiency per unit node and the packet delivery ratio with less energy utilization. In addition, the First Node Death (FND) is also meliorated when compared to the LEACH and LEACH-C protocols.
TL;DR: A novel multi-view attributed graph clustering framework, which exploits both node attributes and graphs, and instead of deep neural networks, applies a graph filtering technique to achieve a smooth node representation.
Abstract: Multi-view graph clustering has been intensively investigated during the past years. However, existing methods are still limited in two main aspects. On the one hand, most of them can not deal with data that have both attributes and graphs. Nowadays, multi-view attributed graph data are ubiquitous and the need for effective clustering methods is growing. On the other hand, many state-of-the-art algorithms are either shallow or deep models. Shallow methods may seriously restrict their capacity for modeling complex data, while deep approaches often involve large number of parameters and are expensive to train in terms of running time and space needed. In this paper, we propose a novel multi-view attributed graph clustering (MAGC) framework, which exploits both node attributes and graphs. Our novelty lies in three aspects. First, instead of deep neural networks, we apply a graph filtering technique to achieve a smooth node representation. Second, the original graph could be noisy or incomplete and is not directly applicable, thus we learn a consensus graph from data by considering the heterogeneous views. Third, high-order relations are explored in a flexible way by designing a new regularizer. Extensive experiments demonstrate the superiority of our method in terms of effectiveness and efficiency.
TL;DR: A dynamic optimization scheme for the IoT fog computing system with multiple mobile devices (MDs), where the radio and computational resources, and offloading decisions, can be dynamically coordinated and allocated with the variation of radio resources and computation demands is proposed.
Abstract: Fog computing system is able to facilitate computation-intensive applications and emerges as one of the promising technology for realizing the Internet of Things (IoT). By offloading the computational tasks to the fog node (FN) at the network edge, both the service latency and energy consumption can be improved, which is significant for industrial IoT applications. However, the dynamics of computational resource usages in the FN, the radio environment and the energy in the battery of IoT devices make the offloading mechanism design become challenging. Therefore, in this article, we propose a dynamic optimization scheme for the IoT fog computing system with multiple mobile devices (MDs), where the radio and computational resources, and offloading decisions, can be dynamically coordinated and allocated with the variation of radio resources and computation demands. Specifically, with the objective to minimize the system cost related to latency, energy consumption, and weights of MDs, we propose a joint computation offloading and radio resource allocation algorithm based on Lyapunov optimization. Through minimizing the derived upper bound of the Lyapunov drift-plus-penalty function, we divide the main problem into several subproblems at each time slot and address them accordingly. Through performance evaluation, the effectiveness of the proposed scheme can be verified.
TL;DR: The proposed ODSD framework has exceptional benefits for real-time applications while maintaining the security of the dynamic storage of data.
Abstract: The Industry 4.0 IoT network integration with blockchain architecture is a decentralized, distributed ledger mechanism used to record multi-user transactions. Blockchain requires a data storage system designed to be secure, reliable, and fully transparent, emerged as a preferred IoT-based digital storage on WSN. Blockchain technology is being used in the paper to construct the node recognition system according to the storage of data for WSNs. The data storage process on such data must be secure and traceable in different forensics and decision making. The primary theme of the dynamic data security is therefore for rejecting exploitation of the unauthorized user and for evaluating the mechanism in tracing and evidence of system’s data operation in a dynamic manner, growth and quality features under the stochastic state of the model; (1) a mathematical method for the secured storage of data in dynamic is built through distributed node cooperation in IoT industry. (2) the ownership transition feature and the dynamic storage of data system architecture are configured, (3) the emerging distributed storage architecture for blockchain-based WSN will substantially reduce overhead storage for each node without affecting data integrity; (4) minimize the latency of data reconstruction in distributed over storage system, and propose an effective and scalable algorithm for optimizing storage latency issue. In addition to this research, the system implements verified possession of data for replacing the evidence in original digital currency for mining and to store new data blocks that will be compared to the proof system, dramatically reduces computational capacity. The proposed ODSD framework has exceptional benefits for real-time applications while maintaining the security of the dynamic storage of data.
TL;DR: PolyShard as mentioned in this paper is a coded storage and computation protocol for blockchains, which achieves information-theoretic upper bounds on the efficiency of the storage, system throughput, as well as on trust.
Abstract: Today’s blockchain designs suffer from a trilemma claiming that no blockchain system can simultaneously achieve decentralization, security, and performance scalability. For current blockchain systems, as more nodes join the network, the efficiency of the system (computation, communication, and storage) stays constant at best. A leading idea for enabling blockchains to scale efficiency is the notion of sharding: different subsets of nodes handle different portions of the blockchain, thereby reducing the load for each individual node. However, existing sharding proposals achieve efficiency scaling by compromising on trust - corrupting the nodes in a given shard will lead to the permanent loss of the corresponding portion of data. In this paper, we settle the trilemma by demonstrating a new protocol for coded storage and computation in blockchains. In particular, we propose PolyShard : “polynomially coded sharding” scheme that achieves information-theoretic upper bounds on the efficiency of the storage, system throughput, as well as on trust, thus enabling a truly scalable system. We provide simulation results that numerically demonstrate the performance improvement over state of the arts, and the scalability of the PolyShard system. Finally, we discuss potential enhancements, and highlight practical considerations in building such a system.
TL;DR: This paper proposes a novel approach for Android malware detection and familial classification based on the Graph Convolutional Network (GCN), and is the first study to explore the application of graph neural network in the field of malware classification.