Sign in to use this feature.

Years

Between: -

Article Types

Countries / Regions

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Search Results (11,274)

Search Parameters:
Journal = Entropy

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
Review
Overview of Tensor-Based Cooperative MIMO Communication Systems—Part 1: Tensor Modeling
Entropy 2023, 25(8), 1181; https://doi.org/10.3390/e25081181 - 08 Aug 2023
Abstract
Due to increasingly strong and varied performance requirements, cooperative wireless communication systems today occupy a prominent place in both academic research and industrial development. The technological and economic challenges for future sixth-generation (6G) wireless systems are considerable, with the objectives of improving coverage, [...] Read more.
Due to increasingly strong and varied performance requirements, cooperative wireless communication systems today occupy a prominent place in both academic research and industrial development. The technological and economic challenges for future sixth-generation (6G) wireless systems are considerable, with the objectives of improving coverage, data rate, latency, reliability, mobile connectivity and energy efficiency. Over the past decade, new technologies have emerged, such as massive multiple-input multiple-output (MIMO) relay systems, intelligent reflecting surfaces (IRS), unmanned aerial vehicular (UAV)-assisted communications, dual-polarized (DP) antenna arrays, three dimensional (3D) polarized channel modeling, and millimeter-wave (mmW) communication. Full article
(This article belongs to the Special Issue Wireless Networks: Information Theoretic Perspectives III)
Article
Capacity-Achieving Input Distributions of Additive Vector Gaussian Noise Channels: Even-Moment Constraints and Unbounded or Compact Support
Entropy 2023, 25(8), 1180; https://doi.org/10.3390/e25081180 - 08 Aug 2023
Viewed by 78
Abstract
We investigate the support of a capacity-achieving input to a vector-valued Gaussian noise channel. The input is subjected to a radial even-moment constraint and is either allowed to take any value in Rn or is restricted to a given compact subset of [...] Read more.
We investigate the support of a capacity-achieving input to a vector-valued Gaussian noise channel. The input is subjected to a radial even-moment constraint and is either allowed to take any value in Rn or is restricted to a given compact subset of Rn. It is shown that the support of the capacity-achieving distribution is composed of a countable union of submanifolds, each with a dimension of n1 or less. When the input is restricted to a compact subset of Rn, this union is finite. Finally, the support of the capacity-achieving distribution is shown to have Lebesgue measure 0 and to be nowhere dense in Rn. Full article
(This article belongs to the Special Issue Shannon Entropy: Mathematical View)
Article
A Transverse Hamiltonian Approach to Infinitesimal Perturbation Analysis of Quantum Stochastic Systems
Entropy 2023, 25(8), 1179; https://doi.org/10.3390/e25081179 - 08 Aug 2023
Viewed by 108
Abstract
This paper is concerned with variational methods for open quantum systems with Markovian dynamics governed by Hudson–Parthasarathy quantum stochastic differential equations. These QSDEs are driven by quantum Wiener processes of the external bosonic fields and are specified by the system Hamiltonian and system–field [...] Read more.
This paper is concerned with variational methods for open quantum systems with Markovian dynamics governed by Hudson–Parthasarathy quantum stochastic differential equations. These QSDEs are driven by quantum Wiener processes of the external bosonic fields and are specified by the system Hamiltonian and system–field coupling operators. We consider the system response to perturbations in these operators and introduce a transverse Hamiltonian which encodes the propagation of the perturbations through the unitary system–field evolution. This approach provides an infinitesimal perturbation analysis tool which can be used for the development of optimality conditions in quantum control and filtering problems. As performance criteria, such settings employ quadratic (or more complicated) cost functionals of the system and field variables to be minimized over the energy and coupling parameters of system interconnections. We demonstrate an application of the transverse Hamiltonian variational approach to a mean square optimal coherent quantum filtering problem for a measurement-free field-mediated cascade connection of a quantum system with a quantum observer. Full article
(This article belongs to the Special Issue Quantum Probability and Randomness IV)
Show Figures

Figure 1

Article
An Image Encryption Algorithm Based on Improved Hilbert Curve Scrambling and Dynamic DNA Coding
Entropy 2023, 25(8), 1178; https://doi.org/10.3390/e25081178 - 08 Aug 2023
Viewed by 119
Abstract
As an effective method for image security protection, image encryption is widely used in data hiding and content protection. This paper proposes an image encryption algorithm based on an improved Hilbert curve with DNA coding. Firstly, the discrete wavelet transform (DWT) decomposes the [...] Read more.
As an effective method for image security protection, image encryption is widely used in data hiding and content protection. This paper proposes an image encryption algorithm based on an improved Hilbert curve with DNA coding. Firstly, the discrete wavelet transform (DWT) decomposes the plaintext image by three-level DWT to obtain the high-frequency and low-frequency components. Secondly, different modes of the Hilbert curve are selected to scramble the high-frequency and low-frequency components. Then, the high-frequency and low-frequency components are reconstructed separately using the inverse discrete wavelet transform (IDWT). Then, the bit matrix of the image pixels is scrambled, changing the pixel value while changing the pixel position and weakening the strong correlation between adjacent pixels to a more significant correlation. Finally, combining dynamic DNA coding and ciphertext feedback to diffuse the pixel values improves the encryption effect. The encryption algorithm performs the scrambling and diffusion in alternating transformations of space, frequency, and spatial domains, breaking the limitations of conventional scrambling. The experimental simulation results and security analysis show that the encryption algorithm can effectively resist statistical attacks and differential attacks with good security and robustness. Full article
(This article belongs to the Special Issue Image Encryption and Privacy Protection Based on Chaotic Systems)
Show Figures

Figure 1

Article
Enhancing Image Quality via Robust Noise Filtering Using Redescending M-Estimators
Entropy 2023, 25(8), 1176; https://doi.org/10.3390/e25081176 - 07 Aug 2023
Viewed by 204
Abstract
In the field of image processing, noise represents an unwanted component that can occur during signal acquisition, transmission, and storage. In this paper, we introduce an efficient method that incorporates redescending M-estimators within the framework of Wiener estimation. The proposed approach effectively suppresses [...] Read more.
In the field of image processing, noise represents an unwanted component that can occur during signal acquisition, transmission, and storage. In this paper, we introduce an efficient method that incorporates redescending M-estimators within the framework of Wiener estimation. The proposed approach effectively suppresses impulsive, additive, and multiplicative noise across varied densities. Our proposed filter operates on both grayscale and color images; it uses local information obtained from the Wiener filter and robust outlier rejection based on Insha and Hampel’s tripartite redescending influence functions. The effectiveness of the proposed method is verified through qualitative and quantitative results, using metrics such as PSNR, MAE, and SSIM. Full article
(This article belongs to the Special Issue Pattern Recognition and Data Clustering in Information Theory)
Show Figures

Figure 1

Communication
Geometric Insights into the Multivariate Gaussian Distribution and Its Entropy and Mutual Information
Entropy 2023, 25(8), 1177; https://doi.org/10.3390/e25081177 - 07 Aug 2023
Viewed by 196
Abstract
In this paper, we provide geometric insights with visualization into the multivariate Gaussian distribution and its entropy and mutual information. In order to develop the multivariate Gaussian distribution with entropy and mutual information, several significant methodologies are presented through the discussion, supported by [...] Read more.
In this paper, we provide geometric insights with visualization into the multivariate Gaussian distribution and its entropy and mutual information. In order to develop the multivariate Gaussian distribution with entropy and mutual information, several significant methodologies are presented through the discussion, supported by illustrations, both technically and statistically. The paper examines broad measurements of structure for the Gaussian distributions, which show that they can be described in terms of the information theory between the given covariance matrix and correlated random variables (in terms of relative entropy). The content obtained allows readers to better perceive concepts, comprehend techniques, and properly execute software programs for future study on the topic’s science and implementations. It also helps readers grasp the themes’ fundamental concepts to study the application of multivariate sets of data in Gaussian distribution. The simulation results also convey the behavior of different elliptical interpretations based on the multivariate Gaussian distribution with entropy for real-world applications in our daily lives, including information coding, nonlinear signal detection, etc. Involving the relative entropy and mutual information as well as the potential correlated covariance analysis, a wide range of information is addressed, including basic application concerns as well as clinical diagnostics to detect the multi-disease effects. Full article
(This article belongs to the Special Issue Entropy and Organization in Natural and Social Systems)
Show Figures

Figure 1

Article
Ensemble Improved Permutation Entropy: A New Approach for Time Series Analysis
Entropy 2023, 25(8), 1175; https://doi.org/10.3390/e25081175 - 07 Aug 2023
Viewed by 171
Abstract
Entropy quantification approaches have gained considerable attention in engineering applications. However, certain limitations persist, including the strong dependence on parameter selection, limited discriminating power, and low robustness to noise. To alleviate these issues, this paper introduces two novel algorithms for time series analysis: [...] Read more.
Entropy quantification approaches have gained considerable attention in engineering applications. However, certain limitations persist, including the strong dependence on parameter selection, limited discriminating power, and low robustness to noise. To alleviate these issues, this paper introduces two novel algorithms for time series analysis: the ensemble improved permutation entropy (EIPE) and multiscale EIPE (MEIPE). Our approaches employ a new symbolization process that considers both permutation relations and amplitude information. Additionally, the ensemble technique is utilized to reduce the dependence on parameter selection. We performed a comprehensive evaluation of the proposed methods using various synthetic and experimental signals. The results illustrate that EIPE is capable of distinguishing white, pink, and brown noise with a smaller number of samples compared to traditional entropy algorithms. Furthermore, EIPE displays the potential to discriminate between regular and non-regular dynamics. Notably, when compared to permutation entropy, weighted permutation entropy, and dispersion entropy, EIPE exhibits superior robustness against noise. In practical applications, such as RR interval data classification, bearing fault diagnosis, marine vessel identification, and electroencephalographic (EEG) signal classification, the proposed methods demonstrate better discriminating power compared to conventional entropy measures. These promising findings validate the effectiveness and potential of the algorithms proposed in this paper. Full article
(This article belongs to the Special Issue Information Theory and Nonlinear Signal Processing)
Show Figures

Figure 1

Article
Asymmetric Measurement-Device-Independent Quantum Key Distribution through Advantage Distillation
Entropy 2023, 25(8), 1174; https://doi.org/10.3390/e25081174 - 07 Aug 2023
Viewed by 161
Abstract
Measurement-device-independent quantum key distribution (MDI-QKD) completely closes the security loopholes caused by the imperfection of devices at the detection terminal. Commonly, a symmetric MDI-QKD model is widely used in simulations and experiments. This scenario is far from a real quantum network, where the [...] Read more.
Measurement-device-independent quantum key distribution (MDI-QKD) completely closes the security loopholes caused by the imperfection of devices at the detection terminal. Commonly, a symmetric MDI-QKD model is widely used in simulations and experiments. This scenario is far from a real quantum network, where the losses of channels connecting each user are quite different. To adapt such a feature, an asymmetric MDI-QKD model is proposed. How to improve the performance of asymmetric MDI-QKD also becomes an important research direction. In this work, an advantage distillation (AD) method is applied to further improve the performance of asymmetric MDI-QKD without changing the original system structure. Simulation results show that the AD method can improve the secret key rate and transmission distance, especially in the highly asymmetric cases. Therefore, this scheme will greatly promote the development of future MDI-QKD networks. Full article
(This article belongs to the Special Issue Advances in Quantum Computing)
Show Figures

Figure 1

Article
Semiosis as a Source of Providing Empirical Phenomena with a New Type of Cohesion
Entropy 2023, 25(8), 1173; https://doi.org/10.3390/e25081173 - 07 Aug 2023
Viewed by 175
Abstract
Embodying the indexical signs is vital to semiosis as a cohesive material agency mediating between consequents and antecedents. One unique factor of biology compared with standard physics and chemistry is the cohesion enabling the biological components, codes and organizations to accommodate themselves with [...] Read more.
Embodying the indexical signs is vital to semiosis as a cohesive material agency mediating between consequents and antecedents. One unique factor of biology compared with standard physics and chemistry is the cohesion enabling the biological components, codes and organizations to accommodate themselves with a specific material embodiment. Every individual body is uniquely biological and requires a specific cohesion of material origin for its own sake that could not be found in the non-living material world. The relevant cohesion comes from the exchange interaction of the atomic quantum particles, such as the carbon atoms, which is far greater than the electrons as a common exchange mediator adopted for the spatial cohesion ubiquitous in physics and chemistry. What is specific to the temporal cohesion latent in the atomic exchange is the immutable identity of the individual quantum particle surviving only over a limited time, while being constantly alternated with the new ones of the same kinds in a successive manner. Semiosis is supported by the underlying teleonomic cohesion, such that the preceding temporal cohesion may constantly induce the succeeding similar one ad infinitum. Full article
(This article belongs to the Special Issue Probability, Entropy, Information, and Semiosis in Living Systems)
Article
Outage Performance Analysis of Improper Gaussian Signaling for Two-User Downlink NOMA Systems with Imperfect Successive Interference Cancellation
Entropy 2023, 25(8), 1172; https://doi.org/10.3390/e25081172 - 06 Aug 2023
Viewed by 177
Abstract
The improper Gaussian signaling (IGS) technique can improve the achievable rate of an interference-limited network by fully exploiting the second-order statistics of complex signaling. This paper addresses the outage performance analysis of a two-user downlink non-orthogonal multiple access (NOMA) system using the IGS [...] Read more.
The improper Gaussian signaling (IGS) technique can improve the achievable rate of an interference-limited network by fully exploiting the second-order statistics of complex signaling. This paper addresses the outage performance analysis of a two-user downlink non-orthogonal multiple access (NOMA) system using the IGS technique in the presence of imperfect successive interference cancellation (SIC). The strong channel user (SU) adopts the IGS, while the weak channel user (WU) adopts the traditional proper Gaussian signaling (PGS). Considering a practical scenario where the transmitter has obtained the statistics of the channel coefficients instead of the instantaneous channel state information (CSI), the expressions of the achievable rates of both users under residual interference due to imperfect SIC are derived, together with their outage probabilities, subject to predetermined target rates and channel statistics. Given a fixed transmit power of the WU, both the transmit power and the degree of impropriety of the SU are optimized to minimize the outage probability subject to the outage constraint of the WU. Numerical results are provided to assess the benefits of the proposed IGS-based downlink NOMA system, which are consistent with the analysis. Full article
(This article belongs to the Section Information Theory, Probability and Statistics)
Show Figures

Figure 1

Article
Improved Adaptive Multipoint Optimal Minimum Entropy Deconvolution and Application on Bearing Fault Detection in Random Impulsive Noise Environments
Entropy 2023, 25(8), 1171; https://doi.org/10.3390/e25081171 - 06 Aug 2023
Viewed by 162
Abstract
Random impulsive noise is a special kind of noise, which has strong impact features and random disturbances with large amplitude, short duration, and long intervals. This type of noise often displays nonGaussianity, while common background noise obeys Gaussian distribution. Hence, random impulsive noise [...] Read more.
Random impulsive noise is a special kind of noise, which has strong impact features and random disturbances with large amplitude, short duration, and long intervals. This type of noise often displays nonGaussianity, while common background noise obeys Gaussian distribution. Hence, random impulsive noise greatly differs from common background noise, which renders many commonly used approaches in bearing fault diagnosis inapplicable. In this work, we explore the challenge of bearing fault detection in the presence of random impulsive noise. To deal with this issue, an improved adaptive multipoint optimal minimum entropy deconvolution (IAMOMED) is introduced. In this IAMOMED, an envelope autocorrelation function is used to automatically estimate the cyclic impulse period instead of setting an approximate period range. Moreover, the target vector in the original MOMED is rearranged to enhance its practical applicability. Finally, particle swarm optimization is employed to determine the optimal filter length for selection purposes. According to these improvements, IAMOMED is more suitable for detecting bearing fault features in the case of random impulsive noise when compared to the original MOMED. The contrast experiments demonstrate that the proposed IAMOMED technique is capable of effectively identifying fault characteristics from the vibration signal with strong random impulsive noise and, in addition, it can accurately diagnose the fault types. Thus, the proposed method provides an alternative fault detection tool for rotating machinery in the presence of random impulsive noise. Full article
(This article belongs to the Section Multidisciplinary Applications)
Show Figures

Figure 1

Article
Identification of Solid and Liquid Materials Using Acoustic Signals and Frequency-Graph Features
Entropy 2023, 25(8), 1170; https://doi.org/10.3390/e25081170 - 05 Aug 2023
Viewed by 124
Abstract
Material identification is playing an increasingly important role in various sectors such as industry, petrochemical, mining, and in our daily lives. In recent years, material identification has been utilized for security checks, waste sorting, etc. However, current methods for identifying materials require direct [...] Read more.
Material identification is playing an increasingly important role in various sectors such as industry, petrochemical, mining, and in our daily lives. In recent years, material identification has been utilized for security checks, waste sorting, etc. However, current methods for identifying materials require direct contact with the target and specialized equipment that can be costly, bulky, and not easily portable. Past proposals for addressing this limitation relied on non-contact material identification methods, such as Wi-Fi-based and radar-based material identification methods, which can identify materials with high accuracy without physical contact; however, they are not easily integrated into portable devices. This paper introduces a novel non-contact material identification based on acoustic signals. Different from previous work, our design leverages the built-in microphone and speaker of smartphones as the transceiver to identify target materials. The fundamental idea of our design is that acoustic signals, when propagated through different materials, reach the receiver via multiple paths, producing distinct multipath profiles. These profiles can serve as fingerprints for material identification. We captured and extracted them using acoustic signals, calculated channel impulse response (CIR) measurements, and then extracted image features from the time–frequency domain feature graphs, including histogram of oriented gradient (HOG) and gray-level co-occurrence matrix (GLCM) image features. Furthermore, we adopted the error-correcting output code (ECOC) learning method combined with the majority voting method to identify target materials. We built a prototype for this paper using three mobile phones based on the Android platform. The results from three different solid and liquid materials in varied multipath environments reveal that our design can achieve average identification accuracies of 90% and 97%. Full article
Show Figures

Figure 1

Article
Distance Matters: A Distance-Aware Medical Image Segmentation Algorithm
Entropy 2023, 25(8), 1169; https://doi.org/10.3390/e25081169 - 05 Aug 2023
Viewed by 190
Abstract
The transformer-based U-Net network structure has gained popularity in the field of medical image segmentation. However, most networks overlook the impact of the distance between each patch on the encoding process. This paper proposes a novel GC-TransUnet for medical image segmentation. The key [...] Read more.
The transformer-based U-Net network structure has gained popularity in the field of medical image segmentation. However, most networks overlook the impact of the distance between each patch on the encoding process. This paper proposes a novel GC-TransUnet for medical image segmentation. The key innovation is that it takes into account the relationships between patch blocks based on their distances, optimizing the encoding process in traditional transformer networks. This optimization results in improved encoding efficiency and reduced computational costs. Moreover, the proposed GC-TransUnet is combined with U-Net to accomplish the segmentation task. In the encoder part, the traditional vision transformer is replaced by the global context vision transformer (GC-VIT), eliminating the need for the CNN network while retaining skip connections for subsequent decoders. Experimental results demonstrate that the proposed algorithm achieves superior segmentation results compared to other algorithms when applied to medical images. Full article
(This article belongs to the Special Issue Deep Learning Models and Applications to Computer Vision)
Show Figures

Figure 1

Article
Quantifying Parameter Interdependence in Stochastic Discrete Models of Biochemical Systems
Entropy 2023, 25(8), 1168; https://doi.org/10.3390/e25081168 - 05 Aug 2023
Viewed by 220
Abstract
Stochastic modeling of biochemical processes at the cellular level has been the subject of intense research in recent years. The Chemical Master Equation is a broadly utilized stochastic discrete model of such processes. Numerous important biochemical systems consist of many species subject to [...] Read more.
Stochastic modeling of biochemical processes at the cellular level has been the subject of intense research in recent years. The Chemical Master Equation is a broadly utilized stochastic discrete model of such processes. Numerous important biochemical systems consist of many species subject to many reactions. As a result, their mathematical models depend on many parameters. In applications, some of the model parameters may be unknown, so their values need to be estimated from the experimental data. However, the problem of parameter value inference can be quite challenging, especially in the stochastic setting. To estimate accurately the values of a subset of parameters, the system should be sensitive with respect to variations in each of these parameters and they should not be correlated. In this paper, we propose a technique for detecting collinearity among models’ parameters and we apply this method for selecting subsets of parameters that can be estimated from the available data. The analysis relies on finite-difference sensitivity estimations and the singular value decomposition of the sensitivity matrix. We illustrated the advantages of the proposed method by successfully testing it on several models of biochemical systems of practical interest. Full article
(This article belongs to the Special Issue Mathematical Modeling in Systems Biology)
Show Figures

Figure 1

Article
NRVC: Neural Representation for Video Compression with Implicit Multiscale Fusion Network
Entropy 2023, 25(8), 1167; https://doi.org/10.3390/e25081167 - 04 Aug 2023
Viewed by 231
Abstract
Recently, end-to-end deep models for video compression have made steady advancements. However, this resulted in a lengthy and complex pipeline containing numerous redundant parameters. The video compression approaches based on implicit neural representation (INR) allow videos to be directly represented as a function [...] Read more.
Recently, end-to-end deep models for video compression have made steady advancements. However, this resulted in a lengthy and complex pipeline containing numerous redundant parameters. The video compression approaches based on implicit neural representation (INR) allow videos to be directly represented as a function approximated by a neural network, resulting in a more lightweight model, whereas the singularity of the feature extraction pipeline limits the network’s ability to fit the mapping function for video frames. Hence, we propose a neural representation approach for video compression with an implicit multiscale fusion network (NRVC), utilizing normalized residual networks to improve the effectiveness of INR in fitting the target function. We propose the multiscale representations for video compression (MSRVC) network, which effectively extracts features from the input video sequence to enhance the degree of overfitting in the mapping function. Additionally, we propose the feature extraction channel attention (FECA) block to capture interaction information between different feature extraction channels, further improving the effectiveness of feature extraction. The results show that compared to the NeRV method with similar bits per pixel (BPP), NRVC has a 2.16% increase in the decoded peak signal-to-noise ratio (PSNR). Moreover, NRVC outperforms the conventional HEVC in terms of PSNR. Full article
(This article belongs to the Topic Recent Trends in Image Processing and Pattern Recognition)
Show Figures

Figure 1

Back to TopTop