Research Article |
|
Corresponding author: Sofia V. Torianik ( torianiksofia@gmail.com ) © 2026 Tatiana S. Ilina, Sofia V. Torianik, Dmitrii S. Zakhidov, Dmitry A. Kiselev.
This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Citation:
Ilina TS, Torianik SV, Zakhidov DS, Kiselev DA (2026) Prediction of ferroelectric properties of (K,Na)NbO3-based solid solutions with the aid of interpretable descriptors. Modern Electronic Materials 12(2): 83-94. https://doi.org/10.3897/j.moem.12.2.194213
|
This work puts forward an interpretable approach for predicting ferroelectric properties on the basis of sure independence screening and sparsifying operator (SISSO) method, which uses a symbol regression for studying mathematically compact expressions having explicit physical sense. In combination with ensemble machine learning (ML) methods, i.e., extra trees regressor (ETR), random forest (RF), gradient boosting regressor (GBR), and extreme gradient boosting (XGBoost), as well as SHAP (SHapley Additive exPlanations) analysis for the selection and interpretation of features, the approach developed in this work simultaneously delivers high prediction accuracy and possibility to study fundamental mechanisms underlying the formation of ferroelectric properties in materials. Based on the available experimental data for 476 potassium-sodium niobate (KNN-based) ceramic specimens, feature engineering has been carried out, as a result of which the key physical descriptors have been separated and the optimal choice of predictors has been determined. The model developed herein allows explicit, i.e., in a formularized form, description of quantitative relationships between structural parameters and functional characteristics of materials. The methodological approach to interpretable machine learning put forward in this work opens up new possibilities for the optimization-driven design of piezoelectric ceramics and other functional materials, and will be useful both for fundamental research and practical applications.
KNN ceramics, ferroelectric properties, machine learning, sure independence screening and sparsifying operator
The development of lead-free KNN-based piezoceramics has become one of the most rapidly growing trends of materials science in recent decades due to their high piezoelectric response and environmental friendliness [
One of the most promising tools to solve the above task is machine learning (ML). The implementation of ML methods gives new opportunities in materials science for accelerated search for compositions with preset characteristics and retrieval of latent regularities in the “composition – structure – properties” system [
Despite the high predictive capability, most of the existing ML models, such as deep neural networks or complex ensemble methods, often operate by the “black box” principle, which limits their application in materials science [
One of the most powerful tools to develop interpretable models is the use of symbolic regression, e.g. the sure independence screening and sparsifying operator (SISSO) method [
Along with interpretable methods, e.g. SISSO, prediction accuracy is maximized in case of wide application of ensemble machine learning methods, including extra trees regressor (ETR), random forest (RF), gradient boosting regressor (GBR), and extreme gradient boosting (XGBoost). For example, the ETR model with an optimum set of seven features allowed predicting the d33 of KNN with an error of ~49 pC/N [
Despite the above achievements, most works are focused on the prediction of a single feature, typically, d33, whereas the practical application of materials requires a set of characteristics be known, e.g. the piezoelectric coefficient, the Curie temperature TC, and the dielectric permittivity ε.
The aim of this work is system analysis and comparing the efficiency of ensemble machine learning algorithms (RF, ETR, XGBoost, and GBR) in predicting the three key properties of lead-free KNN-based piezoelectric ceramics: the piezoelectric coefficient d33, the Curie temperature TC, and the dielectric permittivity ε. The work will also deal with comparison between the models for prediction accuracy, retrieval of physically meaning regularities using SISSO in combination with SHAP, and validation of the modeling results against experimental data borrowed from literature.
The target properties for this work were the piezoelectric coefficient (d33), the dielectric permittivity at room temperature measured at a frequency of 10 kHz (ε), and the Curie temperature (TC).
In this work, the dataset includes 476 KNN-based ceramic specimens [
| A-site | B-site | Reference | |
| Effective ionic radii | rA | rB | [ |
| t is tolerance factor | [ |
||
| µ is octahedral factor | µ = rB/rO | ||
| Volume of atom | VA | VB | [ |
| Atomic weight | AWA | AWB | |
| Effective nuclear charge (Slater) | NCA | NCB | |
| Distance from core electron (Schubert) | DCEA | DCEB | |
| Distance from valence electron (Schubert) | DVEA | DVEB | |
| Electron affinity | EAA | EAB | |
| Nuclear magnetic moment | MNA | MNB | |
| Valence electron number | NVA | NVB | |
| Electronegativity (Pauling) | ENA | ENB | [ |
For each composition, the initial features summarized in Table
, (1)
(2)
where n is the number of atoms in the A/B-sites of the perovskite structure and fi is the atomic fraction of each of the ions.
At the first stage, the dataset with a set of required fundamental features were used for obtaining interpretable descriptors using SISSO. This allowed not only to increase the accuracy of prediction due to the use of the models, but also to preserve their physical interpretability. Unlike the direct use of regression models, we used a two-stage feature selection strategy for reducing the dimension of the initial space of descriptors obtained using SISSO and excluding multicollinearity which deleteriously affects the calculative efficiency of the models.
The resultant set of 500 SISSO descriptors for each of the three target properties (d33, TC, and ε) were ranged by the degree of mutual interrelation and correlation with the target property. The descriptors weakly correlating with the target property (Pearson correlation coefficient <0.1) and the strongly mutually interrelating ones (Pearson correlation coefficient >0.7) were excluded. Then, 20 descriptors remained that were weakly correlated with each other and well correlated with the target property.
For the remaining 20 most relevant descriptors, their effects on the predictive capacity of the models were quantitatively characterized using the mutual information (MI). Mutual information allows one to evaluate the relationships between the descriptors and the target property, which is of special importance for analysis of complex physical properties of ferroelectrics. As a result of analysis, seven most meaning descriptors for each of the three target properties were selected for further learning.
The seven most meaning descriptors generated with SISSO were used for further modeling using ensemble machine learning algorithms, e.g. RF, ETR, XGBoost, and GBR.
The resultant machine learning models were interpreted for the final set of descriptors using the SHAP method (SHapley Additive exPlanations). This approach allows quantitative characterization the importance of each feature for the overall prediction. SHAP analysis of features allows ranging the descriptors by the degrees of their physical meaning, which is important for meaningful verification of the models from the standpoints of process physics.
For each target property, the dataset included more than 200 experimental values. As noted above, 7 most informative descriptors were selected for each parameter at the feature selection stage. The final set of descriptors used for the machine leaning models is summarized in Table
| d33 | ε | TC |
| f1 = (EAA – AWA)(t – ENA) | f1 = 1/(ENB – VB) | f1 = (VB – NVA)(rB – NVA) |
| f2 = (NVB – MNB)2 | f2 = MNB × EAB × (DCEB – DCEA) | f2 = DCEB × VB + (DCEB – DCEA) |
| f3 = MNB × DCEA × (NVB – VB) | f3 = (VA – AWA)(MNB – NVA) | |
| f4 = MNB × MNA × (DVEB – DCEA) | f4 = μ × MNA + (MNB – rA) | f4 = rA2 – μ × VA |
| f5 = MNB ×AWA × (DVEB – DCEA) | f5 = (DVEB – DCEA) × (DCEB – DCEA) | |
| f6 = ENA × NVA + (NVB – NVA) | f6 = (ENB + ENA) – (MNB + NVA) | f6 = MNA × AWA × (NCB – NCA) |
| f7 = (ENB – VB) × (MNB – VB) | f7 = NCB × rA × t ×EAA |
Figures
Pearson correlation matrix for set of features for (a) d33, (b) ε, (c) TC, and (d) MI for SISSO descriptors
The descriptor meaning charts obtained using the MI method are shown in Fig.
Pearson and MI analyses of the descriptors suggest that the generated set of descriptors is optimal, balanced, and free from multicollinearity and non-informative features.
The initial data were divided into the training and test sets in a 80/20 ratio. Four machine learning models were selected for the prediction of the properties of KNN-based ceramics: ETR, RF, GBR, and XGBoost. The learning of each model for d33, ε, and TС prediction was carried out independently, using the respective sets of 7 descriptors. The performance of the learnt models was evaluated based on the determination coefficients (R2) of the training and test sets.
Model performance evaluation results are presented in Fig.
Performance of ML models: (a–c) ETR, (d–f) RF, (g–i) GBR, and (i–l) XGBoost in prediction of (a, d, g, j) d33, (b, e, h, k) ε, and (c, f, i, l) TC for KNN-based ceramics
The proximity of the data points to the perfect fit lines in the diagrams confirms good predictive capability of the algorithms tested. Quantitative comparison between the models is presented in the form of bar charts (Fig.
A final check of the predictive capability of the models was carried out for independent correlation sets containing 10 compositions each, for each target property. The validation sets for d33, ε, and TС are presented in Supplementary Information.
Comparison between the predicted and experimental values for the validation data is shown in Fig.
Validation of ML models: (a) ETR for d33, (b) ETR for ε, and (c) RF for TC for independent experimental data borrowed from literature
Average relative error of ETR, RF, GBR, and XGBoost models in prediction of d33, ε, and TC
| Model | Average relative error (%) | ||
| d33 | ε | TC | |
| ETR | 10.7 | 7.8 | 7.8 |
| RF | 13.0 | 8.1 | 6.7 |
| GBR | 13.5 | 11.8 | 8.4 |
| XGBoost | 14.7 | 9.4 | 6.8 |
Based on the preliminary analysis of the four machine learning models tested for each of the three target properties, algorithms were selected which were the most suitable for the prediction of respective properties. The ETR model is the optimum one for the prediction of piezoelectric coefficient, since it showed the least average relative error for its independent validation set (10.7 %) combined with competitive R2 for the test set (75 %). Prediction of dielectric permittivity is also best done using the ETR model which showed the smallest error for the validation data (7.8 %) and stable R2 values for the test set (83 %). The RF model proved to be the most effective in predicting the Curie temperature due to the smallest average relative error (6.7 %) for the validation set, while retaining high R2 (91 %).
The key tool of machine learning model interpretation is to evaluate the contribution of individual features, and this was implemented in this work using the SHAP method. Figure
SHAP-based analysis of impact of features on predictive capability of models: (a) ETR for d33, (b) ETR for ε, and (c) RF for TC
For interpretable machine learning in the analysis of KNN-based ceramic materials, the key result is the identification of the descriptors which have the lowest SHAP values, indicating their predominant impact on the prediction of the target properties.
A significant impact of the descriptor f2 = (NVB – MNB)2 on the predicted piezoelectric coefficient d33 can be accounted for by the physical nature of the parameter MNB (nuclear magnetic moment of the B-cations in ABO3-type perovskite structures). The parameter MNB exerts a strong impact on the value of d33, since it is an effective indicator which integrates the electron configuration and crystal structure that determine the piezoelectric response of materials [
The greatest impact on the prediction of dielectric permittivity comes from the descriptor f4 = μ × MNA+ (MNB – rA). The component µ is the octahedral factor determining the geometry of the oxygen octahedron BO6. According to classical standpoints [
Analysis of SHAP values allowed to highlight the descriptor f2 = DCEB × VB + (DCEB – DCEA), which integrates the electron configuration and geometric parameters of atoms determining the Curie temperature (TC) of KNN-based ceramics. The validity of using the above-listed atomic features was additionally confirmed by earlier works [
In this work, the prediction of d33, ε, and TC of KNN-based ferroelectric ceramics was carried out sequentially using a hybrid strategy, i.e., a combination of the Sure Independence Screening and Sparsifying Operator (SISSO) with ensemble machine learning methods (Extra Trees Regressor (ETR), Random Forest (RF), Gradient Boosting Regressor (GBR), and eXtreme Gradient Boosting (XGBoost)).
For each target property (the piezoelectric coefficient d33, the dielectric permittivity ε, and the Curie temperature TC), descriptors were identified that exert the maximum impact on the predictive capability of the machine learning models. We showed that the best results in d33 prediction were achieved using the ETR model, delivering an average relative error of about 10.7 %. for the validation set which was not used for leaning. For ε, the smallest error (7.8 %) was also obtained for the ETR model, and for TC, the best result was achieved using the RF model, the error being 6.7 %.
Thus, physically interpretable predictors were developed that allow accurate prediction of the key ferroelectric parameters of KNN-based ceramics. The results confirm the efficiency of the suggested approach combining the SISSO method with ensemble machine learning methods and open up new possibilities for the design of materials with tailored functional parameters.
The study was performed with financial support from the Russian Science Foundation (grant No. 24-79-00281).
| Sample number | Chemical formula |
| 1 | 0.959K0.48Na0.52NbO3-–0.04Bi0.5Na0.5ZrO3–0.001LaFeO3 |
| 2 | (K0.465Na0.465Li0.07)NbO3 |
| 3 | 0.958K0.48Na0.52NbO3–0.04Bi0.5Na0.5ZrO3–0.002LaFeO3 |
| 4 | 0.97K0.48Na0.56NbO3–0.03Bi0.5Li0.5ZrO3 |
| 5 | 0.965(K0.5Na0.5)(Nb0.96Sb0.04)O3–0.02(Bi0.5Na0.5)(Zr0.8Ti0.2)O3–0.015CaZrO3 |
| 6 | (K0.44Na0.52Li0.04)0.99Cu0.005(Nb0.86Ta0.10Sb0.04)O3 |
| 7 | 0.95(K0.48Na0.52)NbO3–0.05Ca0.15(Bi0.5Na0.5)0.85ZrO3 |
| 8 | 0.95(K0.48Na0.52)NbO3–0.05Ca0.4(Bi0.5Na0.5)0.6ZrO3 |
| 9 | 0.98(K0.5Na0.5)0.94Li0.06(Nb0.96Sb0.04)O3–0.02(Bi0.5Na0.5)(Zr0.8Sn0.1Hf0.1)O3 |
| 10 | 0.96(K0.4Na0.6)(Nb0.96Sb0.04)O3–0.04Bi0.5K0.5Zr0.6Sn0.4O3 |
| Sample number | Chemical formula |
| 1 | (Na0.5K0.5)0.975Li0.025Nb0.74Sb0.08Ta0.18O3 |
| 2 | 0.96(K0.45Na0.55)NbO3–0.04BaHfO3 |
| 3 | 0.95(K0.45Na0.55)NbO3–0.05BaHfO3 |
| 4 | 0.94(K0.45Na0.55)NbO3–0.06BaHfO3 |
| 5 | 0.95K0.5Na0.5Nb0.965Sb0.035O3–0.01CaSnO3–0.04Bi0.5K0.5HfO3 |
| 6 | 0.96K0.5Na0.5Nb0.96Sb0.04O3–0.01CaSnO3–0.03Bi0.5K0.5HfO3 |
| 7 | 0.96K0.5Na0.5Nb0.95Sb0.05O3–0.01CaSnO3–0.03Bi0.5K0.5HfO3 |
| 8 | 0.96K0.5Na0.5Nb0.94Sb0.06O3–0.01CaSnO3–0.03Bi0.5K0.5HfO3 |
| 9 | 0.96K0.5Na0.5Nb0.93Sb0.07O3–0.01CaSnO3–0.03Bi0.5K0.5HfO3 |
| 10 | 0.98(K0.52Na0.48)Nb0.95Sb0.05O3–0.02Bi0.5(Na0.8K0.2)0.5ZrO3 |
| Sample number | Chemical formula |
| 1 | ((K0.5Na0.5)0.9506Bi0.0194Li0.03)(Nb0.9506Sc0.0194Ta0.03)O3 |
| 2 | 0.95(K0.48Na0.52)NbO3–0.05Ca0.6(Bi0.5Na0.5)0.4ZrO3 |
| 3 | 0.96(K0.48Na0.49Li0.03)NbO3–0.04Bi0.5Na0.5ZrO3 |
| 4 | 0.96(K0.5Na0.5)NbO3–0.04(Bi0.5Na0.5)ZrO3 |
| 5 | 0.956K0.40Na0.60NbO3–0.014BiScO3–0.03Bi0.5(Na0.6K0.3Li0.1)0.5HfO3 |
| 6 | 0.99K0.48Na0.56NbO3–0.01Bi0.5Li0.5ZrO3 |
| 7 | 0.956K0.48Na0.52NbO3–0.04Bi0.5Na0.5ZrO3–0.004LaFeO3 |
| 8 | 0.956K0.48Na0.52NbO3–0.04Bi0.5Na0.5ZrO3–0.004BiAlO3 |
| 9 | 0.96(K0.48Na0.32Li0.2)NbO3–0.04Bi0.5Na0.5ZrO3 |
| 10 | 0.959K0.48Na0.52NbO3–0.04Bi0.5Na0.5ZrO3–0.01LaFeO3 |