.png)
Brushstroke Classification from Oil Painting Images Using Convolutional Neural Networks for Tool Optimization
Abstract
This research introduces an integrated framework that applies Convolutional Neural Networks (CNNs) to classify brushstroke types from oil painting images and utilizes the classification results to inform the design and optimization of painting tools. Researchers will conduct the brush testing activities in four sessions: Session 1: Still life painting test, Session 2: Portrait painting test, Session 3: Landscape painting test, and Session 4: Rose painting test.The classification results were mapped to specific ergonomic and functional brush design parameters, resulting in the production of ten custom-designed brush prototypes. These brushes were fabricated using precision prototyping techniques and evaluated by twenty art students and five professional artists. Quantitative user feedback revealed high satisfaction across all performance categories, including ergonomic comfort, stroke control, and paint handling. The findings confirm that CNN-based analysis of brushstroke characteristics can directly support the practical innovation of art tools, bridging computational visual analysis and traditional artistic practice. This study offers a data-driven approach to creative tool design and presents a new interdisciplinary pathway that combines deep learning, material design, and fine arts.
Keywords
Full Text:
PDFReferences
X. Yang and J. Hu, “Deep neural networks for Chinese traditional landscape painting creation,” Proc. SPIE 12348, Image Processing: Algorithms and Systems XX, vol. 12348, pp. 123483T–123483T-9, 2022, doi: 10.1117/12.2641585.
H. Chen, “Painting style conversion and artistic creation exploration based on deep learning,” Int. J. High Speed Electron. Syst., 2024, doi: 10.1142/s0129156425401688.
K. Xu, “Automated artist identification using deep learning and transfer learning techniques,” Sci. Technol. Eng. Chem. Environ. Prot., 2024, doi: 10.61173/kw89wm08.
S. Smirnov and A. Eguizabal, “Deep learning for object detection in fine-art paintings,” in 2018 Metrology for Archaeology and Cultural Heritage (MetroArchaeo), 2018, pp. 45–49, doi: 10.1109/MetroArchaeo43810.2018.9089828.
M. L. de Guevara, “Painting algorithms,” Ph.D. dissertation, 2022. [Online]. Available:
H. Chen, “Painting style conversion and artistic creation exploration based on deep learning,” Int. J. High Speed Electron. Syst., 2024, doi: 10.1142/s0129156425401688.
L. MacDonald et al., “Reflectance transformation imaging systems for cultural heritage,” Journal of Cultural Heritage, vol. 22, pp. 917–926, 2017, doi: 10.1016/j.culher.2016.03.007.
X. Yang and J. Hu, “Deep neural networks for Chinese traditional landscape painting creation,” Proc. SPIE 12348, Image Processing: Algorithms and Systems XX, vol. 12348, pp. 123483T–123483T-9, 2022, doi: 10.1117/12.2641585.
M. Shugrina, C.-Y. Li, and S. Fidler, “Neural Brushstroke Engine,” ACM Trans. Graph., vol. 41, no. 4, pp. 1–18, 2022, doi: 10.1145/3550454.3555472.
Y. Fu, H. Yu, C.-K. Yeh, J.-J. Zhang, and T.-Y. Lee, “High Relief from Brush Painting,” IEEE Trans. Vis. Comput. Graph., vol. 25, no. 6, pp. 2763–2776, 2019, doi: 10.1109/TVCG.2018.2860004.
A. Hertzmann, “Painterly rendering with curved brush strokes of multiple sizes,” in Proc. 25th Annu. Conf. Comput. Graph. Interact. Tech., 1998, pp. 453–460, doi: 10.1145/280814.280951.
Z. Yao, Q. Sun, B. Liu, Y. Lu, G. Liu, X.-D. Yang, and H. Mi, “InkBrush: A Sketching Tool for 3D Ink Painting,” in Proc. CHI Conf. Human Factors Comput. Syst., 2024, doi: 10.1145/3613904.3642128.
A. I. Karimov, M. Strelnikov, S. Mazin, D. Goryunov, S. Leonov, and D. Butusov, “Physically Motivated Model of a Painting Brush for Robotic Painting and Calligraphy,” Robotics, vol. 13, no. 6, p. 94, 2024, doi: 10.3390/robotics13060094.
Z. Miao, Y. Zhang, Z. Zheng, and Z. Sun, “Image palette: painting style transfer via brushstroke control synthesis,” Multimed. Tools Appl., vol. 76, pp. 7989–8010, 2017, doi: 10.1007/s11042-016-3408-0.
F. Lamberti, A. Sanna, and G. Paravati, “Computer-assisted analysis of painting brushstrokes: digital image processing for unsupervised extraction of visible features from van Gogh’s works,” EURASIP Journal on Image and Video Processing, vol. 2014, no. 53, pp. 1–17, 2014, doi: 10.1186/1687-5281-2014-53.
K. Georgoulaki, “Classification of Impressionist and Pointillist Paintings Based on Their Brushstrokes Characteristics,” ACM Journal on Computing and Cultural Heritage, 2024, doi: 10.1145/3665501.
Y. Fu, H. Yu, C.-K. Yeh, T.-Y. Lee, and J. Zhang, “Fast Accurate and Automatic Brushstroke Extraction,” ACM Trans. Multimed. Comput. Commun. Appl., vol. 17, no. 1s, pp. 1–24, 2021, doi: 10.1145/3429742.
Z. Miao, Y. Zhang, Z. Zheng, and Z. Sun, “Image palette: painting style transfer via brushstroke control synthesis,” Multimedia Tools and Applications, vol. 76, pp. 7989–8010, 2017, doi: 10.1007/s11042-016-3408-0.
M. Sun, D. Zhang, J. Ren, Z. Wang, and J. S. Jin, “Brushstroke based sparse hybrid convolutional neural networks for author classification of Chinese ink-wash paintings,” in Proc. IEEE Int. Conf. Image Process. (ICIP), 2015, pp. 626–630, doi: 10.1109/ICIP.2015.7350874.
L. Qiao, X. Guo, and W. Li, “Classification of Chinese and Western Painting Images Based on Brushstrokes Feature,” in Lecture Notes in Computer Science, vol. 12533, pp. 325–337, 2020, doi: 10.1007/978-3-030-65736-9_30.
J. Min, J. Ahn, S. Ahn, H.-J. Choi, and S. Ahn, “Digital imaging methods for painting analysis: the application of RTI and 3D scanning to the study of brushstrokes and paintings,” Multimedia Tools and Applications, vol. 79, pp. 25427–25439, 2020, doi: 10.1007/s11042-020-09263-0.
J. Kim, J. Y. Jun, M. Hong, H. Shim, and J.-H. Ahn, “Classification of Oil Painting Using Machine Learning with Visualized Depth Information,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-2/W15, pp. 617–621, 2019, doi: 10.5194/isprs-archives-XLII-2-W15-617-2019.
R. Radpour et al., “Advances in Automated Pigment Mapping for 15th-Century Manuscript Illuminations Using 1-D Convolutional Neural Networks and Hyperspectral Reflectance Image Cubes,” Applied Sciences, vol. 14, no. 16, 2024, doi: 10.3390/app14166857.
A. I. Karimov et al., “Physically Motivated Model of a Painting Brush for Robotic Painting and Calligraphy,” Robotics, vol. 13, no. 6, p. 94, 2024, doi: 10.3390/robotics13060094.
E. Azimi, A. Ashtari, and J. Ahn, “Patch-Based Oil Painting Forgery Detection Based on Brushstroke Analysis Using Generative Adversarial Networks and Depth Visualization,” Applied Sciences, vol. 15, no. 1, 2024, doi: 10.3390/app15010075.
M. Shahi, R. Rajabi, and F. Masoumzadeh, “CNN-based classification of Persian miniature paintings from five renowned schools,” Digital Applications in Archaeology and Cultural Heritage, 2025, doi: 10.1016/j.daach.2024.e00397.
DOI: https://doi.org/10.47738/jads.v6i4.1081
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0