Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
SYSTEM FOR TRAINING A DEEP-LEARNING ALGORITHM AND ASSOCIATED METHOD
Document Type and Number:
WIPO Patent Application WO/2023/078747
Kind Code:
A1
Abstract:
This system (1) for training a deep-learning algorithm (ALGO2) for detecting a defect in a ceramic rolling element (2), comprises: - means (3) for capturing a set of digital radiographic images (DATA1) of rolling elements (2) comprising defects and not comprising any defects, - filtering means (6), - means (7) for generating a data set (DATA3) on the basis of the set of filtered radiographic images (DATA2), - implementing means (8), - training means (10) configured to train a deep-learning algorithm (ALGO2) on the basis of the set of radiographic images (DATA1), and - comparing means (12) configured to compare the classification of the images of the image set performed by the statistical learning algorithm (ALGO1) and the classification of the images of the image set performed by the deep-learning algorithm (ALGO2) with a view to determining the accuracy of the classification of the deep-learning algorithm with respect to the classification performed by the statistical learning algorithm.

Inventors:
CARREROT HERVE (FR)
HEBRARD YOANN (FR)
Application Number:
PCT/EP2022/079878
Publication Date:
May 11, 2023
Filing Date:
October 26, 2022
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
SKF AB (SE)
SKF AEROSPACE FRANCE SAS (FR)
International Classes:
G06V10/143; F16C19/00; F16C19/52; F16C33/32; F16C33/34; G06V10/20; G06V10/26; G06V10/44; G06V10/778; G06V10/80; G06V10/82
Other References:
JANSSENS OLIVIER ET AL: "Convolutional Neural Network Based Fault Detection for Rotating Machinery", JOURNAL OF SOUND AND VIBRATION, ELSEVIER, AMSTERDAM , NL, vol. 377, 24 May 2016 (2016-05-24), pages 331 - 345, XP029564152, ISSN: 0022-460X, DOI: 10.1016/J.JSV.2016.05.027
CHOUDHARY ANURAG ET AL: "Convolutional neural network based bearing fault diagnosis of rotating machine using thermal images", MEASUREMENT, INSTITUTE OF MEASUREMENT AND CONTROL. LONDON, GB, vol. 176, 20 February 2021 (2021-02-20), XP086541378, ISSN: 0263-2241, [retrieved on 20210220], DOI: 10.1016/J.MEASUREMENT.2021.109196
JIANG LILI ET AL: "Casting defect detection in X-ray images using convolutional neural networks and attention-guided data augmentation", MEASUREMENT, INSTITUTE OF MEASUREMENT AND CONTROL. LONDON, GB, vol. 170, 18 November 2020 (2020-11-18), XP086438678, ISSN: 0263-2241, [retrieved on 20201118], DOI: 10.1016/J.MEASUREMENT.2020.108736
HU CHUANFEI ET AL: "An Efficient Convolutional Neural Network Model Based on Object-Level Attention Mechanism for Casting Defect Detection on Radiography Images", vol. 67, no. 12, 1 December 2020 (2020-12-01), USA, pages 10922 - 10930, XP055930146, ISSN: 0278-0046, Retrieved from the Internet [retrieved on 20220612], DOI: 10.1109/TIE.2019.2962437
DOMINGO MERY ET AL: "Automatic Defect Recognition in X-Ray Testing Using Computer Vision", CORR (ARXIV), 10 January 2017 (2017-01-10), pages 1026 - 1035, XP055405098, ISBN: 978-1-5090-4822-9, DOI: 10.1109/WACV.2017.119
Attorney, Agent or Firm:
SCHONECKE, Mitja (DE)
Download PDF:
Claims:
Claims

1 . Method for training a deep-learning algorithm (ALGO2) for detecting a defect in a ceramic rolling element (2) , comprising: capturing a set of digital radiographic images (DATA1 ) of rolling elements (2) comprising defects and not comprising any defects, filtering a first time each image of the set of images (DATA1 ) in order to improve the contrast of each image, generating a data set (DATA3) on the basis of the set of filtered radiographic images (DATA2) , classifying, on the basis of the data set (DATA3) , each image of the set of radiographic images (DATA1 ) using a statistical learning algorithm (ALGO1 ) into a class (CL1 ) of suspect rolling elements or into a class (CL2) of non-suspect rolling elements, training, on the basis of the set of radiographic images (DATA1 ), a deep-learning algorithm (ALGO2) so that the deep-learning algorithm classifies each image of the set of radiographic images into the class (CL1 ) of suspect rolling elements or into the class (CL2) of non-suspect rolling elements, and comparing the classification of the images of the image set performed by the statistical learning algorithm (ALGO1 ) and the classification of the images of the image set performed by the deep-learning algorithm (ALGO2) with a view to determ ining the accuracy of the classification of the deeplearning algorithm with respect to the classification performed by the statistical learning algorithm .

2. Method according to Claim 1 , wherein the generation of a training data set (DATA3) comprises: segmenting each image into various regions (Z1 , Z2, Z3) , filtering a second time each region of each image of the set of images to obtain a data vector, the data vector forming the training data set (DATA3) .

3. Method according to either of Claims 1 and 2, wherein the classification of each image of the set of radiographic images by a statistical learning algorithm (ALGO1 ) comprises: computing a value of an image-analysis indicator on the basis of the indicative data set (DATA3) of each image of the set of filtered images (DATA2) , comparing the analysis indicator to a threshold, and classifying each image depending on the result of the comparison.

4. Method according to Claim 3, wherein the image-analysis indicator comprises computing an average, and/or a standard deviation, and/or a median, and/or a greyscale gradient.

5. Method according to any one of the preceding claims, wherein the training of a deep-learning algorithm (ALGO2) comprises: segmenting each filtered image into a plurality of regions (Z1 , Z2, Z3), processing each region of each image using the deep-learning algorithm (ALGO2) with a view to detecting at least one defect on the basis of a selection criterion, detecting a defect in light of a selection criterion specific to each region, and classifying each image.

6. Method according to Claim 5, wherein the selection criterion comprises the geometry of the rolling element in said region, and/or texture in said region and/or contrast in said region.

7. Method according to any one of Claims 1 to 4, wherein the deeplearning algorithm (ALGO2) comprises a convolutional neural network.

8. Method according to any one of the preceding claims, wherein the comparison of the classification of the images of the image set performed by the statistical learning algorithm (ALGO1 ) and of the classification of the images of the image set performed by the deep-learning algorithm (ALGO2) comprises: comparing the classification performed by the statistical learning algorithm (ALGO1 ) and the classification performed by the deep-learning algorithm (ALGO2) for each same image of the set of radiographic images, determ ining the number of images classified into the same class (CL1 , CL2) by the statistical learning algorithm and by the deep-learning algorithm , and determ ining the classification accuracy of the deep-learning algorithm by computing the ratio between the number of images classified into the same class by the two algorithms and the total number of images in the set of radiographic images.

9. System (1 ) for training a deep-learning algorithm (ALGO2) for detecting a defect in a ceram ic rolling element (2), comprising: means (3) for capturing a set of digital radiographic images (DATA1 ) of rolling elements (2) comprising defects and not comprising any defects, filtering means (6) configured to improve the contrast of each image of the set of images (DATA1 ), means (7) for generating a data set (DATA3) on the basis of the set of filtered radiographic images (DATA2) , implementing means (8) configured to implement a statistical learning algorithm (ALGO1 ) configured to classify, on the basis of the data set (DATA2) , each image of the image set (DATA1 ) into a class (CL1 ) of suspect rolling elements or into a class (CL2) of non-suspect rolling elements, training means ( 10) configured to train, on the basis of the set of radiographic images (DATA1 ), a deep-learning algorithm (ALGO2) so that the deep-learning algorithm classifies each image of the set of radiographic images into the class (CL1 ) of suspect rolling elements or into the class (CL2) of nonsuspect rolling elements, and comparing means ( 12) configured to compare the classification of the images of the image set performed by the statistical learning algorithm (ALGO1 ) and the classification of the images of the image set performed by the deeplearning algorithm (ALGO2) with a view to determ ining the accuracy of the classification of the deep-learning algorithm with respect to the classification performed by the statistical learning algorithm .

Description:
Description

Title: System for training a deep-learning algorithm and associated method

Technical field of the invention

The present invention relates to ceram ic rolling elements, and more particularly relates to the detection of manufacturing defects in such rolling elements.

Prior art

I n order to guide a mechanical assembly in rotation, it is generally proposed to use rolling bearings equipped with rolling elements made of ceram ic or of steel. The rolling elements may for example be balls or even cylindrical, conical or spherical rollers.

These rolling elements of rolling bearings allow a circular movement of a shaft with respect to a fixed element to be ensured while lim iting frictional force.

They are applicable to reversible electric motors or combustion engines, both in the automotive and aeronautical fields.

However, as ceramic rolling elements are produced by sintering, they may contain inclusions of foreign material, non-uniform agglomerations of material, or porosities.

These defects are liable to make the rolling elements fail and therefore to damage the product comprising the rolling bearing equipped with such rolling elements.

For example, when the rolling bearing equipped with failed rolling elements is located on a rotating shaft, they may cause spalling and/or overheating and the shaft will rotate with increasing difficulty.

Moreover, the rolling elements are liable to completely disunite from the other components of the bearing and thus cause the rotating shaft to disassociate from its surrounding mechanical system : this may prove to be critical in aeronautics.

To prevent failure of a rolling element, it is advantageous to detect these defects right after its manufacture.

It is known to use x-rays to obtain radiographic images of rolling elements. These images, after processing, are analysed by a human operator with a view to recognition of defects in the rolling element.

However, the procedure of recognition of defects in a rolling element by an operator is unsuitable for mass manufactured rolling elements.

As the ability of an operator to process images is lim ited, the defectrecognition procedure may slow the entirety of the rolling-element production line.

Furthermore, the operator may make m istakes in his interpretation of the images.

It is known to use a deep-learning algorithm , a neural network for example, to recognize predetermined features in an image.

However, in order for a deep-learning algorithm to perform well it must be trained.

I n light of the above, the goal of the invention is to overcome the aforementioned constraints.

Sum mary of the invention

One subject of the invention is therefore a method for training a deeplearning algorithm for detecting a defect in a ceram ic rolling element, comprising:

-capturing a set of digital radiographic images of rolling elements comprising defects and not comprising any defects,

-filtering a first time each image of the set of images in order to improve the contrast of each image,

-generating a data set on the basis of the set of filtered radiographic images,

-classifying, on the basis of the data set, each image of the set of radiographic images using a statistical learning algorithm into a class of suspect rolling elements or into a class of non-suspect rolling elements,

-training, on the basis of the set of radiographic images, a deep-learning algorithm so that the deep-learning algorithm classifies each image of the set of radiographic images into the class of suspect rolling elements or into the class of non-suspect rolling elements, and

-comparing the classification of the images of the image set performed by the statistical learning algorithm and the classification of the images of the image set performed by the deep-learning algorithm with a view to determ ining the accuracy of the classification of the deep-learning algorithm with respect to the classification performed by the statistical learning algorithm .

The analysis of the data of the classification performed by the learning algorithm makes it possible to interpret the variation in the weights of the deeplearning algorithm when it comprises a neural network.

When the precision of the deep-learning algorithm is sufficient, the procedure for recognition of defects in the rolling element may be automated so as to increase the production rate of a line for producing rolling elements while m inimizing the risks of error in the interpretation of the image set.

Preferably, the generation of a training data set comprises: -segmenting each image into various regions, -filtering a second time each region of each image of the set of images to obtain a data vector, the data vector forming the training data set.

Advantageously, the classification of each image of the set of radiographic images by a statistical learning algorithm comprises:

-computing a value of an image-analysis indicator on the basis of the indicative data set of each image of the set of filtered images,

-comparing the analysis indicator to a threshold, and

-classifying each image depending on the result of the comparison.

Preferably, the image-analysis indicator comprises computing an average, and/or a standard deviation, and/or a median, and/or a greyscale gradient.

Advantageously, the training of a deep-learning algorithm comprises: -segmenting each filtered image into various regions, and -processing each region of each image using the deep-learning algorithm with a view to detecting at least one defect on the basis of a selection criterion, -detecting a defect in light of a selection criterion specific to each region, and

-classifying each image.

Preferably, the selection criterion comprises the geometry of the rolling element in said region, and/or texture in said region and/or contrast in said region. Advantageously, the deep-learning algorithm comprises a convolutional neural network.

Preferably, the comparison of the classification of the images of the image set performed by the statistical learning algorithm and of the classification of the images of the image set performed by the deep-learning algorithm comprises:

-comparing the classification performed by the statistical learning algorithm and the classification performed by the deep-learning algorithm for each same image of the set of radiographic images,

-determ ining the number of images classified into the same class by the statistical learning algorithm and by the deep-learning algorithm , and

-determ ining the classification accuracy of the deep-learning algorithm by computing the ratio between the number of images classified into the same class by the two algorithms and the total number of images in the set of radiographic images.

Another subject of the invention is a system for training a deep-learning algorithm for detecting a defect in a ceram ic rolling element, comprising:

-means for capturing a set of digital radiographic images of rolling elements comprising defects and not comprising any defects,

-filtering means configured to improve the contrast of each image of the set of images,

-means for generating a data set on the basis of the set of filtered radiographic images,

-implementing means configured to implement a statistical learning algorithm configured to classify, on the basis of the data set, each image of the image set into a class of suspect rolling elements or into a class of non-suspect rolling elements,

-training means configured to train, on the basis of the set of radiographic images, a deep-learning algorithm so that the deep-learning algorithm classifies each image of the set of radiographic images into the class of suspect rolling elements or into the class of non-suspect rolling elements, and

-comparing means configured to compare the classification of the images of the image set performed by the statistical learning algorithm and the classification of the images of the image set performed by the deep-learning algorithm with a view to determ ining the accuracy of the classification of the deep-learning algorithm with respect to the classification performed by the statistical learning algorithm .

Brief description of the figures

Other aims, features and advantages of the invention will become apparent on reading the following description, which is given purely by way of non-lim iting example, and with reference to the appended drawings, in which:

[ Fig 1 ] illustrates a system for training a deep-learning algorithm for detecting a defect in a ceram ic rolling element, according to one embodiment of the invention,

[ Fig 2] shows one mode of implementation of the training system according to the invention,

[ Fig 3] shows one example of a filtered image according to the invention, [ Fig 4] shows one example of division of a filtered image, and

[ Fig 5] shows one example of a data set according to the invention. Detailed description of the invention

Figure 1 shows a system for training a deep-learning algorithm ALG1 for detecting a defect in a ceram ic rolling element 2.

The system 1 comprises means 3 for capturing a set of two-dimensional digital radiographic images DATA1 of rolling elements 2 comprising defects and not comprising any defects,

The capturing means 3 comprise a photographic sensor 4 and a generator 5 of high-frequency electromagnetic waves R1 configured to em it the electromagnetic waves R1 towards the element 2.

These electromagnetic waves R1 are subsequently absorbed by the photographic sensor 4.

A two-dimensional digital radiographic image of the rolling element 2 is thus formed.

It will be noted that the generator 4 generally takes the form of a m icrofocus x-ray tube.

According to another embodiment, the capturing means 3 generate a three-dimensional digital radiographic image.

The system 1 further comprises filtering means 6 that are connected to the capturing means 3 and that process the images of the set of images to improve the contrast of each image of the set of images DATA1 captured by the capturing means 3. The filtering means 6 deliver a set of filtered radiographic images DATA2.

The system 1 also comprises means 7 for generating a data set DATA3 from the set of radiographic images DATA2 filtered by the filtering means 6, and implementing means 8 that implement a statistical learning algorithm ALGO1 that is configured to classify, on the basis of the data set DATA3, each image of the set of filtered images DATA2 into a class CL1 of suspect rolling elements 2 or into a class CL2 of non-suspect rolling elements 2. The generating means 7 are connected to the filtering means 6 and to the implementing means 8.

The classification performed by the statistical learning algorithm ALGO1 is for example stored in a memory 9.

The statistical learning algorithm ALGO1 for example comprises a decision-tree algorithm , a random-forest algorithm , a support-vector-machine algorithm , a K-nearest-neighbours algorithm , or a logistic-regression algorithm .

It will be noted that a suspect rolling element is a rolling element 2 the probability of having at least one defect of which is higher than its probability of not having any defects.

Defects for example comprise inclusions of foreign material, non-uniform agglomerations of material or porosities.

The system 1 further comprises training means 10 that train, on the basis of the set of filtered radiographic images DATA2, a deep-learning algorithm ALGO2 so that the deep-learning algorithm classifies each image of the set of filtered radiographic images DATA2 into the class CL1 of suspect rolling elements or into the class CL2 of non-suspect rolling elements. The training means 10 are connected to the filtering means 6.

The deep-learning algorithm ALGO2 for example comprises a convolutional neural network.

The classification performed by the deep-learning algorithm ALGO2 is for example stored in a memory 1 1 .

The system 1 further comprises comparing means 12 that compare the classification performed by the statistical learning algorithm ALGO1 , and the classification performed by the deep-learning algorithm ALGO2 in order to determ ine the accuracy of the deep-learning algorithm on the basis of the classification of the statistical learning algorithm . The comparing means 12 are connected to the implementing means 8 and to the training means 10, and for example read the content of the memory 9 of the implementing means storing the classification performed by the statistical learning algorithm ALGO1 and the content of the memory 1 1 of the training means 10 storing the classification performed by the deep-learning algorithm ALGO2.

The system 1 further comprises a processing unit UT that employs the capturing means 3 to capture the set of images DATA1 , the filtering means, means 7 for generating a data set DATA3 on the basis of the set of filtered radiographic images DATA2, the implementing means 8, the training means 10, and the comparing means 12.

The comparing means 12 deliver a data set DATA4 indicative of the classification accuracy of the deep-learning algorithm with respect to the classification performed by the statistical learning algorithm .

Analysis of the data set DATA4 allows the operation of the deep-learning algorithm ALGO2 to be validated.

If the accuracy level is insufficient, new data sets DATA1 are generated with a view to continuing the training of the deep-learning algorithm ALGO2.

As a variant, when a set of images DATA1 of sufficient size is available, the system 1 is implemented on the basis of said set with a view to continuing the training of the deep-learning algorithm ALGO2 and improving the accuracy of said algorithm .

Figure 2 illustrates one example of implementation of the system 1 .

I n a step 20, the capturing means 3 capture the set of two-dimensional digital radiographic images DATA1 of rolling elements 2 comprising defects and not comprising any defects.

The set of images DATA1 for example comprises 100 images, allowing a sufficient classification accuracy to be obtained from the algorithm ALGO1 .

When the set of the images DATA1 is complete, in a step 22, the filtering means 6 filter the images of the set of images DATA1 , so as to improve the contrast of each image, and deliver the set of filtered images DATA2 to the generating means 7 and to the training means 10. On receipt of the set of filtered images DATA2, the generating means 7 generate the data set DATA3 on the basis of the set of filtered images DATA2 (step 24) , then the implementing means 8 implement the statistical learning algorithm ALGO1 so that the statistical learning algorithm ALGO1 classifies each image of the set of filtered images DATA2 into the class CL1 of suspect rolling elements or into the class CL2 of non-suspect rolling elements (step 26) .

Furthermore, on receipt of the set of filtered images DATA2, the training means 10 train the deep-learning algorithm ALGO2 so that the deep-learning algorithm classifies each image of the set of filtered images DATA2 into the class CL1 of suspect rolling elements or into the class CL2 of non-suspect rolling elements (step 28) .

The two steps 24 and 26, and step 28 are for example carried out in parallel.

As a variant, steps 24 and 26, and 28 are carried out sequentially.

I n step 24 of generating the data set DATA3, the generating means 7 segment each image of the set of filtered images DATA2 into various regions.

Next, for each region of each image of the set of filtered images DATA2, the means 7 generate a data vector containing the coding of each image region of the set of images DATA2.

The data set DATA3 comprises the data vector.

Figure 3 illustrates an image, filtered by the filtering means 6, of a rolling element 2.

Figure 4 illustrates division of the filtered image shown in figure 3 into three different regions Z1 , Z2, Z3, each region being characterized by a different greyscale level.

Each image is filtered by greyscale level.

Of course, each image may be divided into more than at least three different regions.

Figure 5 illustrates one example of a data set DATA3 modelled by coding lines Lc.

Each line Lc represents data coding an image of the set of filtered images DATA2.

When the implementing means 8 receive the data set DATA3, in step 26, the algorithm ALGO1 implemented by the implementing means 8 computes a value of an image- analysis indicator on the basis of the data set DATA3 for each image of the set of images DATA2.

The image-analysis indicator for example comprises computing an average, and/or a standard deviation, and/or a median, and/or a greyscale gradient.

Next, the value of the image indicator is compared to a threshold.

If the value of the indicator of an image of the set of images DATA2 is higher than the threshold, said image is for example classified into the class of suspect rolling elements CL1 , and if the value of the indicator of an image is lower than the threshold, said image is for example classified into the class of non-suspect rolling elements CL2.

I n step 28, the training means 10 segment each image of the set of filtered images DATA2 into a plurality of regions, each region corresponding to one selection criterion for example comprising the geometry of the rolling element 2 in said region, and/or the texture in said region and/or the contrast in said region.

Next, the algorithm ALGO2 implemented by the training means 10 processes each region of each image to detect at least one defect on the basis of the selection criterion, detects any defects in the rolling element 2 and classifies said rolling element into one of the classes CL1 and CL2 depending on whether the rolling element 2 is considered to be suspect or not.

For example, if the geometry of the element 2 is not circular to within a predefined tolerance in the region relative to the geometry of the element 2, the algorithm ALGO2 classifies said rolling element 2 into the class CL2.

When all the images of the set of filtered images DATA2 have been classified into one of the classes CL1 and CL2 by the algorithms ALGO1 and ALGO2, in step 30, the comparing means 12 compare the classification performed by the statistical learning algorithm ALGO1 , which classification is stored in the memory 9 of the means 8, and the classification performed by the deep-learning algorithm ALGO2, which classification is stored in the memory 1 1 , for each given image of the set of images DATA1 .

The comparing means 12 determ ine the number of images classified into the same class CL1 , CL2 by the statistical learning algorithm ALGO1 and by the deep-learning algorithm ALGO2, and determ ine the classification accuracy of the deep-learning algorithm ALGO2 by computing the ratio between the number of images classified into the same class by both algorithms ALGO1 , ALGO2 and the total number of images of the set of radiographic images DATA1 .

Next, the comparing means 12 deliver the data set DATA4. The analysis of the data DATA4 of the classification performed by the statistical learning algorithm ALGO1 , which classification is stored in the memory 9, makes it possible to interpret the variation in the weights of the deep-learning algorithm ALGO2 when it comprises a neural network.

When the precision of the deep-learning algorithm ALGO2 is sufficient, the procedure for recognition of defects in the rolling element may be automated so as to increase the production rate of a line for producing rolling elements while m inim izing the risks of error in the interpretation of the image set DATA1 .