EP3637319B1 - Method for generating shape descriptors for two- or three-dimensional geometric shapes - Google Patents
Method for generating shape descriptors for two- or three-dimensional geometric shapes Download PDFInfo
- Publication number
- EP3637319B1 EP3637319B1 EP18199841.0A EP18199841A EP3637319B1 EP 3637319 B1 EP3637319 B1 EP 3637319B1 EP 18199841 A EP18199841 A EP 18199841A EP 3637319 B1 EP3637319 B1 EP 3637319B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- shape
- feature
- descriptors
- shapes
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 52
- 239000013598 vector Substances 0.000 claims description 28
- 238000005457 optimization Methods 0.000 claims description 15
- 238000004422 calculation algorithm Methods 0.000 claims description 14
- 238000010606 normalization Methods 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 6
- 238000013461 design Methods 0.000 claims description 5
- 230000009467 reduction Effects 0.000 claims description 5
- 238000007635 classification algorithm Methods 0.000 claims description 4
- 230000003247 decreasing effect Effects 0.000 claims description 4
- 238000005070 sampling Methods 0.000 claims description 2
- 238000013459 approach Methods 0.000 description 8
- 238000004088 simulation Methods 0.000 description 7
- 238000012938 design process Methods 0.000 description 5
- 230000009466 transformation Effects 0.000 description 5
- 238000010801 machine learning Methods 0.000 description 4
- 238000000513 principal component analysis Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 238000013135 deep learning Methods 0.000 description 3
- 239000012530 fluid Substances 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000000875 corresponding effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012880 independent component analysis Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000037237 body shape Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
- 238000002076 thermal analysis method Methods 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/11—Complex mathematical operations for solving equations, e.g. nonlinear equations, general mathematical optimization problems
- G06F17/13—Differential equations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/478—Contour-based spectral representations or scale-space representations, e.g. by Fourier analysis, wavelet analysis or curvature scale-space [CSS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Definitions
- the invention regards a computer-implemented method for processing of object designs in engineering by generating a set of unified efficient shape descriptors, which is helpful in order to enable engineers to efficiently optimize a shape of an objector, to retrieve a shape, or classify a plurality of shapes.
- shape descriptors which encode the properties of a shape in a lower dimensional representation.
- Shape descriptors can be grouped into two fundamental categories: local and global descriptors. Local descriptors work by determining some salient points on the shape and calculating features based on the geometry in the neighborhood of those key points. Global descriptors calculate features based on the complete shape or large parts of it.
- Examples of global shape descriptors are transformation-based descriptors, such as Fourier descriptors as disclosed for example in “ Efficient feature extraction for 2D/3D objects in mesh representation” (Zhang C, Chen T, IEEE International conference on Image Processing (2001). doi: 10.1109/ICIP.2001.958278 ), spherical harmonics descriptors and 3D Zernike moments as disclosed for example in “ Survey on 3D Shape Descriptors” (L. Zhang, M. Jo ⁇ o da Fonseca, A. Ferreira, Internal Report Univ. Lisboa, POSC/EIA/59938/2004 (2004 )).
- transformation-based descriptors such as Fourier descriptors as disclosed for example in “ Efficient feature extraction for 2D/3D objects in mesh representation” (Zhang C, Chen T, IEEE International conference on Image Processing (2001). doi: 10.1109/ICIP.2001.958278 ), spherical harmonics descriptors and 3D Zernike moments as
- Fourier shape descriptors encode the statistics of the wavelengths, that is, they encode which spatial variations occur when moving along the shape and how strong the signature of each wavelength is, i.e. a spectrum.
- the information about absolute positions in space and the correlated relative changes in a local neighborhood of the shape is distributed over the complete spectrum, i.e. in the complete feature vector.
- wavelengths feature values
- the equivalent insights apply to other transformation-based descriptors, such as Zernike moments, where the Zernike polynomials are used to decompose the shape, or spherical harmonics descriptors.
- US patent application publication US 2009/0157649 A1 discloses a hybrid content-based three-dimensional model search and retrieval method for queries in generic three-dimensional model datasets.
- the hybrid nature of the method is two-fold.
- the method uses a combination of two-dimensional and three-dimensional features as the shape descriptor of a three-dimensional model and, second, the method employs two alternative alignment techniques, CPCA (continuous principal component analysis) and NPCA (normal principal components analysis), for rotation normalization.
- the two-dimensional features are Fourier coefficients extracted from three pairs of depth buffers, which are computed for each Cartesian plane capturing the models along each axis.
- the three-dimensional features are spherical harmonic coefficients extracted from a spherical function based representation that captures the model's surface as well as volume information.
- discriminative features are calculated from 2D and 3D shapes.
- the basic idea for such calculation is that each point of the shape is assumed to emit one or more spherical wave, which are propagated throughout space with a spherical wave kernel e ikr r or some slight modification of it.
- Each point of the shape emitting such spherical wave generates a complex-valued field, which decays with the distance from the point of the shape.
- the contributions of all the spherical waves emitted from each point of the shape add up. Due to their complex-valuedness they will generate an interference pattern throughout space which is characteristic of the shape.
- Such a resulting interference pattern is used in order to represent a given shape.
- feature descriptors are calculated for a set of N feature locations positioned some distance away from the shape and distributed around the shape. Since contributions with different wave numbers can be associated with each point of the shape and each contribution decays with distance, the interference pattern at those feature locations will be very characteristic of the shape and the relative positon of the shape and the feature location.
- the feature descriptors are calculated for a set of M wave numbers, so for each feature location M feature descriptors are calculated resulting in M ⁇ N feature descriptors for one shape, i.e. a M ⁇ N -dimensional feature vector which is the shape descriptor F .
- a set of global shape descriptors for a set of two or three-dimensional geometric shapes is generated.
- a set ⁇ R n ⁇ of N feature locations is determined by an engineer, for example, and read in from a user interface or read from a memory.
- and n 1, ..., N .
- a parameter ⁇ ⁇ is read in, which is a parameter controlling a degree of locality of the features.
- This parameter may be read in directly from an interface where the respective value is input by an engineer, but may of course also be read in from a memory where for example a default value for the parameter is stored.
- s is a position vector of points of the shape s
- i is the imaginary unit
- ⁇ x ⁇ ⁇ [ ⁇ i ( x i ) ⁇ ]
- 1/ ⁇ is the L ⁇ norm of the vector x .
- the now calculated feature descriptors are the elements of an M ⁇ N dimensional vector of features which is the shape descriptor for shape s .
- the feature descriptors for each shape are normalized to the volume or surface area of the respective shape, i.e. a normalization factor of 1/ Vol shape s (volume normalization) or 1/ Area shape s (area normalization) can be used for each feature descriptor.
- Each of the shape descriptors of the novel set of shape descriptors, which is generated by the inventive method is represented by a set of feature descriptors, that may also be called diffraction features, which can be derived from any geometry in a well-defined and straight-forward manner, and which encodes relevant local and global geometric aspects of each shape.
- the number of feature descriptors, i.e. the dimensionality of the shape descriptor, some qualitative aspects of the features, and the global properties of the set of shape descriptors can be adjusted freely and therefore enables the engineer to adjust it to the type and amount of available data, as well as to the requirements from the data management side for storage in memory and on disk, and to the future applications to be performed on the set of shape descriptors.
- the advantageous aspect of the inventive method is to enable effective storage, post-processing and information extraction for a possibly large set of large shapes in an improved and effective manner.
- the shape descriptor as calculated by the inventive method is a global descriptor, where for each shape descriptor of each shape and for each entry in the vector, i.e. each feature descriptor the complete shape is taken into account.
- each feature descriptor is rather sensitive to local changes.
- each entry in each shape descriptor is most sensitive to local changes of that region of the shape, which is spatially closest to its feature location.
- the inventive method thus provides a low dimensional representation for a set of shapes that allows efficient computational processing while at the same time does not require omission of information due to voxelization or extracting statistics from the shapes like state of the art approaches, but instead always uses the complete information of the complete set of shapes.
- the shape data are provided as volume or surface meshes and an advantageous aspect of the present invention is that it can easily be adapted to such situations.
- the positions of the feature locations are chosen preferably to lie on a surface around the complete set of shapes.
- Preferred surfaces are for example a sphere with radius D, a cuboid with edge lengths A, B, and C, or a right circular cylinder with radius D and height H.
- the distribution of the points on the surface could be either deterministic, where the positions on the surface are calculated by a deterministic algorithm to follow a desired pattern or randomly, where the positions on the surface are determined by a randomized sampling technique in order to follow a desired distribution.
- the value for the center and the dimensions of such surfaces can be either given directly as absolute numbers or determined relative to the shapes by an algorithm, where, for example, the maximal linear length of each shape is calculated and then the parameters of the surface are set to a multiple of maximal length found for the complete set of shapes.
- the feature locations are chosen relative to the complete set of shapes and the variations of the positions of individual shapes within the set of shapes is encoded in the shape descriptors.
- the location of the shape features could be chosen relative to each shape in the set of shapes individually, which amounts to a normalization of the position of the feature location to each shape individually and removes the dependency of relative shifts between the shapes in the set of shapes from the shape descriptors.
- the M wave numbers may be chosen to range from k min to k max and the spacing between the values may be chosen according to a desired behavior, for example, constant, linearly increasing or decreasing, exponentially increasing or decreasing, or user-defined values. It is additionally possible to add random noise of a defined strength to the values of the wave numbers.
- the values for k min and k max can be either specified directly as absolute numbers or calculated relative to each shape with an algorithm, where, for example, k min and k max are multiples of 2 ⁇ L and L is a length scale extracted from the set of shapes by determining the smallest sphere or cuboid which fully contains the set of shapes and then setting L to the value of the radius or the largest edge length of such a minimal sphere or cuboid, respectively.
- the feature locations as well as the values for the wave numbers are determined by an optimization procedure which optimizes a desired property of the complete set of shape descriptors. For example, for a given set of shapes, the position vectors of the feature locations as well as the values for the wave numbers are optimized in order to maximize the mutual distances between the shape descriptors. Alternatively, for a given training set of shapes along with some class labels, the position vectors as well as the values for the wave numbers are optimized in order to maximize classification performance when applying a classification algorithm to the set of shape descriptors of the training set, which tries to determine the proper class label for each shape.
- a pose-normalization procedure is applied to the shape descriptor of each shape in the set of shapes F s in order to arrive at a normalized shape descriptor F s , final , which is then used for further processing.
- a set of symmetry operations ⁇ R b ⁇ is included which map the set of feature locations ⁇ R n ⁇ onto itself.
- the shape descriptors from one shape F s of all those symmetry operations are considered equivalent and thus define the identity mapping on the final feature vector F s,final .
- the corresponding set of shape descriptors can be further processed by applying dimensionality reduction and manifold embedding techniques such as principal component analysis (PCA), independent component analysis (ICA), locally linear embedding (LLE), multi-dimensional scaling (MDS), Isomaps, or other linear or non-linear techniques.
- PCA principal component analysis
- ICA independent component analysis
- LLE locally linear embedding
- MDS multi-dimensional scaling
- Isomaps or other linear or non-linear techniques.
- the shape descriptor is reorganized and the dimensionality of each shape descriptor is possibly reduced from M ⁇ N to D ⁇ M ⁇ N, which allows for an even more useful and compact low-dimensional representation of shapes for a given set of shapes.
- the inventive method is further developed when the calculated set of shape descriptors (set of diffraction feature shape descriptors) are used as an input in a classification algorithm, which is thus run based on the respective shape descriptor. For a given set of shapes, which are organized in several categories the diffraction feature shape descriptor of one specific new shape is used to determine the category to which this newly observed shape belongs.
- the classification can either be done in a supervised manner, where a labeled training data set with shapes and their respective categories is used to train a classifier.
- the classification algorithm can be any of the established algorithms such as linear classifiers, support vector machines, kernel estimation, decision trees, neural networks, learning vector quantization or deep learning convolutional neural network approaches to name a few.
- the classification can also be organized in an unsupervised manner, where the categories for the shapes as well as the classification of the newly observed shape are determined by a clustering algorithm, for example a density-based, distribution-based, centroid-based, or hierarchical clustering algorithm.
- the set of diffraction feature shape descriptors may be used in a shape retrieval algorithm where for a given query shape the feature descriptors of that shape are used to find a set of similar shapes from the given set of shapes.
- the similarity of two shapes is evaluated by assessing the similarity of the two corresponding shape descriptors. For example, the absolute value (L2-norm) of a difference vector of the two shape descriptors of the two shapes can serve as a distance measure for the two shapes and shapes with smaller distances are considered more similar.
- the set of diffraction feature shape descriptors may also be used in a surrogate-assisted shape optimization process.
- a set of shape descriptors as described by this invention is calculated from the data from many shape optimization runs, possibly from different application fields (e.g., crash, aero-dynamics, structural mechanics, thermal analysis, noise-vibration-harshness, etc%), where quality criteria for many different shapes are determined, and this set is used to learn one or more surrogate models, which, given the diffraction feature shape descriptor of a new shape as input, will predict the performance values of the shape in one or more disciplines.
- the position vectors R n point to feature locations.
- figure 1 illustrates that the feature locations are chosen to all lie on a sphere where the length of R n is fixed for all n,
- 5 L and where L is some characteristic length scale of some shape S s of the set of shapes, i.e. its maximum linear dimension.
- the distribution of the feature locations on the sphere could be chosen accordingly by using a regular grid in the azimuthal and polar angles or to be a Fibonacci lattice.
- R n
- 5L is the length (L2 norm) of the position vector of the feature location
- s is a position vector of the points on the shape S s and the integral is summing all contributions from each point of the shape S s .
- i is the imaginary unit and k m the wave number.
- the pre-factor ( R n ) ⁇ e -ik m R n is included to factor out the trivial far-field dependence of the features and its exponent ⁇ as well as the exponent of the denominator in the integral is set to 2 in the example in order to have a slightly larger bias toward local features as compared to choosing an exponent of 1 (which is the value for the wave kernel of physical light diffraction patterns). In order to adapt the degree of locality this exponent may be set by an engineer.
- the shape data is naturally provided as a volume or surface mesh.
- Figure 1 shows an example for the positioning of the feature locations around one specific car shape S from the set of shapes.
- the maximal linear dimension L of the car shape S as well as the integration vector s running over the car shape is also indicated.
- scale-invariance with respect to the overall scale of each shape S from the set of shapes is achieved if desired by using the normalization of the shape to the absolute surface area or volume of the shape, as indicated by the last factor in the above equation, and by calculating the maximal linear length L of each shape s and placing the feature locations on a sphere with a radius given in terms of this length L and also selecting the wave numbers dependent on this length scale.
- a symmetry-transformation just re-names the feature locations, i.e. permutes the ordering of the set of feature locations. All shape descriptors, which are produced under such symmetry transformation just have permuted entries and are considered as equivalent.
- both measures realize pose normalization of the three-dimensional (3D) shape.
- multi-disciplinary shape optimization starting from an initial shape.
- such optimization could be an optimization of the car body shape s for aerodynamic efficiency where drag should be minimized while certain other aspects of the flow should be maintained such as downforce in the rear part of the car.
- the structural mechanical properties of the car should also be optimized for supporting various given static loads cases.
- the car shape is parameterized by one or more methods most convenient for the development engineer of each discipline and such parameterization usually changes during such a process as different parts of the car are optimized separately in each discipline.
- the evaluation of the aerodynamic properties is done with computational fluid dynamics (CFD) and finite element method (FEM) simulations, for example.
- the efficient low-dimensional representation must represent the complete car geometry. Even further gain is possible by using a unified efficient low-dimensional representation, which can be utilized in multiple disciplines such as CFD of FEA simultaneously.
- the proposed set of diffraction feature shape descriptors for a set of shapes is a very promising realization of such unified efficient low dimensional representations for a set of shapes.
- the set of diffraction feature shape descriptors is calculated for a set of shapes generated during some initial phase of the design procedure.
- the dimensionality of each diffraction feature shape descriptor can be reduced by applying a dimensionality reduction technique such as principal component analysis or locally linear embedding to the complete set of shape descriptors.
- surrogate models such as Gaussian process kriging models, support vector regressors, or random forest models are trained on the set of dimensionally reduced shape descriptors to predict the aerodynamic and structural mechanics performance given the dimensionality reduced diffraction feature shape descriptors of a new shape as input.
- surrogate models can be used in one of the many surrogate-assisted single-objective and multi-objective optimization approaches that are already known in the art. In such optimization approaches, for a newly proposed design the diffraction feature shape descriptor is calculated, the dimensionality reduction transformation is applied and then the surrogate models are used to estimate the aerodynamic and structural mechanics performance of the new shape, without running the resource consuming CFD or FEM simulations.
- the set of diffraction feature shape descriptors are used in shape matching or shape retrieval algorithms where similarities between shapes need to be assessed.
- This application is, for example, relevant in the engineering design process when an engineer develops a new shape and then tries to find similar shapes in the existing database of shapes, which were already evaluated in prior design processes.
- the feature locations are chosen where the same feature locations and wave vectors will be used for all shapes.
- the diffraction feature shape descriptor F s is calculated.
- the query shape is evaluated with the clustering algorithm which was used to determine the categories and all shapes with the same class label are determined and considered as similar.
- step S1 the feature locations are defined.
- step S2 the wave numbers are defined.
- step S3 the degree of locality is set.
- all these inputs that are necessary in order to calculate the set of feature descriptors in step S4 may be read in from a memory, which is part of a computer system that is used in order to calculate the feature descriptors and later on to generate the set of shape descriptors ⁇ F s ⁇ from the feature descriptors.
- the computer furthermore includes a processor connected to the memory where the calculation of the feature descriptors is done and also the generation of the set of shape descriptors ⁇ F s ⁇ .
- the definition of the feature location, the wave numbers and the degree of locality could be input into the computer system directly by an engineer via an interface.
- the feature descriptors After the feature descriptors have been calculated for each shape s, they are assigned to elements of feature vector, in order to generate the set of shape descriptors ⁇ F s ⁇ in step S5.
- the set of shape descriptors ⁇ F s ⁇ is then output either directly into an algorithm where, based on the set of shape descriptors ⁇ F s ⁇ , further processing is performed, for example in order to perform shape matching or retrieval of the shape, or to perform surrogate-assisted optimization as already mentioned above in greater detail.
- the set of shape descriptors ⁇ F s ⁇ may also be stored in the memory of the computer system.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Pure & Applied Mathematics (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Algebra (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Operations Research (AREA)
- Image Generation (AREA)
- Processing Or Creating Images (AREA)
- Length Measuring Devices By Optical Means (AREA)
Description
- The invention regards a computer-implemented method for processing of object designs in engineering by generating a set of unified efficient shape descriptors, which is helpful in order to enable engineers to efficiently optimize a shape of an objector, to retrieve a shape, or classify a plurality of shapes.
- During the engineering design process of complex shapes, such as shapes of cars or turbo-fan engine blades, the crucial question exists how to represent all possible shapes for development and evaluation. In the context of shape optimization many different types of representations exist, prominent examples are direct parameterizations or various deformation methods. During a design process for a certain shape, many different geometries are created and their performance is evaluated in various disciplines, such as aerodynamic efficiency, crashworthiness, structural mechanical properties, thermal properties, noise, etc. In the course of the design process the type as well as the details of the representation usually changes frequently.
- The complete set of geometries along with the evaluated performance data constitutes a very valuable dataset, which enables the engineers to generate novel insights and knowledge. In such a context machine learning offers very powerful tools for automatic data analysis and knowledge generation, such as prediction and classification models, or dimensionality reduction techniques. Usually, the parameters of the shape representation are used as the input values for such machine learning techniques. However, if representations of the shapes vary between different datasets, the direct application of machine learning techniques to the complete dataset using the representation parameters as inputs is not possible, even though they all encode the same type of geometric shape, which are in principle comparable to each other. The reason is that the meaning of the input parameters changes, as for example, in one representation the parameters encode the shape of the frontal part of a car, whereas in another representation the rear is encoded.
- The alternative of directly using the coordinates of the entire shape geometry as input parameters for the machine learning has the major drawback that a huge training dataset with geometry and performance data is necessary, due to the very high dimensionality of the input parameter space. But in typical engineering applications, the generation of data is quite time and resource consuming and therefore the amount of data is usually rather limited in comparison to modern learning approaches, such as deep learning for 2D image data.
- In order to tackle this problem, usually shape descriptors are used which encode the properties of a shape in a lower dimensional representation.
- There exist many shape descriptors for two and three-dimensional shapes in the literature, as reviewed, for example, in "Survey on 3D Shape Descriptors" (L. Zhang, M. João da Fonseca, A. Ferreira, Internal Report Univ. Lisboa, POSC/EIA/59938/2004 (2004)). More recent approaches also utilize deep learning, see, for example, "Deepshape: Deep learned shape descriptor for 3D shape matching and retrieval" (J. Xie, Y. Fang, F. Zhu, E. Wong, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1275-1283 (2015) doi: 10.1109/CVPR.2015.7298732).
- Shape descriptors can be grouped into two fundamental categories: local and global descriptors. Local descriptors work by determining some salient points on the shape and calculating features based on the geometry in the neighborhood of those key points. Global descriptors calculate features based on the complete shape or large parts of it.
- Examples of global shape descriptors are transformation-based descriptors, such as Fourier descriptors as disclosed for example in "Efficient feature extraction for 2D/3D objects in mesh representation" (Zhang C, Chen T, IEEE International conference on Image Processing (2001). doi: 10.1109/ICIP.2001.958278), spherical harmonics descriptors and 3D Zernike moments as disclosed for example in "Survey on 3D Shape Descriptors" (L. Zhang, M. João da Fonseca, A. Ferreira, Internal Report Univ. Lisboa, POSC/EIA/59938/2004 (2004)). All these global shape descriptors sum over all points of the shape and transform them into a different representation by using some sort of kernel function. As a drawback, the known global descriptors suffer from a lack of local geometric information. Firstly, as a pre-processing step, the shape is either voxelized or some shape signatures such as centroid distances are derived which incorporates a loss of information about the local structure of the shape. Secondly, the individual entries in the actual feature vectors derived by using the actual transform are really global as each feature encodes one specific type of statistics of the complete shape without directly encoding local geometric information (of the already coarse-grained representation) as well. For example, Fourier shape descriptors encode the statistics of the wavelengths, that is, they encode which spatial variations occur when moving along the shape and how strong the signature of each wavelength is, i.e. a spectrum. The information about absolute positions in space and the correlated relative changes in a local neighborhood of the shape is distributed over the complete spectrum, i.e. in the complete feature vector. When truncating the spectrum by selecting only a small set of feature values (wavelengths), which is a necessary step to arrive at a manageable feature vector, some portion of such information is lost and it is a priori not clear what the implications are for the global and local representation of the shape. The equivalent insights apply to other transformation-based descriptors, such as Zernike moments, where the Zernike polynomials are used to decompose the shape, or spherical harmonics descriptors.
- US patent application publication
US 2009/0157649 A1 discloses a hybrid content-based three-dimensional model search and retrieval method for queries in generic three-dimensional model datasets. The hybrid nature of the method is two-fold. First, the method uses a combination of two-dimensional and three-dimensional features as the shape descriptor of a three-dimensional model and, second, the method employs two alternative alignment techniques, CPCA (continuous principal component analysis) and NPCA (normal principal components analysis), for rotation normalization. The two-dimensional features are Fourier coefficients extracted from three pairs of depth buffers, which are computed for each Cartesian plane capturing the models along each axis. The three-dimensional features are spherical harmonic coefficients extracted from a spherical function based representation that captures the model's surface as well as volume information. - It is thus an object of the present invention to provide a method for generating a set of shape descriptors for a set of two or three-dimensional geometric shapes as an efficient unified low-dimensional representation of a set of shapes that allows cost-efficient processing in an engineering process without losing information deriving from an entire set of shapes of objects.
- This objective is achieved by a computer-implemented method for processing object designs in engineering as defined in
claim 1. - Before aspects and details of the present invention are explained with respect to the figures, the basic idea underlying the set of feature descriptors shall be explained. With the method according to the present invention, discriminative features are calculated from 2D and 3D shapes. The basic idea for such calculation is that each point of the shape is assumed to emit one or more spherical wave, which are propagated throughout space with a spherical wave kernel
- Such a resulting interference pattern is used in order to represent a given shape. For such a given shape, feature descriptors are calculated for a set of N feature locations positioned some distance away from the shape and distributed around the shape. Since contributions with different wave numbers can be associated with each point of the shape and each contribution decays with distance, the interference pattern at those feature locations will be very characteristic of the shape and the relative positon of the shape and the feature location. Generally, the feature descriptors are calculated for a set of M wave numbers, so for each feature location M feature descriptors are calculated resulting in M · N feature descriptors for one shape, i.e. a M · N-dimensional feature vector which is the shape descriptor
F . - According to the inventive method a set of global shape descriptors for a set of two or three-dimensional geometric shapes is generated. At first, a set {
R n } of N feature locations is determined by an engineer, for example, and read in from a user interface or read from a memory. The feature locations have a distance from the shapes in the set of shapes andR n is the position vector of the feature location having the length Rn = |R n | and n = 1, ..., N. Additionally a set {km } of M wave numbers with m = 1, ..., M is determined by an engineer and read in via a user interface or also read from a memory. Further, a parameter γ ∈ is read in, which is a parameter controlling a degree of locality of the features. This parameter may be read in directly from an interface where the respective value is input by an engineer, but may of course also be read in from a memory where for example a default value for the parameter is stored. - For each shape s of the set of shapes {Ss ,s = 1, ..., Ns } a feature descriptor is then calculated for each of the N feature locations and M wave numbers, according to the rule
s is a position vector of points of the shape s, i is the imaginary unit, ∥x ∥ α = [Σ i (xi ) α ]1/α is the Lα norm of the vectorx . The now calculated feature descriptors are the elements of an M · N dimensional vector of features which is the shape descriptor for shape s. The feature descriptors for each shape are normalized to the volume or surface area of the respective shape, i.e. a normalization factor of 1/Volshape s (volume normalization) or 1/Areashape s (area normalization) can be used for each feature descriptor. The feature descriptors are associated with the shape descriptor of shape s according to - Finally, the set of shape descriptors for all shapes is output for further processing.
- Each of the shape descriptors of the novel set of shape descriptors, which is generated by the inventive method is represented by a set of feature descriptors, that may also be called diffraction features, which can be derived from any geometry in a well-defined and straight-forward manner, and which encodes relevant local and global geometric aspects of each shape. The number of feature descriptors, i.e. the dimensionality of the shape descriptor, some qualitative aspects of the features, and the global properties of the set of shape descriptors can be adjusted freely and therefore enables the engineer to adjust it to the type and amount of available data, as well as to the requirements from the data management side for storage in memory and on disk, and to the future applications to be performed on the set of shape descriptors. The advantageous aspect of the inventive method is to enable effective storage, post-processing and information extraction for a possibly large set of large shapes in an improved and effective manner.
- The shape descriptor as calculated by the inventive method is a global descriptor, where for each shape descriptor of each shape and for each entry in the vector, i.e. each feature descriptor the complete shape is taken into account. However, due to the fact that the distance between the feature location and the contribution of each part of each shape enters explicitly and, in particular, it's scaling with the inverse distance to the power of γ, each feature descriptor is rather sensitive to local changes. In particular, each entry in each shape descriptor is most sensitive to local changes of that region of the shape, which is spatially closest to its feature location.
- The inventive method thus provides a low dimensional representation for a set of shapes that allows efficient computational processing while at the same time does not require omission of information due to voxelization or extracting statistics from the shapes like state of the art approaches, but instead always uses the complete information of the complete set of shapes.
- In usual engineering applications, the shape data are provided as volume or surface meshes and an advantageous aspect of the present invention is that it can easily be adapted to such situations. For each feature descriptor of each shape s in the set of shapes {Ss, s = 1, ..., Ns } the integration over the shape is performed by summing over all mesh cells c of each shape where the contribution of each mesh cell c is calculated using the center-of-mass coordinate of each cell,
s c , and the volume- or area-weighted sum is taken over all mesh cells, i.e., - The positions of the feature locations are chosen preferably to lie on a surface around the complete set of shapes. Preferred surfaces are for example a sphere with radius D, a cuboid with edge lengths A, B, and C, or a right circular cylinder with radius D and height H. The distribution of the points on the surface could be either deterministic, where the positions on the surface are calculated by a deterministic algorithm to follow a desired pattern or randomly, where the positions on the surface are determined by a randomized sampling technique in order to follow a desired distribution. The value for the center and the dimensions of such surfaces (radius D of the sphere, edge lengths A, B, and C of the cuboid, radius D and height H of the right circular cylinder) can be either given directly as absolute numbers or determined relative to the shapes by an algorithm, where, for example, the maximal linear length of each shape is calculated and then the parameters of the surface are set to a multiple of maximal length found for the complete set of shapes. In this case, the feature locations are chosen relative to the complete set of shapes and the variations of the positions of individual shapes within the set of shapes is encoded in the shape descriptors. Alternatively, the location of the shape features could be chosen relative to each shape in the set of shapes individually, which amounts to a normalization of the position of the feature location to each shape individually and removes the dependency of relative shifts between the shapes in the set of shapes from the shape descriptors.
- The M wave numbers may be chosen to range from kmin to kmax and the spacing between the values may be chosen according to a desired behavior, for example, constant, linearly increasing or decreasing, exponentially increasing or decreasing, or user-defined values. It is additionally possible to add random noise of a defined strength to the values of the wave numbers. The values for kmin and kmax can be either specified directly as absolute numbers or calculated relative to each shape with an algorithm, where, for example, kmin and kmax are multiples of
- It is in particular preferred that the feature locations as well as the values for the wave numbers are determined by an optimization procedure which optimizes a desired property of the complete set of shape descriptors. For example, for a given set of shapes, the position vectors of the feature locations as well as the values for the wave numbers are optimized in order to maximize the mutual distances between the shape descriptors. Alternatively, for a given training set of shapes along with some class labels, the position vectors as well as the values for the wave numbers are optimized in order to maximize classification performance when applying a classification algorithm to the set of shape descriptors of the training set, which tries to determine the proper class label for each shape.
- Advantageously, a pose-normalization procedure is applied to the shape descriptor of each shape in the set of shapes
F s in order to arrive at a normalized shape descriptorF s, final, which is then used for further processing. For example, a set of symmetry operations {Rb } is included which map the set of feature locations {R n } onto itself. The shape descriptors from one shapeF s of all those symmetry operations are considered equivalent and thus define the identity mapping on the final feature vectorF s,final . - In order to minimize the computational cost for applications of the diffraction feature shape descriptors, for a given set of shapes the corresponding set of shape descriptors can be further processed by applying dimensionality reduction and manifold embedding techniques such as principal component analysis (PCA), independent component analysis (ICA), locally linear embedding (LLE), multi-dimensional scaling (MDS), Isomaps, or other linear or non-linear techniques. In this process the shape descriptor is reorganized and the dimensionality of each shape descriptor is possibly reduced from M · N to D ≤ M · N, which allows for an even more useful and compact low-dimensional representation of shapes for a given set of shapes.
- The inventive method is further developed when the calculated set of shape descriptors (set of diffraction feature shape descriptors) are used as an input in a classification algorithm, which is thus run based on the respective shape descriptor. For a given set of shapes, which are organized in several categories the diffraction feature shape descriptor of one specific new shape is used to determine the category to which this newly observed shape belongs. The classification can either be done in a supervised manner, where a labeled training data set with shapes and their respective categories is used to train a classifier. Depending on the data set and the number of calculated feature descriptors, the classification algorithm can be any of the established algorithms such as linear classifiers, support vector machines, kernel estimation, decision trees, neural networks, learning vector quantization or deep learning convolutional neural network approaches to name a few. The classification can also be organized in an unsupervised manner, where the categories for the shapes as well as the classification of the newly observed shape are determined by a clustering algorithm, for example a density-based, distribution-based, centroid-based, or hierarchical clustering algorithm.
- Alternatively, the set of diffraction feature shape descriptors may be used in a shape retrieval algorithm where for a given query shape the feature descriptors of that shape are used to find a set of similar shapes from the given set of shapes. The similarity of two shapes is evaluated by assessing the similarity of the two corresponding shape descriptors. For example, the absolute value (L2-norm) of a difference vector of the two shape descriptors of the two shapes can serve as a distance measure for the two shapes and shapes with smaller distances are considered more similar.
- The set of diffraction feature shape descriptors may also be used in a surrogate-assisted shape optimization process. In such a context, a set of shape descriptors as described by this invention is calculated from the data from many shape optimization runs, possibly from different application fields (e.g., crash, aero-dynamics, structural mechanics, thermal analysis, noise-vibration-harshness, etc...), where quality criteria for many different shapes are determined, and this set is used to learn one or more surrogate models, which, given the diffraction feature shape descriptor of a new shape as input, will predict the performance values of the shape in one or more disciplines.
- Explanations on an embodiment of the present invention will now be given with respect to the annexed drawings in which
- Figure 1
- illustrates feature locations arranged on a surface enclosing one respective shape of the set of shape to be represented, and
- Figure 2
- is a flowchart in which the main method steps according to the invention are illustrated.
- For a given set of shapes {Ss , s = 1, ..., Ns } the set of shape descriptors {
F s , s = 1, ..., Ns } (i.e. the set of diffraction feature vectors) can be calculated in the following way which is explained with reference tofigure 1 . First, N position vectorsR n , where n={1,...,N} are chosen some distance away from the shapes {Ss } and distributed all around the shapes. The position vectorsR n point to feature locations. As an example,figure 1 illustrates that the feature locations are chosen to all lie on a sphere where the length ofR n is fixed for all n, |R n | = 5 L and where L is some characteristic length scale of some shape Ss of the set of shapes, i.e. its maximum linear dimension. The distribution of the feature locations on the sphere could be chosen accordingly by using a regular grid in the azimuthal and polar angles or to be a Fibonacci lattice. - Then, a set of wave numbers is determined by the engineer, for example
F s } can be generated where each individual shape descriptorR n | = 5L is the length (L2 norm) of the position vector of the feature location,s is a position vector of the points on the shape Ss and the integral is summing all contributions from each point of the shape Ss. i is the imaginary unit and km the wave number. The pre-factor (Rn)γ e-ikm Rn is included to factor out the trivial far-field dependence of the features and its exponent γ as well as the exponent of the denominator in the integral is set to 2 in the example in order to have a slightly larger bias toward local features as compared to choosing an exponent of 1 (which is the value for the wave kernel of physical light diffraction patterns). In order to adapt the degree of locality this exponent may be set by an engineer. - In typical engineering applications where the shapes are usually evaluated with respect to some performance using simulations such as computational fluid dynamics (CFD) or computations structural dynamics (CSD), the shape data is naturally provided as a volume or surface mesh. In such a case the integral over the shape can be represented as a sum over all mesh cells c and the contribution of each mesh cell c is calculated using the center-of-mass coordinate of each cell,
s c , and the volume- or area-weighted sum is taken over all mesh cells, i.e., -
Figure 1 shows an example for the positioning of the feature locations around one specific car shape S from the set of shapes. The maximal linear dimension L of the car shape S as well as the integration vectors running over the car shape is also indicated. - It is to be noted, that scale-invariance with respect to the overall scale of each shape S from the set of shapes is achieved if desired by using the normalization of the shape to the absolute surface area or volume of the shape, as indicated by the last factor in the above equation, and by calculating the maximal linear length L of each shape s and placing the feature locations on a sphere with a radius given in terms of this length L and also selecting the wave numbers dependent on this length scale.
- Further, invariance of the features with respect to orientation of the shape can be achieved if desired by determining a set of symmetry transformations {Rb } which map the set of feature locations onto itself, {Rb : {Rn } → {Rb (Rn ) = Rn' }}. A symmetry-transformation just re-names the feature locations, i.e. permutes the ordering of the set of feature locations. All shape descriptors, which are produced under such symmetry transformation just have permuted entries and are considered as equivalent.
- In combination, both measures realize pose normalization of the three-dimensional (3D) shape.
- The set of shape descriptors {
F s , s = 1, ..., Ns } of a set of shapes serves as a low-dimensional representation of the complete set of shapes and is, according to a preferred embodiment of the invention, used to build models which are trained to predict a performance of a new shape. Thus, one preferred embodiment regards multi-disciplinary shape optimization starting from an initial shape. For example, such optimization could be an optimization of the car body shape s for aerodynamic efficiency where drag should be minimized while certain other aspects of the flow should be maintained such as downforce in the rear part of the car. In addition to the aerodynamics, the structural mechanical properties of the car should also be optimized for supporting various given static loads cases. For such application, the car shape is parameterized by one or more methods most convenient for the development engineer of each discipline and such parameterization usually changes during such a process as different parts of the car are optimized separately in each discipline. The evaluation of the aerodynamic properties is done with computational fluid dynamics (CFD) and finite element method (FEM) simulations, for example. - A significant gain and speed-up in the individual disciplines, CFD or FEM, can already be achieved by utilizing surrogate models, which replace part of the actual CFD or FEM simulations and - after being trained on a set of simulation data obtained for a set of shapes - predict the aerodynamics and structural mechanics for new car shapes only using the efficient low-dimensional representation of the car shape as input. In order to utilize all available data, the efficient low-dimensional representation must represent the complete car geometry. Even further gain is possible by using a unified efficient low-dimensional representation, which can be utilized in multiple disciplines such as CFD of FEA simultaneously.
- The proposed set of diffraction feature shape descriptors for a set of shapes is a very promising realization of such unified efficient low dimensional representations for a set of shapes. In such a scenario, the set of diffraction feature shape descriptors is calculated for a set of shapes generated during some initial phase of the design procedure. The dimensionality of each diffraction feature shape descriptor can be reduced by applying a dimensionality reduction technique such as principal component analysis or locally linear embedding to the complete set of shape descriptors. Then surrogate models, such as Gaussian process kriging models, support vector regressors, or random forest models are trained on the set of dimensionally reduced shape descriptors to predict the aerodynamic and structural mechanics performance given the dimensionality reduced diffraction feature shape descriptors of a new shape as input. Then, such models can be used in one of the many surrogate-assisted single-objective and multi-objective optimization approaches that are already known in the art. In such optimization approaches, for a newly proposed design the diffraction feature shape descriptor is calculated, the dimensionality reduction transformation is applied and then the surrogate models are used to estimate the aerodynamic and structural mechanics performance of the new shape, without running the resource consuming CFD or FEM simulations. Thus, a new car shape with improved aerodynamic and structural mechanics performance can be achieved with a numerical optimization approach, where depending on the details of the surrogate-assisted optimization algorithm, the number of necessary CFD and FEM simulations can be drastically reduced. Similar approaches can be taken for other and arbitrary number of disciplines, where this embodiment of the invention serves as the one unified efficient low-dimensional representation for a set of shapes.
- One significant advantage of the shape descriptors generated by the invention used for such applications described above using CFD simulations in particular, is that the interference pattern encoded in the diffraction feature shape descriptors is sensitive to small changes of the geometry, which might have strong impact on the aerodynamics. But at the same time, the features are global in nature, where large scale changes are captured as well. And additionally, when used without any pose normalization, the features are sensitive to the absolute positioning and orientation of the shapes which is a very good aspect when used for modelling fluid flow around shapes or the effect static or dynamic directed forces have in a shape since in both applications the absolute orientation of the shapes is important.
- According to another advantageous embodiment not covered by the claimed invention, the set of diffraction feature shape descriptors are used in shape matching or shape retrieval algorithms where similarities between shapes need to be assessed. This application is, for example, relevant in the engineering design process when an engineer develops a new shape and then tries to find similar shapes in the existing database of shapes, which were already evaluated in prior design processes. In a typical application we are given a set of shapes, {Ss , s = 1, ..., Ns }, which is for example the archive of already evaluated shapes, which we would like to partition into different categories and then allow for shape retrieval applications, where the most similar shape to a novel shape to arrive later is sought. First, the feature locations are chosen where the same feature locations and wave vectors will be used for all shapes. Then, for each shape Ss the diffraction feature shape descriptor
F s is calculated. The set of shapes {Ss } can then be partitioned into different categories by applying a clustering algorithm on the set of respective shape descriptors {F s , s = 1, ..., Ns }. For the subsequent shape retrieval application the query shape is evaluated with the clustering algorithm which was used to determine the categories and all shapes with the same class label are determined and considered as similar. The major advantage of the proposed set of diffraction feature shape descriptors calculated in the above described manner is that one unified set of shape descriptors can be used for all applications described above. For properly chosen feature locations, degree of locality and wave numbers, the one set of shape descriptor {F s , s = 1, ..., Ns } calculated once for the associated set of shapes {Ss , s = 1, ..., Ns } can be simultaneously used for all types of applications, such as shape classification, shape retrieval, performance prediction of new shapes, surrogate assisted shape optimization, and more. This is enabled by the global nature of the shape descriptors, which are at the same time sensitive to local changes of shapes due to the interference and complex valuedness of the shape descriptors. - In
figure 2 there is shown a simplified flowchart to illustrate the main method steps according to the invention. At first in step S1 the feature locations are defined. Then, in step S2 the wave numbers are defined. It is to be noted that, of course, the sequence of the first two method steps S1 and S2 may be altered. Further, in step S3 the degree of locality is set. According to one aspect of the invention, all these inputs that are necessary in order to calculate the set of feature descriptors in step S4 may be read in from a memory, which is part of a computer system that is used in order to calculate the feature descriptors and later on to generate the set of shape descriptors {F s } from the feature descriptors. The computer furthermore includes a processor connected to the memory where the calculation of the feature descriptors is done and also the generation of the set of shape descriptors {F s }. - Alternatively, the definition of the feature location, the wave numbers and the degree of locality could be input into the computer system directly by an engineer via an interface.
- After the feature descriptors have been calculated for each shape s, they are assigned to elements of feature vector, in order to generate the set of shape descriptors {
F s } in step S5. The set of shape descriptors {F s } is then output either directly into an algorithm where, based on the set of shape descriptors{F s }, further processing is performed, for example in order to perform shape matching or retrieval of the shape, or to perform surrogate-assisted optimization as already mentioned above in greater detail. Of course, the set of shape descriptors {F s } may also be stored in the memory of the computer system.
Claims (11)
- A computer-implemented method for processing object designs in engineering by generating a set of shape descriptors {
F s , s = 1, ..., Ns } for a set of two or three dimensional geometric shapes, comprising the following steps:- reading a set {R n } of N feature locations, whereinR n is the position vector of a feature location having the length Rn = |R n | and n = 1, ..., N (S1);- reading (S2) a set {km } of M wave numbers, wherein m = 1, ..., M;- for each shape s calculating (S4) for each of the N feature locationsR n and M wave numbers km a feature descriptor fs (n,m) according to the rules is a position vector of points of the shape,i is the imaginary unit,C is a normalization constant which can be chosen either C = 1 or to normalize the feature to the absolute volume or surface area of the shape: C = 1/∫ shape s d 3s .;- assigning (S5) the calculated feature descriptors fs (n,m) to an M · N dimensional vector of features as the shape descriptorF s according to- outputting (S6) the set of shape descriptors {F s , s = 1, ...,Ns } for further processing. - The computer-implemented method according to claim 1,
wherein data of the shapes is provided as a volume or surface mesh and for each feature descriptor the integral is calculated according tos c is a center-of-mass coordinate of the respective cell c,Ac is the volume or area of the respective mesh cell c, and - The computer-implemented method according to claim 1 or 2,
wherein positions of the feature locations lie on a surface around the shapes with the feature locations being calculated by a deterministic algorithm to follow a desired pattern or randomly, where the positions of the feature locations on the surface are determined by a randomized sampling technique in order to follow a desired distribution. - The computer-implemented method according to any one of claims 1 to 3,
wherein the M wave numbers are chosen to range from kmin to kmax and a spacing between values of the wave numbers is constant, linearly increasing, linearly decreasing, exponentially increasing, exponentially decreasing or explicitly given by a user. - The computer-implemented method according to claim 4,
wherein random noise of a defined strength can also be added to the values of the wave numbers. - The computer-implemented method according to any one of claims 1 to 5,
wherein a dimensionality reduction or embedding technique is used to transform the complete set of shape descriptors {F s } and possibly reduce the dimensionality of each shape descriptorF s in the set of shape descriptors. - The computer-implemented method according to any one of claims 1 to 6,
wherein the feature locations and/or the values for the wave numbers are determined by an optimization algorithm. - The computer-implemented method according to any one of claims 1 to 7,
wherein a pose-normalization procedure is applied to each shape descriptor in the set of shape descriptors {F s, s = 1, ..., Ns } (S7). - The computer-implemented method according to any one of claims 1 to 8,
wherein a classification algorithm is run based on the calculated set of shape descriptors {F s ,s = 1, ...,Ns } (S7). - The computer-implemented method according to any one of claims 1 to 8,
wherein a performance prediction process is performed which could be integrated into a surrogate-assisted shape optimization process based on the calculated set of shape descriptors {F s,s = 1, ...,Ns } (S7).
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP18199841.0A EP3637319B1 (en) | 2018-10-11 | 2018-10-11 | Method for generating shape descriptors for two- or three-dimensional geometric shapes |
US16/598,527 US20200117838A1 (en) | 2018-10-11 | 2019-10-10 | Method for generating a set of shape descriptors for a set of two or three dimensional geometric shapes |
JP2019186513A JP6855547B2 (en) | 2018-10-11 | 2019-10-10 | A method for generating a set of shape descriptors for a set of 2D or 3D geometric shapes |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP18199841.0A EP3637319B1 (en) | 2018-10-11 | 2018-10-11 | Method for generating shape descriptors for two- or three-dimensional geometric shapes |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3637319A1 EP3637319A1 (en) | 2020-04-15 |
EP3637319B1 true EP3637319B1 (en) | 2022-05-25 |
Family
ID=64023933
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18199841.0A Active EP3637319B1 (en) | 2018-10-11 | 2018-10-11 | Method for generating shape descriptors for two- or three-dimensional geometric shapes |
Country Status (3)
Country | Link |
---|---|
US (1) | US20200117838A1 (en) |
EP (1) | EP3637319B1 (en) |
JP (1) | JP6855547B2 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110446980B (en) * | 2017-03-21 | 2022-05-27 | Asml荷兰有限公司 | Object recognition and comparison |
EP3734477B1 (en) * | 2019-05-03 | 2023-03-29 | Honda Research Institute Europe GmbH | Method for structural optimization of objects using a descriptor for deformation modes |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1586020A2 (en) * | 2003-01-25 | 2005-10-19 | Purdue Research Foundation | Methods, systems, and data structures for performing searches on three dimensional objects |
US7660468B2 (en) * | 2005-05-09 | 2010-02-09 | Like.Com | System and method for enabling image searching using manual enrichment, classification, and/or segmentation |
US7949186B2 (en) * | 2006-03-15 | 2011-05-24 | Massachusetts Institute Of Technology | Pyramid match kernel and related techniques |
US20090157649A1 (en) * | 2007-12-17 | 2009-06-18 | Panagiotis Papadakis | Hybrid Method and System for Content-based 3D Model Search |
US10297022B2 (en) * | 2013-09-13 | 2019-05-21 | The Regents Of The University Of California | Method and system for analysis of volumetric data |
-
2018
- 2018-10-11 EP EP18199841.0A patent/EP3637319B1/en active Active
-
2019
- 2019-10-10 US US16/598,527 patent/US20200117838A1/en not_active Abandoned
- 2019-10-10 JP JP2019186513A patent/JP6855547B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
EP3637319A1 (en) | 2020-04-15 |
JP6855547B2 (en) | 2021-04-07 |
JP2020098571A (en) | 2020-06-25 |
US20200117838A1 (en) | 2020-04-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Bronstein et al. | Shape recognition with spectral distances | |
Bohn et al. | Analysis of car crash simulation data with nonlinear machine learning methods | |
US9323886B2 (en) | Performance predicting apparatus, performance predicting method, and program | |
EP3179407A1 (en) | Recognition of a 3d modeled object from a 2d image | |
Yesilli et al. | Topological feature vectors for chatter detection in turning processes | |
Qiu et al. | Multi-stage design space reduction and metamodeling optimization method based on self-organizing maps and fuzzy clustering | |
Ip et al. | A 3D object classifier for discriminating manufacturing processes | |
Kakillioglu et al. | 3D capsule networks for object classification with weight pruning | |
Moitra et al. | Cluster-based data reduction for persistent homology | |
EP3637319B1 (en) | Method for generating shape descriptors for two- or three-dimensional geometric shapes | |
Khan et al. | Physics-informed feature-to-feature learning for design-space dimensionality reduction in shape optimisation | |
Gabryel | The bag-of-features algorithm for practical applications using the MySQL database | |
Bespalov and et al. | Scale-space representation and classification of 3d models | |
WO2024234108A1 (en) | Method and system for accelerated operation of layers used in a machine learning model and differentiable point rendering using proximity attention | |
Dommaraju et al. | Simultaneous exploration of geometric features and performance in design optimization | |
WO2011155288A1 (en) | Data index dimension reduction method, and data search method and device using same | |
Di Ruberto | Histogram of Radon transform and texton matrix for texture analysis and classification | |
Aso et al. | Automatic parametric modeling technique for structural design standardization | |
JP5969836B2 (en) | Model application apparatus, model application method, and program | |
Wang et al. | A 3D shape descriptor based on spherical harmonics through evolutionary optimization | |
Zhang et al. | Similarity assessment of mechanical parts based on integrated product information model | |
Park et al. | Interior wind noise prediction and visual explanation system for exterior vehicle design using combined convolution neural networks | |
Blachnik et al. | Simplifying SVM with weighted LVQ algorithm | |
Greenfield et al. | Link prediction methods for generating speaker content graphs | |
Durou et al. | Measuring and optimising performance of an offline text writer identification system in terms of dimensionality reduction techniques |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20201007 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602018035931 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G06K0009460000 Ipc: G06K0009000000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06K 9/52 20060101ALI20211126BHEP Ipc: G06K 9/48 20060101ALI20211126BHEP Ipc: G06K 9/00 20060101AFI20211126BHEP |
|
INTG | Intention to grant announced |
Effective date: 20211214 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1494554 Country of ref document: AT Kind code of ref document: T Effective date: 20220615 Ref country code: DE Ref legal event code: R096 Ref document number: 602018035931 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R084 Ref document number: 602018035931 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 746 Effective date: 20220727 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20220525 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1494554 Country of ref document: AT Kind code of ref document: T Effective date: 20220525 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220926 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220825 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220826 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220825 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602018035931 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G06K0009000000 Ipc: G06V0010000000 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220925 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602018035931 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20230228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20221031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221011 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221031 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221011 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20181011 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220525 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20241021 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20241024 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20241025 Year of fee payment: 7 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602018035931 Country of ref document: DE Owner name: HONDA MOTOR CO., LTD., JP Free format text: FORMER OWNER: HONDA RESEARCH INSTITUTE EUROPE GMBH, 63073 OFFENBACH, DE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20250410 AND 20250416 |