PORTABLE DEVICE WITH IMAGE SENSOR AND ILLUMINATION SYSTEM FOR TEXTILE CLASSIFICATION
The invention relates to the field of garment care. It is known that ironing devices are provided with temperature sensors. The temperature sensors are used to control operation of the ironing device and to avoid damaging the textile (of the garments) due to inappropriate operating parameters. If the user uses the ironing device for treating different textiles, it is still necessary for the user to manually adjust at least one setting, such as the temperature of the soleplate of the ironing device, in order to achieve efficient treatment of the textile. For an optimal ironing result, the temperature should be at the maximum temperature that flattens the wrinkles but not damages the fabric. In order to omit manual control, it has been suggested to reduce the maximum temperature. The disadvantage of this approach is that the ironing of tougher materials, such as jeans and linen, require more time. Usually, in order to determine the appropriate temperature setting, the user relies on care labels which are attached to the garments. This manual approach is not convenient for the user. Moreover, it has been shown that with years of use, these labels often get lost leaving the user with no information regarding the kind of fabric or the required temperature for treating the textile. US 2016/0145794 discloses an iron having an image sensor so that digital image processing enables a fabric type to be detected, and the iron settings to be controlled. DE 10 2013 210 996 discloses a smartphone app by which an image of clothing is analysed to determined washing machine settings or garment treatment products to be used. It is an object of the invention to propose an improved portable textile treatment device that avoids or mitigates the above-mentioned problems. The invention is defined by the independent claims. The dependent claims define advantageous embodiments. To this end, the invention proposes a portable device comprising a bottom surface intended to be in contact with a textile. The portable device comprises:
The image sensor and the control unit are integrated within the portable device. The image sensor has an active surface sensitive to light, which is oriented compared to said bottom surface, with an absolute value of the orientation angle being in the range 15-70 degrees; and/or the illumination system has a light source oriented compared to the said bottom surface, with an absolute value of the orientation angle being in the range 15-70 degrees. This portable device has the advantage to perform a textile classification in a standalone way, remotely from the device that will actually treat the textile. Detailed explanations and other aspects of the invention will be given below. Particular aspects of the invention will now be explained with reference to the embodiments described hereinafter and considered in connection with the accompanying drawings, in which identical parts or sub-steps are designated in the same manner: The textile treatment device 1 corresponds to a pressurized steam ironing system with boiler in the base 2 The textile treatment device 1 comprises a handheld ironing device having a first casing 2. The first casing 2 includes a handle 3 for the user to hold the textile treatment device 1. The handheld ironing device is a portable device which is portable by a single user treating the textile (TEX). The textile treatment device 1 also includes a second casing 2 The textile treatment device 1 further includes a control unit 8 integrated within the portable textile treatment device. This integration allows that all necessary control and signal processing is done on the textile treatment device itself, without any need to interact with external devices or use external computation resources. Preferably, the control unit 8 is in signal communication with the water supply 9 The first casing 2 and the second casing 2 The hose cord HC also comprises a second pipe PP2 for carrying water from the water supply 9 The first pipe PP1 and the second pipe PP2 are preferably connected to two different inlets of the steam chamber 10, as illustrated. The first casing 2 comprises a steam chamber 10 adapted to receive steam from the steam generator 9. The first casing 2 also comprises a heatable soleplate 4 comprising steam vents 11. Through the steam vents 11, the steam is supplied from the steam chamber 10 to the textile TXT under treatment. The steam chamber 10 is in thermal contact with a heating system 12. The heating system 12 is intended to heat the heatable soleplate 4, and to heat the steam chamber 10 so that steam received from the steam generator 9 does not condensate. The heating system 12, the heatable soleplate 4, and the steam chamber 10 are in thermal contact. The heating system 12 is controlled by the control unit 8 in order to vary the thermal energy supplied by the heating system 12. By way of example, the heating system 12 includes at least one resistive heating element (not shown) which are in heat transfer communication with the heatable soleplate 4 being intended to contact the textile under during treatment. When treating the textile (TEX), the user moves the textile treatment device over the textile to be treated while a heatable soleplate 4 of the textile treatment device 1 is in planar contact with the textile. Additionally or alternatively, it is conceivable that the textile treatment device is be configured as a garment steamer. The textile treatment device 1 includes an image sensor 5 for taking an image of the textile to be treated. By way of example, the image sensor 5 is arranged such as looking in a through-hole or in a through-recess H of the heatable soleplate 4. In that case, the image sensor 5 can be arranged either inside the thickness of the heatable soleplate 4, or arranged above the heatable soleplate 4. The through-hole/through-recess H can for example be arranged at a front part of the heatable soleplate. This allows acquisition of an image of the textile by the image sensor 5, while the heatable soleplate 4 is in planar contact with the textile. However, it is also possible that the image sensor is arranged at different locations in cooperation with the textile treatment device 1, such as:
Preferably, the image sensor has an active surface sensitive to light, which is oriented with respect to the surface of the heatable soleplate 4 being in contact with the textile, with an absolute value of an orientation angle a5 being in the range 0-85 degres C., preferably within 15-70 degres C. This is illustrated in This orientation angle allows a more flexible implementation of the image sensor in the textile treatment device 1 in terms of resulting in a more compact space. The textile treatment device 1 may include an optical system 7. The optical system has at least one optical element, such as lenses, mirrors and/or apertures and is configured to generate a focused image of a surface portion of the textile TEX on an active surface of the image sensor 5. However, it is also conceivable that the image sensor 5 receives light directly emitted from the textile, i.e. light which has not passed through an optical system. As illustrated in Preferably, the first symmetrical axis N7 is inclined with an absolute angle a7 with respect to the surface of the heatable soleplate 4 being in contact with the textile. The orientation angle a7 is in the range 15-90 degres C. The image sensor 5 (and similarly the image sensors 5 The first symmetrical axis N7 and the second symmetrical axis N5 forms an angle a75 less or equal than the maximum value of the angle a5 between the active surface sensitive to light of the image sensor and the surface of the heatable soleplate 4, so in the range [0; 70] degres C. By having a certain non-null angle value for a75, it can be made sure that the focus plane of the image sensor is exactly in the plane of the textile. That means that both “far away” as well as “close by” content in the image are in focus. Having an image in focus taken by the image sensor is advantageous for the convolutional neural network to obtain a more accurate classification of the fabric type. The textile treatment device 1 further includes an illumination system 6 for illuminating a portion of the textile which is imaged using the image sensor 5. The illumination system 6 may include a light source, such as a LED (light emitting diodes) and/or a laser beam. The light source allows acquiring images under proper illumination conditions, thereby making textile classification more reliable. Preferably, the light source of the illumination system 6 is oriented with respect to the surface of the heatable soleplate 4 being in contact with the textile, with an absolute value of an orientation angle a6 being in the range 0-85 degres C., preferably within 15-70 degres C. This is illustrated in This orientation angle a6 of the light source allows to capturing more details of the textile characteristics. However, it is also conceivable that many of the technical effects and advantages described herein can still be obtained using a textile treatment device which has no illumination system 6. When angle a7 is very close (or equal) to angle a6, a very “flat” image of the textile TXT is obtained, not much ‘depth information’ can be seen in the image, whereas when angle a7 is much different from angle a6, a lot of ‘depth information’ will be revealed in the image because of the shadows that are casted by the surface of the textile TXT. This depth information is advantageous for the convolutional neural network to obtain a more accurate classification of the fabric type. The angles a7, a5, a75 verify the relation a7+a5−a75=90 degres C. For example: a7=65 degres C., a5=35 degres C., a75=10 degres C., a6=49 degres C. Preferably, the illumination system 6 comprises at least one light emitting diode arranged next to said first symmetrical axis N7. For example, the at least one light emitting diode comprises two light emitting diodes (LED1, LED2) arranged symmetrically around the first symmetrical axis N7, as illustrated in In another example (not shown), the at least one light emitting diode comprises three light emitting diodes (LED1, LED2, LED3) arranged symmetrically around the first symmetrical axis N7. The three light emitting diodes (LED1, LED2, LED3) form a conical arrangement around the first symmetrical axis N7. Preferably, the light emitting diodes are operated in pulsed operation by the control unit 8 to prevent motion blur and prevent rolling shutter effect. The light emitting diodes are given a very bright flash of light during approximately 30 microseconds, and then are off during approximately 30 milliseconds (1/1000 duty cycle). During the flash of light a current of approximately 1 A flows through the LEDs. The average power dissipation per light emitting diode is approximately 0.001*1 A*2.5V=2.5 mW. Preferably, the illumination system 6 is adapted to generate a light beam in the Infrared (IR) wavelengths. For example, light emitting diodes (LED1, LED2, LED3) emitting in the Infrared wavelengths can be used. The reason to use Infrared light is because many fabric dies are transparent for infrared light. That means that a red textile and a blue textile and a white textile and a black textile all look exactly the same using infrared light. All textiles look as if they were white. In the context of the invention, not being able to distinguish colors is not a problem, because the algorithm used according to the invention does not use color to obtain the classification of the textile. Indeed, color does not contain any information on fabric type (wool, silk, cotton): All fabric types can have all colors. By using Infrared, because all the textiles look as having the same “color”, it is thus not needed to change the exposure time or illumination intensity when going from one textile to the other. This simplifies the control of the illumination system 6, as well as contributes to faster image acquisition. And in the case the textile is woven with yarns that have different colors, in infrared light these colors all appear as white, so the fabric recognition algorithm is not disturbed by any ‘print’ on the textile. The control unit 8 is in signal communication with the image sensor 5 and the illumination system 6. The control unit 8 is configured to execute an algorithm stored in the textile treatment device 1. The algorithm determines, using the taken image as an input of the algorithm, a classification of the textile. The classification of the textile may include assigning at least one output classes to the textile. This solution of obtaining a classification of the textile allows deriving suitable values for some operating parameters of the textile treatment device. Thereby, efficient treatment of the textile and reliable prevention of damage to the textile can be achieved. The classes may be provided by or generated using output classes of an artificial neural network (ANN). By way of example, the classes may be classes of a fabric type of the textile, or classes of a level of delicateness of the fabric for ironing the textile. Those classifications are advantageous because they provide a sufficiently detailed level of classification, for controlling accordingly at least one operating parameter of the textile treatment device. The classes of fabric type, such as material, may include classes, such as “wool”, “nylon”, “linen”, “jeans” and “cotton”. The classes of fabric level of delicateness may include classes, such as “delicate” (including for example, but not limited to the list of material defined by acetate, elastane, polyamide, polypropylene, cupro, silk, polyester, triacetate, viscose, and wool) or “tough” (including for example, but not limited to the list of material defined by linen, jeans, cotton). Delicate fabrics are considered fabrics that are sensitive to heat, and hence are usually recommended to be ironed with 1-dot and 2-dots settings, as per standard IEC 60311, while tough fabrics are considered to require higher temperature to obtain acceptable ironing results and are usually recommended to be ironed with 3-dots settings. However, it is noted that this is only a recommendation from standard IEC 60311, so not mandatory. Below table extracted from standard IEC 60311 summarizes this correspondence: For example, a textile which is classified to the class “delicate” is treated using a relatively lower temperature of the heatable soleplate 4, for example in the range 70-160 degres C. For example, a textile which is assigned to the class “tough” is treated using a relatively higher temperature of the heatable soleplate 4, for example in the range 140-210 degres C. In the embodiment of A first embodiment of this invention is as shown in The valve V1 in this embodiment is a standard electro-valve with one open (ON) and one closed (OFF) position. The open/close states of the valves V1 and V2 are controlled by control signal CS from the control unit 8. The valve V2 in this embodiment is a customized electro-valve which does not have a real closed position. For valve V2, it has a large diameter (for example 4 mm) when being in open (ON) position, and a small diameter orifice (for example 2 mm) when being in closed (OFF) position. The valve V1 controls steam on/off (release steam/not release steam), while valve V2 controls high (when ON) steam rate and low steam rate when OFF. The different combinations and the resultant steam rates at the exit of the first pipe PP1 are listed in the below table 1: In this embodiment, the valve V2 in open (ON) position preferably has a orifice diameter larger than valve V1 orifice diameter in open (NO) position. For example, valve V2 has orifice diameter of 4 mm when being in open (ON) position, and valve V1 has orifice diameter of 3 mm when being in open (ON) position. This is for the purpose of minimizing losses caused by valve V1. In this embodiment, the order of valve V1 (control release of steam) and valve V2 (controls steam rate) can also be exchanged to produce similar results. The second embodiment of this invention is as shown in Different steam rates at the exit of the first pipe PP1 can be obtained using a combination of E-valve states. This is shown in the below table 2: The third embodiment of this invention is as shown in The third embodiment of this invention reduces the amount of external tube connections, reducing the size of the E-valve configuration required to deliver this function. Another benefit of the third embodiment is the reduction in condensation of steam to water in the E-valve configuration during the start of ironing or if the steam function has not been triggered for an extended period of time, thus reducing carryover water, which can result in a so-called “spitting” problem at the steam vents 11 of the heatable soleplate 4. This is due to the reduction of the overall thermal mass of the E-valve configuration. The fourth embodiment of this invention is as shown in The benefits of size reduction of E-valve configuration and reduction in carrying over water and thus spitting described in the third embodiment are also valid in the fourth embodiment. It is noted that similar valve arrangement of valves V1 and V2 can be arranged at the exit of the steam generator of the device of The textile treatment device 1 This embodiment differs from the embodiment described along with In the embodiment of The textile treatment device 1 This embodiment differs from the embodiment described along with In the embodiment of The textile treatment device 1 In the embodiment of The textile treatment device 1 The textile treatment device 1 In the embodiment of The textile treatment device 1 In addition, the textile treatment device 1 The steam chamber 10 is in thermal contact with a heating system 12 The textile treatment device 1 The textile treatment device 1 The textile treatment device 1 In the embodiment of The textile treatment device if corresponds to a washing machine device. The textile treatment device if comprises a tumbler 200 for receiving textile (i.e. garments) to wash. The tumbler 200 is brought into rotation by motor M. The tumbler 200 is adapted to receive water W from a water supply (not shown). A heating element 300 is arranged in contact with the tumbler 200 to heat the water W in the tumbler. A control unit 8 allows controlling the rotation speed of the motor M, and the electrical power supplied to the heating element 300. For sake of representation, the communication system 22, the image sensor, and the interface 25 are not represented. The image sensor 5 can be arranged in a bottom inside part of the tumbler 200, or arranged in a top part of the textile treatment device 1 In the embodiment of The textile treatment device 1 This embodiment differs from the embodiment described along with In the embodiment of In the embodiments described above comprising a steam engine for generating steam to be supplied to the textile, such as the steam generator 9 and/or the steam chamber 10, the amount of steam can be set based on the obtained classification of the textile. Preferably, a textile which is classified to the class “delicate” is treated using a lower amount of steam, for example in the range 50-99 g/mn. Preferably, a textile which is assigned to the class “tough” is treated using a higher amount of steam, for example in the range 100-160 g/mn. Increasing the steam rate if the fabric is deemed as more tough (or less delicate), improves the ironing and/or steaming results in terms of removing creases on the textile/garments. It has been shown that using the classification of the textile, it is possible to efficiently adapt operation of the textile treatment device 1 to the textile under treatment. Thereby, this contributes to a convenient and optimal result of the textile treatment, and also prevents damaging the textile due to improper settings of the textile treatment device 1. It is possible for the textile treatment device 1 to automatically adjust at least one operating parameter of the textile treatment device 1 during treatment of a textile if the textile treatment device 1 detects a change in the textile classification. Thereby, a time-efficient treatment of the textile (or garment made of a textile) is made possible. In the exemplary textile treatment device 1, which is shown in The term artificial neural network may be defined to mean a collection of neural processing units. The ANN has connections between the neural processing units which have a connection weight. The ANN may include a plurality of layers. The layers may include an input layer, one or more hidden layers (also denoted as intermediate layers), and an output layer. The ANN may be a feedforward neural network or a recurrent neural network. It has been shown that using the ANN 14, it is possible to efficiently and reliably classify textiles which are under treatment, so that operating parameters can be adapted for ensuring proper treatment of the textile, and which eliminate the risk of damaging the textile. In the exemplary embodiment, the ANN 14 is preferably trained by an external computing system, using images from a database and associated their known textile classifications. The trained ANN is then stored in the textile treatment device 1. The higher the number of images used for the training of the ANN, the better the performance of the ANN for classifying a given textile from which an image is taken by the image sensor arranged in the textile treatment device 1. An exemplary training process 100 for training the ANN is schematically illustrated in The training process 100 leads to a weight correction of the connection weights 18 (shown in In a first iteration, the connection weights of the ANN are initialized to small random values. An input of sample images of known textiles is provided in step 110 as an input to the ANN. The ANN classifies the input in step 120. Based on a comparison between the classification of the input and the known textiles, it is determined in decision step 150, whether the classification is performed with a sufficient accuracy. If the classification is performed with a sufficient accuracy (decision step 150:Y), the training process 100 is ended in step 130. If the classification is not performed with a sufficient accuracy (decision step 150:N), the connection weights of the ANN are adjusted in step 140. After the adjustment of the connection weights, a further classification 120 of the same or of different known input samples is performed. In the illustrated exemplary embodiment, the operations of the training process is preferably performed in an external computing system 23 (shown in Using the external computing system 23, it is possible to perform a faster and more accurate training of the ANN, compared to conducting this same training on the textile treatment device 1. However, it is also possible that the training process is performed by the textile treatment device 1, if the control unit 8 has sufficient computational resources. As is illustrated in Further, the network 24 may include the Internet (INT) and an Intranet which is a wired or wireless local area network (WLAN). It is also possible that the textile treatment device 1 is connectable to the external computing system 23 via any other transmission medium defining a wireless and/or wire-based transmission. The textile treatment device 1 is adapted to transmit to the external computing system 23, using the communication system 22, images taken by the image sensor, as well as an associated textile classification. In case the user is of the opinion that the algorithm did not correctly identify the classification of the textile, the user can manually enter a user input (via an interface that will be described later) corresponding to a corrected textile classification. The user input corresponds to a different classification of the textile which deviates from the classification of the textile obtained by the control unit 8. The corrected textile classification (also called user-specified classification) can not only be used by the device 1 to control an operating parameter of the device accordingly, but also be sent by the communication system 22 and used by the external computing system 23 as input for a new training of the algorithm, as similarly described along with The textile treatment device 1 includes a user interface 25 (shown in For example, the user interface 25 allows the user:
The user-specified classification may include an assignment of the textile to at least one pre-defined classes as described previously. The user-specified classification may correspond to a classification of the textile determined based on the user's knowledge only, or user's own appreciation, or based on a guidance from various indications such as content of the care label (also denoted as laundry tag) of the textile, such as “wool”, “nylon”, “linen” or “cotton”. Preferably, any of the textile treatment devices according to the invention is adapted to store a plurality of user-specified classifications (i.e. corresponding to different classifications compared to the initial textile classifications obtained by the textile treatment device), and each of the associated taken images, before transmission to the external computing system 23. Sending a plurality of manually corrected textile classification can advantageously be used by the external computing system as input for a new training of the algorithm. Preferably, the textile treatment device is adapted to receive, from the external computing system (23), using the communication system 22, an updated version of the algorithm. If the updated version of the algorithm is an improved version of the algorithm initially stored, for example an improved version obtained after a new training, the textile classification is more accurate and robust. In the exemplary embodiment, which is illustrated in Using a CNN as a classifier is relatively computationally less demanding. In particular, substantially instant classifications can be generated by a CNN running on low-computational resources hardware. This also contributes to make possible the integration of the image sensor and the control unit within the portable textile treatment device, for textile classification. As mentioned above, an advantage of executing a CNN is that the computational resources are relatively low compared to more traditional image processing algorithms, which makes its execution in the textile treatment device easier, without the need to have a control unit having very high computational resources. The term “convolutional neural network” may be defined to mean an ANN having at least one convolutional layer. A convolutional layer may be defined as a layer which applies a convolution to a layer which immediately precedes the convolutional layer. The convolutional layer may include a plurality of neural processing units, wherein each of the neural processing units receives inputs from a pre-defined section of the preceding layer. The pre-defined section may also be called a local receptive field of the neural processing unit. The distribution of weights within the pre-defined section may be the same for each neural processing unit in the convolutional layer. In addition to the convolutional layers, the CNN may include one or more subsampling layers and/or one or more normalization layers. In the textile treatment device according to the invention, a field of view of the image sensor is in the range 1×1 mm to 5×5 mm. This field of view corresponds to the minimal dimension, taken on the textile, and that needs to be imaged to capture sufficient details of the textile structure. More generally, a field of view of the taken image is in the range of 1 mm2to 25 mm2of a rectangular or squared area with at least 1 mm in one dimension. However, a larger field of view could also be considered. Choosing the field of view in this range allows taking an image containing sufficient details of the textile, in particular the weaving pattern and/or size of yarn and interlacing fibers. Taking a picture with a field of view smaller than the lower value of this range would not allow capturing sufficient details of the textile. On the contrary, taking a picture with a field of view larger than the upper value of this range would only allow capturing redundant information on the details of the textile, given the periodic structure of the weaving pattern of the textile. This would result in increasing the computational resources for no significant added benefits in terms of textile classification. Alternatively, images having field of view in this range can be obtained from an image having a larger field of view, followed by an appropriate down-sampling or downsizing. Preferably, a resolution of the input image 26 given as input of the algorithm defines a square array of pixels in the range 64×64 pixels and 320×320 pixels. Choosing the resolution in this range allows sampling a given field of view with sufficient details of the textile, while limiting the computational resources. Preferably, a resolution proportional to the field of view can be chosen. Images having resolution in this range can directly be obtained from the image sensor having the same resolution. Alternatively, images having resolution in this range can be obtained from an image sensor having a better resolution, followed by an appropriate down-sampling or downsizing. A convolutional layer applies a convolution operation to the input, passing the result to the next layer. A convolution layer includes a plurality of neural processing units. Each of the neural processing units receives inputs from an input section 27 of the input image 26, which is shifted during the convolution operation. The input section 27 may correspond to a two-dimensional array of pixels, for example a rectangular or squared section of the input image 26, such as, for example, a cluster of 3×3 or 4×4 or 5×5 pixels. The input section 27 may also be denoted as a local receptive field for the neural processing unit. The neural processing unit may be configured to process the a section 27 of the input image 26 using weights that form a convolution matrix or kernel matrix which is multiplied with the input section 27. In other words, the convolutional layer performs an element-wise multiplication of the values in the kernel matrix with the pixel values of the input section. The multiplications are all summed up to obtain a single number. Each neural processing unit of the convolutional layer may have the same weight values within the kernel matrix. This concept is known as weight sharing. The convolution layer may have one or more dimensions. For each dimension, the convolution layer outputs a two-dimensional array 28 The CNN may also include one or more subsampling layers SUB. Each of the subsampling layers may be arranged between two neighboring convolutional layers. The subsampling layer may be configured to perform a non-linear down-sampling on each of the output images 28 Specifically, the subsampling layer partitions each of the input image 28 One of these functions is the so-called “max pooling” or generally pooling function. Using the “max pooling” function, the subsampling layer determines the maximum pixel value contained in a rectangular or squared sub-region. In the exemplary CNN, which is illustrated in This first stage 51 is followed by a second stage S2 during which final textile classification is performed. Every dot is a layer of the neural network. In total the network has 32 layers. The layer number is indicated by the first part of the name of every layer.
The images which are shown in TEXT1: cotton, TEXT2: 65% polyester +35% cotton, TEXT3: nylon, TEXT4: jeans, TEXT5: wool, TEXT6: linen. Images which are supplied as input to the CNN may correspond to grayscale images. However, it is also possible that color images are similarly used as input for the CNN. The grayscale or color images of the image sensor may be directly supplied to the convolutional layer of the first stage of the CNN. However, it is also possible that one or more filters are applied to the images generated by the image sensor, before the images are used as input for the CNN. Examples for such image processing filters include but are not limited to noise reduction, sharpening, gamma correction, softening, lens shading correction, lens deformation correction, lens chromatic aberration correction . . . Preferably, the textile treatment device 1 depicted in The motion sensor 34 may be configured as an inertial motion sensor. The inertial motion sensor may include an accelerometer and/or a gyroscope. The sensor output of the motion sensor 34 is representative of at least one motion parameter (e.g., orientation, displacement, velocity, and/or an acceleration). Depending on the sensor output of the motion sensor 34, the control unit 8 may control operation of the heatable soleplate 4 and/or operation of the steam generator 9. By way of example, the heatable soleplate temperature may be raised at higher velocities and be decreased at a lower velocity. Thereby, the heatable soleplate temperature may be raised above a fabric specific steady-state temperature (i.e. device is not moving) if sufficient velocity is detected. Further, in order to avoid damages to the textile, the heatable soleplate temperature may be lowered to a “safe temperature” upon detection of prolonged absence of motion. These aspects will be described in more details in the following along with the flow chart of Additionally or alternatively, the control unit 8 uses the output of the motion sensor for controlling the least one operating parameter of the textile treatment device which is also controlled based on the classification of the textile. This allows for a more reliable control of the at least one operating parameter. The textile treatment device corresponds to any textile treatment device described above. An image of the textile to be treated is taken in step 210 using the image sensor. The image may be taken when the heatable soleplate of the textile treatment device is in planar and heat conductive contact with the textile to be treated. A control unit, which is integrated within the textile treatment device executes in step 220 an algorithm, which is stored in the textile treatment device, using the image as an input of the algorithm. The algorithm receives at its input, an image which has been acquired by the image sensor of the textile treatment device. Depending on the image, the control unit determines the classification of the textile by executing the algorithm. The control unit controls in step 230, based on the obtained classification, at least one operating parameter of the textile treatment device. The controlling step 230 of the at least one operating parameter may include controlling, using the classification of the textile, for example the temperature of the heatable soleplate 4. Thereby, it is possible to set the temperature of the heatable soleplate so that efficient treatment of the textile in step 230A is ensured and damaging of the textile is reliably avoided. Additionally or alternatively, the step of controlling 230 the at least one operating parameter may include controlling, using the classification of the textile, an amount of steam to be supplied to the textile. This allows in step 230A an efficient treatment of the textile by using steam and reduces risks of damaging the textile. As similarly described above, the accuracy and/or robustness of the textile classification can be improved by re-training the algorithm, for example by an external computing system. In order to allow the external computing system to perform the operations for training again the algorithm, data are transmitted from the textile treatment device to the external computing system using a communication system 22 of the textile treatment device. To this end, data are determined from:
The data are transmitted in step 250 to the external computing system for re-training/optimizing the algorithm. The external computing system performs in step 260 the operation for re-training the algorithm, using this data as a new set of training examples. After the external computing system has completed these operations and that a corresponding new version of the algorithm is created, the textile treatment device receives in step 270 from the external computing system, the new version of the algorithm, in order to replace the algorithm that was initially stored in the textile treatment device by this new version of the algorithm. The new version of the algorithm defines a computer program product taking the form of an executable file, an executable library, or a downloadable mobile application for mobile phone and/or smartphone. The computer program product contains instruction codes for obtaining a classification of a textile from an image of the textile. The instruction codes defines a convolutional neural network (CNN) having at least one convolutional layer, as described above. In this flow chart, steps/decisions steps represented in dotted lines corresponds to preferred or optional steps/decisions. This method of treating a textile TXT is applicable to a textile treatment device as previously described along with The method comprises:
If the step 1002 of detecting movement did not detect any movement of said textile treatment device during more than a given first time duration D1, which is illustrated by the “y” branch of the decision step 1003, the method performs a step 1004 of actively decreasing the temperature of the heatable soleplate 4 up to reaching a first given temperature T1 having a value below said first temperature target TT1. By “actively”, it is meant that specific and proactive measures are taken to decrease temperature of the heatable soleplate 4. In other words, the decrease of temperature is caused by an active cooling-down of the soleplate temperature, and not by a passive cooling-down caused by the natural thermal exchange (or leakage) of the heatable soleplate 4 with its environment, such as with ambient air and/or contact with the textile. Those steps improve the safety of the textile treatment device in case the textile treatment device would keep still, without any movement, for more than a given duration Dl. By detecting this situation, the soleplate temperature is cooled down to avoid a too long contact between the soleplate and the textile (or garment) that might otherwise result in damaging the textile and/or creating risks of fire. In particular, this method proves its efficiency in the situation where the temperature of the soleplate is set to a relatively higher temperature compared to nominal ironing temperature, considering the type of textile being treated, in particular textile classified as delicate, in order to have an even more efficient result of the ironing/steaming. Under such circumstances, it becomes crucial that safety measures are taken to actively and quickly cool-down the temperature of the soleplate if the textile treatment device is already without movement during more than a duration threshold D1 above which textile/garment would be damaged. It is noted that “temperature target” refers to the desired soleplate temperature to be reached, by regulating electrical power provided to the soleplate in order to reach this targeted value of the soleplate temperature. Because soleplates have usually relative high thermal mass, reaching the temperature target is not instantaneous and may take a certain duration. In the flow chart of the method according to the invention, a step of setting the soleplate temperature to a given temperature target does not mean that at the exit of this step, the temperature target has been reached already. If the step 1002 of detecting movement did detect some movement of said textile treatment device before the end of the given first time duration D1, which is illustrated by the “n” branch of the decision step 1003, the method returns to performing the first step 1001 of setting a first temperature target TT1 for the heatable soleplate 4. By no movement, it is referred to a movement below a certain movement threshold, the movement threshold including a zero value. For example, the first time duration D1 is in the range from a few seconds to a few minutes, preferably 30-90 seconds, preferably 60 seconds. For example, the first temperature target TT1 is in the range 100-220 degres C. For example, the first given temperature T1 is in the range 120-170 degres C., preferably in the range 140-150 degres C. Preferably, the temperature of soleplate is measured according to Standard IEC 60311. It is noted that the first step 1001 can be done before the step 1002, or that the step 1002 can be done before the first step 1001. Preferably, the method further comprises a step 1005 of detecting a classification of the textile being treated, wherein said classification is defined as: a fabric type of the textile, or a fabric level of delicateness for treating the textile. This step 1005 is similar as the classification detection previously described along with the description. It is preferably performed before the first step 1001 of setting a first temperature target TT1 for the heatable soleplate 4. Preferably, if the step 1002 of detecting movement did not detect any movement of said textile treatment device during more than a given second time duration D2, said second time duration D2 being less than said first time duration D1, which is illustrated by the “y” branch of the decision step 1012, the method performs a second step 1006 of setting a second temperature target TT2 for the heatable soleplate 4, said second temperature target TT2 being less than said first temperature target TT1. This second step 1006 of setting a second temperature target TT2 for the heatable soleplate 4 constitutes an additional safety measure. Indeed, by setting the temperature target of the soleplate to a lower value compared to the first temperature target TT1, the soleplate will start to passively cool-down by natural thermal exchange (or leakage) of the heatable soleplate 4 with its environment, such as with ambient air and/or contact with the textile. Under this circumstances, and if at the end the textile treatment device remains without any movement up to reaching the first time duration D1, the step 1004 of actively decreasing the temperature of the heatable soleplate 4 could be done quicker, considering that when the step 1004 is performed, the soleplate temperature has already decreased passively before. If the step 1002 of detecting movement did detect some movement of said textile treatment device before the end of the given second time duration D2, which is illustrated by the “n” branch of the decision step 1012, the method returns to performing the first step 1001 of setting a first temperature target TT1 for the heatable soleplate 4. For example, the second time duration D2 is in the range from a few hundreds of milliseconds to a few tens of seconds, preferably 5-20 seconds, preferably 10 seconds. It is noted that if the second time duration D2 is in the order of a few hundreds of milliseconds, this means that the step 1006 of setting a second temperature target TT2 for the heatable soleplate 4 is triggered almost instantaneously. Preferably, the method comprises a step 1007 of associating a value to said first temperature target TT1 depending on said classification. Preferably, the value of said first temperature target TT1 for the heatable soleplate 4 is as follows:
Preferably, the method comprises a step 1013 of associating a value to said first given temperature T1 depending on said classification and said first temperature target TT1, for example as follows:
Preferably, the method further comprises a step 1008 of associating a value to said first time duration D1 and/or said second time duration D2, depending on said first temperature target TT1 and/or said classification. Since a preferred requirement is that the textile has to resist to heat without damage if the textile treatment device is not moving during this time duration D1 and/or D2, this requirement is more easily fulfilled if value of D1 and/or D2 are determined based on the first temperature target TT1 and/or said classification. A delicate fabric can resist to heat damage for a longer time duration if the soleplate temperature is lower, and a tough fabric can resist to heat damage for a longer time duration if the soleplate temperature is higher. For a given classification of textile, this textile can resist to heat damage for a time duration that depends on a maximum soleplate temperature, and this maximum soleplate temperature is relatively lower if dealing with a delicate fabric and relatively higher if dealing with a tough fabric. Preferably, the step 1004 of actively decreasing the temperature of the heatable soleplate 4 is performed only if the temperature of the heatable soleplate 4 is above said first given temperature T1. This is illustrated by the “y” branch of the decision step 1009. The reason for having this step is that at the end of the total duration D1 where the textile treatment device is not moving, the heatable soleplate 4 passively lost sufficient thermal energy by thermal exchange (or leakage) of the heatable soleplate 4 with its environment, such as with ambient air and/or contact with the textile. In that case, the temperature of the soleplate reached at the end of the total duration D1 is sufficiently low for not performing e step 1004 of actively decreasing the temperature of the heatable soleplate 4. This is illustrated by the “n” branch of the decision step 1009. Preferably, the step 1004 of actively decreasing the temperature of the heatable soleplate 4 comprising injecting an amount of water in a steam chamber 10 being in thermal contact with said heatable soleplate 4. Injecting an amount of water in a steam chamber 10 constitutes a fast and effective way to actively cool-down temperature of the heatable soleplate 4. By introducing water into the steam chamber of the soleplate, the latent heat of vaporization of water is utilized to lower the temperature of the soleplate, when the water turns into steam. Moreover, this approach allows to re-use hardware feature of the textile treatment device, namely the steam chamber 10, that is used in other circumstances for generating steam over the textile, so is a cost-effective approach. Preferably, injecting an amount of water in said steam chamber 10 comprises injecting water with a continuous flow rate. Preferably, continuous flow rate has a value between 4-25 g/mn, preferably 15 g/mn. Preferably, injecting an amount of water in said steam chamber 10 comprises injecting water with different successive flow rates. Preferably, the different successive flow rates comprise a first flow rate in the range 2-10 g/mn during a first time duration in the range 20-60 seconds, followed by a second flow rate in the range 5-25 g/mn during a second time duration in the range 10-40 seconds. The value of those ranges for the water flow, either continuous or consecutive, is an optimal compromise between:
The amount of water injected in the steam chamber depends on the mass and temperature of the soleplate, since during the active decrease of soleplate temperature, the power to soleplate is preferably interrupted. The amount of water used for actively decreasing the soleplate temperature depends on the mass of the soleplate, the initial temperature TT1 of the soleplate, and the desired final temperature T1 of the soleplate. Those parameters allow to determine the heat energy needed to be removed through water evaporation by the soleplate. Typically, the soleplate has a mass between 0.3 kg to 0.6 kg. Preferably, the method further comprises a step 1010 of passively decreasing the temperature of the heatable soleplate 4 up to reaching a second given temperature T2 having a value less than said first given temperature T1. This step is advantageous to counter situation where a rebound in soleplate temperature at the end of active cooling could happen due to local heat concentration or uneven temperature distribution in the soleplate. Preferably, the method further comprising a step 1011 of associating a value to said second temperature T2, said value depending on said classification. Preferably, the value of said second temperature T2 is in the range 105-145 degres C. if the fabric level of delicateness is classified as delicate, and in the range 125-165 degres C. if the fabric level of delicateness is classified as tough. The invention also relates to a computer program product taking the form of an executable file, or an executable library, or a downloadable mobile application for mobile phone and/or smartphone, the computer program product containing instruction codes for implementing the method described above along with The various steps of the method 1000 according to the invention can be implemented in a textile treatment device as depicted in In addition to already provided description along with The value and range for T1 and TT1 have been described previously along with the method 1000 according to the invention. Preferably, the means for actively decreasing the temperature of the heatable soleplate 4 comprise:
The pumping of water by the pump P2 is done with a continuous flow rate or successive different flow rates as described above. Preferably, the textile treatment device also comprises a one-way valve OV1 arranged between said water supply 9 It is noted that this one-way valve OV1 could also be integrated within the pump P2. Above-described means for actively decreasing the temperature of the heatable soleplate 4 implemented in a textile treatment device as depicted in The invention also relates to a portable device 1100 as depicted in The portable device 1100 comprises a bottom surface BS intended to be in contact with a textile TXT.
The image sensor and the control unit are integrated within the portable device 1100. This has the same advantages described previously. The image sensor has an active surface sensitive to light, which is oriented (not shown) compared to said bottom surface BS, with an absolute value of the orientation angle being in the range [15; 70] degrees. Alternatively or in combination, the illumination system 6 has a light source oriented (not shown) compared to the said bottom surface BS, with an absolute value of the orientation angle being in the range [15; 70] degrees. The orientation of the image sensor and/or the orientation illumination system are same as described previously along with The control unit 8 Preferably, the portable device includes an artificial neural network (ANN), as previously described. Preferably, the artificial neural network (ANN) is a convolutional neural network (CNN) having at least one convolutional layer, as previously described. Preferably, the portable device further comprises a first communication module 22 The first communication module 22 Preferably, the portable device further comprises an interface 25 for receiving a user input of a user using the portable device, wherein said user input corresponds to a different classification of the textile derived from the classification of the textile obtained by the control unit 8 The first communication module 22 Preferably, the portable device is further adapted to store a plurality of said different classification and associated taken image, before transmission to said external computing system 23, similarly as previously described along with other Figures. Preferably, the first communication module 22 Preferably, the portable device further comprises a second communication module (22 The second communication system (22 For example, the classification may correspond to a fabric type of the textile, or a fabric level of delicateness for ironing the textile. The classification of fabric type, such as material, may include classes, such as “wool”, “nylon”, “linen”, “jeans” and “cotton”. The classes of fabric level of delicateness may include classes, such as “delicate” (including for example, but not limited to the list of material defined by acetate, elastane, polyamide, polypropylene, cupro, silk, polyester, triacetate, viscose, and wool) or “tough” (including for example, but not limited to the list of material defined by linen, jeans, cotton). The information reflecting a given classification may for example correspond to an optimum temperature for treating the textile (for example a treatment to be done by the domestic appliance DA), or an amount of steam to be applied on the textile during treatment (for example a treatment to be done by the domestic appliance DA). The information reflecting a given classification is for example derived from a look-up table stored in the portable device, the look-up table linking a given classification with a given information reflecting said given classification. Preferably, the second communication module 22 Preferably, the display 25 is further adapted to display said classification. Preferably, as previously described, the classification is chosen among:
Preferably, a field of view of the taken image is in the range 1×1 mm to 5×5 mm. More generally, a field of view of the taken image is in the range of 1 mm2to 25 mm2of a rectangular or squared area with at least 1 mm in one dimension. However, a larger field of view could also be considered. Preferably, a resolution of the image defines a square array of pixels is in the range 64×64 pixels and 320×320 pixels. Preferably, the portable device corresponds to a portable textile classifier device. The portable device may also correspond to a mobile phone or a smartphone For example, the portable textile classifier device may comprise rechargeable battery for providing electrical supply to internal electrical components during use. The invention also relates to a domestic appliance DA comprising:
Preferably, the domestic appliance DA corresponds to a textile treatment device. Preferably, the domestic appliance DA is a textile treatment device taken among the set defined by a pressurized steam ironing system with boiler, a pressurized steam ironing system without boiler, a steam ironing device, a handheld garment steamer, a stand garment steamer, a stain removal device, a washing machine device, and a dry ironing device. Those devices may correspond to devices 1, 1 The at least one operating parameter controlled based on the classification obtained by the portable device are same as operating parameters described for devices 1, 1 Although the invention has been described on the basis of using squared images taken by the image sensor, the invention applies similarly if non-squared images are used, such as rectangular images. The above embodiments as described are only illustrative, and not intended to limit the technique approaches of the present invention. Although the present invention is described in details referring to the preferable embodiments, those skilled in the art will understand that the technique approaches of the present invention can be modified or equally displaced without departing from the protective scope of the claims of the present invention. In particular, where the invention has been described based on an ironing device, it can be applied to any textile treatment device, such as a garment steamer. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. Any reference signs in the claims should not be construed as limiting the scope. The invention relates to a portable device (1100) comprising a bottom surface (BS) intended to be in contact with a textile (TXT). The portable device comprises an image sensor (5) for taking an image of a textile, and an illumination system (6) for illuminating a portion of the textile when said image is being taken. The portable device also comprises a control unit (8a) for executing an algorithm stored in the portable device, using the taken image as an input of said algorithm, to obtain a classification of the textile. The image sensor and the control unit are integrated within the portable device. The image sensor has an active surface sensitive to light, which is oriented compared to said bottom surface (BS), with an absolute value of the orientation angle being in the range 15-70 degrees; and/or the illumination system (6) has a light source oriented compared to the said bottom surface (BS), with an absolute value of the orientation angle being in the range 15-70 degrees. 1. A portable device comprising a bottom surface intended to be in contact with a textile, the portable device comprising:
an image sensor for taking an image of a textile; an illumination system for illuminating a portion of the textile when said image is being taken; a control unit for executing an algorithm stored in the portable device, using the taken image as an input of said algorithm, to obtain a classification of the textile; wherein:
the image sensor and the control unit are integrated within the portable device; the image sensor has an active surface sensitive to light, which is oriented compared to said bottom surface, with an absolute value of the orientation angle being in the range 15-70 degrees; and/or the illumination system has a light source oriented compared to the said bottom surface, with an absolute value of the orientation angle being in the range 15-70 degrees. 2. The portable device according to 3. The portable device according to 4. The portable device according to wherein the first communication module is adapted to transmit to the external computing system said different classification and the taken image, wherein the first communication module is further adapted to receive, from the external computing system, an updated version of said algorithm. 5. The portable device according to 6. The portable device according to 7. The portable device according to 8. The portable device according to 9. The portable device according to a fabric type of the textile,
information relating to a level of delicateness of the fabric. 10. The portable device according to 11. The portable device according to 12. A domestic appliance comprising:
a third communication module for connecting with a portable device according to a control unit for controlling, based on said classification, at least one operating parameter of the domestic appliance. 13. A domestic appliance according to 14. A domestic appliance according to 15. A domestic appliance according to FIELD OF THE INVENTION
BACKGROUND OF THE INVENTION
OBJECT AND SUMMARY OF THE INVENTION
BRIEF DESCRIPTION OF THE DRAWINGS
DETAILED DESCRIPTION OF THE INVENTION
• (1 dot) 70 < T < 120 Acetate, elastane, polyamide, polypropylene • • (2 dots) 100 < T < 160 Cupro, polyester, silk, triacetate, viscose, wool • • • (3 dots) 140 < T < 210 Cotton, linen V1 State (Controls release of steam) On (Open) Off (Close) V2 State On (Open - large High Steam No Steam (Controls steam orifice) rate) Off (Close - small Low Steam No Steam orifice) V1 State (Small - 2 mm orifice) On (Open) Off (Close) V2 State On (Open) High Steam Medium Steam (Large - 3 mm Off (Close) Low Steam No Steam orifice)
The different layers can be summarized as follows with self-explanatory labeling (the first number designating the corresponding layer number in
The portable device further comprises:























