Rekognition

Table of Contents

Client

class Rekognition.Client

A low-level client representing Amazon Rekognition:

client = session.create_client('rekognition')

These are the available methods:

can_paginate(operation_name)

Check if an operation can be paginated.

Parameters
operation_name (string) -- The operation name. This is the same name as the method name on the client. For example, if the method name is create_foo, and you'd normally invoke the operation as client.create_foo(**kwargs), if the create_foo operation can be paginated, you can use the call client.get_paginator("create_foo").
Returns
True if the operation can be paginated, False otherwise.
compare_faces(**kwargs)

Compares a face in the source input image with each face detected in the target input image.

Note

If the source image contains multiple faces, the service detects the largest face and uses it to compare with each face detected in the target image.

In response, the operation returns an array of face matches ordered by similarity score with the highest similarity scores first. For each face match, the response provides a bounding box of the face and confidence value (indicating the level of confidence that the bounding box contains a face). The response also provides a similarity score, which indicates how closely the faces match.

Note

By default, only faces with the similarity score of greater than or equal to 80% are returned in the response. You can change this value.

In addition to the face matches, the response returns information about the face in the source image, including the bounding box of the face and confidence value.

Note

This is a stateless API operation. That is, the operation does not persist any data.

For an example, see get-started-exercise-compare-faces

This operation requires permissions to perform the rekognition:CompareFaces action.

See also: AWS API Documentation

Request Syntax

response = client.compare_faces(
    SourceImage={
        'Bytes': b'bytes',
        'S3Object': {
            'Bucket': 'string',
            'Name': 'string',
            'Version': 'string'
        }
    },
    TargetImage={
        'Bytes': b'bytes',
        'S3Object': {
            'Bucket': 'string',
            'Name': 'string',
            'Version': 'string'
        }
    },
    SimilarityThreshold=...
)
Parameters
  • SourceImage (dict) --

    [REQUIRED]

    Source image either as bytes or an S3 object

    • Bytes (bytes) --

      Blob of image bytes up to 5 MBs.

    • S3Object (dict) --

      Identifies an S3 object as the image source.

      • Bucket (string) --

        Name of the S3 bucket.

      • Name (string) --

        S3 object key name.

      • Version (string) --

        If the bucket is versioning enabled, you can specify the object version.

  • TargetImage (dict) --

    [REQUIRED]

    Target image either as bytes or an S3 object

    • Bytes (bytes) --

      Blob of image bytes up to 5 MBs.

    • S3Object (dict) --

      Identifies an S3 object as the image source.

      • Bucket (string) --

        Name of the S3 bucket.

      • Name (string) --

        S3 object key name.

      • Version (string) --

        If the bucket is versioning enabled, you can specify the object version.

  • SimilarityThreshold (float) -- The minimum level of confidence in the match you want included in the result.
Return type

dict

Returns

Response Syntax

{
    'SourceImageFace': {
        'BoundingBox': {
            'Width': ...,
            'Height': ...,
            'Left': ...,
            'Top': ...
        },
        'Confidence': ...
    },
    'FaceMatches': [
        {
            'Similarity': ...,
            'Face': {
                'BoundingBox': {
                    'Width': ...,
                    'Height': ...,
                    'Left': ...,
                    'Top': ...
                },
                'Confidence': ...
            }
        },
    ]
}

Response Structure

  • (dict) --

    • SourceImageFace (dict) --

      The face from the source image that was used for comparison.

      • BoundingBox (dict) --

        Identifies the bounding box around the object or face. The left (x-coordinate) and top (y-coordinate) are coordinates representing the top and left sides of the bounding box. Note that the upper-left corner of the image is the origin (0,0).

        The top and left values returned are ratios of the overall image size. For example, if the input image is 700x200 pixels, and the top-left coordinate of the bounding box is 350x50 pixels, the API returns a left value of 0.5 (350/700) and a top value of 0.25 (50/200).

        The width and height values represent the dimensions of the bounding box as a ratio of the overall image dimension. For example, if the input image is 700x200 pixels, and the bounding box width is 70 pixels, the width returned is 0.1.

        Note

        The bounding box coordinates can have negative values. For example, if Amazon Rekognition is able to detect a face that is at the image edge and is only partially visible, the service can return coordinates that are outside the image bounds and, depending on the image edge, you might get negative values or values greater than 1 for the left or top values.

        • Width (float) --

          Width of the bounding box as a ratio of the overall image width.

        • Height (float) --

          Height of the bounding box as a ratio of the overall image height.

        • Left (float) --

          Left coordinate of the bounding box as a ratio of overall image width.

        • Top (float) --

          Top coordinate of the bounding box as a ratio of overall image height.

      • Confidence (float) --

        Confidence level that the selected bounding box contains a face.

    • FaceMatches (list) --

      Provides an array of CompareFacesMatch objects. Each object provides the bounding box, confidence that the bounding box contains a face, and the similarity between the face in the bounding box and the face in the source image.

      • (dict) --

        For the provided the bounding box, confidence level that the bounding box actually contains a face, and the similarity between the face in the bounding box and the face in the source image.

        • Similarity (float) --

          Level of confidence that the faces match.

        • Face (dict) --

          Provides face metadata (bounding box and confidence that the bounding box actually contains a face).

          • BoundingBox (dict) --

            Identifies the bounding box around the object or face. The left (x-coordinate) and top (y-coordinate) are coordinates representing the top and left sides of the bounding box. Note that the upper-left corner of the image is the origin (0,0).

            The top and left values returned are ratios of the overall image size. For example, if the input image is 700x200 pixels, and the top-left coordinate of the bounding box is 350x50 pixels, the API returns a left value of 0.5 (350/700) and a top value of 0.25 (50/200).

            The width and height values represent the dimensions of the bounding box as a ratio of the overall image dimension. For example, if the input image is 700x200 pixels, and the bounding box width is 70 pixels, the width returned is 0.1.

            Note

            The bounding box coordinates can have negative values. For example, if Amazon Rekognition is able to detect a face that is at the image edge and is only partially visible, the service can return coordinates that are outside the image bounds and, depending on the image edge, you might get negative values or values greater than 1 for the left or top values.

            • Width (float) --

              Width of the bounding box as a ratio of the overall image width.

            • Height (float) --

              Height of the bounding box as a ratio of the overall image height.

            • Left (float) --

              Left coordinate of the bounding box as a ratio of overall image width.

            • Top (float) --

              Top coordinate of the bounding box as a ratio of overall image height.

          • Confidence (float) --

            Level of confidence that what the bounding box contains is a face.

Examples

This operation compares the largest face detected in the source image with each face detected in the target image.

response = client.compare_faces(
    SimilarityThreshold=90,
    SourceImage={
        'S3Object': {
            'Bucket': 'mybucket',
            'Name': 'mysourceimage',
        },
    },
    TargetImage={
        'S3Object': {
            'Bucket': 'mybucket',
            'Name': 'mytargetimage',
        },
    },
)

print(response)

Expected Output:

{
    'FaceMatches': [
        {
            'Face': {
                'BoundingBox': {
                    'Height': 0.334814816713,
                    'Left': 0.318888902664,
                    'Top': 0.493333339691,
                    'Width': 0.25,
                },
                'Confidence': 99.9991226196,
            },
            'Similarity': 100,
        },
    ],
    'SourceImageFace': {
        'BoundingBox': {
            'Height': 0.334814816713,
            'Left': 0.318888902664,
            'Top': 0.493333339691,
            'Width': 0.25,
        },
        'Confidence': 99.9991226196,
    },
    'ResponseMetadata': {
        '...': '...',
    },
}
create_collection(**kwargs)

Creates a collection in an AWS Region. You can add faces to the collection using the operation.

For example, you might create collections, one for each of your application users. A user can then index faces using the IndexFaces operation and persist results in a specific collection. Then, a user can search the collection for faces in the user-specific container.

For an example, see example1 .

This operation requires permissions to perform the rekognition:CreateCollection action.

See also: AWS API Documentation

Request Syntax

response = client.create_collection(
    CollectionId='string'
)
Parameters
CollectionId (string) --

[REQUIRED]

ID for the collection that you are creating.

Return type
dict
Returns
Response Syntax
{
    'StatusCode': 123,
    'CollectionArn': 'string'
}

Response Structure

  • (dict) --
    • StatusCode (integer) --

      HTTP status code indicating the result of the operation.

    • CollectionArn (string) --

      Amazon Resource Name (ARN) of the collection. You can use this to manage permissions on your resources.

Examples

This operation creates a Rekognition collection for storing image data.

response = client.create_collection(
    CollectionId='myphotos',
)

print(response)

Expected Output:

{
    'CollectionArn': 'aws:rekognition:us-west-2:123456789012:collection/myphotos',
    'StatusCode': 200,
    'ResponseMetadata': {
        '...': '...',
    },
}
delete_collection(**kwargs)

Deletes the specified collection. Note that this operation removes all faces in the collection. For an example, see example1 .

This operation requires permissions to perform the rekognition:DeleteCollection action.

See also: AWS API Documentation

Request Syntax

response = client.delete_collection(
    CollectionId='string'
)
Parameters
CollectionId (string) --

[REQUIRED]

ID of the collection to delete.

Return type
dict
Returns
Response Syntax
{
    'StatusCode': 123
}

Response Structure

  • (dict) --
    • StatusCode (integer) --

      HTTP status code that indicates the result of the operation.

Examples

This operation deletes a Rekognition collection.

response = client.delete_collection(
    CollectionId='myphotos',
)

print(response)

Expected Output:

{
    'StatusCode': 200,
    'ResponseMetadata': {
        '...': '...',
    },
}
delete_faces(**kwargs)

Deletes faces from a collection. You specify a collection ID and an array of face IDs to remove from the collection.

This operation requires permissions to perform the rekognition:DeleteFaces action.

See also: AWS API Documentation

Request Syntax

response = client.delete_faces(
    CollectionId='string',
    FaceIds=[
        'string',
    ]
)
Parameters
  • CollectionId (string) --

    [REQUIRED]

    Collection from which to remove the specific faces.

  • FaceIds (list) --

    [REQUIRED]

    An array of face IDs to delete.

    • (string) --
Return type

dict

Returns

Response Syntax

{
    'DeletedFaces': [
        'string',
    ]
}

Response Structure

  • (dict) --

    • DeletedFaces (list) --

      An array of strings (face IDs) of the faces that were deleted.

      • (string) --

Examples

This operation deletes one or more faces from a Rekognition collection.

response = client.delete_faces(
    CollectionId='myphotos',
    FaceIds=[
        'ff43d742-0c13-5d16-a3e8-03d3f58e980b',
    ],
)

print(response)

Expected Output:

{
    'DeletedFaces': [
        'ff43d742-0c13-5d16-a3e8-03d3f58e980b',
    ],
    'ResponseMetadata': {
        '...': '...',
    },
}
detect_faces(**kwargs)

Detects faces within an image (JPEG or PNG) that is provided as input.

For each face detected, the operation returns face details including a bounding box of the face, a confidence value (that the bounding box contains a face), and a fixed set of attributes such as facial landmarks (for example, coordinates of eye and mouth), gender, presence of beard, sunglasses, etc.

The face-detection algorithm is most effective on frontal faces. For non-frontal or obscured faces, the algorithm may not detect the faces or might detect faces with lower confidence.

Note

This is a stateless API operation. That is, the operation does not persist any data.

For an example, see get-started-exercise-detect-faces .

This operation requires permissions to perform the rekognition:DetectFaces action.

See also: AWS API Documentation

Request Syntax

response = client.detect_faces(
    Image={
        'Bytes': b'bytes',
        'S3Object': {
            'Bucket': 'string',
            'Name': 'string',
            'Version': 'string'
        }
    },
    Attributes=[
        'DEFAULT'|'ALL',
    ]
)
Parameters
  • Image (dict) --

    [REQUIRED]

    The image in which you want to detect faces. You can specify a blob or an S3 object.

    • Bytes (bytes) --

      Blob of image bytes up to 5 MBs.

    • S3Object (dict) --

      Identifies an S3 object as the image source.

      • Bucket (string) --

        Name of the S3 bucket.

      • Name (string) --

        S3 object key name.

      • Version (string) --

        If the bucket is versioning enabled, you can specify the object version.

  • Attributes (list) --

    A list of facial attributes you want to be returned. This can be the default list of attributes or all attributes. If you don't specify a value for Attributes or if you specify ["DEFAULT"] , the API returns the following subset of facial attributes: BoundingBox , Confidence , Pose , Quality and Landmarks . If you provide ["ALL"] , all facial attributes are returned but the operation will take longer to complete.

    If you provide both, ["ALL", "DEFAULT"] , the service uses a logical AND operator to determine which attributes to return (in this case, all attributes).

    • (string) --
Return type

dict

Returns

Response Syntax

{
    'FaceDetails': [
        {
            'BoundingBox': {
                'Width': ...,
                'Height': ...,
                'Left': ...,
                'Top': ...
            },
            'AgeRange': {
                'Low': 123,
                'High': 123
            },
            'Smile': {
                'Value': True|False,
                'Confidence': ...
            },
            'Eyeglasses': {
                'Value': True|False,
                'Confidence': ...
            },
            'Sunglasses': {
                'Value': True|False,
                'Confidence': ...
            },
            'Gender': {
                'Value': 'MALE'|'FEMALE',
                'Confidence': ...
            },
            'Beard': {
                'Value': True|False,
                'Confidence': ...
            },
            'Mustache': {
                'Value': True|False,
                'Confidence': ...
            },
            'EyesOpen': {
                'Value': True|False,
                'Confidence': ...
            },
            'MouthOpen': {
                'Value': True|False,
                'Confidence': ...
            },
            'Emotions': [
                {
                    'Type': 'HAPPY'|'SAD'|'ANGRY'|'CONFUSED'|'DISGUSTED'|'SURPRISED'|'CALM'|'UNKNOWN',
                    'Confidence': ...
                },
            ],
            'Landmarks': [
                {
                    'Type': 'EYE_LEFT'|'EYE_RIGHT'|'NOSE'|'MOUTH_LEFT'|'MOUTH_RIGHT'|'LEFT_EYEBROW_LEFT'|'LEFT_EYEBROW_RIGHT'|'LEFT_EYEBROW_UP'|'RIGHT_EYEBROW_LEFT'|'RIGHT_EYEBROW_RIGHT'|'RIGHT_EYEBROW_UP'|'LEFT_EYE_LEFT'|'LEFT_EYE_RIGHT'|'LEFT_EYE_UP'|'LEFT_EYE_DOWN'|'RIGHT_EYE_LEFT'|'RIGHT_EYE_RIGHT'|'RIGHT_EYE_UP'|'RIGHT_EYE_DOWN'|'NOSE_LEFT'|'NOSE_RIGHT'|'MOUTH_UP'|'MOUTH_DOWN'|'LEFT_PUPIL'|'RIGHT_PUPIL',
                    'X': ...,
                    'Y': ...
                },
            ],
            'Pose': {
                'Roll': ...,
                'Yaw': ...,
                'Pitch': ...
            },
            'Quality': {
                'Brightness': ...,
                'Sharpness': ...
            },
            'Confidence': ...
        },
    ],
    'OrientationCorrection': 'ROTATE_0'|'ROTATE_90'|'ROTATE_180'|'ROTATE_270'
}

Response Structure

  • (dict) --

    • FaceDetails (list) --

      Details of each face found in the image.

      • (dict) --

        Structure containing attributes of the face that the algorithm detected.

        • BoundingBox (dict) --

          Bounding box of the face.

          • Width (float) --

            Width of the bounding box as a ratio of the overall image width.

          • Height (float) --

            Height of the bounding box as a ratio of the overall image height.

          • Left (float) --

            Left coordinate of the bounding box as a ratio of overall image width.

          • Top (float) --

            Top coordinate of the bounding box as a ratio of overall image height.

        • AgeRange (dict) --

          The estimated age range, in years, for the face. Low represents the lowest estimated age and High represents the highest estimated age.

          • Low (integer) --

            The lowest estimated age.

          • High (integer) --

            The highest estimated age.

        • Smile (dict) --

          Indicates whether or not the face is smiling, and the confidence level in the determination.

          • Value (boolean) --

            Boolean value that indicates whether the face is smiling or not.

          • Confidence (float) --

            Level of confidence in the determination.

        • Eyeglasses (dict) --

          Indicates whether or not the face is wearing eye glasses, and the confidence level in the determination.

          • Value (boolean) --

            Boolean value that indicates whether the face is wearing eye glasses or not.

          • Confidence (float) --

            Level of confidence in the determination.

        • Sunglasses (dict) --

          Indicates whether or not the face is wearing sunglasses, and the confidence level in the determination.

          • Value (boolean) --

            Boolean value that indicates whether the face is wearing sunglasses or not.

          • Confidence (float) --

            Level of confidence in the determination.

        • Gender (dict) --

          Gender of the face and the confidence level in the determination.

          • Value (string) --

            Gender of the face.

          • Confidence (float) --

            Level of confidence in the determination.

        • Beard (dict) --

          Indicates whether or not the face has a beard, and the confidence level in the determination.

          • Value (boolean) --

            Boolean value that indicates whether the face has beard or not.

          • Confidence (float) --

            Level of confidence in the determination.

        • Mustache (dict) --

          Indicates whether or not the face has a mustache, and the confidence level in the determination.

          • Value (boolean) --

            Boolean value that indicates whether the face has mustache or not.

          • Confidence (float) --

            Level of confidence in the determination.

        • EyesOpen (dict) --

          Indicates whether or not the eyes on the face are open, and the confidence level in the determination.

          • Value (boolean) --

            Boolean value that indicates whether the eyes on the face are open.

          • Confidence (float) --

            Level of confidence in the determination.

        • MouthOpen (dict) --

          Indicates whether or not the mouth on the face is open, and the confidence level in the determination.

          • Value (boolean) --

            Boolean value that indicates whether the mouth on the face is open or not.

          • Confidence (float) --

            Level of confidence in the determination.

        • Emotions (list) --

          The emotions detected on the face, and the confidence level in the determination. For example, HAPPY, SAD, and ANGRY.

          • (dict) --

            The emotions detected on the face, and the confidence level in the determination. For example, HAPPY, SAD, and ANGRY.

            • Type (string) --

              Type of emotion detected.

            • Confidence (float) --

              Level of confidence in the determination.

        • Landmarks (list) --

          Indicates the location of the landmark on the face.

          • (dict) --

            Indicates the location of the landmark on the face.

            • Type (string) --

              Type of the landmark.

            • X (float) --

              x-coordinate from the top left of the landmark expressed as the ration of the width of the image. For example, if the images is 700x200 and the x-coordinate of the landmark is at 350 pixels, this value is 0.5.

            • Y (float) --

              y-coordinate from the top left of the landmark expressed as the ration of the height of the image. For example, if the images is 700x200 and the y-coordinate of the landmark is at 100 pixels, this value is 0.5.

        • Pose (dict) --

          Indicates the pose of the face as determined by pitch, roll, and the yaw.

          • Roll (float) --

            Value representing the face rotation on the roll axis.

          • Yaw (float) --

            Value representing the face rotation on the yaw axis.

          • Pitch (float) --

            Value representing the face rotation on the pitch axis.

        • Quality (dict) --

          Identifies image brightness and sharpness.

          • Brightness (float) --

            Value representing brightness of the face. The service returns a value between 0 and 100 (inclusive). A higher value indicates a brighter face image.

          • Sharpness (float) --

            Value representing sharpness of the face. The service returns a value between 0 and 100 (inclusive). A higher value indicates a sharper face image.

        • Confidence (float) --

          Confidence level that the bounding box contains a face (and not a different object such as a tree).

    • OrientationCorrection (string) --

      The algorithm detects the image orientation. If it detects that the image was rotated, it returns the degrees of rotation. If your application is displaying the image, you can use this value to adjust the orientation.

      For example, if the service detects that the input image was rotated by 90 degrees, it corrects orientation, performs face detection, and then returns the faces. That is, the bounding box coordinates in the response are based on the corrected orientation.

      Note

      If the source image Exif metadata populates the orientation field, Amazon Rekognition does not perform orientation correction and the value of OrientationCorrection will be nil.

Examples

This operation detects faces in an image stored in an AWS S3 bucket.

response = client.detect_faces(
    Image={
        'S3Object': {
            'Bucket': 'mybucket',
            'Name': 'myphoto',
        },
    },
)

print(response)

Expected Output:

{
    'FaceDetails': [
        {
            'BoundingBox': {
                'Height': 0.180000007153,
                'Left': 0.555555582047,
                'Top': 0.336666673422,
                'Width': 0.239999994636,
            },
            'Confidence': 100,
            'Landmarks': [
                {
                    'Type': 'EYE_LEFT',
                    'X': 0.639473736286,
                    'Y': 0.408196240664,
                },
                {
                    'Type': 'EYE_RIGHT',
                    'X': 0.726666092873,
                    'Y': 0.410392254591,
                },
                {
                    'Type': 'NOSE_LEFT',
                    'X': 0.691246211529,
                    'Y': 0.442409604788,
                },
                {
                    'Type': 'MOUTH_DOWN',
                    'X': 0.630619823933,
                    'Y': 0.46700039506,
                },
                {
                    'Type': 'MOUTH_UP',
                    'X': 0.721560895443,
                    'Y': 0.471142619848,
                },
            ],
            'Pose': {
                'Pitch': 4.05080652237,
                'Roll': 0.995074748993,
                'Yaw': 13.6937904358,
            },
            'Quality': {
                'Brightness': 37.6016998291,
                'Sharpness': 80,
            },
        },
    ],
    'OrientationCorrection': 'ROTATE_0',
    'ResponseMetadata': {
        '...': '...',
    },
}
detect_labels(**kwargs)

Detects instances of real-world labels within an image (JPEG or PNG) provided as input. This includes objects like flower, tree, and table; events like wedding, graduation, and birthday party; and concepts like landscape, evening, and nature. For an example, see get-started-exercise-detect-labels .

For each object, scene, and concept the API returns one or more labels. Each label provides the object name, and the level of confidence that the image contains the object. For example, suppose the input image has a lighthouse, the sea, and a rock. The response will include all three labels, one for each object.

{Name: lighthouse, Confidence: 98.4629}

{Name: rock,Confidence: 79.2097}

{Name: sea,Confidence: 75.061}

In the preceding example, the operation returns one label for each of the three objects. The operation can also return multiple labels for the same object in the image. For example, if the input image shows a flower (for example, a tulip), the operation might return the following three labels.

{Name: flower,Confidence: 99.0562}

{Name: plant,Confidence: 99.0562}

{Name: tulip,Confidence: 99.0562}

In this example, the detection algorithm more precisely identifies the flower as a tulip.

You can provide the input image as an S3 object or as base64-encoded bytes. In response, the API returns an array of labels. In addition, the response also includes the orientation correction. Optionally, you can specify MinConfidence to control the confidence threshold for the labels returned. The default is 50%. You can also add the MaxLabels parameter to limit the number of labels returned.

Note

If the object detected is a person, the operation doesn't provide the same facial details that the DetectFaces operation provides.

This is a stateless API operation. That is, the operation does not persist any data.

This operation requires permissions to perform the rekognition:DetectLabels action.

See also: AWS API Documentation

Request Syntax

response = client.detect_labels(
    Image={
        'Bytes': b'bytes',
        'S3Object': {
            'Bucket': 'string',
            'Name': 'string',
            'Version': 'string'
        }
    },
    MaxLabels=123,
    MinConfidence=...
)
Parameters
  • Image (dict) --

    [REQUIRED]

    The input image. You can provide a blob of image bytes or an S3 object.

    • Bytes (bytes) --

      Blob of image bytes up to 5 MBs.

    • S3Object (dict) --

      Identifies an S3 object as the image source.

      • Bucket (string) --

        Name of the S3 bucket.

      • Name (string) --

        S3 object key name.

      • Version (string) --

        If the bucket is versioning enabled, you can specify the object version.

  • MaxLabels (integer) -- Maximum number of labels you want the service to return in the response. The service returns the specified number of highest confidence labels.
  • MinConfidence (float) --

    Specifies the minimum confidence level for the labels to return. Amazon Rekognition doesn't return any labels with confidence lower than this specified value.

    If MinConfidence is not specified, the operation returns labels with a confidence values greater than or equal to 50 percent.

Return type

dict

Returns

Response Syntax

{
    'Labels': [
        {
            'Name': 'string',
            'Confidence': ...
        },
    ],
    'OrientationCorrection': 'ROTATE_0'|'ROTATE_90'|'ROTATE_180'|'ROTATE_270'
}

Response Structure

  • (dict) --

    • Labels (list) --

      An array of labels for the real-world objects detected.

      • (dict) --

        Structure containing details about the detected label, including name, and level of confidence.

        • Name (string) --

          The name (label) of the object.

        • Confidence (float) --

          Level of confidence.

    • OrientationCorrection (string) --

      Amazon Rekognition returns the orientation of the input image that was detected (clockwise direction). If your application displays the image, you can use this value to correct the orientation. If Amazon Rekognition detects that the input image was rotated (for example, by 90 degrees), it first corrects the orientation before detecting the labels.

      Note

      If the source image Exif metadata populates the orientation field, Amazon Rekognition does not perform orientation correction and the value of OrientationCorrection will be nil.

Examples

This operation detects labels in the supplied image

response = client.detect_labels(
    Image={
        'S3Object': {
            'Bucket': 'mybucket',
            'Name': 'myphoto',
        },
    },
    MaxLabels=123,
    MinConfidence=70,
)

print(response)

Expected Output:

{
    'Labels': [
        {
            'Confidence': 99.2507247925,
            'Name': 'People',
        },
        {
            'Confidence': 99.2507400513,
            'Name': 'Person',
        },
    ],
    'ResponseMetadata': {
        '...': '...',
    },
}
detect_moderation_labels(**kwargs)

Detects explicit or suggestive adult content in a specified .jpeg or .png image. Use DetectModerationLabels to moderate images depending on your requirements. For example, you might want to filter images that contain nudity, but not images containing suggestive content.

To filter images, use the labels returned by DetectModerationLabels to determine which types of content are appropriate. For information about moderation labels, see howitworks-moderateimage .

See also: AWS API Documentation

Request Syntax

response = client.detect_moderation_labels(
    Image={
        'Bytes': b'bytes',
        'S3Object': {
            'Bucket': 'string',
            'Name': 'string',
            'Version': 'string'
        }
    },
    MinConfidence=...
)
Parameters
  • Image (dict) --

    [REQUIRED]

    Provides the source image either as bytes or an S3 object.

    The region for the S3 bucket containing the S3 object must match the region you use for Amazon Rekognition operations.

    You may need to Base64-encode the image bytes depending on the language you are using and whether or not you are using the AWS SDK. For more information, see example4 .

    If you use the Amazon CLI to call Amazon Rekognition operations, passing image bytes using the Bytes property is not supported. You must first upload the image to an Amazon S3 bucket and then call the operation using the S3Object property.

    For Amazon Rekognition to process an S3 object, the user must have permission to access the S3 object. For more information, see manage-access-resource-policies .

    • Bytes (bytes) --

      Blob of image bytes up to 5 MBs.

    • S3Object (dict) --

      Identifies an S3 object as the image source.

      • Bucket (string) --

        Name of the S3 bucket.

      • Name (string) --

        S3 object key name.

      • Version (string) --

        If the bucket is versioning enabled, you can specify the object version.

  • MinConfidence (float) --

    Specifies the minimum confidence level for the labels to return. Amazon Rekognition doesn't return any labels with a confidence level lower than this specified value.

    If you don't specify MinConfidence , the operation returns labels with confidence values greater than or equal to 50 percent.

Return type

dict

Returns

Response Syntax

{
    'ModerationLabels': [
        {
            'Confidence': ...,
            'Name': 'string',
            'ParentName': 'string'
        },
    ]
}

Response Structure

  • (dict) --

    • ModerationLabels (list) --

      A list of labels for explicit or suggestive adult content found in the image. The list includes the top-level label and each child label detected in the image. This is useful for filtering specific categories of content.

      • (dict) --

        Provides information about a single type of moderated content found in an image. Each type of moderated content has a label within a hierarchical taxonomy. For more information, see howitworks-moderateimage .

        • Confidence (float) --

          Specifies the confidence that Amazon Rekognition has that the label has been correctly identified.

          If you don't specify the MinConfidence parameter in the call to DetectModerationLabels , the operation returns labels with a confidence value greater than or equal to 50 percent.

        • Name (string) --

          The label name for the type of content detected in the image.

        • ParentName (string) --

          The name for the parent label. Labels at the top-level of the hierarchy have the parent label "" .

generate_presigned_url(ClientMethod, Params=None, ExpiresIn=3600, HttpMethod=None)

Generate a presigned url given a client, its method, and arguments

Parameters
  • ClientMethod (string) -- The client method to presign for
  • Params (dict) -- The parameters normally passed to ClientMethod.
  • ExpiresIn (int) -- The number of seconds the presigned url is valid for. By default it expires in an hour (3600 seconds)
  • HttpMethod (string) -- The http method to use on the generated url. By default, the http method is whatever is used in the method's model.
Returns

The presigned url

get_paginator(operation_name)

Create a paginator for an operation.

Parameters
operation_name (string) -- The operation name. This is the same name as the method name on the client. For example, if the method name is create_foo, and you'd normally invoke the operation as client.create_foo(**kwargs), if the create_foo operation can be paginated, you can use the call client.get_paginator("create_foo").
Raises OperationNotPageableError
Raised if the operation is not pageable. You can use the client.can_paginate method to check if an operation is pageable.
Return type
L{botocore.paginate.Paginator}
Returns
A paginator object.
get_waiter(waiter_name)
index_faces(**kwargs)

Detects faces in the input image and adds them to the specified collection.

Amazon Rekognition does not save the actual faces detected. Instead, the underlying detection algorithm first detects the faces in the input image, and for each face extracts facial features into a feature vector, and stores it in the back-end database. Amazon Rekognition uses feature vectors when performing face match and search operations using the and operations.

If you provide the optional externalImageID for the input image you provided, Amazon Rekognition associates this ID with all faces that it detects. When you call the operation, the response returns the external ID. You can use this external image ID to create a client-side index to associate the faces with each image. You can then use the index to find all faces in an image.

In response, the operation returns an array of metadata for all detected faces. This includes, the bounding box of the detected face, confidence value (indicating the bounding box contains a face), a face ID assigned by the service for each face that is detected and stored, and an image ID assigned by the service for the input image If you request all facial attributes (using the detectionAttributes parameter, Amazon Rekognition returns detailed facial attributes such as facial landmarks (for example, location of eye and mount) and other facial attributes such gender. If you provide the same image, specify the same collection, and use the same external ID in the IndexFaces operation, Amazon Rekognition doesn't save duplicate face metadata.

For an example, see example2 .

This operation requires permissions to perform the rekognition:IndexFaces action.

See also: AWS API Documentation

Request Syntax

response = client.index_faces(
    CollectionId='string',
    Image={
        'Bytes': b'bytes',
        'S3Object': {
            'Bucket': 'string',
            'Name': 'string',
            'Version': 'string'
        }
    },
    ExternalImageId='string',
    DetectionAttributes=[
        'DEFAULT'|'ALL',
    ]
)
Parameters
  • CollectionId (string) --

    [REQUIRED]

    The ID of an existing collection to which you want to add the faces that are detected in the input images.

  • Image (dict) --

    [REQUIRED]

    Provides the source image either as bytes or an S3 object.

    The region for the S3 bucket containing the S3 object must match the region you use for Amazon Rekognition operations.

    You may need to Base64-encode the image bytes depending on the language you are using and whether or not you are using the AWS SDK. For more information, see example4 .

    If you use the Amazon CLI to call Amazon Rekognition operations, passing image bytes using the Bytes property is not supported. You must first upload the image to an Amazon S3 bucket and then call the operation using the S3Object property.

    For Amazon Rekognition to process an S3 object, the user must have permission to access the S3 object. For more information, see manage-access-resource-policies .

    • Bytes (bytes) --

      Blob of image bytes up to 5 MBs.

    • S3Object (dict) --

      Identifies an S3 object as the image source.

      • Bucket (string) --

        Name of the S3 bucket.

      • Name (string) --

        S3 object key name.

      • Version (string) --

        If the bucket is versioning enabled, you can specify the object version.

  • ExternalImageId (string) -- ID you want to assign to all the faces detected in the image.
  • DetectionAttributes (list) --

    A list of facial attributes that you want to be returned. This can be the default list of attributes or all attributes. If you don't specify a value for Attributes or if you specify ["DEFAULT"] , the API returns the following subset of facial attributes: BoundingBox , Confidence , Pose , Quality and Landmarks . If you provide ["ALL"] , all facial attributes are returned but the operation will take longer to complete.

    If you provide both, ["ALL", "DEFAULT"] , the service uses a logical AND operator to determine which attributes to return (in this case, all attributes).

    • (string) --
Return type

dict

Returns

Response Syntax

{
    'FaceRecords': [
        {
            'Face': {
                'FaceId': 'string',
                'BoundingBox': {
                    'Width': ...,
                    'Height': ...,
                    'Left': ...,
                    'Top': ...
                },
                'ImageId': 'string',
                'ExternalImageId': 'string',
                'Confidence': ...
            },
            'FaceDetail': {
                'BoundingBox': {
                    'Width': ...,
                    'Height': ...,
                    'Left': ...,
                    'Top': ...
                },
                'AgeRange': {
                    'Low': 123,
                    'High': 123
                },
                'Smile': {
                    'Value': True|False,
                    'Confidence': ...
                },
                'Eyeglasses': {
                    'Value': True|False,
                    'Confidence': ...
                },
                'Sunglasses': {
                    'Value': True|False,
                    'Confidence': ...
                },
                'Gender': {
                    'Value': 'MALE'|'FEMALE',
                    'Confidence': ...
                },
                'Beard': {
                    'Value': True|False,
                    'Confidence': ...
                },
                'Mustache': {
                    'Value': True|False,
                    'Confidence': ...
                },
                'EyesOpen': {
                    'Value': True|False,
                    'Confidence': ...
                },
                'MouthOpen': {
                    'Value': True|False,
                    'Confidence': ...
                },
                'Emotions': [
                    {
                        'Type': 'HAPPY'|'SAD'|'ANGRY'|'CONFUSED'|'DISGUSTED'|'SURPRISED'|'CALM'|'UNKNOWN',
                        'Confidence': ...
                    },
                ],
                'Landmarks': [
                    {
                        'Type': 'EYE_LEFT'|'EYE_RIGHT'|'NOSE'|'MOUTH_LEFT'|'MOUTH_RIGHT'|'LEFT_EYEBROW_LEFT'|'LEFT_EYEBROW_RIGHT'|'LEFT_EYEBROW_UP'|'RIGHT_EYEBROW_LEFT'|'RIGHT_EYEBROW_RIGHT'|'RIGHT_EYEBROW_UP'|'LEFT_EYE_LEFT'|'LEFT_EYE_RIGHT'|'LEFT_EYE_UP'|'LEFT_EYE_DOWN'|'RIGHT_EYE_LEFT'|'RIGHT_EYE_RIGHT'|'RIGHT_EYE_UP'|'RIGHT_EYE_DOWN'|'NOSE_LEFT'|'NOSE_RIGHT'|'MOUTH_UP'|'MOUTH_DOWN'|'LEFT_PUPIL'|'RIGHT_PUPIL',
                        'X': ...,
                        'Y': ...
                    },
                ],
                'Pose': {
                    'Roll': ...,
                    'Yaw': ...,
                    'Pitch': ...
                },
                'Quality': {
                    'Brightness': ...,
                    'Sharpness': ...
                },
                'Confidence': ...
            }
        },
    ],
    'OrientationCorrection': 'ROTATE_0'|'ROTATE_90'|'ROTATE_180'|'ROTATE_270'
}

Response Structure

  • (dict) --

    • FaceRecords (list) --

      An array of faces detected and added to the collection. For more information, see howitworks-index-faces .

      • (dict) --

        Object containing both the face metadata (stored in the back-end database) and facial attributes that are detected but aren't stored in the database.

        • Face (dict) --

          Describes the face properties such as the bounding box, face ID, image ID of the source image, and external image ID that you assigned.

          • FaceId (string) --

            Unique identifier that Amazon Rekognition assigns to the face.

          • BoundingBox (dict) --

            Identifies the bounding box around the object or face. The left (x-coordinate) and top (y-coordinate) are coordinates representing the top and left sides of the bounding box. Note that the upper-left corner of the image is the origin (0,0).

            The top and left values returned are ratios of the overall image size. For example, if the input image is 700x200 pixels, and the top-left coordinate of the bounding box is 350x50 pixels, the API returns a left value of 0.5 (350/700) and a top value of 0.25 (50/200).

            The width and height values represent the dimensions of the bounding box as a ratio of the overall image dimension. For example, if the input image is 700x200 pixels, and the bounding box width is 70 pixels, the width returned is 0.1.

            Note

            The bounding box coordinates can have negative values. For example, if Amazon Rekognition is able to detect a face that is at the image edge and is only partially visible, the service can return coordinates that are outside the image bounds and, depending on the image edge, you might get negative values or values greater than 1 for the left or top values.

            • Width (float) --

              Width of the bounding box as a ratio of the overall image width.

            • Height (float) --

              Height of the bounding box as a ratio of the overall image height.

            • Left (float) --

              Left coordinate of the bounding box as a ratio of overall image width.

            • Top (float) --

              Top coordinate of the bounding box as a ratio of overall image height.

          • ImageId (string) --

            Unique identifier that Amazon Rekognition assigns to the source image.

          • ExternalImageId (string) --

            Identifier that you assign to all the faces in the input image.

          • Confidence (float) --

            Confidence level that the bounding box contains a face (and not a different object such as a tree).

        • FaceDetail (dict) --

          Structure containing attributes of the face that the algorithm detected.

          • BoundingBox (dict) --

            Bounding box of the face.

            • Width (float) --

              Width of the bounding box as a ratio of the overall image width.

            • Height (float) --

              Height of the bounding box as a ratio of the overall image height.

            • Left (float) --

              Left coordinate of the bounding box as a ratio of overall image width.

            • Top (float) --

              Top coordinate of the bounding box as a ratio of overall image height.

          • AgeRange (dict) --

            The estimated age range, in years, for the face. Low represents the lowest estimated age and High represents the highest estimated age.

            • Low (integer) --

              The lowest estimated age.

            • High (integer) --

              The highest estimated age.

          • Smile (dict) --

            Indicates whether or not the face is smiling, and the confidence level in the determination.

            • Value (boolean) --

              Boolean value that indicates whether the face is smiling or not.

            • Confidence (float) --

              Level of confidence in the determination.

          • Eyeglasses (dict) --

            Indicates whether or not the face is wearing eye glasses, and the confidence level in the determination.

            • Value (boolean) --

              Boolean value that indicates whether the face is wearing eye glasses or not.

            • Confidence (float) --

              Level of confidence in the determination.

          • Sunglasses (dict) --

            Indicates whether or not the face is wearing sunglasses, and the confidence level in the determination.

            • Value (boolean) --

              Boolean value that indicates whether the face is wearing sunglasses or not.

            • Confidence (float) --

              Level of confidence in the determination.

          • Gender (dict) --

            Gender of the face and the confidence level in the determination.

            • Value (string) --

              Gender of the face.

            • Confidence (float) --

              Level of confidence in the determination.

          • Beard (dict) --

            Indicates whether or not the face has a beard, and the confidence level in the determination.

            • Value (boolean) --

              Boolean value that indicates whether the face has beard or not.

            • Confidence (float) --

              Level of confidence in the determination.

          • Mustache (dict) --

            Indicates whether or not the face has a mustache, and the confidence level in the determination.

            • Value (boolean) --

              Boolean value that indicates whether the face has mustache or not.

            • Confidence (float) --

              Level of confidence in the determination.

          • EyesOpen (dict) --

            Indicates whether or not the eyes on the face are open, and the confidence level in the determination.

            • Value (boolean) --

              Boolean value that indicates whether the eyes on the face are open.

            • Confidence (float) --

              Level of confidence in the determination.

          • MouthOpen (dict) --

            Indicates whether or not the mouth on the face is open, and the confidence level in the determination.

            • Value (boolean) --

              Boolean value that indicates whether the mouth on the face is open or not.

            • Confidence (float) --

              Level of confidence in the determination.

          • Emotions (list) --

            The emotions detected on the face, and the confidence level in the determination. For example, HAPPY, SAD, and ANGRY.

            • (dict) --

              The emotions detected on the face, and the confidence level in the determination. For example, HAPPY, SAD, and ANGRY.

              • Type (string) --

                Type of emotion detected.

              • Confidence (float) --

                Level of confidence in the determination.

          • Landmarks (list) --

            Indicates the location of the landmark on the face.

            • (dict) --

              Indicates the location of the landmark on the face.

              • Type (string) --

                Type of the landmark.

              • X (float) --

                x-coordinate from the top left of the landmark expressed as the ration of the width of the image. For example, if the images is 700x200 and the x-coordinate of the landmark is at 350 pixels, this value is 0.5.

              • Y (float) --

                y-coordinate from the top left of the landmark expressed as the ration of the height of the image. For example, if the images is 700x200 and the y-coordinate of the landmark is at 100 pixels, this value is 0.5.

          • Pose (dict) --

            Indicates the pose of the face as determined by pitch, roll, and the yaw.

            • Roll (float) --

              Value representing the face rotation on the roll axis.

            • Yaw (float) --

              Value representing the face rotation on the yaw axis.

            • Pitch (float) --

              Value representing the face rotation on the pitch axis.

          • Quality (dict) --

            Identifies image brightness and sharpness.

            • Brightness (float) --

              Value representing brightness of the face. The service returns a value between 0 and 100 (inclusive). A higher value indicates a brighter face image.

            • Sharpness (float) --

              Value representing sharpness of the face. The service returns a value between 0 and 100 (inclusive). A higher value indicates a sharper face image.

          • Confidence (float) --

            Confidence level that the bounding box contains a face (and not a different object such as a tree).

    • OrientationCorrection (string) --

      The algorithm detects the image orientation. If it detects that the image was rotated, it returns the degree of rotation. You can use this value to correct the orientation and also appropriately analyze the bounding box coordinates that are returned.

      Note

      If the source image Exif metadata populates the orientation field, Amazon Rekognition does not perform orientation correction and the value of OrientationCorrection will be nil.

Examples

This operation detects faces in an image and adds them to the specified Rekognition collection.

response = client.index_faces(
    CollectionId='myphotos',
    DetectionAttributes=[
    ],
    ExternalImageId='myphotoid',
    Image={
        'S3Object': {
            'Bucket': 'mybucket',
            'Name': 'myphoto',
        },
    },
)

print(response)

Expected Output:

{
    'FaceRecords': [
        {
            'Face': {
                'BoundingBox': {
                    'Height': 0.334814816713,
                    'Left': 0.318888902664,
                    'Top': 0.493333339691,
                    'Width': 0.25,
                },
                'Confidence': 99.9991226196,
                'FaceId': 'ff43d742-0c13-5d16-a3e8-03d3f58e980b',
                'ImageId': '465f4e93-763e-51d0-b030-b9667a2d94b1',
            },
            'FaceDetail': {
                'BoundingBox': {
                    'Height': 0.334814816713,
                    'Left': 0.318888902664,
                    'Top': 0.493333339691,
                    'Width': 0.25,
                },
                'Confidence': 99.9991226196,
                'Landmarks': [
                    {
                        'Type': 'EYE_LEFT',
                        'X': 0.397676467896,
                        'Y': 0.624834597111,
                    },
                    {
                        'Type': 'EYE_RIGHT',
                        'X': 0.481093645096,
                        'Y': 0.63171172142,
                    },
                    {
                        'Type': 'NOSE_LEFT',
                        'X': 0.419862389565,
                        'Y': 0.711194038391,
                    },
                    {
                        'Type': 'MOUTH_DOWN',
                        'X': 0.405253022909,
                        'Y': 0.749770104885,
                    },
                    {
                        'Type': 'MOUTH_UP',
                        'X': 0.475324898958,
                        'Y': 0.755854964256,
                    },
                ],
                'Pose': {
                    'Pitch': -9.71364593506,
                    'Roll': 4.70728111267,
                    'Yaw': -24.4386634827,
                },
                'Quality': {
                    'Brightness': 29.2335891724,
                    'Sharpness': 80,
                },
            },
        },
        {
            'Face': {
                'BoundingBox': {
                    'Height': 0.325925916433,
                    'Left': 0.514444470406,
                    'Top': 0.151111111045,
                    'Width': 0.244444444776,
                },
                'Confidence': 99.9995040894,
                'FaceId': '8be04dba-4e58-520d-850e-9eae4af70eb2',
                'ImageId': '465f4e93-763e-51d0-b030-b9667a2d94b1',
            },
            'FaceDetail': {
                'BoundingBox': {
                    'Height': 0.325925916433,
                    'Left': 0.514444470406,
                    'Top': 0.151111111045,
                    'Width': 0.244444444776,
                },
                'Confidence': 99.9995040894,
                'Landmarks': [
                    {
                        'Type': 'EYE_LEFT',
                        'X': 0.600689232349,
                        'Y': 0.290842205286,
                    },
                    {
                        'Type': 'EYE_RIGHT',
                        'X': 0.680814146996,
                        'Y': 0.296090424061,
                    },
                    {
                        'Type': 'NOSE_LEFT',
                        'X': 0.639533221722,
                        'Y': 0.352259576321,
                    },
                    {
                        'Type': 'MOUTH_DOWN',
                        'X': 0.589208304882,
                        'Y': 0.386898875237,
                    },
                    {
                        'Type': 'MOUTH_UP',
                        'X': 0.674560010433,
                        'Y': 0.394125759602,
                    },
                ],
                'Pose': {
                    'Pitch': -4.68313837051,
                    'Roll': 2.10295295715,
                    'Yaw': 6.71665525436,
                },
                'Quality': {
                    'Brightness': 34.9516983032,
                    'Sharpness': 160,
                },
            },
        },
    ],
    'OrientationCorrection': 'ROTATE_0',
    'ResponseMetadata': {
        '...': '...',
    },
}
list_collections(**kwargs)

Returns list of collection IDs in your account. If the result is truncated, the response also provides a NextToken that you can use in the subsequent request to fetch the next set of collection IDs.

For an example, see example1 .

This operation requires permissions to perform the rekognition:ListCollections action.

See also: AWS API Documentation

Request Syntax

response = client.list_collections(
    NextToken='string',
    MaxResults=123
)
Parameters
  • NextToken (string) -- Pagination token from the previous response.
  • MaxResults (integer) -- Maximum number of collection IDs to return.
Return type

dict

Returns

Response Syntax

{
    'CollectionIds': [
        'string',
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • CollectionIds (list) --

      An array of collection IDs.

      • (string) --
    • NextToken (string) --

      If the result is truncated, the response provides a NextToken that you can use in the subsequent request to fetch the next set of collection IDs.

Examples

This operation returns a list of Rekognition collections.

response = client.list_collections(
)

print(response)

Expected Output:

{
    'CollectionIds': [
        'myphotos',
    ],
    'ResponseMetadata': {
        '...': '...',
    },
}
list_faces(**kwargs)

Returns metadata for faces in the specified collection. This metadata includes information such as the bounding box coordinates, the confidence (that the bounding box contains a face), and face ID. For an example, see example3 .

This operation requires permissions to perform the rekognition:ListFaces action.

See also: AWS API Documentation

Request Syntax

response = client.list_faces(
    CollectionId='string',
    NextToken='string',
    MaxResults=123
)
Parameters
  • CollectionId (string) --

    [REQUIRED]

    ID of the collection from which to list the faces.

  • NextToken (string) -- If the previous response was incomplete (because there is more data to retrieve), Amazon Rekognition returns a pagination token in the response. You can use this pagination token to retrieve the next set of faces.
  • MaxResults (integer) -- Maximum number of faces to return.
Return type

dict

Returns

Response Syntax

{
    'Faces': [
        {
            'FaceId': 'string',
            'BoundingBox': {
                'Width': ...,
                'Height': ...,
                'Left': ...,
                'Top': ...
            },
            'ImageId': 'string',
            'ExternalImageId': 'string',
            'Confidence': ...
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • Faces (list) --

      An array of Face objects.

      • (dict) --

        Describes the face properties such as the bounding box, face ID, image ID of the source image, and external image ID that you assigned.

        • FaceId (string) --

          Unique identifier that Amazon Rekognition assigns to the face.

        • BoundingBox (dict) --

          Identifies the bounding box around the object or face. The left (x-coordinate) and top (y-coordinate) are coordinates representing the top and left sides of the bounding box. Note that the upper-left corner of the image is the origin (0,0).

          The top and left values returned are ratios of the overall image size. For example, if the input image is 700x200 pixels, and the top-left coordinate of the bounding box is 350x50 pixels, the API returns a left value of 0.5 (350/700) and a top value of 0.25 (50/200).

          The width and height values represent the dimensions of the bounding box as a ratio of the overall image dimension. For example, if the input image is 700x200 pixels, and the bounding box width is 70 pixels, the width returned is 0.1.

          Note

          The bounding box coordinates can have negative values. For example, if Amazon Rekognition is able to detect a face that is at the image edge and is only partially visible, the service can return coordinates that are outside the image bounds and, depending on the image edge, you might get negative values or values greater than 1 for the left or top values.

          • Width (float) --

            Width of the bounding box as a ratio of the overall image width.

          • Height (float) --

            Height of the bounding box as a ratio of the overall image height.

          • Left (float) --

            Left coordinate of the bounding box as a ratio of overall image width.

          • Top (float) --

            Top coordinate of the bounding box as a ratio of overall image height.

        • ImageId (string) --

          Unique identifier that Amazon Rekognition assigns to the source image.

        • ExternalImageId (string) --

          Identifier that you assign to all the faces in the input image.

        • Confidence (float) --

          Confidence level that the bounding box contains a face (and not a different object such as a tree).

    • NextToken (string) --

      If the response is truncated, Amazon Rekognition returns this token that you can use in the subsequent request to retrieve the next set of faces.

Examples

This operation lists the faces in a Rekognition collection.

response = client.list_faces(
    CollectionId='myphotos',
    MaxResults=20,
)

print(response)

Expected Output:

{
    'Faces': [
        {
            'BoundingBox': {
                'Height': 0.180000007153,
                'Left': 0.555555999279,
                'Top': 0.336667001247,
                'Width': 0.239999994636,
            },
            'Confidence': 100,
            'FaceId': '1c62e8b5-69a7-5b7d-b3cd-db4338a8a7e7',
            'ImageId': '147fdf82-7a71-52cf-819b-e786c7b9746e',
        },
        {
            'BoundingBox': {
                'Height': 0.165555998683,
                'Left': 0.309630006552,
                'Top': 0.706667006016,
                'Width': 0.220741003752,
            },
            'Confidence': 100,
            'FaceId': '29a75abe-397b-5101-ba4f-706783b2246c',
            'ImageId': '147fdf82-7a71-52cf-819b-e786c7b9746e',
        },
        {
            'BoundingBox': {
                'Height': 0.323442012072,
                'Left': 0.323332995176,
                'Top': 0.5,
                'Width': 0.242221996188,
            },
            'Confidence': 99.998298645,
            'FaceId': '38271d79-7bc2-5efb-b752-398a8d575b85',
            'ImageId': 'd5631190-d039-54e4-b267-abd22c8647c5',
        },
        {
            'BoundingBox': {
                'Height': 0.03555560112,
                'Left': 0.373887002468,
                'Top': 0.247777998447,
                'Width': 0.0474776998162,
            },
            'Confidence': 99.9921035767,
            'FaceId': '3b01bef0-c883-5654-ba42-d5ad28b720b3',
            'ImageId': '812d9f04-86f9-54fc-9275-8d0dcbcb6784',
        },
        {
            'BoundingBox': {
                'Height': 0.0533333010972,
                'Left': 0.293769001961,
                'Top': 0.356667011976,
                'Width': 0.0712165981531,
            },
            'Confidence': 99.9991989136,
            'FaceId': '4839a608-49d0-566c-8301-509d71b534d1',
            'ImageId': '812d9f04-86f9-54fc-9275-8d0dcbcb6784',
        },
        {
            'BoundingBox': {
                'Height': 0.324925988913,
                'Left': 0.515555977821,
                'Top': 0.151335000992,
                'Width': 0.243332996964,
            },
            'Confidence': 99.99949646,
            'FaceId': '70008e50-75e4-55d0-8e80-363fb73b3a14',
            'ImageId': 'd5631190-d039-54e4-b267-abd22c8647c5',
        },
        {
            'BoundingBox': {
                'Height': 0.037777800113,
                'Left': 0.700296998024,
                'Top': 0.187777996063,
                'Width': 0.0504450984299,
            },
            'Confidence': 99.926399231,
            'FaceId': '7f5f88ed-d684-5a88-b0df-01e4a521552b',
            'ImageId': '812d9f04-86f9-54fc-9275-8d0dcbcb6784',
        },
        {
            'BoundingBox': {
                'Height': 0.055555600673,
                'Left': 0.139466002584,
                'Top': 0.463333010674,
                'Width': 0.0727002993226,
            },
            'Confidence': 99.9946975708,
            'FaceId': '895b4e2c-81de-5902-a4bd-d1792bda00b2',
            'ImageId': '812d9f04-86f9-54fc-9275-8d0dcbcb6784',
        },
        {
            'BoundingBox': {
                'Height': 0.32592600584,
                'Left': 0.514443993568,
                'Top': 0.151111006737,
                'Width': 0.244443997741,
            },
            'Confidence': 99.99949646,
            'FaceId': '8be04dba-4e58-520d-850e-9eae4af70eb2',
            'ImageId': '465f4e93-763e-51d0-b030-b9667a2d94b1',
        },
        {
            'BoundingBox': {
                'Height': 0.18888899684,
                'Left': 0.378338009119,
                'Top': 0.235556006432,
                'Width': 0.252225995064,
            },
            'Confidence': 99.9999008179,
            'FaceId': '908544ad-edc3-59df-8faf-6a87cc256cf5',
            'ImageId': '3c731605-d772-541a-a5e7-0375dbc68a07',
        },
        {
            'BoundingBox': {
                'Height': 0.334814995527,
                'Left': 0.318888992071,
                'Top': 0.493333011866,
                'Width': 0.25,
            },
            'Confidence': 99.9990997314,
            'FaceId': 'ff43d742-0c13-5d16-a3e8-03d3f58e980b',
            'ImageId': '465f4e93-763e-51d0-b030-b9667a2d94b1',
        },
    ],
    'ResponseMetadata': {
        '...': '...',
    },
}
search_faces(**kwargs)

For a given input face ID, searches for matching faces in the collection the face belongs to. You get a face ID when you add a face to the collection using the IndexFaces operation. The operation compares the features of the input face with faces in the specified collection.

Note

You can also search faces without indexing faces by using the SearchFacesByImage operation.

The operation response returns an array of faces that match, ordered by similarity score with the highest similarity first. More specifically, it is an array of metadata for each face match that is found. Along with the metadata, the response also includes a confidence value for each face match, indicating the confidence that the specific face matches the input face.

For an example, see example3 .

This operation requires permissions to perform the rekognition:SearchFaces action.

See also: AWS API Documentation

Request Syntax

response = client.search_faces(
    CollectionId='string',
    FaceId='string',
    MaxFaces=123,
    FaceMatchThreshold=...
)
Parameters
  • CollectionId (string) --

    [REQUIRED]

    ID of the collection the face belongs to.

  • FaceId (string) --

    [REQUIRED]

    ID of a face to find matches for in the collection.

  • MaxFaces (integer) -- Maximum number of faces to return. The operation returns the maximum number of faces with the highest confidence in the match.
  • FaceMatchThreshold (float) -- Optional value specifying the minimum confidence in the face match to return. For example, don't return any matches where confidence in matches is less than 70%.
Return type

dict

Returns

Response Syntax

{
    'SearchedFaceId': 'string',
    'FaceMatches': [
        {
            'Similarity': ...,
            'Face': {
                'FaceId': 'string',
                'BoundingBox': {
                    'Width': ...,
                    'Height': ...,
                    'Left': ...,
                    'Top': ...
                },
                'ImageId': 'string',
                'ExternalImageId': 'string',
                'Confidence': ...
            }
        },
    ]
}

Response Structure

  • (dict) --

    • SearchedFaceId (string) --

      ID of the face that was searched for matches in a collection.

    • FaceMatches (list) --

      An array of faces that matched the input face, along with the confidence in the match.

      • (dict) --

        Provides face metadata. In addition, it also provides the confidence in the match of this face with the input face.

        • Similarity (float) --

          Confidence in the match of this face with the input face.

        • Face (dict) --

          Describes the face properties such as the bounding box, face ID, image ID of the source image, and external image ID that you assigned.

          • FaceId (string) --

            Unique identifier that Amazon Rekognition assigns to the face.

          • BoundingBox (dict) --

            Identifies the bounding box around the object or face. The left (x-coordinate) and top (y-coordinate) are coordinates representing the top and left sides of the bounding box. Note that the upper-left corner of the image is the origin (0,0).

            The top and left values returned are ratios of the overall image size. For example, if the input image is 700x200 pixels, and the top-left coordinate of the bounding box is 350x50 pixels, the API returns a left value of 0.5 (350/700) and a top value of 0.25 (50/200).

            The width and height values represent the dimensions of the bounding box as a ratio of the overall image dimension. For example, if the input image is 700x200 pixels, and the bounding box width is 70 pixels, the width returned is 0.1.

            Note

            The bounding box coordinates can have negative values. For example, if Amazon Rekognition is able to detect a face that is at the image edge and is only partially visible, the service can return coordinates that are outside the image bounds and, depending on the image edge, you might get negative values or values greater than 1 for the left or top values.

            • Width (float) --

              Width of the bounding box as a ratio of the overall image width.

            • Height (float) --

              Height of the bounding box as a ratio of the overall image height.

            • Left (float) --

              Left coordinate of the bounding box as a ratio of overall image width.

            • Top (float) --

              Top coordinate of the bounding box as a ratio of overall image height.

          • ImageId (string) --

            Unique identifier that Amazon Rekognition assigns to the source image.

          • ExternalImageId (string) --

            Identifier that you assign to all the faces in the input image.

          • Confidence (float) --

            Confidence level that the bounding box contains a face (and not a different object such as a tree).

Examples

This operation searches for matching faces in the collection the supplied face belongs to.

response = client.search_faces(
    CollectionId='myphotos',
    FaceId='70008e50-75e4-55d0-8e80-363fb73b3a14',
    FaceMatchThreshold=90,
    MaxFaces=10,
)

print(response)

Expected Output:

{
    'FaceMatches': [
        {
            'Face': {
                'BoundingBox': {
                    'Height': 0.32592600584,
                    'Left': 0.514443993568,
                    'Top': 0.151111006737,
                    'Width': 0.244443997741,
                },
                'Confidence': 99.99949646,
                'FaceId': '8be04dba-4e58-520d-850e-9eae4af70eb2',
                'ImageId': '465f4e93-763e-51d0-b030-b9667a2d94b1',
            },
            'Similarity': 99.9722213745,
        },
        {
            'Face': {
                'BoundingBox': {
                    'Height': 0.165555998683,
                    'Left': 0.309630006552,
                    'Top': 0.706667006016,
                    'Width': 0.220741003752,
                },
                'Confidence': 100,
                'FaceId': '29a75abe-397b-5101-ba4f-706783b2246c',
                'ImageId': '147fdf82-7a71-52cf-819b-e786c7b9746e',
            },
            'Similarity': 97.0415496826,
        },
        {
            'Face': {
                'BoundingBox': {
                    'Height': 0.18888899684,
                    'Left': 0.378338009119,
                    'Top': 0.235556006432,
                    'Width': 0.252225995064,
                },
                'Confidence': 99.9999008179,
                'FaceId': '908544ad-edc3-59df-8faf-6a87cc256cf5',
                'ImageId': '3c731605-d772-541a-a5e7-0375dbc68a07',
            },
            'Similarity': 95.9452056885,
        },
    ],
    'SearchedFaceId': '70008e50-75e4-55d0-8e80-363fb73b3a14',
    'ResponseMetadata': {
        '...': '...',
    },
}
search_faces_by_image(**kwargs)

For a given input image, first detects the largest face in the image, and then searches the specified collection for matching faces. The operation compares the features of the input face with faces in the specified collection.

Note

To search for all faces in an input image, you might first call the operation, and then use the face IDs returned in subsequent calls to the operation.

You can also call the DetectFaces operation and use the bounding boxes in the response to make face crops, which then you can pass in to the SearchFacesByImage operation.

The response returns an array of faces that match, ordered by similarity score with the highest similarity first. More specifically, it is an array of metadata for each face match found. Along with the metadata, the response also includes a similarity indicating how similar the face is to the input face. In the response, the operation also returns the bounding box (and a confidence level that the bounding box contains a face) of the face that Amazon Rekognition used for the input image.

For an example, see example3 .

This operation requires permissions to perform the rekognition:SearchFacesByImage action.

See also: AWS API Documentation

Request Syntax

response = client.search_faces_by_image(
    CollectionId='string',
    Image={
        'Bytes': b'bytes',
        'S3Object': {
            'Bucket': 'string',
            'Name': 'string',
            'Version': 'string'
        }
    },
    MaxFaces=123,
    FaceMatchThreshold=...
)
Parameters
  • CollectionId (string) --

    [REQUIRED]

    ID of the collection to search.

  • Image (dict) --

    [REQUIRED]

    Provides the source image either as bytes or an S3 object.

    The region for the S3 bucket containing the S3 object must match the region you use for Amazon Rekognition operations.

    You may need to Base64-encode the image bytes depending on the language you are using and whether or not you are using the AWS SDK. For more information, see example4 .

    If you use the Amazon CLI to call Amazon Rekognition operations, passing image bytes using the Bytes property is not supported. You must first upload the image to an Amazon S3 bucket and then call the operation using the S3Object property.

    For Amazon Rekognition to process an S3 object, the user must have permission to access the S3 object. For more information, see manage-access-resource-policies .

    • Bytes (bytes) --

      Blob of image bytes up to 5 MBs.

    • S3Object (dict) --

      Identifies an S3 object as the image source.

      • Bucket (string) --

        Name of the S3 bucket.

      • Name (string) --

        S3 object key name.

      • Version (string) --

        If the bucket is versioning enabled, you can specify the object version.

  • MaxFaces (integer) -- Maximum number of faces to return. The operation returns the maximum number of faces with the highest confidence in the match.
  • FaceMatchThreshold (float) -- (Optional) Specifies the minimum confidence in the face match to return. For example, don't return any matches where confidence in matches is less than 70%.
Return type

dict

Returns

Response Syntax

{
    'SearchedFaceBoundingBox': {
        'Width': ...,
        'Height': ...,
        'Left': ...,
        'Top': ...
    },
    'SearchedFaceConfidence': ...,
    'FaceMatches': [
        {
            'Similarity': ...,
            'Face': {
                'FaceId': 'string',
                'BoundingBox': {
                    'Width': ...,
                    'Height': ...,
                    'Left': ...,
                    'Top': ...
                },
                'ImageId': 'string',
                'ExternalImageId': 'string',
                'Confidence': ...
            }
        },
    ]
}

Response Structure

  • (dict) --

    • SearchedFaceBoundingBox (dict) --

      The bounding box around the face in the input image that Amazon Rekognition used for the search.

      • Width (float) --

        Width of the bounding box as a ratio of the overall image width.

      • Height (float) --

        Height of the bounding box as a ratio of the overall image height.

      • Left (float) --

        Left coordinate of the bounding box as a ratio of overall image width.

      • Top (float) --

        Top coordinate of the bounding box as a ratio of overall image height.

    • SearchedFaceConfidence (float) --

      The level of confidence that the searchedFaceBoundingBox , contains a face.

    • FaceMatches (list) --

      An array of faces that match the input face, along with the confidence in the match.

      • (dict) --

        Provides face metadata. In addition, it also provides the confidence in the match of this face with the input face.

        • Similarity (float) --

          Confidence in the match of this face with the input face.

        • Face (dict) --

          Describes the face properties such as the bounding box, face ID, image ID of the source image, and external image ID that you assigned.

          • FaceId (string) --

            Unique identifier that Amazon Rekognition assigns to the face.

          • BoundingBox (dict) --

            Identifies the bounding box around the object or face. The left (x-coordinate) and top (y-coordinate) are coordinates representing the top and left sides of the bounding box. Note that the upper-left corner of the image is the origin (0,0).

            The top and left values returned are ratios of the overall image size. For example, if the input image is 700x200 pixels, and the top-left coordinate of the bounding box is 350x50 pixels, the API returns a left value of 0.5 (350/700) and a top value of 0.25 (50/200).

            The width and height values represent the dimensions of the bounding box as a ratio of the overall image dimension. For example, if the input image is 700x200 pixels, and the bounding box width is 70 pixels, the width returned is 0.1.

            Note

            The bounding box coordinates can have negative values. For example, if Amazon Rekognition is able to detect a face that is at the image edge and is only partially visible, the service can return coordinates that are outside the image bounds and, depending on the image edge, you might get negative values or values greater than 1 for the left or top values.

            • Width (float) --

              Width of the bounding box as a ratio of the overall image width.

            • Height (float) --

              Height of the bounding box as a ratio of the overall image height.

            • Left (float) --

              Left coordinate of the bounding box as a ratio of overall image width.

            • Top (float) --

              Top coordinate of the bounding box as a ratio of overall image height.

          • ImageId (string) --

            Unique identifier that Amazon Rekognition assigns to the source image.

          • ExternalImageId (string) --

            Identifier that you assign to all the faces in the input image.

          • Confidence (float) --

            Confidence level that the bounding box contains a face (and not a different object such as a tree).

Examples

This operation searches for faces in a Rekognition collection that match the largest face in an S3 bucket stored image.

response = client.search_faces_by_image(
    CollectionId='myphotos',
    FaceMatchThreshold=95,
    Image={
        'S3Object': {
            'Bucket': 'mybucket',
            'Name': 'myphoto',
        },
    },
    MaxFaces=5,
)

print(response)

Expected Output:

{
    'FaceMatches': [
        {
            'Face': {
                'BoundingBox': {
                    'Height': 0.323442012072,
                    'Left': 0.323332995176,
                    'Top': 0.5,
                    'Width': 0.242221996188,
                },
                'Confidence': 99.998298645,
                'FaceId': '38271d79-7bc2-5efb-b752-398a8d575b85',
                'ImageId': 'd5631190-d039-54e4-b267-abd22c8647c5',
            },
            'Similarity': 99.9703674316,
        },
    ],
    'SearchedFaceBoundingBox': {
        'Height': 0.334814816713,
        'Left': 0.318888902664,
        'Top': 0.493333339691,
        'Width': 0.25,
    },
    'SearchedFaceConfidence': 99.9991226196,
    'ResponseMetadata': {
        '...': '...',
    },
}

Paginators

The available paginators are:

class Rekognition.Paginator.ListCollections
paginator = client.get_paginator('list_collections')
paginate(**kwargs)

Creates an iterator that will paginate through responses from Rekognition.Client.list_collections().

See also: AWS API Documentation

Request Syntax

response_iterator = paginator.paginate(
    PaginationConfig={
        'MaxItems': 123,
        'PageSize': 123,
        'StartingToken': 'string'
    }
)
Parameters
PaginationConfig (dict) --

A dictionary that provides parameters to control pagination.

  • MaxItems (integer) --

    The total number of items to return. If the total number of items available is more than the value specified in max-items then a NextToken will be provided in the output that you can use to resume pagination.

  • PageSize (integer) --

    The size of each page.

  • StartingToken (string) --

    A token to specify where to start paginating. This is the NextToken from a previous response.

Return type
dict
Returns
Response Syntax
{
    'CollectionIds': [
        'string',
    ],

}

Response Structure

  • (dict) --
    • CollectionIds (list) --

      An array of collection IDs.

      • (string) --
class Rekognition.Paginator.ListFaces
paginator = client.get_paginator('list_faces')
paginate(**kwargs)

Creates an iterator that will paginate through responses from Rekognition.Client.list_faces().

See also: AWS API Documentation

Request Syntax

response_iterator = paginator.paginate(
    CollectionId='string',
    PaginationConfig={
        'MaxItems': 123,
        'PageSize': 123,
        'StartingToken': 'string'
    }
)
Parameters
  • CollectionId (string) --

    [REQUIRED]

    ID of the collection from which to list the faces.

  • PaginationConfig (dict) --

    A dictionary that provides parameters to control pagination.

    • MaxItems (integer) --

      The total number of items to return. If the total number of items available is more than the value specified in max-items then a NextToken will be provided in the output that you can use to resume pagination.

    • PageSize (integer) --

      The size of each page.

    • StartingToken (string) --

      A token to specify where to start paginating. This is the NextToken from a previous response.

Return type

dict

Returns

Response Syntax

{
    'Faces': [
        {
            'FaceId': 'string',
            'BoundingBox': {
                'Width': ...,
                'Height': ...,
                'Left': ...,
                'Top': ...
            },
            'ImageId': 'string',
            'ExternalImageId': 'string',
            'Confidence': ...
        },
    ],

}

Response Structure

  • (dict) --

    • Faces (list) --

      An array of Face objects.

      • (dict) --

        Describes the face properties such as the bounding box, face ID, image ID of the source image, and external image ID that you assigned.

        • FaceId (string) --

          Unique identifier that Amazon Rekognition assigns to the face.

        • BoundingBox (dict) --

          Identifies the bounding box around the object or face. The left (x-coordinate) and top (y-coordinate) are coordinates representing the top and left sides of the bounding box. Note that the upper-left corner of the image is the origin (0,0).

          The top and left values returned are ratios of the overall image size. For example, if the input image is 700x200 pixels, and the top-left coordinate of the bounding box is 350x50 pixels, the API returns a left value of 0.5 (350/700) and a top value of 0.25 (50/200).

          The width and height values represent the dimensions of the bounding box as a ratio of the overall image dimension. For example, if the input image is 700x200 pixels, and the bounding box width is 70 pixels, the width returned is 0.1.

          Note

          The bounding box coordinates can have negative values. For example, if Amazon Rekognition is able to detect a face that is at the image edge and is only partially visible, the service can return coordinates that are outside the image bounds and, depending on the image edge, you might get negative values or values greater than 1 for the left or top values.

          • Width (float) --

            Width of the bounding box as a ratio of the overall image width.

          • Height (float) --

            Height of the bounding box as a ratio of the overall image height.

          • Left (float) --

            Left coordinate of the bounding box as a ratio of overall image width.

          • Top (float) --

            Top coordinate of the bounding box as a ratio of overall image height.

        • ImageId (string) --

          Unique identifier that Amazon Rekognition assigns to the source image.

        • ExternalImageId (string) --

          Identifier that you assign to all the faces in the input image.

        • Confidence (float) --

          Confidence level that the bounding box contains a face (and not a different object such as a tree).