One video, and what the API returned

A 13-second vertical video, 720 by 1280, analyzed by the API. Below: the result as the API returned it, the same result laid out shot by shot, and the text rendering a model can read. Nothing in it is edited; only the links to the crops are shortened, since real ones are signed and last an hour.

The result

6 shots in 6 scenes, 28 words, 12 elements on the picture, a cast of 1. What every field means.

17-1003576625514683.mp42.7 MB
GET /v1/analyses/an_…/result14.8 KB
{
  "format": "video-analysis",
  "version": "1",
  "generator": "video-analysis-api 1",
  "made_at": "2026-10-04T07:04:31.919Z",
  "video": {"name": "17-1003576625514683.mp4", "bytes": 2812322, "container": "mov,mp4,m4a,3gp,3g2,mj2", "duration": 13.467, "width": 720, "height": 1280, "fps": 30, "codec": "h264", "audio": true},
  "transcript": {
    "language": "en",
    "seconds": 13.608,
    "text": "Dental powder cleans dog teeth fast. This effortless new way to support your dog's dental health that takes just thirty seconds, targets tartar buildup, all without a toothbrush.",
    "words": [
      {"w": "Dental", "s": 0.24, "e": 0.72, "c": 0.983, "spk": 0},
      {"w": "powder", "s": 0.72, "e": 1.12, "c": 0.965, "spk": 0},
      {"w": "cleans", "s": 1.12, "e": 1.52, "c": 0.999, "spk": 0},
      {"w": "dog", "s": 1.52, "e": 1.92, "c": 1, "spk": 0},
      {"w": "teeth", "s": 1.92, "e": 2.4, "c": 0.999, "spk": 0},
      {"w": "fast.", "s": 2.4, "e": 3.23, "c": 0.98, "spk": 0},
      {"w": "This", "s": 3.52, "e": 3.84, "c": 0.998, "spk": 0},
      {"w": "effortless", "s": 3.84, "e": 4.4, "c": 1, "spk": 0},
      {"w": "new", "s": 4.4, "e": 4.64, "c": 0.977, "spk": 0},
      {"w": "way", "s": 4.64, "e": 4.88, "c": 1, "spk": 0},
      {"w": "to", "s": 4.88, "e": 5.12, "c": 1, "spk": 0},
      {"w": "support", "s": 5.12, "e": 5.44, "c": 1, "spk": 0},
      {"w": "your", "s": 5.44, "e": 5.6, "c": 1, "spk": 0},
      {"w": "dog's", "s": 5.6, "e": 6, "c": 0.997, "spk": 0},
      {"w": "dental", "s": 6, "e": 6.32, "c": 0.999, "spk": 0},
      {"w": "health", "s": 6.32, "e": 6.88, "c": 1, "spk": 0},
      {"w": "that", "s": 6.88, "e": 7.12, "c": 0.943, "spk": 0},
      {"w": "takes", "s": 7.12, "e": 7.44, "c": 1, "spk": 0},
      {"w": "just", "s": 7.44, "e": 7.76, "c": 1, "spk": 0},
      {"w": "thirty", "s": 7.76, "e": 8.16, "c": 1, "spk": 0},
      {"w": "seconds,", "s": 8.16, "e": 8.8, "c": 0.71, "spk": 0},
      {"w": "targets", "s": 8.8, "e": 9.12, "c": 0.973, "spk": 0},
      {"w": "tartar", "s": 9.12, "e": 9.6, "c": 0.989, "spk": 0},
      {"w": "buildup,", "s": 9.6, "e": 10.16, "c": 0.761, "spk": 0},
      {"w": "all", "s": 10.16, "e": 10.48, "c": 0.999, "spk": 0},
      {"w": "without", "s": 10.48, "e": 10.72, "c": 1, "spk": 0},
      {"w": "a", "s": 10.72, "e": 10.88, "c": 1, "spk": 0},
      {"w": "toothbrush.", "s": 10.88, "e": 11.28, "c": 0.999, "spk": 0}
    ],
    "utterances": [
      {"s": 0.24, "e": 3.36, "spk": 0, "text": "Dental powder cleans dog teeth fast."},
      {"s": 3.52, "e": 11.28, "spk": 0, "text": "This effortless new way to support your dog's dental health that takes just thirty seconds, targets tartar buildup, all without a toothbrush."}
    ]
  },
  "cuts": [
    {"frame": 105, "t": 3.5, "kind": "cut"},
    {"frame": 202, "t": 6.733, "kind": "cut"},
    {"frame": 260, "t": 8.667, "kind": "cut"},
    {"frame": 302, "t": 10.067, "kind": "cut"},
    {"frame": 341, "t": 11.367, "kind": "cut"}
  ],
  "boundaries": [
    {"frame": 105, "t": 3.5, "kind": "cut", "match": {"inliers": 5, "spread": 0.041, "scale": 0.764, "diff": 63.645}},
    {"frame": 202, "t": 6.733, "kind": "cut", "match": {"inliers": 2, "spread": 0, "scale": 1, "diff": null}},
    {"frame": 260, "t": 8.667, "kind": "cut", "match": {"inliers": 5, "spread": 0, "scale": 1, "diff": null}},
    {"frame": 302, "t": 10.067, "kind": "cut", "match": {"inliers": 4, "spread": 0.067, "scale": 0.517, "diff": 58.413}},
    {"frame": 341, "t": 11.367, "kind": "cut", "match": {"inliers": 5, "spread": 0, "scale": 1, "diff": null}}
  ],
  "shots": [
    {"n": 1, "s": 0, "e": 3.5, "scene": 1, "kind": "start"},
    {"n": 2, "s": 3.5, "e": 6.733, "scene": 2, "kind": "cut"},
    {"n": 3, "s": 6.733, "e": 8.667, "scene": 3, "kind": "cut"},
    {"n": 4, "s": 8.667, "e": 10.067, "scene": 4, "kind": "cut"},
    {"n": 5, "s": 10.067, "e": 11.367, "scene": 5, "kind": "cut"},
    {"n": 6, "s": 11.367, "e": 13.467, "scene": 6, "kind": "cut"}
  ],
  "scenes": [
    {"n": 1, "s": 0, "e": 3.5},
    {"n": 2, "s": 3.5, "e": 6.733},
    {"n": 3, "s": 6.733, "e": 8.667},
    {"n": 4, "s": 8.667, "e": 10.067},
    {"n": 5, "s": 10.067, "e": 11.367},
    {"n": 6, "s": 11.367, "e": 13.467}
  ],
  "elements": [
    {
      "id": 1,
      "kind": "caption",
      "text": "Dental powder cleans\ndog teeth fast 🤯 🦷",
      "description": "White text with a black outline, accompanied by mind-blown and tooth emojis.",
      "s": 0,
      "e": 3.5,
      "sampled": {"s": 0, "e": 3.5},
      "box": {"x": 0.125, "y": 0.247, "w": 0.748, "h": 0.083},
      "frames": 14,
      "refined": {"s": false, "e": true}
    },
    {
      "id": 2,
      "kind": "caption",
      "text": "This effortless new way",
      "description": "White text with a black outline displayed across the lower area of the screen.",
      "s": 3.5,
      "e": 4.75,
      "sampled": {"s": 3.5, "e": 4.75},
      "box": {"x": 0.104, "y": 0.702, "w": 0.791, "h": 0.043},
      "frames": 5,
      "refined": {"s": true, "e": false}
    },
    {
      "id": 3,
      "kind": "caption",
      "text": "to support your dog's",
      "description": "White text with a black outline displayed across the lower area of the screen.",
      "s": 4.75,
      "e": 5.75,
      "sampled": {"s": 4.75, "e": 5.75},
      "box": {"x": 0.138, "y": 0.702, "w": 0.724, "h": 0.046},
      "frames": 4,
      "refined": {"s": false, "e": false}
    },
    {
      "id": 4,
      "kind": "caption",
      "text": "dental health,",
      "description": "White text with a black outline centered in the lower third.",
      "s": 5.75,
      "e": 6.733,
      "sampled": {"s": 5.75, "e": 6.75},
      "box": {"x": 0.273, "y": 0.701, "w": 0.455, "h": 0.046},
      "frames": 4,
      "refined": {"s": false, "e": true}
    },
    {
      "id": 5,
      "kind": "progress bar",
      "text": "28",
      "description": "A semi-transparent dark circular countdown timer graphic with a white progress ring arc and white digital countdown numbers in the center.",
      "s": 6.733,
      "e": 8.667,
      "sampled": {"s": 6.75, "e": 8.75},
      "box": {"x": 0.329, "y": 0.113, "w": 0.356, "h": 0.222},
      "frames": 8,
      "refined": {"s": true, "e": true}
    },
    {
      "id": 6,
      "kind": "caption",
      "text": "that takes",
      "description": "White text with a black outline centered in the lower third.",
      "s": 6.733,
      "e": 7.267,
      "sampled": {"s": 6.75, "e": 7.25},
      "box": {"x": 0.334, "y": 0.704, "w": 0.333, "h": 0.035},
      "frames": 2,
      "refined": {"s": true, "e": true}
    },
    {
      "id": 7,
      "kind": "caption",
      "text": "just 30 seconds",
      "description": "White text with a black outline centered in the lower third.",
      "s": 7.267,
      "e": 8.633,
      "sampled": {"s": 7.25, "e": 8.75},
      "box": {"x": 0.231, "y": 0.701, "w": 0.536, "h": 0.046},
      "frames": 6,
      "refined": {"s": true, "e": true}
    },
    {
      "id": 8,
      "kind": "caption",
      "text": "targets tartar buildup",
      "description": "White text with a black outline centered in the lower third.",
      "s": 8.633,
      "e": 10,
      "sampled": {"s": 8.75, "e": 10},
      "box": {"x": 0.147, "y": 0.702, "w": 0.706, "h": 0.045},
      "frames": 5,
      "refined": {"s": true, "e": false}
    },
    {
      "id": 9,
      "kind": "caption",
      "text": "all without",
      "description": "White text with a black outline centered in the lower third.",
      "s": 10,
      "e": 10.5,
      "sampled": {"s": 10, "e": 10.5},
      "box": {"x": 0.329, "y": 0.704, "w": 0.347, "h": 0.035},
      "frames": 2,
      "refined": {"s": false, "e": true}
    },
    {
      "id": 10,
      "kind": "caption",
      "text": "a toothbrush.",
      "description": "White caption text with a black outline.",
      "s": 10.5,
      "e": 11.25,
      "sampled": {"s": 10.5, "e": 11.25},
      "box": {"x": 0.282, "y": 0.703, "w": 0.441, "h": 0.036},
      "frames": 3,
      "refined": {"s": true, "e": false}
    },
    {
      "id": 11,
      "kind": "title",
      "text": "LEARN MORE\nBELOW",
      "description": "Large bold white block letters with a heavy black outline.",
      "s": 11.25,
      "e": 13.5,
      "sampled": {"s": 11.25, "e": 13.5},
      "box": {"x": 0.162, "y": 0.247, "w": 0.678, "h": 0.12},
      "frames": 9,
      "refined": {"s": false, "e": false}
    },
    {
      "id": 12,
      "kind": "other",
      "text": "PETLAB CO. ADVERTISEMENT. ACTOR PORTRAYAL. CUSTOMERS RECEIVED COMPENSATION FOR SHARING THEIR REAL-LIFE EXPERIENCES. INDIVIDUAL RESULTS MAY VARY.",
      "description": "Fine white legal disclaimer text with a thin black outline running across two lines at the bottom.",
      "s": 11.25,
      "e": 13.5,
      "sampled": {"s": 11.25, "e": 13.5},
      "box": {"x": 0.068, "y": 0.835, "w": 0.876, "h": 0.042},
      "frames": 9,
      "refined": {"s": false, "e": false}
    }
  ],
  "characters": {
    "rule": {"minScenes": 2, "minShare": 0.25, "neverBodyParts": true},
    "cast": [
      {
        "label": "A",
        "name": "Golden retriever",
        "kind": "animal",
        "role": "pet",
        "description": "Golden retriever with light golden coat",
        "portrait": "characters/A/scene-03-2.jpg",
        "scenes": [3, 5, 6],
        "crops": [
          {
            "scene": 3,
            "t": 8.517,
            "file": "characters/A/scene-03-2.jpg",
            "box": {"x": 0.09, "y": 0, "w": 0.91, "h": 0.73},
            "sure": true,
            "url": "https://…signed…/characters/A/scene-03-2.jpg"
          },
          {
            "scene": 5,
            "t": 10.217,
            "file": "characters/A/scene-05-1.jpg",
            "box": {"x": 0, "y": 0.38, "w": 1, "h": 0.62},
            "sure": true,
            "url": "https://…signed…/characters/A/scene-05-1.jpg"
          },
          {
            "scene": 5,
            "t": 11.217,
            "file": "characters/A/scene-05-2.jpg",
            "box": {"x": 0, "y": 0.38, "w": 1, "h": 0.62},
            "sure": true,
            "url": "https://…signed…/characters/A/scene-05-2.jpg"
          },
          {
            "scene": 3,
            "t": 6.883,
            "file": "characters/A/scene-03-1.jpg",
            "box": {"x": 0.2, "y": 0, "w": 0.8, "h": 0.73},
            "sure": true,
            "url": "https://…signed…/characters/A/scene-03-1.jpg"
          },
          {
            "scene": 6,
            "t": 13.317,
            "file": "characters/A/scene-06-2.jpg",
            "box": {"x": 0.4, "y": 0.26, "w": 0.6, "h": 0.54},
            "sure": true,
            "url": "https://…signed…/characters/A/scene-06-2.jpg"
          },
          {
            "scene": 6,
            "t": 11.517,
            "file": "characters/A/scene-06-1.jpg",
            "box": {"x": 0.4, "y": 0.28, "w": 0.6, "h": 0.52},
            "sure": true,
            "url": "https://…signed…/characters/A/scene-06-1.jpg"
          }
        ],
        "portrait_url": "https://…signed…/characters/A/scene-03-2.jpg"
      }
    ],
    "extras": [
      {"label": "B", "name": "Woman hugging dog", "kind": "person", "role": "extra", "scenes": [], "why": "the model called it an extra"}
    ],
    "scenes": [
      {"n": 1, "s": 0, "e": 3.5, "frames": [{"t": 0.15, "present": []}, {"t": 1.75, "present": []}, {"t": 3.35, "present": []}], "cast": [], "extras": 0},
      {
        "n": 2,
        "s": 3.5,
        "e": 6.733,
        "frames": [{"t": 3.65, "present": []}, {"t": 5.117, "present": []}, {"t": 6.583, "present": []}],
        "cast": [],
        "extras": 0
      },
      {
        "n": 3,
        "s": 6.733,
        "e": 8.667,
        "frames": [
          {
            "t": 6.883,
            "present": [
              {
                "label": "A",
                "box": {"x": 0.2, "y": 0, "w": 0.8, "h": 0.73},
                "sure": true,
                "crop": "characters/A/scene-03-1.jpg",
                "url": "https://…signed…/characters/A/scene-03-1.jpg"
              }
            ]
          },
          {
            "t": 8.517,
            "present": [
              {
                "label": "A",
                "box": {"x": 0.09, "y": 0, "w": 0.91, "h": 0.73},
                "sure": true,
                "crop": "characters/A/scene-03-2.jpg",
                "url": "https://…signed…/characters/A/scene-03-2.jpg"
              }
            ]
          }
        ],
        "cast": ["A"],
        "extras": 0
      },
      {"n": 4, "s": 8.667, "e": 10.067, "frames": [{"t": 8.817, "present": []}, {"t": 9.917, "present": []}], "cast": [], "extras": 0},
      {
        "n": 5,
        "s": 10.067,
        "e": 11.367,
        "frames": [
          {
            "t": 10.217,
            "present": [
              {
                "label": "A",
                "box": {"x": 0, "y": 0.38, "w": 1, "h": 0.62},
                "sure": true,
                "crop": "characters/A/scene-05-1.jpg",
                "url": "https://…signed…/characters/A/scene-05-1.jpg"
              }
            ]
          },
          {
            "t": 11.217,
            "present": [
              {
                "label": "A",
                "box": {"x": 0, "y": 0.38, "w": 1, "h": 0.62},
                "sure": true,
                "crop": "characters/A/scene-05-2.jpg",
                "url": "https://…signed…/characters/A/scene-05-2.jpg"
              }
            ]
          }
        ],
        "cast": ["A"],
        "extras": 0
      },
      {
        "n": 6,
        "s": 11.367,
        "e": 13.467,
        "frames": [
          {
            "t": 11.517,
            "present": [
              {
                "label": "A",
                "box": {"x": 0.4, "y": 0.28, "w": 0.6, "h": 0.52},
                "sure": true,
                "crop": "characters/A/scene-06-1.jpg",
                "url": "https://…signed…/characters/A/scene-06-1.jpg"
              }
            ]
          },
          {
            "t": 13.317,
            "present": [
              {
                "label": "A",
                "box": {"x": 0.4, "y": 0.26, "w": 0.6, "h": 0.54},
                "sure": true,
                "crop": "characters/A/scene-06-2.jpg",
                "url": "https://…signed…/characters/A/scene-06-2.jpg"
              }
            ]
          }
        ],
        "cast": ["A"],
        "extras": 0
      }
    ]
  },
  "methods": {"transcript": "deepgram nova-3, speakers and utterances", "cuts": "pyscenedetect adaptive (threshold 3.0, min scene 6 frames) + fades (threshold 12)", "boundaries": "orb+ransac across ±3 frames with element boxes masked; cut < 12 inliers or spread < 0.2; punch when scale off 1 by 0.05; none when aligned diff < 6.0", "elements": "gemini-3.8-flash at 4 fps, 24 frames a call overlapping by 4, folded; each start and end put on the frame by pixel difference inside the box", "characters": "gemini-3.8-flash on 14 scene frames, cropped locally; cast kept when in 2+ scenes or 25%+ of the video, never a body part"}
}
Paste the result into an assistant and ask about the video.

The same result, shot by shot

Built from the JSON above by this page, with no model: each shot with how it begins, who is in its scene, what is said during it and what is on the picture.

ShotBegins withCastSaidOn the picture
1
0.00s to 3.50s
startnobodyDental powder cleans dog teeth fast.
caption Dental powder cleans dog teeth fast 🤯 🦷
2
3.50s to 6.73s
cutnobodyThis effortless new way to support your dog's dental health
caption This effortless new way
caption to support your dog's
caption dental health,
3
6.73s to 8.67s
cutAthat takes just thirty seconds,
progress bar 28
caption that takes
caption just 30 seconds
caption targets tartar buildup
4
8.67s to 10.07s
cutnobodytargets tartar buildup,
caption targets tartar buildup
caption all without
5
10.07s to 11.37s
cutAall without a toothbrush.
caption all without
caption a toothbrush.
title LEARN MORE BELOW
other PETLAB CO. ADVERTISEMENT. ACTOR PORTRAYAL. CUSTOMERS RECEIVED COMPENSATION FOR SHARING THEIR REAL-LIFE EXPERIENCES. INDIVIDUAL RESULTS MAY VARY.
6
11.37s to 13.47s
cutAnothing
title LEARN MORE BELOW
other PETLAB CO. ADVERTISEMENT. ACTOR PORTRAYAL. CUSTOMERS RECEIVED COMPENSATION FOR SHARING THEIR REAL-LIFE EXPERIENCES. INDIVIDUAL RESULTS MAY VARY.

Sentences, as the transcript has them: 0.24s to 3.36s; 3.52s to 11.28s.

The same result as plain text

Ask for format=text and the API returns the same facts as a document to read top to bottom.

# 17-1003576625514683.mp4

720Ă—1280, 30 fps, 13.47s, with sound. 6 scenes, 6 shots, 12 elements on the picture, cast of 1.
Speech: 28 words, en.

## Cast

- A "Golden retriever" (animal, pet): Golden retriever with light golden coat. In scenes 3, 5, 6.

Extras, not in the cast: Woman hugging dog (the model called it an extra).

## Scene 1, 0.00s to 3.50s

Cast: none.
Shots: 1 (start, 0.00s to 3.50s).

Said:
- 0.24s to 3.36s, speaker 0: Dental powder cleans dog teeth fast.

On the picture:
- 0.00s to 3.50s, caption at x 0.125 y 0.247 w 0.748 h 0.083: "Dental powder cleans\ndog teeth fast 🤯 🦷". White text with a black outline, accompanied by mind-blown and tooth emojis.

## Scene 2, 3.50s to 6.73s

Cast: none.
Shots: 2 (cut, 3.50s to 6.73s).

Said:
- 3.52s to 11.28s, speaker 0: This effortless new way to support your dog's dental health that takes just thirty seconds, targets tartar buildup, all without a toothbrush.

On the picture:
- 3.50s to 4.75s, caption at x 0.104 y 0.702 w 0.791 h 0.043: "This effortless new way". White text with a black outline displayed across the lower area of the screen.
- 4.75s to 5.75s, caption at x 0.138 y 0.702 w 0.724 h 0.046: "to support your dog's". White text with a black outline displayed across the lower area of the screen.
- 5.75s to 6.73s, caption at x 0.273 y 0.701 w 0.455 h 0.046: "dental health,". White text with a black outline centered in the lower third.

## Scene 3, 6.73s to 8.67s

Cast: A.
Shots: 3 (cut, 6.73s to 8.67s).

Said:
- 3.52s to 11.28s, speaker 0: This effortless new way to support your dog's dental health that takes just thirty seconds, targets tartar buildup, all without a toothbrush.

On the picture:
- 6.73s to 8.67s, progress bar at x 0.329 y 0.113 w 0.356 h 0.222: "28". A semi-transparent dark circular countdown timer graphic with a white progress ring arc and white digital countdown numbers in the center.
- 6.73s to 7.27s, caption at x 0.334 y 0.704 w 0.333 h 0.035: "that takes". White text with a black outline centered in the lower third.
- 7.27s to 8.63s, caption at x 0.231 y 0.701 w 0.536 h 0.046: "just 30 seconds". White text with a black outline centered in the lower third.
- 8.63s to 10.00s, caption at x 0.147 y 0.702 w 0.706 h 0.045: "targets tartar buildup". White text with a black outline centered in the lower third.

## Scene 4, 8.67s to 10.07s

Cast: none.
Shots: 4 (cut, 8.67s to 10.07s).

Said:
- 3.52s to 11.28s, speaker 0: This effortless new way to support your dog's dental health that takes just thirty seconds, targets tartar buildup, all without a toothbrush.

On the picture:
- 8.63s to 10.00s, caption at x 0.147 y 0.702 w 0.706 h 0.045: "targets tartar buildup". White text with a black outline centered in the lower third.
- 10.00s to 10.50s, caption at x 0.329 y 0.704 w 0.347 h 0.035: "all without". White text with a black outline centered in the lower third.

## Scene 5, 10.07s to 11.37s

Cast: A.
Shots: 5 (cut, 10.07s to 11.37s).

Said:
- 3.52s to 11.28s, speaker 0: This effortless new way to support your dog's dental health that takes just thirty seconds, targets tartar buildup, all without a toothbrush.

On the picture:
- 10.00s to 10.50s, caption at x 0.329 y 0.704 w 0.347 h 0.035: "all without". White text with a black outline centered in the lower third.
- 10.50s to 11.25s, caption at x 0.282 y 0.703 w 0.441 h 0.036: "a toothbrush.". White caption text with a black outline.
- 11.25s to 13.50s, title at x 0.162 y 0.247 w 0.678 h 0.12: "LEARN MORE\nBELOW". Large bold white block letters with a heavy black outline.
- 11.25s to 13.50s, other at x 0.068 y 0.835 w 0.876 h 0.042: "PETLAB CO. ADVERTISEMENT. ACTOR PORTRAYAL. CUSTOMERS RECEIVED COMPENSATION FOR SHARING THEIR REAL-LIFE EXPERIENCES. INDIVIDUAL RESULTS MAY VARY.". Fine white legal disclaimer text with a thin black outline running across two lines at the bottom.

## Scene 6, 11.37s to 13.47s

Cast: A.
Shots: 6 (cut, 11.37s to 13.47s).

On the picture:
- 11.25s to 13.50s, title at x 0.162 y 0.247 w 0.678 h 0.12: "LEARN MORE\nBELOW". Large bold white block letters with a heavy black outline.
- 11.25s to 13.50s, other at x 0.068 y 0.835 w 0.876 h 0.042: "PETLAB CO. ADVERTISEMENT. ACTOR PORTRAYAL. CUSTOMERS RECEIVED COMPENSATION FOR SHARING THEIR REAL-LIFE EXPERIENCES. INDIVIDUAL RESULTS MAY VARY.". Fine white legal disclaimer text with a thin black outline running across two lines at the bottom.