Bio Model v0 is in development. No results yet, and we'll publish the misses with the hits. Join the waitlist

Vitals Bio

The world model for living things. One model, one API. From any camera: who each animal is, how it's moving, how it's doing, and where it's going next.

Bio Model v0 is in development. No results yet.

A herd of Hereford cattle on green pasture, looking at the cameraIllustrative overlay
Overlay drawn by hand to show the API's output, not produced by a trained model. Photo: Quintin Soloviev, Wikimedia Commons, CC BY 4.0.
IdentityThe same animal, every frame
PoseHead, spine and every leg
MotionSpeed, heading, gait
StateCalm, stressed, in pain, lame, unwell
Next secondsWhere it's likely to be
IntentGrazing, heading to water, about to bolt

One call. Every animal in the frame. Send video from any camera you already have. Get back typed JSON your robot, vehicle or app can act on.

Who

A stable ID per animal, kept across frames and cameras, so "C-0412" today is C-0412 next week.

Pose

Keypoints for head, spine and legs. The thing a milking arm or a herding drone needs to know first.

State

Calm, stressed, in pain, lame or unwell, compared with that animal's own normal and with how sure the model is.

Next

A short forecast: the path over the next few seconds and what the animal looks to be doing.

analyze.pyPythonPlanned API
import vitals

result = vitals.biomodel.analyze("barn-cam-2.mp4")

for animal in result.animals:
    print(animal.id, animal.state.label, animal.next.intent)

C-0412  calm   walking to water
C-0151  alert  standing, facing the gate
C-0518  lame   lying down soon

The planned shape of the API. Bio Model v0 isn't released; the output above is made up to show the format.

Horses grazing on an alpine meadow below the Cadini di Misurina peaksIllustrative overlay

There are world models for objects and for people. Nobody has built one for animals.

Illustrative overlay. Photo: kallerna, Wikimedia Commons, CC BY-SA 4.0

Why us. Big labs train on video of cars, cups and people. We train where the animals are, and our cameras learn what actually happened next.

  • The labels nobody else hasEvery Vitals Cam alert asks the rancher what happened: treated, fine, or not sure. Each answer is an outcome label tied to the video before it.
  • Each animal against its own normalA horse that always lies down a lot is fine. One that never does is not. State is measured against the individual first.
  • Honest numbersTest plans are locked before we score. Every result says whether it came from real data or simulation, and we publish the misses.
  • Video stays closeThe model runs on the device where it can. Only what's needed leaves the farm.

For every machine that works around animals. And for the people who look after them.

A cow standing in an automatic milking robot, its hind legs beside the robot arm

Farm robotics. Milking robots, poultry-house robots and feed pushers that know which animal is in front of them and how it's standing.

Not a Vitals customer. Photo: .Anja., Wikimedia Commons, CC BY-SA 4.0

A flock of sheep seen from straight above, between a dirt track and treesIllustrative overlay

Herding drones. Every animal from above, and where the group is heading.

Photo: Paulo Valdivieso from Lisboa, Portugal, Wikimedia Commons, CC BY-SA 2.0

A mule deer crossing an empty desert roadIllustrative overlay

Vehicles and roads. A deer about to cross is a few seconds of warning a car can use.

Photo: BLMUtah, Wikimedia Commons, Public domain

Young dairy cattle by a wooden barn, some standing and some lying downIllustrative overlay

Livestock health. Vitals Cam is the first app built on the model: a solar camera that tells a rancher which animal to check today.

Vitals Cam   Photo: Thomas Quine, Wikimedia Commons, CC BY 2.0

A black and white dog running across moorland toward the cameraIllustrative overlay

Home and pet robots. A robot vacuum or a pet camera that knows the dog from the cat, and when either is off.

Photo: TimOve, Wikimedia Commons, CC BY 2.0

Vets, zoos, wildlife and behavior labs. Hours of video, scored the same way every time.

Gait scoringPain facesEnclosure activityCamera trapsHerd countsBehavior codingBefore and after treatment

Photos show the kinds of places the model is for. None of the robots, farms or animals pictured is a Vitals customer or partner. Overlays are drawn by hand.

Where we are. We'd rather you hear it from us.

Working today

  • Vitals Cam: a solar camera on a working cattle ranch in Sunol, California since October.
  • The outcome loop: every alert asks what happened next.
  • Locked test plans, scored once, misses published.

Not yet

  • Bio Model v0 is being built and trained now. There are no results to report.
  • The API and SDKs aren't released. The shape on this site is a plan.
  • No robotics, vehicle or lab partner has signed on.

Build on the first model of animals.

Bio Model v0 is in development. Join the developer waitlist for early API access, or pilot it on your own cameras.

One call, typed JSON

Send video, get back each animal's identity, pose, state and next few seconds.

API and SDK
See the first app on it

Vitals Cam tells a rancher which animal to check today.

Vitals Cam

Overlays on photos are drawn by hand to show what the API will return. They aren't output from a trained model, and the IDs and states are made up. Photos are from Wikimedia Commons; see photo credits.

Vitals Bio describes animal behavior and wellbeing. It doesn't diagnose, treat or prevent any condition, and it isn't an emergency service.