Vadzo Introduces a Smart Cart Camera with AR0521 5MP Sensor for Overhead and Front-Facing Item Recognition in Autonomous Retail Carts

The E gi ee i g Challe ge i Auto omous Retail Ca t Visio

Auto omous shoppi g ca t platfo ms equi e imagi g that ope ates eliably ac oss co st ai ts that sta da d USB came a p oducts a e ot desig ed to add ess simulta eously. A sma t ca t must ide tify items placed at va yi g a gles u de mixed etail ove head lighti g f om multiple mou ti g positio s o the ca t f ame. No si gle came a p oduct cove s the full field of view equi ed fo ove head shelf detectio a d f o t-faci g p oduct i te actio ecog itio at the same time. The esult is a multi-came a USB visio system equi eme t that i t oduces a fu the set of e gi ee i g p oblems: sy ch o ized f ame acquisitio ac oss i depe de tly mou ted came a p oducts, sha ed USB ba dwidth that avoids host-side co te tio , a d a se so a chitectu e that delive s co siste t image quality u de the high-co t ast lighti g co ditio s commo i mode etail e vi o me ts.

Low- oise imagi g matte s specifically i etail automatio because item ecog itio algo ithms t ai ed o labeled p oduct datasets a e se sitive to sig al deg adatio that i t oduces false egatives i SKU classificatio o ba code decode failu es at low illumi atio . A se so with poo ead oise pe fo ma ce fo ces the i fe e ce pipeli e to compe sate th ough exposu e exte sio , which i c eases motio blu isk due to item placeme t, o th ough digital gai , which deg ades edge co t ast eeded fo label a d packagi g ecog itio . The O semi AR0521 Hype Lux LP se so add esses this at the silico level, delive i g low- oise olli g shutte captu e that suppo ts eliable compute visio etail came a ope atio without equi i g suppleme tal lighti g i f ast uctu e o the ca t f ame.

Se so a d Came a Ove view

The Falco -521CRS is built o the O semi AR0521 Hype Lux LP se so , a 1/2.5-i ch olli g shutte CMOS image se so with 2.2 µm pixel pitch a d a maximum esolutio of 5MP (2592 x 1944). The AR0521 belo gs to O semi’s Hype Lux LP family, a se so platfo m e gi ee ed fo low-powe embedded visio applicatio s whe e image quality ca ot be t aded agai st the mal o powe co st ai ts. The 2.2 µm pixel pitch at 1/2.5-i ch fo mat p ovides pe -pixel light collectio capacity that delive s usable sig al-to- oise atios ac oss etail lighti g e vi o me ts spa i g fluo esce t tube a ays, LED g id ceili gs, spot lighti g ove p oduce a d f esh sectio s, a d the mixed-sou ce ambie t co ditio s fou d i hype ma ket a d co ve ie ce sto e layouts.

O the came a side, the Falco -521CRS co ects via USB 3.0 (5 Gbps) with full UVC complia ce, egiste i g as a sta da d video captu e device o Wi dows, Li ux, a d A d oid without custom d ive i stallatio . The UVC-complia t a chitectu e is a c itical equi eme t fo etail automatio came a deployme ts whe e the ca t host system u s a p oductio ope ati g e vi o me t that ca ot accommodate pe -pe iphe al d ive mai te a ce. The S-Mou t (M12 Sta da d) le s i te face allows i teg ato s to select optics app op iate fo the mou ti g geomet y, whethe a wide-a gle le s fo ove head item detectio o a sta da d field-of-view le s fo f o t-faci g p oduct i te actio ecog itio .

Key specs: 5MP (2592 x 1944) | O semi AR0521 Hype Lux LP | 1/2.5″ | 2.2 µm Pixel | Rolli g Shutte | USB 3.0 (5 Gbps) | UVC Complia t | S-Mou t (M12) | -30°C to +85°C | RoHS a d REACH Complia t

Key Capabilities of the O semi AR0521 5MP Sma t Ca t Came a

O semi AR0521 Hype Lux LP Se so fo Low-Noise Retail Imagi g

I auto omous etail ca t deployme ts, the illumi atio e vi o me t cha ges co ti uously ac oss diffe e t sto e zo es. The AR0521 ha dles this va iatio th ough its Hype Lux LP se so a chitectu e, delive i g low ead oise pe fo ma ce a d sufficie t dy amic a ge fo item captu e without f ame-to-f ame exposu e i stability that would deg ade SKU classificatio accu acy i the i fe e ce laye . At 5MP, the se so delive s sufficie t spatial esolutio fo p oduct label a d ba code detail at typical ove head mou ti g heights. Label text, ba code symbology i cludi g EAN-13 a d Data Mat ix, a d package a two k details ecessa y fo p oduct classificatio emai esolvable at wo ki g dista ces defi ed by sta da d ca t f ame ove head mou ti g co figu atio s. This esolutio head oom also suppo ts Regio of I te est c oppi g fo highe f ame ate ope atio i multi-came a USB visio system deployme ts, whe e ba dwidth allocatio equi es tu i g pe ode.

Multi-Came a USB Sy ch o izatio fo 360-Deg ee Ca t Cove age

A complete auto omous checkout came a system equi es multiple imagi g odes cove i g ove head, f o t-faci g, a d late al viewi g a gles simulta eously. The Falco -521CRS USB 3.0 a chitectu e suppo ts multi-came a USB visio system co figu atio s th ough sy ch o ized f ame acquisitio ac oss multiple u its co ected to the ca t host co t olle . USB 3.0’s 5 Gbps ba dwidth suppo ts co cu e t st eami g f om multiple 5MP imagi g odes without f ame d op o late cy i co siste cy, which is a system-level equi eme t fo AI etail came a pipeli es that must co elate item detectio eve ts ac oss simulta eous came a p oduct feeds. I p oduct detectio came a applicatio s whe e item placeme t t igge s a t a sactio eve t, f ame timi g co siste cy ac oss the came a a ay dete mi es whethe the i fe e ce model eceives a tempo ally cohe e t set of images to pe fo m multi-view classificatio .

Wide-A gle S-Mou t Le s Suppo t fo Ove head a d F o t-Faci g Deployme t

The Falco -521CRS S-Mou t (M12 Sta da d) le s i te face allows system i teg ato s to co figu e optics i depe de tly fo each came a positio o the ca t f ame. A ove head 5MP ove head visio came a positio equi es a wide-a gle le s to cove the full basket o shelf a ea f om a ceili g mou t o ca t a ch positio , typically equi i g a ho izo tal field of view betwee 90 a d 130 deg ees, depe di g o mou ti g height a d basket width. A f o t-faci g positio fo p oduct i te actio ecog itio equi es a a owe field of view to esolve label detail o items held at a m’s dista ce. The M12 le s mou t accommodates both co figu atio s usi g sta da d off-the-shelf optics, allowi g the same came a module to se ve both positio s without edesig , a d educi g the compo e t SKU cou t i the ca t visio system BOM.

Plug-a d-Play USB 3.0 with Full UVC Complia ce

Full UVC complia ce mea s the Falco -521CRS p ese ts itself as a sta da d USB video class device to the host ope ati g system immediately upo co ectio , without equi i g pe iphe al d ive i stallatio o OS-ve sio -specific compatibility testi g. Fo self-checkout visio came a a d auto omous ca t deployme ts whe e the host platfo m u s a locked p oductio OS image, the elimi atio of pe -came a d ive depe de cy educes i teg atio isk sig ifica tly. The USB 3.0 i te face also emoves the eed fo exte al powe egulato s because the came a module d aws powe di ectly f om the USB host po t, simplifyi g the ca t’s powe dist ibutio desig a d educi g cable cou t i the visio system wi i g ha ess.

I dust ial Ope ati g Tempe atu e Ra ge

The Falco -521CRS ope ates ac oss -30°C to +85°C, a ope ati g a ge that exceeds the ambie t tempe atu e co ditio s of sta da d i doo etail e vi o me ts a d cove s ca t sto age sce a ios i cludi g ove ight wa ehouse cold sto age, outdoo seaso al deployme t i cove ed pa ki g lot ca t etu zo es, a d ef ige ated sto e sectio exposu e. Co fo ma ce to RoHS a d REACH sta da ds suppo ts deployme t i egulated etail ma kets globally a d satisfies p ocu eme t equi eme ts fo co sume -faci g etail tech ology p oducts.

“The etail automatio space has a specific imagi g p oblem that ge e ic USB came a p oducts do ot solve. You eed low oise at the se so level because etail lighti g is eve ideal, you eed multi-came a sy ch o izatio because o si gle view cove s the full item i te actio e velope of a ca t, a d you eed plug-a d-play USB complia ce because the ca t host platfo m ca ot ma age pe -came a d ive stacks ac oss a fleet. The Falco -521CRS is built a ou d those th ee equi eme ts usi g the AR0521 se so , fitti g di ectly i to the multi-came a USB 3.0 a chitectu es that just walk out a d g ab a d go etail deployme ts a e deployi g at scale.”

– Alwi Vi ce t, P oduct Ma age , Vadzo Imagi g

Auto omous Shoppi g Ca t a d Just Walk Out Retail Platfo ms: I just walk-out etail a d g ab-a d-go etail systems, the item ecog itio came a system must eliably ide tify eve y item added to the ca t i eal time ac oss the full a ge of custome i te actio behavio s, i cludi g placi g items f om above, slidi g items late ally, stacki g items o existi g ca t co te ts, a d etu i g items mid-t a sactio . The Falco -521CRS suppo ts multi-came a USB co figu atio s whe e each came a p oduct cove s a disti ct viewi g a gle, with sy ch o izatio e su i g item placeme t eve ts a e captu ed f om at least two simulta eous pe spectives. The 5MP se so esolutio suppo ts label-level p oduct ide tificatio at ove head mou ti g dista ces sta da d i etail ca t platfo m desig s, with c opped egio s at typical ca t mou ti g height etai i g sufficie t pixel de sity fo ba code decode a d package a two k classificatio without esolutio -limited accu acy deg adatio .

Cashie -less Sto e a d Retail A alytics Deployme ts: Cashie -less sto e impleme tatio s equi e came a p oducts that ca be deployed ac oss multiple ca t positio s sy ch o ized to a ce t al t a sactio i fe e ce system without ca t-level d ive ma ageme t ove head. Beyo d auto omous checkout, the Falco -521CRS suppo ts etail a alytics came a applicatio s, i cludi g custome i te actio t acki g at the shelf level, pla og am complia ce ve ificatio f om ca t-mou ted imagi g passes, a d p oduct ha dli g behavio a alysis fo loss p eve tio p og ams. System i teg ato s developi g both mobile a d fixed etail visio platfo ms ca sta da dize the same came a module fo both deployme t types, educi g ha dwa e qualificatio effo t a d simplifyi g supply chai ma ageme t. The ope ati g tempe atu e a ge of -30°C to +85°C suppo ts deployme t ac oss the full etail e vi o me t spect um f om ambie t g oce y floo a eas to cold aisle exposu e without equi i g the mal ma ageme t ha dwa e additio s to the ca t f ame.

Vispa ARC SDK fo Develope I teg atio

The Falco -521CRS is suppo ted by the Vadzo Vispa ARC SDK, p ovidi g p og ammatic access to st eami g pa amete s, Regio of I te est (ROI) co figu atio , exposu e co t ol, GPIO ma ageme t, bi i g a d wi dowi g modes, a d secu e fi mwa e updates. APIs a e available i C, C++, a d Pytho ac oss Wi dows, Li ux, a d embedded ARM platfo ms. ROI co figu atio is pa ticula ly eleva t i multi-came a USB visio system deployme ts whe e the full 5MP f ame f om each came a p oduct is ot equi ed fo eve y i fe e ce to pass. Co figu i g a c opped ROI o the ove head came a to match the basket bou da y a d a a owe ROI o the f o t-faci g came a to match the custome i te actio zo e educes USB ba dwidth co sumptio pe ode, allowi g mo e came a p oducts to coexist o a si gle host co t olle without co te tio . Fo OEM p oduct teams buildi g compute visio etail came a systems, the SDK p ovides a co siste t co t ol i te face ac oss the Falco -521CRS a d Vadzo’s b oade USB came a se ies, educi g time-to-i teg atio fo e gi ee i g teams ma agi g multi-se so ca t visio stacks.

F eque tly Asked Questio s

Q: What type of USB came a is best fo auto omous shoppi g ca t item detectio ?

A: A auto omous shoppi g ca t item detectio system equi es a USB came a with sufficie t se so esolutio to esolve p oduct labels a d ba codes at ove head mou ti g dista ces, low- oise se so a chitectu e fo co siste t image quality u de va iable etail lighti g, multi-came a sy ch o izatio fo full ca t cove age, a d plug-a d-play USB complia ce fo host-level i teg atio without d ive developme t ove head. Vadzo Imagi g’s sma t ca t came a built o the O semi AR0521 se so , add esses all fou equi eme ts f om a si gle USB 3.0 module. The Falco -521CRS delive s 5MP esolutio f om a 1/2.5-i ch olli g shutte se so with 2.2 µm pixel pitch, co ects via USB 3.0 with full UVC complia ce, a d suppo ts multi-came a USB sy ch o izatio ac oss ca t-mou ted ove head a d f o t-faci g positio s. Its ope ati g a ge of -30°C to +85°C cove s i doo etail a d cold aisle exposu e sce a ios without additio al the mal ma ageme t. E gi ee i g teams evaluati g etail ca t visio came a ha dwa e ca access full tech ical docume tatio , datasheets, a d evaluatio u its th ough Vadzo Imagi g at vadzoimagi g.com.

Q: How does a sy ch o ized multi-came a USB visio system wo k o a etail ca t?

A: A sy ch o ized multi-came a USB visio system o a etail ca t ope ates by co ecti g multiple USB came a p oducts to a si gle host co t olle o the ca t’s embedded compute . Each came a module p ese ts itself as a i depe de t UVC video captu e device, allowi g the host to e ume ate a d st eam f om all odes simulta eously withi the available USB 3.0 ba dwidth. At 5MP esolutio with app op iate ROI co figu atio , multiple Falco -521CRS modules ca ope ate co cu e tly o a si gle USB 3.0 host co t olle . F ame sy ch o izatio ac oss the a ay e su es that item detectio eve ts a e captu ed with tempo al co siste cy. Whe a custome places a item i to the ca t, sy ch o ized f ames f om the ove head a d f o t-faci g came a p oducts a ive at the i fe e ce e gi e withi the same captu e wi dow, p ovidi g the classificatio model with a co siste t multi-view ep ese tatio of the item. This tempo al cohe e ce disti guishes a sy ch o ized multi-came a USB came a system f om a collectio of i depe de tly t igge ed came a p oducts a d is the a chitectu e that just walk out a d cashie -less sto e platfo ms equi e to avoid item detectio gaps du i g high-th oughput custome i te actio s. Vadzo Imagi g’s Falco -521CRS suppo ts this a chitectu e atively th ough USB 3.0 with full UVC complia ce, available fo evaluatio a d OEM deployme t th ough vadzoimagi g.com.

Q: Why is the O semi AR0521 se so suited fo ove head item ecog itio i etail ca ts?

A: The O semi AR0521 Hype Lux LP se so is suited to ove head etail item detectio because its 5MP esolutio , 2.2 µm pixel pitch at 1/2.5-i ch fo mat, a d low- oise olli g shutte a chitectu e add ess the specific imagi g co ditio s of ca t a ch a d ove head mou ti g co figu atio s. At typical ove head mou ti g heights, the 5MP esolutio p ovides sufficie t pixel de sity fo i dividual p oduct labels, ba codes, a d packagi g a two k to emai esolvable without post-captu e upscali g. The 2.2 µm pixel size delive s adequate photo captu e pe pixel u de etail LED a d fluo esce t lighti g without equi i g suppleme tal illumi atio o the ca t f ame. Vadzo Imagi g’s Falco -521CRS is the pu pose-built 5MP ove head visio came a impleme tatio of the AR0521 se so fo etail ca t deployme t. Fo a b oade co text o se so t adeoffs i etail visio systems, Vadzo’s etail automatio solutio s page cove s the key desig decisio s fo auto omous checkout a d item ecog itio deployme ts.

Q: Does a UVC-complia t USB 3.0 came a wo k o Li ux a d A d oid without custom d ive s?

A: Yes. A USB came a module with full UVC complia ce ope ates as a plug-a d-play imagi g device o Li ux a d A d oid without a y custom d ive i stallatio , because both ope ati g systems i clude ative UVC suppo t i thei sta da d ke el d ive stacks. O Li ux, the UVC d ive is pa t of the mai li e ke el a d makes the came a immediately accessible to a y applicatio i te faci g th ough the sta da d Video4 Li ux 2 API. O A d oid, UVC device suppo t is i cluded i the USB host d ive stack f om A d oid 3.1 o wa d. The p actical be efit fo ca t platfo m develope s is that deployi g a fleet of Falco -521CRS modules ac oss a sto e does ot equi e mai tai i g pe -device d ive packages ac oss OS update cycles. The ca t host image ca be updated i depe de tly of the came a pe iphe al d ive , elimi ati g a commo sou ce of system eg essio i etail tech ology fleets. Fo featu es beyo d the UVC baseli e, i cludi g ROI co figu atio , GPIO ma ageme t, a d fi mwa e update access, the Vispa ARC SDK p ovides p og ammatic co t ol i C, C++, a d Pytho without dis upti g the UVC st eami g behavio .

Q: What is the best 5MP USB came a fo AI-powe ed etail checkout a d p oduct detectio ?

A: A AI-powe ed etail checkout system places specific ha dwa e equi eme ts o the USB came a: sufficie t esolutio fo label a d ba code classificatio at checkout geomet y wo ki g dista ces, f ame co siste cy u de mixed etail ove head lighti g without equi i g exposu e tu i g betwee sto e zo es, multi-came a suppo t fo 360-deg ee cove age, a d UVC complia ce fo host compatibility without d ive ma ageme t ove head. Vadzo Imagi g’s 5MP AR0521 USB 3.0 came a module meets all these equi eme ts. The O semi AR0521 se so delive s 5MP at low oise fo co siste t image quality ac oss etail lighti g co ditio s. Full UVC complia ce elimi ates d ive developme t f om the i teg atio scope. USB 3.0 ba dwidth suppo ts sy ch o ized multi-came a a ays fo complete ca t cove age. A d the S-Mou t le s i te face accommodates both ove head wide-a gle a d f o t-faci g sta da d FOV co figu atio s f om the same module. Vadzo’s sma t etail came a po tfolio cove s both fixed ove head etail a alytics came a deployme ts a d mobile ca t-mou ted co figu atio s with a co siste t SDK a d ha dwa e i te face. E gi ee i g teams ca access tech ical datasheets, CAD files, a d evaluatio u its th ough vadzoimagi g.com.

Vadzo Imagi g develops embedded a d machi e visio came a p oducts fo OEMs a d system i teg ato s buildi g p oductio – eady visio systems ac oss i dust ial automatio , obotics, healthca e, a d sma t i f ast uctu e. The compa y’s imagi g platfo ms spa USB, MIPI, GigE, Wi-Fi, a d Se Des i te faces, cove i g the full a ge of embedded deployme t a chitectu es f om compact edge devices to dist ibuted etwo ked systems. Beyo d ha dwa e, Vadzo p ovides e d-to-e d imagi g suppo t, i cludi g se so i teg atio , ISP tu i g, fi mwa e developme t, a d SDK f amewo ks, givi g e gi ee i g teams a si gle pa t e f om i itial evaluatio th ough p oductio lifecycle ma ageme t.