Advanced Sensing and Control for Vehicles, and Autonomous Cybernetics

The capacity to sense moving through space. Augmented reality to create super-human vision and hearing systems.

 
Extreme images, video, and audio
for welding, satellite images, geology/mining, and audio, sensed using a dynamic-dynamic-range system.

Research paper on the new concept of D2R sensing.

World's first paper on HDR Audio.

Artificial Intelligence system for aircraft, marine, and autonomous vehicles travelling at high-speed, to intelligently sense vehicle dynamics and aerodynamics.

This system is designed for intelligent control of vehicles, and intelligent maintenance and repair scheduling.


 


This project was developed with participation of the University of Toronto, Stanford University, MIT, MannLab, TransPod, and Meta Augmented Reality.

Contact:

Ryan Janzen
Email: ryan [dot] janzen [at] utoronto.ca
Website: ryanjanzen.ca

Veillance Flux: Enhanced Sensing for machines and humans

How does the ability to see move through space?

This new research discovered the "veillance field" which is emitted by eyes, cameras, and other sensors, and travels through space in the opposite direction to normal light.

This discovery led to the new field of extramissive optics, which complements the traditional field of energetic optics. They are not simply converse equivalents, or time-reversed duals of each other. All light energy may be reflected, but not all unique veillance flux may be reflected!

Read more to understand:
Look at the first paper introducing Veillametrics (PDF)

Latest research: Human-Eye Veillametrics (PDF)



Seeing camera veillance: (veillance flux coming 'out' of a camera) . .

Paper that first introduced measuring veillance flux and vixels:

Ryan Janzen and Steve Mann (2014), "An Information-Bearing Extramissive Formulation of Sensing, to Measure Surveillance and Sousveillance" Proc. IEEE CCECE 2014. [ PDF ]







-->

Extramission theory: Dormant for 900 years.
Image at left (illustration by Ibn al-Haytham, 11th century), shows the extramissive theory of light, as advocated by Plato and Ptolemy, which theorized that light consisted of rays emitted by the eyes. We now know this theory to be incorrect, on its own. However, in this new work, we now propose an optical theory of the sensitivity to light that propagates out of the eyes, and out from a camera. We have made a new extramissive theory of sensitivity-to-light, by mathematically accounting for the creation, degeneration and absorption of the ability-to-see as it propagates through space.





Demo #2, with more explanation of measuring/marking veillance field:





Difference between Veillametrics and Abakography:

Abakography is taking a long-exposure photograph of lights moved around in space, to make artistic patterns. Abakography was used by Steve Mann to make computerized sequences of flashing light patterns to make artwork.
Veillametrics is measuring what a camera/eye sees. (www.veillametrics.com) Ryan Janzen introduced veillametrics in the first paper [1], and later we've brought it into augmented-reality in [3] and eye-tests in [2].
When you combine it with abakography, you get veillametric-abakography, which is another way to visualize veillametrics. A veillametric bugsweeper can be moved around and photographed.









The veillance field "emitted" by cameras was first proposed and measured here:

Ryan Janzen and Steve Mann (2014), "An Information-Bearing Extramissive Formulation of Sensing, to Measure Surveillance and Sousveillance" Proc. IEEE CCECE 2014, pp.1-10. DOI: 10.1109/CCECE.2014.6901060
[ PDF with optimized formatting ] [ PDF as published ]
The discovery of the veillance field and veillance flux was applied to human-eye "bio-veillametrics" (as measured by a computer system), in the following paper. This very short paper includes some nicer diagrams of the properties of veillance flux:
Ryan Janzen and Steve Mann (2015). "Sensory Flux from the Eye: Biological Sensing-of-Sensing (Veillametrics) for 3D Augmented-Reality Environments", Proc. IEEE GEM 2015, pp. 205-213. DOI: 10.1109/GEM.2015.7377217
[PDF] [more info]
Dosimeter to detect your "dose" of veillance flux radiation --- i.e. how much you have been photographed or otherwise sensed.
Ryan Janzen and Steve Mann (2014). "Veillance Dosimeter, inspired by body-worn radiation dosimeters, to measure exposure to inverse light", Proc. IEEE GEM 2014, pp.267-9. DOI: 10.1109/GEM.2014.7048117
[PDF as published] [Hi-Res. PDF]
Veillametrics was displayed in Augmediated Reality (AR) glasses:
R. Janzen, S.N. Yasrebi, A.J. Bose, A. Subramanian, S. Mann (2014). "Walking through Sight: Seeing the Ability to See, in a 3-D Augmediated Reality Environment", Proc. IEEE GEM 2014, pp.313-4. DOI: 10.1109/GEM.2014.7048124
[PDF as published] [Hi-Res. PDF]
Sociological analysis of veillance (surveillance+sousveillance):
Steve Mann, Ryan Janzen, Mir Adnan Ali, and Ken Nickerson (2015). "Declaration of Veillance (Surveillance is Half-Truth)", Proc. IEEE GEM 2015 (to appear).
[PDF preprint]

Slides from presentation

Example lab exercise on Veillametrics

veillametrics.com veillometrics.com
Extramissive optics; "Veillance Field" or "Sightfield"; "Veillance Flux"