keymodels
Menu
OperationsFramework / modelModelAccessible

Image analytics

How can image analytics improve people, teams, or organisational effectiveness?

AccessibleOperationalTeam2 min read
Contents

Image analytics is the process of extracting information, meaning and insights from images such as photographs, medical images or graphics.

Image analytics extracts information, patterns and predictions from photographs, video frames, scans, medical images and graphics. It combines computer vision, pattern recognition, geometry, signal processing and machine learning with contextual data about how an image was created.

When to use it

Use image analytics when a decision depends on visual evidence that would be slow, inconsistent or impossible to review manually at the required scale. Applications include quality inspection, medical decision support, asset monitoring, brand detection, accessibility, security and customer research.

Face recognition can verify whether a person matches an enrolled identity or search for a person across a collection. These are materially different tasks with different error and privacy risks. Performance varies across environments and demographic groups, so a headline claim of near-human accuracy does not establish suitability for a real deployment.

The method can help answer questions such as:

  • Which images contain our brand or product?
  • Who appears to use the product, within the limits of lawful and ethically collected evidence?
  • Can visual inspection improve safety, access control or defect detection?

Origins

Modern image analytics developed from digital image processing, computer vision and statistical pattern recognition. Early work taught computers to represent edges, shapes and textures; later machine-learning systems learned features from labelled examples. Deep neural networks accelerated progress in the early twenty-first century as computing power and large image datasets became available. No single inventor accounts for the field.

What it is

Older image search relied heavily on filenames, captions and metadata. A search for “pink elephant” might therefore retrieve an image carrying those words even when its pixels showed something else. Contemporary systems can analyse visual content directly and combine it with metadata such as capture time, device settings or GPS location.

Tasks include classification, object detection, segmentation, optical character recognition, anomaly detection and biometric matching. A model may represent geometry, convert pixels into statistical features or learn a numerical representation from examples. Medical-image systems can highlight suspicious patterns for qualified review; industrial systems can find repeated defects; brand systems can estimate visual exposure. Outputs remain probabilistic and require validation against the intended population and conditions.

How to use it

Begin with the decision, not the available image collection. Define the question, acceptable error, affected people and action that will follow a result. Confirm that image analytics is necessary and proportionate, and establish a lawful basis, retention limits, access controls and a process for challenge or human review where consequences are significant.

Create a representative, documented dataset. Check image quality, labels, provenance, consent or other authority, and whether historic data embed bias. Separate training, validation and operational testing. Measure false positives and false negatives by relevant subgroup and environment, monitor drift and prevent the model from inferring sensitive attributes that the purpose does not require.

Practical example

Casinos and retailers have used image systems to identify selected visitors, detect suspected exclusion breaches or classify activity. Such uses may create value, but they also illustrate why governance matters. In 2011 Carnegie Mellon researchers showed that face recognition combined with public online data could identify some students and connect identities to sensitive information. The result demonstrated that publicly accessible images are not ethically consequence-free raw material.

A deployer should therefore conduct privacy, security and discrimination assessments, give clear notice where required, restrict secondary use and provide human escalation. Images collected for access control should not quietly become a marketing profile. Medical outputs should support qualified clinicians rather than make unsupported autonomous diagnoses.

Top practical tip

Tie the model to one strategic question and one governed decision. Validate performance in the actual environment before scaling, then monitor errors and drift continuously.

Top pitfall

Availability is not permission. Images can expose identity, location, health and relationships; collect and analyse only what is necessary, lawful, secure and defensible to the people affected.

Further reading

For more on image analytics see for example:

  • Baughman, A., Gao, J. and Pan, J.-Y. (eds) (2015) Multimedia Data Mining and Analytics: Disruptive Innovation, New York: Springer
  • http://www.analytics-magazine.org/ november-december-2011/694-images-a-videos-really-big-data
  • http://www.springer.com/computer/image+processing/journal/11493
  • http://www.theguardian.com/technology/2014/may/04/ facial-recognition-technology-identity-tesco-ethical-issues