Skip to main content

Technology

Edge Computing

Low-power processors optimized for AI inference and computing at the edge, in IoT and mobile devices.

107 companies

Explainer

Edge Computing explained

Edge computing means processing data close to where it is produced, on a device or a nearby server, instead of sending everything to a distant cloud data center. In chip terms, edge processors are small, low-power chips that run software and AI models inside phones, cameras, cars and sensors.

Edge AI chips often include a neural processing unit (NPU) that handles model inference within a tight power budget, from milliwatts to a few tens of watts. TinyML is the practice of fitting small models onto microcontrollers with only kilobytes or a few megabytes of memory.

How it differs from the usual approach

Cloud chips are judged on peak throughput and are cooled by data center systems. Edge chips are judged on energy, size, cost and response time, and they must work without a steady connection. Models are shrunk through quantization and pruning to fit. Running locally also keeps raw data on the device, which helps privacy and cuts network delays.

Where it is used

  • Phones, for photo processing, voice recognition and on-device assistants.
  • Cameras and doorbells that detect people or vehicles.
  • Driver assistance and automated driving systems.
  • Factory machines that spot defects or predict failures.
  • Wearables and hearing aids with always-on sensing.

What to watch

  • Microsoft set a 40 TOPS NPU requirement for its Copilot+ PC branding, announced in May 2024, which pushed laptop chip makers to add larger NPUs.
  • Smaller language models are being designed to run on phones and laptops.
  • Microcontroller vendors are adding NPUs so that small devices can run AI.
  • Memory size and software tools, more than raw speed, often decide what a device can run.

Frequently asked questions

What is edge computing?

It is processing data close to its source, on the device or a nearby machine, instead of in a faraway data center. It reduces delay, network traffic and the amount of raw data sent to the cloud.

What is an edge AI chip?

It is a small, low-power processor, usually with an NPU, that runs AI models on a device. It is designed for tight limits on power, size and cost.

Is edge computing replacing the cloud?

No. Most systems use both. Models are often trained in the cloud and then run at the edge, with the cloud used for updates and heavy jobs.