Cloud, Edge and On-Device AI
Where an AI model runs—cloud, edge device or directly on a user’s device—changes latency, privacy, cost, reliability and available computing power.
Learning objectives
What you will be able to do
- Explain cloud, edge and on-device ai accurately in your own words.
- Recognise how the concept appears in real AI products and professional work.
- Identify an important limitation, risk or evaluation requirement.
- Apply the concept through a practical activity and knowledge check.
Core explanation
Build the right mental model
Cloud AI offers scalable computing and centralised updates. It is suitable for large models but requires connectivity and transfers data to remote infrastructure. Edge AI runs near the data source, such as a gateway or factory server. On-device AI runs directly on a phone, laptop, vehicle or sensor.
Local processing can reduce latency and keep sensitive raw data closer to the user, but devices have limits on memory, energy and processing. Model compression, quantisation and specialised hardware help.
Many systems are hybrid: immediate detection happens locally while aggregated analysis and retraining happen in the cloud.
Cloud inference
A remote hosted service runs the model.
Edge inference
Processing occurs near the data source.
On-device AI
The end-user device executes the model locally.
Quantisation
Reducing numerical precision to make a model smaller and faster.
Safety camera
A camera detects a hazard locally and immediately triggers an alert; anonymised events are later analysed in the cloud.
Apply your learning
Practical activity
- Compare cloud, edge and on-device deployment for one AI task.
- Score each for latency, privacy, cost, offline use and update complexity.
- Choose and justify an architecture.
Write your answers in a learning journal. The value comes from connecting the concept to your own profession.
Knowledge check
Test your understanding
Q1Why run AI at the edge?
Answer: To reduce latency, bandwidth use, dependence on connectivity or exposure of raw data.
Q2What is a hybrid architecture?
Answer: A system that divides AI processing between local/edge and cloud components.
If you cannot explain the answer without reading it, revisit the core explanation and example before continuing.
Continue with authoritative sources
Important industry resources
These links lead to official organisations, industry laboratories or established open-source learning projects.