AI and machine learning · Free online course

Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG

Run AI on your own hardware so confidential drawings, specifications and plant data never leave the building: open-weight models and their licences, GPU and RAM sizing, quantisation, Ollama, Open WebUI for a team, the API and Python, offline RAG with citations, datasheet extraction, vision models, benchmarking, air-gapped deployment and an acceptable use policy.

  • 13 modules
  • 10h 40m of video
  • Intermediate
  • English
  • ₹0, free
  • Lab practice in your browser
Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG course cover

₹0Free for good

Worth ₹6,999 by length and depth against classroom training. It has always been free; that is not a former price.

No card. Checkout takes a minute and gives you a receipt.

Certificate ₹599, optional. The course is free either way.

Overview

About Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG

Run AI on your own hardware so confidential plant data never leaves the building, with Ollama, Open WebUI and offline RAG.

Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG is a free, self-paced online course from EDWartens for engineers at plants, EPC contractors, consultancies, defence and oil and gas operators in India, the Gulf and worldwide who need AI on confidential documents, and the IT and OT staff who run the server. It has 13 modules and 10h 40m of video lessons, with written notes, a practice task per module, a practical project and a final assessment of 15 questions (pass mark 60%). Learning costs nothing and needs only a free account. The optional EDWartens Certificate of Completion, verifiable by code, is a one-off ₹599 inclusive of GST for learners in India; it is not a vendor credential. Updated 1 November 2026.

Who it is for: Engineers at plants, EPC contractors, consultancies, defence and oil and gas operators in India, the Gulf and worldwide who need AI on confidential documents, and the IT and OT staff who run the server

This course includes

  • 10h 40m of video lessons
  • 13 modules with written notes and diagrams
  • One final assessment: 15 questions, pass mark 60%
  • Ask-an-engineer support from practising engineers
  • Lifetime access, the course does not expire
  • Optional verifiable certificate when you finish
  1. Step 1 of 3

    Learn the 13 modules

    10h 40m of video lessons, written notes and a practice task per module, at your own pace.

  2. Step 2 of 3

    Pass the final assessment

    15 questions drawn from every module, pass mark 60%, 3 attempts.

  3. Step 3 of 3

    Take the certificate, if you want it

    Optional, paid once, only if you choose it. The course stays free either way.

    See the certificate and its price

A look inside

Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG: Syllabus at a glance
Syllabus at a glance
Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG: What you will be able to do
What you will be able to do
Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG: Tools and credits
Tools and credits

From the lessons

  • 1. The Ollama Course: Intro to Ollama

    Why run AI locally: confidentiality, export control, cost and offline sites

    by Matt Williams

  • Optimize Your AI - Quantization Explained

    Hardware sizing: VRAM, RAM, CPU-only and quantisation (GGUF, Q4, Q8)

    by Matt Williams

  • Self-Host a local AI platform! Ollama + Open WebUI

    Open WebUI: a private ChatGPT for the team

    by Christian Lempa

  • 6. An Introduction to RAG - Part of the Free Ollama Course

    Offline RAG over drawings, specifications and manuals

    by Matt Williams

  • Llama 3.2 Vision + Ollama: Chat with Images LOCALLY

    Vision models locally: reading nameplates and P&ID snippets

    by Leon van Zyl

  • Master Ollama's File Layout in Minutes!

    Air-gapped deployment, updates and access control

    by Matt Williams

Lesson frames belong to the creators named in the Credits and are shown from YouTube.

What you learn

What you will be able to do

By the end you will be able to:

  • Explain when a model must run locally
  • Size VRAM, RAM and speed for a model
  • Install Ollama and write Modelfiles
  • Run Open WebUI for a team with roles and groups
  • Build an offline RAG pipeline that cites and refuses

How it works

How this course works

  1. Watch the lessons

    Short video lessons, one module at a time, at your own pace.

  2. Read the notes

    Open the Reading tab for the written notes and diagrams of the module.

  3. Practise in the 3D labOptional

    Try the module in the free 3D lab, in your browser.

  4. Check yourself

    Answer the questions to see what stuck before you move on.

  5. Final assessment

    Pass the final once you have been through the modules.

  6. Certificate, if you want oneOptional

    Optional, with a page anyone can use to verify it.

Syllabus

Course content, module by module

In order, at whatever pace suits you. Each module ends with a practice task that builds on the last.

Modules
13
Video lessons
40
Of video
10h 40m
Final questions
15
  1. 01

    Why run AI locally: confidentiality, export control, cost and offline sites, with lab practice:

    4 lessons · 33m
  2. 02

    Open-weight models and their licences: Llama, Qwen, Gemma, Mistral and gpt-oss

    4 lessons · 31m
  3. 03

    Hardware sizing: VRAM, RAM, CPU-only and quantisation (GGUF, Q4, Q8)

    4 lessons · 57m
  4. 04

    Installing Ollama: the CLI, environment variables and the Modelfile

    5 lessons · 51m
  5. 05

    Open WebUI: a private ChatGPT for the team

    2 lessons · 1h 6m
  6. 06

    The Ollama REST API and Python

    3 lessons · 3h 17m
  7. 07

    Offline RAG over drawings, specifications and manuals, with lab practice:

    4 lessons · 54m
  8. 08

    Structured output: extracting data from datasheets, with lab practice:

    2 lessons · 22m
  9. Final assessment · 15 questions, pass mark 60%

3D lab

Practise in the 3D lab

Practise what makes a private AI server useful: answers that cite their source, exact structured output, and personal data removed before anything is shared.

Train and testWatch

Optional. Skip it whenever you like: it never blocks your progress or your certificate.

Project

The course project

Optional practice that ends in the kind of job the course prepares you for, with the documents that go with it.

About 14 hours

A private team AI server that answers from project specifications with citations, sized, tested and governed

Stand up Ollama and Open WebUI as a team server. Index a project's specification PDFs, make a preset that cites the clause and says NOT FOUND, size the hardware and test it on twenty questions. Then write the acceptable use policy and risk register that let engineers use it on confidential documents.

This project at a glance
  1. 5documents in the pack
  2. 6steps to follow
  3. Laboptional: in the 3D lab
  4. 5things to hand in
  5. 14 hof work, at your pace

Do it in the lab: 4 steps.

Sample document pack, 5 documents, filled in for the scenario

  • URSRequirements for the private specification assistant
  • SDSDesign and sizing note for the team AI server
  • ProcedureAcceptable use policy for AI tools
  • Test reportAcceptance test of the specification assistant on project 2607
  • Risk registerRisk register for the office AI server

Read inside the course and download as a workbook. The project is optional practice, marked when you submit it; the certificate needs only the modules and the final assessment.

Tools

Software, hardware and lessons

Software

Ollama, Open WebUI (in Docker), Python with the ollama, chromadb and pydantic packages, and optionally LM Studio and promptfoo. All are free to download.

Hardware

A laptop with 16 GB of RAM runs the small models used in the modules. A GPU with 8 GB or more of memory, or an Apple silicon Mac with 16 GB or more, makes them faster. The sizing module shows how to size a team server; you do not need to buy one.

Who it is for

Intermediate. For engineers in plants, EPC contractors, consultancies, defence and oil and gas who want AI on data they cannot paste into a hosted chatbot. You should be comfortable with a command line and able to run a short Python script; Generative AI and LLM Foundations is the natural course before this one.

Video lessons by

  • Matt Williams
  • IBM Technology
  • freeCodeCamp.org
  • Christian Lempa
  • NetworkChuck
  • Tech With Tim
  • Syntax
  • Real Python
  • Sam Witteveen
  • pixegami
  • Case Done by AI
  • Professor Patterns
  • Tony Kipkemboi
  • Ian Wootten
  • Leon van Zyl
  • Skill Leap AI
  • Jason Koo
  • BlueSpork
  • AppSecEngineer

Independent creators, credited in full under Credits.

Software you need

What to download, where from, what it costs and how to install it. Every link goes to the maker's own site, never a mirror.

Open WebUI runs in Docker from ghcr.io/open-webui/open-webui, so it needs no separate download. On a Linux server use Docker Engine rather than Docker Desktop. LM Studio and promptfoo are optional.

Required

  1. 01

    Ollama

    Ollama Inc.

    Free
    Runs on
    macOS 14 Sonoma or later, Windows 10 or later, Linux
    Account
    None needed

    Ollama is free and open source (MIT licence). Each model you download has its own licence; check it before commercial use.

  2. 02

    Python

    Python Software Foundation

    Free
    Runs on
    Windows (not Windows 7 or earlier), macOS and Linux. Windows builds for x64, 32-bit and Arm64.
    Account
    None needed

    Python is free, open source software. You can use it for learning and for commercial work at no cost.

    Alternatives

  3. 03

    Docker Desktop

    Docker, Inc.

    Free for personal use, education and small businesses
    Runs on
    Windows 10 64-bit version 22H2 (build 19045) or Windows 11 64-bit version 23H2 (build 22631) or later, with WSL 2 and hardware virtualisation on, 8 GB RAM. Also macOS and Linux.
    Account
    None needed

    Free for personal use, education, non-commercial open source projects, and businesses with fewer than 250 employees and less than 10 million US dollars in annual revenue. Larger businesses need a paid subscription. Docker Engine on Linux is open source and is not covered by these terms.

    Alternatives

    • Docker Engine (Linux): Free, open source engine for Linux. Not covered by the Docker Desktop subscription terms.

Optional

Useful, not needed to finish the course.

  1. 04

    Visual Studio Code

    Microsoft

    Free
    Runs on
    Windows 64-bit (supported Windows client versions), macOS (latest and two previous releases), Linux (Ubuntu 20.04, Debian 10, RHEL 8, Fedora 36 or later)
    Account
    None needed
    Size
    Less than 200 MB download, under 500 MB installed

    Free to download and use. Extensions from the Marketplace each have their own licence.

    Official download pagecode.visualstudio.com

Checked against each maker's own page on 27 September 2026. Trial lengths and editions change; the maker's page is the final word.

What you walk away with

Your certificate for Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG

Finish the course, pass the final, and this is the document with your name on it.

Sample Wartens Certificate of Completion for Private AI with Local LLMs: Ollama, Open WebUI and Offline RAG, issued through the EDWartens training portal
Sample. The issued certificate carries your name, your final score, a unique certificate ID and its own QR code.
  • Verifiable by anyone

  • Adds to LinkedIn in one click

  • QR code on the certificate

  • Names what you can do

  • A permanent link

  • Earned, not attended

Learning is free. The certificate is optional.

Add it now and pay only when you have finished the course, or come back for it later. One-off, US$28.99, with a receipt.

Issued by Wartens Ltd (England and Wales, company no. 15262249) through the EDWartens training portal, as a Certificate of Completion for this self-paced course. Sold in India by Wartens Automation Private Limited. It is not a vendor certification, a university award or a CPD-accredited activity, and it does not certify competence on live equipment. Delivered electronically; see the refund policy.

Practise what you learn in the free 3D lab

Technical work is judged on what you can do: wiring, commissioning, finding a fault. Doing a task yourself teaches more than watching it a second time, and a lab lets you try it safely before you meet real equipment. It does not replace working on real hardware.

  • Practise safely, so a mistake costs nothing.
  • The lab checks your work like a site test, so you know when it is right.
  • Free, in your browser, with nothing to install.

Why learn with EDWartens

What you get with this course.

  • Free from the first lesson to the final assessment.
  • Practice in a free 3D lab in your browser, with nothing to install.
  • Video lessons with written notes and a project.
  • An optional certificate that anyone can verify online.

FAQ

Common questions

Who is this private AI and local LLM course for?

It is for engineers who want to use AI on documents they cannot paste into a hosted chatbot. That includes process, instrument, electrical and project engineers at EPC contractors, consultancies, plants, defence and public-sector projects, and oil and gas operators worldwide. IT and OT staff who will run the server for them will find it useful too.

Is the course free to learn?

Yes. Every module, the notes, the worked problems, the project and the final assessment are free, and every piece of software used is free to download. The certificate is optional.

What do I need to know first?

You should be comfortable with a command line and able to run a short Python script. If tokens, context windows and RAG are new to you, take Generative AI and LLM Foundations first. After this course, RAG and Chatbots with LangChain goes deeper into retrieval.

What hardware do I need to run local LLMs?

A laptop with 16 GB of RAM is enough for the small models used in the modules. A GPU with 8 GB or more of memory makes them several times faster. So does an Apple silicon Mac with 16 GB or more. Module 3 teaches you to size a team server from the model, context length and number of users. Then you can write the purchase request yourself.

Which software does it use?

Ollama to run the models, Open WebUI in Docker as the team chat interface, and Python with the ollama, chromadb and pydantic packages for the API, offline RAG and extraction modules. LM Studio and promptfoo appear as optional tools. Versions move every few weeks, so the notes say what was current in October 2026 and tell you to check.

Is a local model safe to use on confidential and export-controlled data?

A local model keeps the data on hardware you control, which is what most confidentiality clauses require. It does not make the answers correct. The course teaches the data classes, the locked-down server, the logging and the acceptable use policy. Export-controlled data still needs your security officer's approval for any tool. No AI output reaches a live plant without review and test.

How long does the Private AI with Local LLMs course take?

About 18 hours of video, notes and practice at your own pace, of which about 11 hours is video. The optional team server project takes about 14 hours more.

What certificate does the Private AI with Local LLMs course give?

An EDWartens certificate of completion. It is issued when you finish the modules and pass the 15-question final at 60 percent. It has a number anyone can verify on our site. It is not a credential from Ollama, Open WebUI or any model maker. None of them is affiliated with EDWartens.

Do I have to use the lab?

No. The lab is optional practice. You can skip it whenever you like, and it never blocks your progress, the final assessment or your certificate.

Is the lab free?

Yes. Every lab level for this course opens in your browser, free, with nothing to install.

Is the Private AI with Local LLMs course free in India, and what does the certificate cost?

Yes. Learning costs ₹0 in India: every module, the written notes, the practice tasks and the final assessment, with no card and no trial period. The only paid item is the optional EDWartens Certificate of Completion, ₹599 including GST for this intermediate course, paid in rupees through Razorpay, and only if you want it after passing the final assessment.

What topics does the Private AI with Local LLMs course cover, module by module?

The Private AI with Local LLMs course has 13 modules. It opens with "Why run AI locally: confidentiality, export control, cost and offline sites", goes through "Open-weight models and their licences: Llama, Qwen, Gemma, Mistral and gpt-oss", "Open WebUI: a private ChatGPT for the team", "Vision models locally: reading nameplates and P&ID snippets" and "Governance: what may go in, logging and acceptable use" and ends with "Final assessment". The full list with minutes is under "What you learn" on this page.

What can I do after the Private AI with Local LLMs course?

After the Private AI with Local LLMs course: Decide which documents may go to a hosted AI tool, which must stay on a local model and which go nowhere; Compare open-weight models and their licences: Apache 2.0, MIT and the Llama community licence; Size GPU memory and speed for a model from its parameters, quantisation, context length and users. These are the practical outcomes the course is written around, and the final assessment of 15 questions checks them.

What software and hardware do I need for the Private AI with Local LLMs course, and does it cost anything?

For the Private AI with Local LLMs course, software: Ollama, Open WebUI (in Docker), Python with the ollama, chromadb and pydantic packages, and optionally LM Studio and promptfoo. All are free to download. Hardware: A laptop with 16 GB of RAM runs the small models used in the modules. A GPU with 8 GB or more of memory, or an Apple silicon Mac with 16 GB or more, makes them faster. The sizing module shows how to size a team server; you do not need to buy one. The course itself is free.

Is the Private AI with Local LLMs course suitable for me, and what level is it?

Private AI with Local LLMs is rated intermediate. Intermediate. For engineers in plants, EPC contractors, consultancies, defence and oil and gas who want AI on data they cannot paste into a hosted chatbot. You should be comfortable with a command line and able to run a short Python script; Generative AI and LLM Foundations is the natural course before this one. It is written for engineers at plants, EPC contractors, consultancies, defence and oil and gas operators in India, the Gulf and worldwide who need AI on confidential documents, and the IT and OT staff who run the server, and has 10h 40m of video lessons at your own pace.

Which jobs use the skills from the Private AI with Local LLMs course?

Skills from the Private AI with Local LLMs course (for example: decide which documents may go to a hosted AI tool, which must stay on a local model and which go nowhere) are used in AI engineer work. The course gives you practical evidence of the skill; it does not promise a job, and employers decide on experience and interview.

All course facts
Price
₹0, free for good. No trial, no card. Comparable classroom training of this length costs about ₹6,999.
Who it is for
Engineers at plants, EPC contractors, consultancies, defence and oil and gas operators in India, the Gulf and worldwide who need AI on confidential documents, and the IT and OT staff who run the server
Format
13 self-paced modules, 10h 40m of video, written notes, a practice task per module and one final assessment.
Level
Intermediate. Intermediate. For engineers in plants, EPC contractors, consultancies, defence and oil and gas who want AI on data they cannot paste into a hosted chatbot. You should be comfortable with a command line and able to run a short Python script; Generative AI and LLM Foundations is the natural course before this one.
Brand
Vendor-neutral
Software
Ollama, Open WebUI (in Docker), Python with the ollama, chromadb and pydantic packages, and optionally LM Studio and promptfoo. All are free to download.
Hardware
A laptop with 16 GB of RAM runs the small models used in the modules. A GPU with 8 GB or more of memory, or an Apple silicon Mac with 16 GB or more, makes them faster. The sizing module shows how to size a team server; you do not need to buy one.
Certificate
Optional EDWartens Certificate of Completion, ₹599 inclusive of GST for learners in India, verifiable by code. Not a vendor credential.
Video lessons by
Matt Williams, IBM Technology, freeCodeCamp.org, Christian Lempa, NetworkChuck, Tech With Tim, Syntax, Real Python, Sam Witteveen, pixegami, Case Done by AI, Professor Patterns, Tony Kipkemboi, Ian Wootten, Leon van Zyl, Skill Leap AI, Jason Koo, BlueSpork, AppSecEngineer (independent creators, credited below)
Language
English
Last updated
1 November 2026

More free courses: Free AI courses for engineers · Free generative AI and ChatGPT courses

Classroom course, Bangalore

PLC training in Bangalore

The Automation Engineer Program (AEP) is our classroom course in PLC programming and industrial automation, taught in person at our Electronic City centre.

Credits

Who made the video lessons

The video lessons in this course were created by the people below, not by EDWartens. Every lesson streams from its creator's own YouTube channel; EDWartens neither hosts nor sells that footage, and the creators are not affiliated with EDWartens and do not endorse this course. What EDWartens wrote is the study plan, the notes, the practice tasks and the assessments.

  • Matt Williamsthe free Ollama Course lessons on installing Ollama, the CLI, environment variables, custom models, model types, quantisation, the file layout, the OpenAI-compatible API, RAG and embeddings
  • IBM Technologythe explainers on Ollama, open-source LLMs, privacy-preserving AI at home, open against closed AI, Llama, llama.cpp, LLM benchmarks, LLM as a judge, AI governance and AI data exposure, and the local deployment recap in the final module
  • freeCodeCamp.orgthe three-hour Ollama course by Paulo Dichone, building local AI apps with the API and Python
  • Christian Lempathe self-hosted Ollama and Open WebUI platform build
  • NetworkChuckhosting the full local AI stack on a Linux GPU server with per-user restrictions
  • Tech With Timthe LM Studio tutorial
  • Syntaxthe episode on local AI hardware, setup and models
  • Real Pythonrunning models locally with Ollama and Python
  • Sam Witteveenbuilding a vision app with Ollama structured outputs
  • pixegamithe Python RAG tutorial with local LLMs over PDFs
  • Case Done by AIthe complete guide to Open WebUI admin settings
  • Professor PatternsOpen WebUI knowledge bases, RAG and embeddings
  • Tony Kipkemboistructured outputs with Ollama and Pydantic models
  • Ian WoottenOllama structured outputs in five minutes
  • Leon van ZylLlama 3.2 Vision with Ollama, chatting with images locally
  • Skill Leap AIrunning OpenAI's open-weight gpt-oss models locally
  • Jason Koogetting started with promptfoo for testing models
  • BlueSporkrunning a model fully offline from a USB drive
  • AppSecEngineerthe guide to the OWASP Top 10 for LLM applications

If you are one of these creators and would like a lesson removed or credited differently, write to info@edwartens.co.in.