Smartbit project · Product engineering

Examiner

A certification learning product built around a practical question: how can learners trust the material they practise with, and how can a study system distinguish a completed session from knowledge that lasts?

Independent Smartbit product Initial scope: Microsoft AZ-305 Current focus: content quality and adaptive practice
Discuss the project

How to read the project status

Current capability

Behavior implemented in the application and its supporting services.

Designed capability

Specified in the v2 learning-model design; not presented here as shipped functionality.

Future roadmap — direction, not commitment

Product strategy options, not delivery commitments or current features.

Challenge

Examiner began during preparation for Microsoft’s Azure Solutions Architect Expert certification. Practice material gathered from different sources did not always have dependable answers or explanations. That made it hard to tell whether a learner was reinforcing sound knowledge or rehearsing a mistake.

The product problem extended beyond question accuracy. A correct response in one session is useful feedback, but it does not by itself show whether the underlying knowledge will be available later. Examiner treats content trust and learning-state design as connected engineering problems.

Vision

Build a maintainable certification learning system in which questions can be reviewed and corrected as source content, practice can be adapted to a learner’s progress, and future review can reinforce knowledge after initial mastery.

The longer-term direction is a learning lifecycle rather than a single exam attempt. Durable review is a design objective; the current application’s pool-based mastery behavior remains distinct from the proposed scheduled-review model.

Current Solution

Current capability

Structured exam and study experiences

The browser application presents compiled AZ-305 questions in exam and study flows. It supports answer review, explanations, scoring, and domain-level performance analysis.

Adaptive practice

Standalone study uses a five-question active pool, per-question mastery progression, and bounded sessions. On graduation, a question leaves the active pool and an eligible replacement can be selected.

Multiple question forms

The content pipeline and application support single choice, multiple choice, hotspot, and drag-and-drop question forms.

Separate content from interface

Question material is maintained separately from application code and compiled into a JSON dataset consumed by the web application.

Technical Architecture

The current architecture separates question authoring and compilation from the learner-facing experience. Azure infrastructure is defined as code; the presence of these definitions should not be read as a claim that every environment is currently deployed or production-operated.

  1. Author and verify: certification questions are maintained as structured Markdown source material.
  2. Extract and compile: Node.js tooling validates and transforms source content into a compiled question dataset.
  3. Render and study: a React and Vite web application loads the dataset and uses SurveyJS to render exam and study interactions.
  4. Persist study state: .NET isolated Azure Functions expose APIs for adaptive stats, study sessions, tags, and adaptive pools; Azure Table Storage is the configured persistence service.
  5. Define the platform: Bicep describes Azure Static Web Apps, Functions, Storage, Key Vault, and Application Insights with Log Analytics.

Current data model and APIs support the existing progress and pool behavior. The separate v2 due-review tables, endpoints, and migration path are design work, not represented as live services here.

Learning Model

Current capability

Standalone study tracks sessions with a 50-question boundary and uses a five-question active pool. Per-question mastery has six levels, from New to Auto Easy. New questions require two accepted correct answers to graduate; later levels advance through successful validation. A graduation removes the question from the active pool. Session completion, pool residency, and mastery are separate measures.

Designed capability — not shipped

The v2 design proposes New, Learning, Review, and Mastered states; explicit due dates and intervals; Again, Hard, Good, and Easy grades; lapse handling; and a due-first selection policy. Mastered questions would remain eligible and return when due. The design also specifies a review dashboard, event history, and a migration from the existing progress model.

Future direction

The product strategy considers broader certification coverage, richer retention analytics, AI-assisted explanations, and team or instructor workflows. These are roadmap possibilities, not current capabilities or dated commitments.

Key Design Decisions

Technologies

Application and content

  • React and Vite
  • SurveyJS
  • JavaScript and Node.js content tooling

Azure platform definition

  • .NET 8 isolated Azure Functions
  • Azure Table Storage
  • Azure Static Web Apps and Bicep
  • Key Vault, Application Insights, and Log Analytics

Lessons Learned

Architecture · Engineering · Product design

Discuss a product engineering challenge

For conversations about cloud architecture, learning systems, or turning a product concept into a maintainable application, contact Smartbit.