Multimodal AI Nutrition Intelligence

Your meal tells a story.
CALY understands it.

CALY turns a meal photo or a natural-language description into recognized foods, estimated portions, nutritional values, and personalized daily guidance — inside one connected mobile experience.

CALY nutrition intelligence mobile experience
YOLODepth Anything V2Qwen 2.5GeminiFlutterFastAPISupabase
Why CALY

Calorie tracking should not feel like homework.

Traditional tracking asks people to separate every ingredient, weigh it, search a database, calculate nutrition, and repeat the entire process for every meal. That friction is exactly what CALY was built to remove.

The challenge

Traditional tracking asks too much from the user.

Every meal can turn into a long sequence of manual decisions before it is ever recorded.

01

Separate every food item and ingredient.

02

Estimate or measure each portion manually.

03

Search nutritional databases item by item.

04

Calculate calories and macronutrients repeatedly.

The CALY shift

From manual steps to one intelligent workflow.

Before
  1. High effort for every meal
  2. Slow and repetitive logging
  3. Inconsistent portion estimates
  4. Low long-term adherence
With CALY
  1. Snap or describe the meal
  2. Review detected ingredients
  3. Track nutrition automatically
  4. Receive personalized guidance
Three ways to log

Built around how people actually eat.

CALY supports different situations without forcing users into one rigid input method.

01

Take a photo

CALY separates the foods on the plate, estimates each portion, calculates nutritional values, and records the meal.

02

Describe your meal

Write naturally in Arabic, Egyptian dialect, Franco-Arabic, English, or mixed language. CALY structures the description into reliable food records.

03

Log a favorite

Save meals you eat often and add them again in seconds — without repeating the full analysis workflow.

Inside the intelligence

Five systems. One seamless experience.

The interface is simple because the engineering behind it is not. Each meal moves through specialized AI, mathematical, and software layers.

Computer Vision

Recognizing every item — not just the plate.

Three fine-tuned YOLO instance-segmentation models run together. A custom Mask-IoU ensemble removes duplicates, protects nested toppings, resolves conflicts, and fills missed regions.

  • Approximately 40,000 images across 220 food classes
  • 46 Egyptian food classes added for regional coverage
  • Pixel-level masks for multiple foods in the same meal
YOLOv8YOLOv11Instance SegmentationMask-IoU Ensemble
Evaluated end to end

A research-scale system, measured like a product.

CALY was evaluated across model performance, portion accuracy, language understanding, response time, and user experience.

0Training images

Curated and optimized for segmentation.

0Food classes

International and Egyptian dishes.

0Best mAP@50

YOLOv11 with smart augmentation.

0Portion MAPE

Across 50 diverse test meals.

0Entity extraction

Natural food descriptions.

0Text pipeline success

End-to-end structured output.

3.8–4.5sFull image workflow

Measured over standard 4G/LTE.

0Beta participants

Seven-day user acceptance test.

The mobile experience

Complex intelligence, designed to feel effortless.

CALY's Flutter application brings onboarding, personalized plan creation, meal logging, daily tracking, meal management, and recommendations into one consistent interface.

Personalized onboardingAge, gender, height, weight, activity level, and goal.

Smart meal loggingCamera, natural-language description, and favorites.

Daily dashboardCalories, protein, carbohydrates, and fat progress.

Meal controlReview, edit, delete, and save meals as favorites.

Explore all interface screens
CALY mobile application interface experience
Designed in FigmaBuilt with Flutter
Product architecture

Connected from screen to model to database.

The backend orchestrates every step — from a user's input to AI inference, nutrition calculations, secure storage, and the updated result shown inside the application.

01 · Experience
User layer

Flutter Mobile App

Profile setup, meal capture, text logging, favorites, and the daily dashboard.

02 · Orchestration
Central service layer

FastAPI Backend

Validates requests and coordinates the complete nutrition workflow.

AuthenticationUser profilesMeal workflowsNutrition logic
03 · Intelligence & Data
AI services

Vision, Language & Recommendations

YOLO, Depth Anything V2, Qwen 2.5, and Gemini.

Data layer

Supabase & Cloud Storage

Identity, profiles, meals, nutrition records, and uploaded images.

Structured result returns to the app: detected foods, estimated grams, nutritional values, daily progress, and personalized guidance.

Flutter & DartFastAPISupabase PostgreSQLSupabase AuthCloudinaryHugging FaceGeminiDocker
Meet the team

The people behind CALY.

CALY is our graduation project for the 2025–2026 academic year, developed by six students from the Statistics & Computer Science Program, Department of Mathematics, Faculty of Science, Capital University.

Graduation ProjectAcademic Year 2025–2026

A multidisciplinary system combining Computer Vision, Natural Language Processing, recommendation intelligence, mobile development, backend engineering, and database design.

CALY icon
Project Supervisor

Prof. Amany E. Aly

Professor of Mathematical Statistics

CALY Android app icon
Closed beta

Experience CALY on Android.

Download the beta APK, create your personalized nutrition plan, and explore CALY's meal logging and daily tracking experience.

Android APKResearch betaInternet required
Download CALY Beta CALY is a research prototype for nutritional tracking and is not a substitute for professional medical advice.