Fitterfly, a digital therapeutics firm based in India, has revealed plans to launch an AI feature named Fitterfly Klik in collaboration with Google Cloud. This initiative allows individuals managing conditions like diabetes to monitor their dietary intake through computer vision technology powered by Gemini 1.5 Flash on Google Cloud’s Vertex AI platform.
Using Fitterfly Klik, users can snap or upload photos of their meals. The app’s AI capability scans a comprehensive database comprising over 37,000 Indian food items to identify and analyze each dish. It calculates portion sizes and offers detailed breakdowns of calorie content, as well as distribution of macronutrients and micronutrients.
The AI is proficient at recognizing both local and international dishes. Users can conveniently track their dietary habits using the app’s meal-tracking feature.
Ammar Jagirdar, head of Fitterfly X-Labs, commented, “With Gemini 1.5 Flash on Vertex AI integrated with the Fitterfly Food Database, Klik simplifies meal logging, even for complex plates with multiple dishes. Modern multimodal models are enhancing accuracy beyond traditional image classification methods, particularly in food recognition. Klik aims to streamline user experience and facilitate healthier lifestyle choices.”
In a broader context, Google Cloud recently introduced new genAI advancements at HIMSS24, including Vertex AI Search for Healthcare. These innovations support healthcare developers in creating more effective assistive technologies, aiming to alleviate administrative burdens within health systems.
Google Cloud has forged several strategic partnerships in healthcare, including collaborations with C3.ai and Oracle, underscoring its commitment to advancing AI applications across various sectors, including pharmaceuticals and healthcare administration.