Release notes

ZEBLOK COMPUTATIONAL AI-MICROCLOUD RELEASE NOTES

Version 1.2.9 (June 2024)

All the below mentioned updates and the updates for our intermidiate version 1.2.8 have been integrated into the release version of AI-Microcloud 1.2.9.

IaaS

Automatic MINIO setup in Bare-metal environments:

• MINIO setup needed on a bare metal setup has been automated through the launcher which earlier was deployed manually by the ZEBLOK team which have decreased the deployment time and have made the environment totally human interaction free.

PaaS

Improvement:

• Microservice and Workstation update feature: Updating spawned microservices and workstation are integrated into the AI-MicroCloud which enables the user to change the resources attached to a workstation or microservice along with the option to change the environment variables and ports.

Notifications and Alerts:

• Notification count will reset after the user has gone through all the notifications and all are marked as read.

• Any new notification that will be captured will pop up onto the users workspace for few seconds and then detail related to it will be captured in the notifications tab.

Bugs Resolved:

• OaaS and AI-API spawned by a users were visible to other users in their organization with any permissions which has been resolved and rectified

• Workstation when not given public access not while onboarding were not visible in the workstation tray during spawning process which is now fixed by out team

• Dashboard UI to be improved in order to give a listed view to the admin of all the workstation types and microservice images that are spawned on any given point of time

• Shared Workstations were not accesible by the users in the organization whom they were shared which was due to the security policies which has been rectified and now its accessible to any users with the proper permissions.

• Plan if not public is not visible to creator which has been fixed and now is a plan is not public it will be visible only to the primary owner of the plan

SaaS

Launcher Bare-Metal:

• Standard Naming Conventions: Renamed variables, functions, and components across modules like Auth, User, and AKS/EKS controllers to adhere to standard naming conventions, improving codebase consistency and readability.

• Async/Await Implementation Throughout: Replaced callback-based functions with async/await syntax in modules such as API service layers, Redux action creators, and data fetching utilities, enhancing code readability and managing asynchronous operations effectively.

• Removal of Bottlenecks: Optimized data fetching by removing redundant API calls, implementing batch insertion for improved performance, and streamlining file operations during cluster creation and updates. Refactored complex logic in AKS/EKS controllers, reducing code complexity and improving scalability.

• Logic Optimization: Streamlined data processing logic in components like API controller layers, improving computational efficiency and reducing resource consumption. Reorganized conditional statements and loops for better code flow and readability.

• Frontend State Management: Integrated Redux Toolkit for state management in front-end components, such as User Profile, Dashboard, and Login, ensuring a centralized and efficient state management system.

• Error Handling and Message Definition: Enhanced error handling mechanisms by centralizing error logging, implementing custom error messages with severity levels, and providing detailed error responses from API endpoints.

• UI Improvements: Revamped UI components for better user experience, introduced warnings, alerts and actions for better visualization.

• Code Segmentation: Broke down complex functions into smaller, manageable parts for easier understanding and modification. Optimized the code by reducing the number of lines in the code.

• In case of deployment failure, the user can download the log file and troubleshoot. Once the issue is identified, the user can edit/modify the cluster and resume the deployment of Ai-MicroCloud.

• A new feature addition is the component version validation. Once the Cluster is successfully created and the MicroCloud is properly deployed the user will automatically get a list which will include a list of all the modules along with their respected versions which can we utilized while using support tickets resulting in quick resolutions

Gen-AI/Co-pilot:

• Embedding Creation Application

  • Datalake Connection Seamless integration with the Zeblok Dataset by default, ensuring easy access to large-scale data

  • Vector DB Embeddings are efficiently stored in ChromaDB, our reliable vector database

  • Embedding With Multiple PDF Create embeddings from multiple documents within a single dataset, enabling comprehensive data representation.

• Finetune Application

  • Vector DB Easily connect with the knowledge vector database to store and retrieve embeddings created with the Embedding Creation Application.

  • Prompt Users can effortlessly ask queries related to the documents, ensuring quick access to relevant information.

Version 1.2.8 (May 2024)

IaaS

Log Storage Solution: ELK stack is widely used for log storage and analysis due to its robust features and flexibility in handling diverse data sources and visualization needs. Our Logs system has been upgraded to persist past logs and store logs after the deletion of the container which will help any developer for debugging and troubleshooting. All the logs are now directed by ELK which makes it faster, responsive and detailed.

Key Benefits:

• Centralized Logging: Collects logs from various sources into a centralized location.

• Real-time Analysis: Enables real-time monitoring and analytics of log data.

• Scalability: Scales to handle large volumes of logs and data streams.

• Flexibility: Supports customization through plugins and configurations.

Security implementation on ISTIO related to SSL: Newer cypher suits have been implemented

Improved Security:

• Stronger Encryption: Newer cipher suites often use stronger encryption algorithms such as AES (Advanced Encryption Standard) with 256-bit keys, providing better protection against modern cryptographic attacks.

• Authentication: Enhanced authentication mechanisms such as Elliptic Curve Cryptography (ECC) for key exchange provide stronger security assurances.

• Forward Secrecy: Many newer cipher suites support Perfect Forward Secrecy (PFS), ensuring that even if a long-term key is compromised, past communications remain secure.

• Resilience to Attacks: Upgrading to newer cipher suites mitigates vulnerabilities associated with older, deprecated algorithms and protocols, enhancing resilience against emerging threats.

PaaS

New Feature:

• Microservice and Workstation Sharing:

  • User can easily share their spawned microservices and workstations among their fellow users who belong to the same organization which benefits as follows:

    • Resource Optimization: Microservices architecture allows components of an application to be independently deployable and scalable. Sharing microservices ensures optimal resource usage by avoiding redundancy and promoting reusability.

    • Collaboration: Teams can collaborate more effectively by sharing common microservices across different projects or departments. This fosters consistency in functionality and reduces development effort.

UI Changes:

• Notifications

  • All the user related activates and component activities are now stored into the Notification Tab, which allows the user to keep track of the MS WS AIAPI and Containerization activities which are taking place on the AI-MicroCloud

  • Also, any error occurred during the any spawning, running or deletion activity are logged into the tab which the user can access easily

• Improved containerization and pipeline UI

  • Deployment tab is being renamed to Containerization which engulfs all the CaaS activities which take place on the MicroCloud which logs all the activities and share the status with users.

Backend Enhancements:

• Private Registry:

  • Secret creation by taking in the repo details was not happening due to the use of special characters in the secret as it was generated randomly, and Kubernetes does not take in special characters for secrets, which was handled by the team and now any Microservice from private registries can be onboarded and spawned with ease on AI-MicroCloud

• URL Authentication:

  • User can only access the Microservices or Jupyter lab instances from inside the MicroCloud which drastically improves the security and reduces the risk of un-authorized access.

  • Without Login credentials no user will be allowed to utilize the services even if the URL is available because on hitting the URL, it will direct back to the login page if not already logged in.

CLI Enhancements:

• Command Enhancements:

  • Model serving command was upgraded to have all the serving methods under one umbrella

  • Zeblok configure command was also enhanced to detect the object storage automatically

Version 1.2.7 (March 2024)

All the below mentioned updates have been integrated into the release version of AI-Microcloud 1.2.7 specific to our Basic SKU

PaaS

User Interface Enhancements

• Dashboard User View Enhancements:

  • Roles and Policies: Finalize the naming conventions for roles and policies on the dashboard.

  • User Roles Depiction: Users' roles are now visually represented on the user list for administrators.

• Datacenter Functionality:

  • Node Type Display: Users can now view the type of node they are accessing within the datacenter.

  • Datacenter Form Revamp: The datacenter form has been optimized to remove unwanted fields.

• Microservice and Workstation Cards Enhancement: Cards in the MS/WS section now include vital information such as license details and service provider information.

  • Terms and Conditions Checkbox: A terms and conditions checkbox has been added during any spawning process, ensuring users acknowledge usage terms before proceeding.

  • Provider Information Display: Third-party service provider details are now visible on respective cards for user reference.

• Activity Logs: Users can now access detailed activity logs for better tracking and monitoring.

• Password Functionality:

  • Forgot Password Page: Users now have access to a forgotten password page for streamlined password recovery.

  • Reset Password Page: A reset password page has been added for users to securely reset their passwords.

• View Password Button: A new "view password" button has been added in the launcher for password visibility convenience.

• Search and Filter Fields: Improved UI functionality with the addition of search and filter fields for enhanced navigation and data organization.

• AppStore Improvement: The AppStore has been optimized to fit in the Intelligent Marketplace(present in earlier versions).

• Error Message Display: Error messages are now displayed on the UI for troubleshooting.

• Login Page: The Login page has been cleaned up for better user experience.

Backend Enhancements

• Event Exporter: Introducing the Event Exporter feature to facilitate seamless exporting of events for analysis and reporting purposes.

• Kubernetes Token Dynamic Fetching: Dynamic fetching of Kubernetes tokens implemented, ensuring enhanced security and efficiency in token management.

• Error Handling Improvements:

  • Error Message Definition: Error messages now display the level of errors, providing clearer insights into system issues.

  • Error Handling: Enhanced error handling mechanisms to address and manage errors more effectively.

• Dashboard Enhancement:

  • Information Details: Improved dashboard interface with detailed depiction of WS, MS, and OaaS (Workstation, Microservice, and Orchestration-as-a-Service) details for better visibility and monitoring.

• Standard Naming Implementation: Standard naming conventions applied throughout the application for consistency and clarity in data representation.

• Async/Await Implementation: Async/Await methodology implemented across the application for improved performance and responsiveness.

• Removal of Bottleneck: Identified bottlenecks have been removed, leading to smoother and more efficient system operations.

• Logic Optimization: System logic optimized to enhance performance and resource utilization.

• Deployment Tab:

  • Deployments tab deals with the containerization of models and then deploying them if non-auto deploy is opted for.

  • Deployments Tab incorporates feature of deploying Ai-API, Pipelines

  • It also shows if containerization fails at certain level while building whose logs are stored for further assessment.

• Email Alerting System: Email alerting system integrated to notify users promptly about important events and system updates.

• Improved Seeding Process:

  • Seeding Process Enhancement: Seeding process has been improved for faster and more reliable data population.

  • Database Preservation: Database preservation ensured with only updated seeds being changed, maintaining data integrity.

• GPU Monitoring on Cloud Environments: GPU monitoring capability added for cloud environments, allowing users to efficiently manage GPU resources.

• Containerization as a Service Revamp: Containerization as a Service feature has been separated and developed as a different module.

CLI Enhancements

• Integrated Object Storage Support:

  • MINIO, BLOB, and S3 Integration: The Command Line Interface (CLI) now seamlessly integrates with MINIO, BLOB, or S3 object storage, adapting to the environment's storage requirements. Users can effortlessly manage and manipulate objects stored in these environments directly from the CLI interface, enhancing flexibility and convenience in data handling.

• Containerization as a Service Integration:

  • Containerization Simplified: With the integration of Containerization as a Service (CaaS), users can now easily deploy and manage containerized applications directly from the CLI. This streamlined approach eliminates the complexities associated with container management, allowing users to focus on building and deploying their applications with ease.

SDK Enhancements

• Integrated Comp-App v1.2.7 changes

  • Made changes in API response processing for Plan and Add-On Orchestration components of the SDK.

  • Updated the Docker Hub subdomain url in the SDK.

• Added Ai-Pipelines Feature

  • Added Ai-Pipeline Auto-Deploy and Non-Auto Deploy feature.

  • Added get_all Ai-Pipelines and validate an Ai-Pipeline interface.

• Added DataSets Feature & Integrated Object Storage Support:

  • SDK integrates seamlessly with the environment’s respective object storage and currently supports S3 (AWS), Blob (Azure), MinIO storage.

  • Users can upload and download files of any size directly on the object storage via SDK from their local or Ai-MicroCloud Environment.

SaaS

Basic Launcher (AWS, AZURE, Bare-Metal)

• This version includes the following major changes.

  • Standard Naming Conventions: Renamed variables, functions, and components across modules like Auth, User, and AKS/EKS controllers to adhere to standard naming conventions, improving codebase consistency and readability.

  • Async/Await Implementation Throughout: Replaced call-back based functions with async/await syntax in modules such as API service layers, Redux action creators, and data fetching utilities, enhancing code readability and managing asynchronous operations effectively.

  • Removal of Bottlenecks: Optimized data fetching by removing redundant API calls, implementing batch insertion for improved performance, and streamlining file operations during cluster creation and updates. Refactored complex logic in AKS/EKS controllers, reducing code complexity and improving scalability.

  • Logic Optimization: Streamlined data processing logic in components like API controller layers, improving computational efficiency and reducing resource consumption.Reorganized conditional statements and loops for better code flow and readability.

  • Frontend State Management: Integrated Redux Toolkit for state management in front-end components, such as User Profile, Dashboard, and Login, ensuring a centralized and efficient state management system.

  • Error Handling and Message Definition: Enhanced error handling mechanisms by centralizing error logging, implementing custom error messages with severity levels, and providing detailed error responses from API endpoints.

  • UI Improvements: Revamped UI components for better user experience, introduced warnings, alerts and actions for better visualization.

  • Code Segmentation: Broke down complex functions into smaller, manageable parts for easier understanding and modification. Optimized the code by reducing the number of lines in the code.

• The launcher application for the cloud platforms i.e. AWS and AZURE allows the user to add an extra set of Node group/Node pool once the cluster is created.

• Provision of adding GPU instance node pools has been included.

• In case of deployment failure, the user can download the log file and troubleshoot. Once the issue is identified, the user can edit/modify the cluster and resume the deployment of Ai-Microcloud.

• A new feature addition is the component version validation. Once the Cluster is successfully created and the MicroCloud is properly deployed the user will automatically get a list which will include a list of all the modules along with their respected versions which can we utilized while using support tickets resulting in quick resolutions

Version 1.2.6 (December 2023)

All the below mentioned updates have been integrated into the major release version of AI-Microcloud 1.2.6 from the earlier version in user i.e. AI-Microcloud 1.2.5

SaaS

Model Serving of Large Language models

• LAMACPPserves quantized models

• Facebook 125M model using vLLM serving

  • Served using command line interface as an API

PaaS

ZBL CLI

• vLLM serving of models as APIs

• LLAMA CPP serving of models as APIs

• Capability of multipart upload of larger model sizes

COMP APP

• Refactoring of the whole code base in comp-app in order to reduce SDK communication crashing and improve Error Handling and API interaction handling

• IAM roles and privileges updated for more User privilege and easy segregation of access in organisation's System admins

• Generic Image for Enterprise edition which allows the use of a single image that would be compatible with all our environments.

UI Improvements for AI-Microcloud

• In the comp app updated the profile page design

• The support button has been added and users can raise tickets from AI-Microcoud itsef

• Once the secret keys are generated they're always available in the session for the user.

• Copy button has been added for the keys

• View password has been also added in the profile page and login page has context menu

• Microservice and Workstations card alignment.

• Removal of the Zeblok Ai-WorkSpace text

• Segregation of Manage account page

• User role should also get displayed on Manage your account page.

• Rename get data-lake key and get api credentials button to Generate Datalake key and Generate API credentials.

• View password button in the register page

• Padding fixes in the UI

• Role table fixes

COMP AUTH

• Complete code refactoring for making the app more resilient and avoid server crashing

• Client libraries for object storage(minIO) have been updated which allow on the fly bucket creation and policy creation on minIO simultaneously on user registration.

Microservices and Workstations

• Introduction of new and updated microservices and workstations into the Microcloud for more dynamic and extensive usability e.g. StreamLIT UI, Sceenscape, ChromaDB, etc.

• The new versions for docker images have been provided on the seeding part of AI-MicroCloud.

Monitoring

• Event Exporter: Dependency on the third party Kubernetes event exporter has been removed and usage of Kube-API is introduced, this has improved event caching and improved reliability, ensuring we are not missing out on released events

CaaS

• CaaS is made available for concurrent users by the help of kubernetes jobs in return with no wait time for any user .

• The containerization as a service has been totally redesigned to help improve the usability and to enhance the user experience.The user can have the CaaS service invoked with custom plans as required according to them and also be able to see the logs for the whole process.

• Improvements

  • Big chunks of data is now being able to be fed and processed while model serving .

  • Any size of models can be served and packaged as an API using our CaaS service

SDK

• Refactoring of the whole code base for validation processes and changes authentication mechanism and packaging for seamless user experience.

IaaS

Hardware

• Intel AMX support now available with Basic and Enterprise SKU of AI-Microcloud

Basic Baremetal Launcher

• Our basic launcher now provides the user to create AI platform into the Bare-metal environment automatically within few minutes by using the launcher filling up some details and providing access credentials(For Bare-Metal connectivity) which are taken in as encrypted data, With all the information taken the scripts to run in the background and providing the URL in the Launcher to access the AI-Microcloud all deployed and ready to use.

Enterprise Azure Launcher

• The enterprise launcher allows the user to connect their 3 hubs with any amount of bare metal servers and the user can easily establish the environment automatically within a few minutes by using the launcher filling up some details.

Platform upgrade

• Our Applications(MicroCLoud, Launcher and OTF) are now compatible for the MONGO Atlas integration, it’s been tested and ready for use

Website

Playground

• New Addition to our Zeblok website www.zeblok.com is the feature of our playground button which enables any interested user to try out our Microcloud free for 21 days by just clicking on the “playground” button and registering on the following forms which will grant him direct accessibility to our playground feature

Fixes and Improvements

Enterprise Launcher fixes

• Bugs on User Interface now resolved

• Removed the cross symbol from the success message. Instead display a message on new window

• User will land on Marketplace tab when log inside the AI-Microcloud

• Launcher script-Token fixed inside the script

• Hash is now being received on email

• User input are taken interactively while running the script

• Launcher user registration email verification is now enabled

• The instance type in the form t2xlarge is fixed

• Masters name removed

• User now lands on Request page on launcher once he logs in

Version 1.2.5 (September 2023)

IaaS Updates

Hardware:

• AIM now runs on Intel Sapphire-Rapid Processor

BASIC:

• Storage for Azure Cloud: AZURE Blob storage from UI for uploading viewing and download of datasets

• AZURE Basic version integrated with Orchestration addon as a usability(Ray usability) which enable the user to use the HPC usability of the platform for training and developing complex models and running immense computations.

• Multi-master cluster on Bare Metal servers supported

PaaS Updates

SDK usability now supports the following components:

• Plans

• Orchestration addon

• Namespaces

• Microservices

CLI:

• Snapshot of Workstations for creating images of build workstations CLI

• AWS S3 storage has been integrated with the CLI so that the user can easily use the terminal for upload, download, view their dataset

• AZURE Blob storage has also been integrated same as the AWS S3 functionality with the CLI which enables the users perform the similar dataset actions seamlessly on both cloud platforms

SaaS Updates

Launchers:

• Basic:

  • Updated UI and integrated with Order to fulfillment (For AWS launcher)

    • User Interface is revamped ,

    • Eks form is updated with the feature of adding desired nod pool and is implemented in both EKS and AKS .

    • The form to create the launcher and complete requests is made user-friendly

    • Integration of azure AKS to establish Basic microcloud

• Enterprise:

  • Updated UI and integrated with Order to fulfillment

  • User can install the Launcher himself

  • Integration Of Azure platform to launch enterprise edition

  • The user interface and form to establish AI-Microcloud is made consistent with the basic launcher and more user-friendly .

ISV:

• Users can deploy intel screenscape using AIM. Intel® SceneScape is the software base to get your custom tracking solutions up and running fast. Intel® SceneScape enables improved decision-making by giving users the near real-time tracking and monitoring data they need to assess the people and objects within their spaces and enterprise environments such as airports, hospitals, retail stores, factories, and warehouses. Intel® SceneScape is also compatible with the Intel® GetiTM platform so that you can create and train custom AI models that enable better monitoring of people, high-value assets, and important areas within your space.

AWS Marketplace

AWS Marketplace:

Zeblok's SaaS product, "AI-MicroCloud," with AWS Marketplace to enable customer onboarding, metering, billing, and vendor-metered tagging functionalities. The integration offers a seamless subscription experience for customers accessing the product on AWS Marketplace, along with accurate billing based on metering records.

Basic:

• Small Flavor:

  • Instance Type: t3.medium

  • CPU Model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2 .50GHz

  • CPU Family: Cascade Lake

  • vCPUs: 2 per instance

  • Memory: 4GiB per instance

  • Total Nodes: 3

  • Overall Resources: 6vCPUs and 12GiB Memory

• Large Flavor:

  • Instance Type: g2.2xlarge

  • CPU Model: Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz

  • CPU Family: IVY Bridge EP

  • vCPUs: 8 per instance

  • Memory: 15GiB per instance

  • GPU: 1 Nvidia GPU 4GiB (Model: K520) per instance

  • Total Nodes: 3

  • Overall Resources: 24vCPUs, 45GiB Memory, and 1 GPU per node

  • K520 4 GB GPU support on AWS Basic version on large flavors type

Enterprise:

• 3 servers in HUB of any AWS provided flavor that are enlisted into the Launcher App which the user can select while configuring their Microcloud.

• The User gets connect up to 5 Bare-metal edge nodes into the environment selecting them through Launcher among the certified hardware provided by Zeblok:

  • Intel® Xeon® Platinum, Gold, Silver or Bronze Processor

  • Intel® Xeon® Processor D-1747NTE, CPU TDP 80W

Version 1.2.4 (June 2023)

IaaS Update

Enterprise version:

• Software Updates: All the software packages are updated to latest version which covers bug fixes and security updates.

• Security:

  • User can select and implement the Minimum base line security standard(MBSS) over edge server using UI of Enterprise launcher.

  • User can restrict the SSH access to the edge server using UI of Enterprise launcher.

• Hardware:

  • Supermicro IoT SuperServer SYS-510D-10C-FN6P is certified for use as edge server.

  • Supermicro IoT SuperServer SYS-110D-20C-FRAN8TP is certified for use as Hub and edge server.

  • Intel® Data Center GPU Flex 140 is tested and certified for use at Hub and edge server

• Monitoring: User can view the edge nodes attached to the cluster and check their online status whether active or not.

Basic version:

• Auto scaling plans on AWS: Users can now define auto-scaling plans in Ai-MicroCloud® which makes the platform capable to scale the infrastructure as the need of resource increases while running the AI workloads.

• Storage: Ai-MicroCloud® datalake now uses S3 as backend in AWS environment.

• Security: Encryption layer provided onto the Basic Launcher while taking in sensitive data from the user which allows the system to be more secured from foreign attack

• HPC: Users can spawn Ray clusters using orchestration add-on feature of Ai-MicroCloud® which will enable them to train and develop models with speed.

PaaS Update

• Datasets: Now users are able to delete the datasets created before using GUI from the micro-cloud itself.

• Bucket Creation: Now any user when onboarding the Micro-cloud will be getting an personal bucket automatically created as soon as they will sigh-up and log-in into the platform.

• Orchestration Add-on: In our platform GUI the orchestration button is added which will enable our users to spawn an Ray cluster and utilize it easily.

• IAM roles: Now our platform will be providing pre defined roles when our micro-cloud is spawned which can then me distributed by the admin role person to the other user in their organization through the utilization of user groups.

• Logs: Logs now enable our users to check the login details of their workstations, Micro-services and AI-APIs and in addition our logs have been increased to contain information for past 30 days which will be handy for troubleshooting.

• CLI: ML-flow integration done which allows users to upload and serve their models easily and efficiently into the platform and use it for training and utility purpose.

SaaS Updates

• Basic Launcher: Our basic launcher now provides the user to create AI platform into the AWS environment automatically within few minutes by using the launcher filling up some details and providing access credentials which are taken in as encrypted data, With all the information taken the scripts to run in the background and providing the URL in the Launcher to access the AI-Microcloud all deployed and ready to use.

• Flexible Environment: On collaboration with the fortune 500 goliath we have adjusted our platform to work under 3rd party network norms in which we will provide only necessary communication of our platform to be allowed and provide that detail to organizations which can be fed on their private network layers and allow the usage of the Microcloud in a more flexible and secure method.

BUG FIXES:

• Removal of the Datalake button on the user interface

• Flickering of the Ai-MicroCloud® login page

• Error handling, error message will be shown at the bottom of the webpage

• Support button fixed with proper ticket creation

• Alerting integrated into the platform to know the status of the environment in case of downtime

• CROSS cloud integration resolved

• Automatic redirection to the next/previous page once action completed on current

• All mandatory fields highlighted in forms for the users

• ML-flow integration on the ZBL CLI

Version 1.2.2 (JANUARY 2023)

IaaS Updates

Edge Monitoring:

• SuperAdmin can monitor CPU and Memory for edge servers and deployed microservices with a more detailed overview which allows them to gather detailed information about individual Edge servers or particular microservices.

• Detailed Graphical representation of the utilization of server resources.

CICD:

• Automatic cyclic updation without taking down the whole environment i.e. only changing the git version which will directly incorporate changes into a pre-deployed AI-M ecosystem

• Automated deployment of the whole ecosystem from a single point of contact just by using variables that are collected from the user irrespective of the platform/environment to be deployed upon.

Edge Security:

• Minimum Baseline security(MBSS) has been incorporated into our ecosystem for providing standardized security according to the global regulations which makes the whole platform very secure to outside attacks.

• Access control on Edge provides SSH and BMC console only from specific subnets and on specific interfaces.

• Data encryption on local storage is incorporated into the system to make it more secure.

PaaS Updated

Order Fulfillment System:

• The new addition to our whole micro-cloud makes the interaction between user from buying the product to login into the micro-cloud really streamline by providing a one stop solution for the organization to place an order and setting up the microcloud.

Launcher:

• “Basic launcher” deployment on cloud platform(AWS)

• “Enterprise launcher” inclusive of the previous launcher version released in the last quarter along with the option to have HUB in either Public cloud or Bare-metal and attachment of multiple Edge nodes irrespective of the placement of HUB

• GUI enhancement from the previous CLI only useability to deploy your Ai-Models to multiple edge nodes simultaneously in an Edge Datacenter as an Ai-API.

Datasets:

A machine learning dataset is a collection of data that is used to train the model. A dataset acts as an example to teach the machine learning algorithm how to make predictions, Now our users can easily onboard their data onto the platform using few simple steps which can be utilized by any Micro-service/workstations that are spawned on the platform

Version 1.2.1 (SEPTEMBER 2022)

SaaS Updates

• Improved Microservice Configuration: Spawning MicroService workflow now has a more flexible and dynamic configuration system for environment variables, arguments, ports, etc.

• Simultaneous EDGE deployments of AI-API and MicroServices.

• Zeblok Cli: Zeblok Cli now provides an option to deploy your Ai-Models to multiple edge nodes simultaneously in an Edge Datacenter as an Ai-API.

• Dynamic plans (CPU and Memory): Spawning Ai-WorkStation, MicroService and Ai-API workflows have been added with an option to attach customized plans (CPU and RAM according to user’s needs) where the resources will be within the limits set by the real-time resource metrics recommendation system.

• Resource manager with monitoring: Resource Manager Tab in Ai-MicroCloud now gives the superadmin and admins an ability to view the monitoring graphs of each resource like Ai-API, Ai-Workstation and MicroServices.

• Crosscloud integration: Ai-Models and Ai-Pipelines have been enabled to show their security scan logs along with previously enabled Ai-WorkStations and MicroServices which gives the users a better understanding of vulnerabilities in their images.

LAUNCHER APP(Edge):

• New GUI for easy and efficient setup of the Microcloud on bare metal servers

• Zeblok Launcher App is the newest member in the Ai-MicroCloud installation ecosystem. This feature seamlessly installs the whole Ai-MicroCloud edge ecosystem from scratch in a bare-metal environment efficiently.

PaaS Updates

• Zeblok CLI is available at - https://www.npmjs.com/package/zbl-cli can be installed using `npm i -g zbl-cli`.

• SDK is available at https://pypi.org/project/zeblok-py/ can be installed using pip install zeblok-py

• SDK: SDK now enables users to simultaneously deploy Ai-Pipelines in multiple enterprise datacenters and collate results (Ai-Runs) in a single endpoint of your choice.

• Minikube setup enabled: The Ai-MicroCloud ecosystem has been upgraded to work in an isolated environment (like minikube) without any access to outside networks with the help of our private image repository.

NEW WEBSITE

• Zeblok.com is live with a new look and updated content for the users to get more insight into our concept and know us better. We would really like you to visit us at: https://www.zeblok.com/

IaaS Updates

EDGE

• Monitoring: SuperAdmin can monitor CPU and Memory for edge servers and deployed microservices.

• Storage: Block storage solution which takes care of data replication across hub servers available for all users. This protects data loss if one of the hub servers goes down.

• Data handling on edge servers: ISVs can use command line to push the data from edge servers (either from hosts or microservices) to custom storage buckets located in the Hub for further use(eg. Model training). For more information, refer the ISV onboarding document ISV Onboarding User Guide_v1.0_01092022.docx

• Image Registry & Security: Users can store docker images on the on-prem image registry located at the Hub. Most importantly, security scans can be performed on docker images for vulnerabilities.

• Scale: 1000 edge servers connected in a single cluster tested in the lab

Enterprise and Edge

• “kubectl” access can be provided to ISVs admin users for specific namespace to spawn multiple microservices via Zeblok’s “ISV Management” microservice. For more information, refer the ISV onboarding document ISV Onboarding User Guide_v1.0_01092022.docx

Version 1.2.0 (JUNE 2022)

SaaS Updates

Zeblok Python SDK now has the feature to deploy simultaneous multi-datacenter Ai-Pipelines with also the ability to integrate the Ai-Runs output with open source tools.

PaaS Updates

• Dashboard now has the ability of one click export users’ data table as CSV for super admin and admins.

• Every user will now get a weekly mail regarding his/ her usage details over the week.

• Private Docker Image repository support has been enabled for both Ai-WorkStations as well as MicroServices, giving users the privilege to pull images from their private repositories.

• Users can now select from multiple versions of an Ai-WorkStation or MicroService while spawning (latest or a previous version).

• Single click social media sign in has been enabled via google.

• Google Authenticator Process has been enabled for a strong multi layered security process.

• MicroService spawning and Ai-API spawning process now have a configuration of plans attached which will also be reflected in the monitoring graphs of the same.

• MicroServices are now flexible to support multiple protocols which can be exposed publicly or can be interconnected to other microservices as an ecosystem.

• Spawning process has been made more error resistant, optimized and also intelligent with zeblok cli auto configuration process while spawning.

• Ai-WorkStation spawning workflow now gives you a choice to mount your S3 bucket from our Ai-DataLake.

• A new MLOps Workflow has been introduced for simultaneous multi-datacenter Ai-Pipeline, Runs and experiments with seamless integration with open source tools, which can be initiated using the zeblok cli.

IaaS Updates

• Zeblok Private Image Repository is the newest member in our Zeblok Infrastructure Ecosystem for real time security scans of the images as well as providing the security scan logs along with the severity of risks. This increases overall security as well as the image pull limit becomes a thing of the past.

• Zeblok Containerization Service has been upgraded for containerizing the Ai-Pipelines images as well as for the auto deployment of the same.

Version 1.1.0 (MARCH 2022)

SaaS Updates

• Openvino Model Serving capabilities are now supported in the Ai-API Engine.

• Openvino toolkit distribution has been upgraded to version 2022.4.1

• Ai-WorkStations have been upgraded with Nvidia Cuda Version 11.4

• JupyterLab has been upgraded to the latest version along with Python v3.9.

PaaS Updates

• New IAM (Identity Access Management) has been developed giving users and admins access to modify roles and permissions in a dynamic way giving more flexibility and ownership to the authorized users.

• Username of the authorized user has been mapped to jupyterlab notebook spawning process giving more insight to security and tracking of activities.

• Zbl Cli has been upgraded for the openvino packaging process of the IR models generated by Openvino notebook giving users more freedom on the Model Serving process.

• Zbl Cli now has a new option/ feature for automating the Ai-API Deployment process using which users can predetermine their choices/ parameters for their deployment.

• A new cross cloud service has been established where the packaged models from the cli are uploaded and image building and pushing to hub steps have been undertaken by the cross cloud service. A mail is sent to the users after the models become ready for deployment via Ai-API Engine.

• Ai-API deployment now supports GRPC protocol where, on using a suitable GRPC client, users can interact with the trained models in a deployed state.

• Zeblok Ai-DataLake has been upgraded and a one click auto account setup system has been introduced for the users along with RBAC security policies.

• Resource Manager has been re-introduced now extending its capabilities for an organization admin too, where the administrator now has full control and insight over the resource consumption and Spawned Resource activities of the members of the Organizational Unit.

• Auto backup of the MongoDB is enabled every 6 hours in all the environments.

• Seamless Database seeding is enabled for quickly restoring the database from the backup.

Version 1.0.0 (DECEMBER 2021)

IaaS Updates

• Zeblok Ai-MicroCloud is now available at Azure Cloud Environment with all the latest features and power giving the same experience of Zeblok AI-MicroCloud on the Azure Platform.

• Zeblok has established Ai-MicroClouds for two private baremetal turned cloud environments: Advantech Labs and Intel Dev Cloud.

PaaS Updates

• Notebook creation workflow has a new field added now for specifying run commands as a post workstation creation lifecycle which comes as a configuration flexibility for the Notebooks’ running.

• DataCenter (only edge categories) have now an option for adding kiosks to them which can be selected for deploying your microservices and Ai-API on a specific kiosk.

• Ai-API workflow has a new step added now for the selection of kiosks while selecting an On-Premise DataCenter.

• Microservices also have a new step added now for the selection of kiosks while selecting an On-Premise DataCenter.

• A new section in the menu has been added for Virtual Machines where you can get the shell access to a kiosk which is available as a node on the on-premise DataCenter.

• Datacenter Monitoring page has been added for getting a status of the performance of all the nodes in the datacenter cluster along with a provision to view the monitoring logs and graphs of a specific node too.

• A button to view the Ai-WorkStation or the MicroService pod logs has been given to view logs while the spawned resource is in running mode.

• Session monitoring of all aiws,microservices and aiapi has been enabled for all the users so that the users can monitor the workloads and resources being consumed by their spawned resources and also decide if they need to upgrade to another plan.

• A brand New user interface has been released giving a rich and smoother experience of the whole Ai-MicroCloud.

Version 0.0.9 (SEPTEMBER 2021)

PaaS Updates:

• Admin analytics dashboard has been updated with more precise and accurate data along with bug fixes providing a more precise idea of the usage by the users.

• Zeblok Authentication MicroService has been updated with more secure tokens and authorization logics while making the user’s authentication and signup process easier than before.

• Zeblok Ai-MicroCloud introduces a brand new workflow for microservices where you can run pre-uploaded and modified images in an isolated and an independent environment in just a few clicks like MongoDB, Intel DLWorkBench, etc.

• Session page now also handles metrics for spawned microservices along with Ai-WorkStations.

• User’s profile has two new tabs for Spawned MicroServices and one for their total runtime consumptions, both of which can be accessed by the SuperAdmin and the Organization’s Admin.

• Periodic Backup in every 6 hours has been established in aws s3 buckets as a disaster management measure.

• Superadmin now gets a new tab in their menu called “Resource Manager” where you can have a look at all and every kind of resource in the Ai-MicroCloud like Ai-WorkStation, MicroServices and Ai-API and also control them if required.

Version 0.0.8 (JUNE 2021)

Infrastructure Re-Architecture is done for better performance.

• Jupyterhub is taken out and Kuberntetes APIs are Introduced for Orchestration giving a more stable infrastructure and debugging system.

• This new Architecture allows more control over resources and gives a faster experience so that the users don’t have to wait for the spawning process for too long.

• Dynamic Plans can be introduced now giving full access to the power of the infrastructure.

• Istio Mesh Networking is introduced for Load Balancing and Networking among the pods for better connectivity along with a better security.

PaaS Updates:

• Login and Signup pages have a new UI now which is also mobile responsive.

• Update has been rolled out for the new Admin analytics dashboard with more analytical metrics for viewing the activities of specific users in an organization.

• Session page has more attributes added for more in depth metering and analysis.

• User’s profile has a new tab for durations of the Ai-WorkStations now.

• The Organizations table has a new View button for viewing the users and their duration of work in the Ai-Workstations.

• Server Side pagination is implemented for reducing the bandwidth usage for users.

• We now introduce a new workflow in our Ai-MicroCloud called Ai-API Engine which can be accessed by going to the Ai-Api section in the menu and clicking on the Create Ai-API button. For more information, you can visit https://computationaldocs.zeblok.com/zeblok-computational-1/ai-api/introduction

• A new separate Zeblok Authentication microservice has been added exclusively for enhanced Authentication Processes and validation and also giving users the ability to secure their account using 2 factor authentication.

• The Login Method has been improved with the addition of Refresh Tokens and JWT Token for a better and new level of security.

Version 0.0.7 (MARCH 2021)

IaaS Updates

All the Zeblok benefits, now in AWS:

Automated/scripted the deployment of the Zeblok platform within AWS, which will help us serve our customers better. How?

• They don’t have to move their data across datacenter or platforms, reducing a large amount of effort and billing, as they don’t have to engineer the data movement in and out of AWS, which also impacts data security. Less movement of data in and out of AWS saves bandwidth cost.

• Usage can be customized as per individual organization needs. Doesn’t matter if the requirement is of 1 GPU or 10 or 100, the system can easily be scaled as and when required. Increasing impact or ROI and decreasing un-utilized cost.

To learn more about our AWS Deployment. Visit here.

PaaS Updates

• Admin can now view stats such as how many users per day, per week have onboarded.

• Admin can sort by Each organization and view how many notebooks and users.

• New menu called Activity Monitor is added. All data aggregation happens here.

• Which user has access to what type of notebooks

• Activity Report is now available.

• Usage statistics are now available - by organization, user group, plan

• Updated Menu Hierarchy and rearranged icons for enhanced user experience

• Successfully implemented and deployed PaaS Foundational components and AI data lake in the AWS environment.

SaaS Updates

• Documentation for AI-Rover is now available.

• Recently collaborated and acquired new video analytics algorithms for edge IoT applications

• Custom AI-rover development workstations are available for the fintech use-cases

• Data Scientists and ML developers can now containerize and deploy their own algorithm workstations in the Zeblok Intelligence Marketplace. The user guide for containerizing of algorithms is available here.

Version 0.0.6 (DECEMBER 2020)

ZEBLOK SUPERADMIN

• A new button of DATA LAKE is added besides the create workstation button where users can experience object storage provided via zeblok for storing their necessary files for their Ai-WorkStation.

• Session Icon (Time Watch) is added to the listed spawned workstation (Active) on the landing page , where you can see your sessions.

• Activity Logs

  1. A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• DashBoard

  1. All users display more information like Allowed Notebook , Last Active etc are visible.

  2. A new Section in View Button of Users is added to Activity Logs , where Super Admin can monitor users activities.

  3. A quick summary of users is displayed and a “View More analytics” button is added for further resources monitoring page.

  4. Users Section - In the users information display , on clicking “View” for a particular user , 2 new tabs of activities and spawnedImages are created to show its activities log and spawned Workstation by user.

  Resources Monitoring

• Super Admin can see following data

  • Total number of resources created like Workstations ,User Groups,Roles, Organizations,Plans etc.

  • Further re-distribution pie charts of various different sub categories of resource like -

    • Workstations : Data Science , Algorithms , Hyperconvergence .

    • Plans : CPU , GPU , Both

    • Data Center : Public , Private

  • A User Statistics Bar graph showing all new Users , all new Beta Users , all new Non Beta Users created along with that all active users , all active Beta users , all active non Beta users.

  • A Stacked Graph of users created each day is shown with categories of Beta and Non Beta User.

  • A pie chart showing Spawned Images data of users along with a table of further different categories of data.

  • Stacked Bar Graphs showing Workstations Created Day wise ,Workstation which are currently running as Day wise ,Number of CPU/GPU spawned with the notebooks on the respective date.

  • A stacked Bar graph showing the count of All Notebooks spawned with different plans.

  • For more detailed information , please refer to https://docs.google.com/document/d/1sv0aMzLhc63X5HKsAPfSufRn8kz8mH4eXnkTHMcPBEU/edit?usp=sharing

  • All the data can be filtered out between any time intervals. While the data which is related to any organization then it will be updated as per the organization.

  • Admin can use filters for both categories like Search by Organization , Search by Duration or Both.

• Workstation

  • In the workstation table , a new column of licence is added to put licenses in algorithms and hpc’s.

• IAM Menu

  • A new menu of IAM introduced which consists of all access management menus like roles , resources , menu and user groups from where superadmin can give or modify access for a specific role in the Ai-MicroCloud.

  • This helps to customize the side navigation menu also.

Enterprise Admin

• Landing Page

  • A new button of DATA LAKE is added besides the create workstation button.

• Session Icon (Time Watch) is added to listed spawned Images (Active) on the landing page , where you can see your sessions.

• Activity Logs

  • A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• DashBoard

  • All users display more information like Allowed Notebook , Last Active etc are visible.

  • A new Section in View Button of Users is added to Activity Logs, where Super Admin can monitor users activities.

  • A quick summary of users is displayed and a “View More analytics” button is added for further resources monitoring page

  • Users Section

    • In the users information display , on clicking “View” for a particular user , 2 new tabs of activities and spawnedImages are created to show its activities log and spawned images by user.

• Resources Monitoring

  • A User Statistics Bar graph showing all new Users , all new Beta Users , all new Non Beta Users created along with that all active users , all active Beta users , all active non Beta users.

  • A Stacked Graph of users onboarded each day is shown with categories of Beta and Non Beta User.

  • A pie chart showing Spawned Images data of users along with a table of further different categories of data.

  • Stacked Bar Graphs showing Workstations Created Day wise ,Workstation which are currently running as Day wise ,Number of CPU/GPU spawned with the notebooks on the respective date.

  • A stacked Bar graph showing the count of All Notebooks spawned with different plans.

  • For more detailed information , please refer to https://docs.google.com/document/d/1sv0aMzLhc63X5HKsAPfSufRn8kz8mH4eXnkTHMcPBEU/edit?usp=sharing (Organization Admin section)

  • All the data can be filtered out between any time intervals. By default , data of the last 6 months is displayed.

Enterprise User

• Activity Logs

  • A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• Landing Page

  • A new button of DATA LAKE is added besides the create workstation button.

• Session Icon (Time Watch) is added to listed spawned Images (Active) on the landing page , where you can see your sessions.

Individual Users

• Activity Logs

  • A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• Landing Page

  • A new button of DATA LAKE is added besides the create workstation button.

• Session Icon (Time Watch) is added to listed spawned Images (Active) on the landing page, where you can see your sessions.

Version 0.0.5 (SEPTEMBER 2020)

• An AlgoStore is now made available for the users to go and get detailed information about all the containers giving knowledge and also making the selection easier according to the needs.

• Read More button on each algorithm provides information on capabilities, a youtube video link and links to other sources for more information.

• Join Slack option provided for all users to join our dedicated Slack channel for any kind of clarification, bug posting and discussion with our team.

• Documentation link is provided at the navbar to read and understand the design and workflows of the Ai-MicroCloud for a non ambiguous experience.

ZEBLOK SUPERADMIN

• Dashboard

  1. Can view all the users present on the platform segregated according to their roles, organizations for getting a view of the whole microcloud users.

  2. Each user is categorized into a beta and non-beta user. Admin can update the user as beta or non-beta. Beta users have many more features unlocked for them than a non beta user.

  3. Each user has a no. of allowed notebooks assigned to him. The user can only spawn that many number of notebooks if he is a beta user which depends on his subscriptions and resource management rules.

  4. Beta users are the ones who are already present in the computational-beta environment. For these users they do not have to buy plans. Their billing would continue as it was happening before. They can spawn a limited number of notebooks as given access by the Zeblok Admin.

• Workstations

  1. All notebook containers are displayed here as a list in a table where the superadmin can perform CRUD operations on the notebooks.

  2. Superadmin can edit the notebook image, name, description, restrict public access, add video hyperlink and other sources, and can add the stripe product ID for charging this workstation.

  3. Superadmin can set the related plan and default plan for the container.

• Spawned Images

  1. Workstations spawned by the users are shown in Ai-WorkSpace along with the current status of their workstations and corresponding sessions.

  2. All the activities of each workstation can be listed by clicking on their respective sessions icon giving a full in-depth overview of the activities done on the Ai-WorkStation.

• Roles

  1. Orgadmin role added giving full access to the organizational unit which consists of an orgadmin and all org users.

  2. Orguser Role added as the role given to the users who are invited to the Ai-MicroCloud via an invite sent out by the OrgAdmin from the dashboard.

• Plans

  1. Plans can now be edited and deleted by the zeblok superadmin giving a more dynamic resource allocation system for the Ai-WorkStations.

• Data Center

  1. Data center requests can be seen here (Requests are by default given a Pending status).

  2. It is the responsibility of zeblok admin to check and approve those data center requests and make them active.

  3. Once approved these data centers would be visible to the users while creating workstations. (shown on the world map)

Enterprise Admin

• Dashboard

  1. Enterprise Admin can invite users to be a part of his enterprise. He/She will be able to send out the mail to the users he wants to invite.

  2. Can view all the users of his enterprise and according to their roles and beta users.

• Other accessibility

  1. The enterprise admin can use the zeblok platform the same way a normal user (spawning workstations, use data lake etc.)

Enterprise User

• SignUp

  1. Enterprise users are invited by enterprise admins to join the zeblok platform under the enterprise.

  2. Once invited, enterprise users will receive a mail to signup to zeblok platform under their respective enterprise.

Individual Users

• Create Workstation

  1. Select Your Plan

     • Available Plans now show all data center locations on map.

     • Plan details (vCPU, GPU, RAM and storage) displayed by hovering mouse over the specific plan card with Buy Plan Button if subscribed and select plan if not subscribed.

     Reference Link : https://computationaldocs.zeblok.com/zeblok-computational-1/spawn-workstation

• Computational App non-HPC

  1. Zeblok Admin Role enhancements with permissions and access

  2. Enterprise Admin Role enhancements with permissions and access

• Computational App HPC

  1. Slurm Workers support for Conda

  2. Slurm Workers support for MPI

• Computational Algo Store

  1. HPC Notebook showing Distributed Tensor flow (CPU only)

• Infrastructure

  1. Full featured TEST environment

  2. HPC file system with LUSTER.

  3. Storage Virtualization re-architecture with CEPH block store

• Encryption in Transit

  1. VPN based for kube traffic

Version 0.0.4 (JUNE 2020)

• Each Notebook has some predefined plans by the admin, and among them is a default plan which is recommended by us for the selected workstation to run without any resource limitations.

• Organization Admin Role Added for better handling of access control within the organization so that the onboarded users can make the microcloud their own.

• Organization Admin has been given the access to view/edit/update/delete all the users under his organization.

Version 0.0.3 (MARCH 2020)

• The better, fresh and responsive user interface is now available.

• Jupyterlab and Notebooks are updated to their latest Versions.

• Each user will now have access to a dedicated GPU and from 4GB to 8GB of memory.

• Each user will be able to spawn one server at a time.

• Cull feature is now introduced. If a workstation is not utilized by users for two hours then it is automatically culled and resources released, if the browser session is killed. JupyterHub will run the culling process every ten minutes and will cull any user pods that have been inactive for more than one hour.

• A license agreement is now required on signUp which is stored in the Database.

• Zeblok Readme Notebook is now available in the environment showing tutorial instructions on retrieving compute, datalake and other platform features.

• Nvidia Rapids example Notebooks are available on spawning the server using Nvidia Rapids Image.

• Now the infrastructure has been moved within a VPN, making it more secure and easy to expand the infrastructure.

• Slack community is added.

Version 0.0.2 (DECEMBER 2019)

• A wide range of Ai-ML and DataScience Notebooks is added now as a library of notebooks giving users multiple options to spawn in JupyterHub like PySpark, TensorFlow and many more.

• Ai-AppStore now includes trademarked notebooks and available for use upon agreeing the license agreement for Terms and usage. For example: Explainable AI by Akai Kaeru.

• Notebooks have been CUDA optimized for the NVIDIA GPU with SLI support.

Version 0.0.1 (SEPTEMBER 2019)

• Users are now able to spawn JupyterHub based notebooks as Ai-Workstation within CEWIT (Center of Excellence in Wireless and Information Technology) Datacenter cluster.

• Users are now allowed to spawn basic minimal notebooks with cuda optimization for NVIDIA GPU cards (RTX6000) saving enormous time for users.

• JWT Authentication layer is now available on top of our JupyterHub that authenticates only the valid users to spawn in a secure manner.