Release notes

ZEBLOK COMPUTATIONAL AI-MICROCLOUD RELEASE ROADMAP

Version 1.2.0 (JUNE 2022)

SaaS Updates

Zeblok Python SDK now has the feature to deploy simultaneous multi-datacenter Ai-Pipelines with also the ability to integrate the Ai-Runs output with open source tools.

PaaS Updates

• Dashboard now has the ability of one click export users’ data table as CSV for super admin and admins.

• Every user will now get a weekly mail regarding his/ her usage details over the week.

• Private Docker Image repository support has been enabled for both Ai-WorkStations as well as MicroServices, giving users the privilege to pull images from their private repositories.

• Users can now select from multiple versions of an Ai-WorkStation or MicroService while spawning (latest or a previous version).

• Single click social media sign in has been enabled via google.

• Google Authenticator Process has been enabled for a strong multi layered security process.

• MicroService spawning and Ai-API spawning process now have a configuration of plans attached which will also be reflected in the monitoring graphs of the same.

• MicroServices are now flexible to support multiple protocols which can be exposed publicly or can be interconnected to other microservices as an ecosystem.

• Spawning process has been made more error resistant, optimized and also intelligent with zeblok cli auto configuration process while spawning.

• Ai-WorkStation spawning workflow now gives you a choice to mount your S3 bucket from our Ai-DataLake.

• A new MLOps Workflow has been introduced for simultaneous multi-datacenter Ai-Pipeline, Runs and experiments with seamless integration with open source tools, which can be initiated using the zeblok cli.

IaaS Updates

• Zeblok Private Image Repository is the newest member in our Zeblok Infrastructure Ecosystem for real time security scans of the images as well as providing the security scan logs along with the severity of risks. This increases overall security as well as the image pull limit becomes a thing of the past.

• Zeblok Containerization Service has been upgraded for containerizing the Ai-Pipelines images as well as for the auto deployment of the same.

Version 1.1.0 (MARCH 2022)

SaaS Updates

• Openvino Model Serving capabilities are now supported in the Ai-API Engine.

• Openvino toolkit distribution has been upgraded to version 2022.4.1

• Ai-WorkStations have been upgraded with Nvidia Cuda Version 11.4

• JupyterLab has been upgraded to the latest version along with Python v3.9.

PaaS Updates

• New IAM (Identity Access Management) has been developed giving users and admins access to modify roles and permissions in a dynamic way giving more flexibility and ownership to the authorized users.

• Username of the authorized user has been mapped to jupyterlab notebook spawning process giving more insight to security and tracking of activities.

• Zbl Cli has been upgraded for the openvino packaging process of the IR models generated by Openvino notebook giving users more freedom on the Model Serving process.

• Zbl Cli now has a new option/ feature for automating the Ai-API Deployment process using which users can predetermine their choices/ parameters for their deployment.

• A new cross cloud service has been established where the packaged models from the cli are uploaded and image building and pushing to hub steps have been undertaken by the cross cloud service. A mail is sent to the users after the models become ready for deployment via Ai-API Engine.

• Ai-API deployment now supports GRPC protocol where, on using a suitable GRPC client, users can interact with the trained models in a deployed state.

• Zeblok Ai-DataLake has been upgraded and a one click auto account setup system has been introduced for the users along with RBAC security policies.

• Resource Manager has been re-introduced now extending its capabilities for an organization admin too, where the administrator now has full control and insight over the resource consumption and Spawned Resource activities of the members of the Organizational Unit.

• Auto backup of the MongoDB is enabled every 6 hours in all the environments.

• Seamless Database seeding is enabled for quickly restoring the database from the backup.

Version 1.0.0 (DECEMBER 2021)

IaaS Updates

• Zeblok Ai-MicroCloud is now available at Azure Cloud Environment with all the latest features and power giving the same experience of Zeblok AI-MicroCloud on the Azure Platform.

• Zeblok has established Ai-MicroClouds for two private baremetal turned cloud environments: Advantech Labs and Intel Dev Cloud.

PaaS Updates

• Notebook creation workflow has a new field added now for specifying run commands as a post workstation creation lifecycle which comes as a configuration flexibility for the Notebooks’ running.

• DataCenter (only edge categories) have now an option for adding kiosks to them which can be selected for deploying your microservices and Ai-API on a specific kiosk.

• Ai-API workflow has a new step added now for the selection of kiosks while selecting an On-Premise DataCenter.

• Microservices also have a new step added now for the selection of kiosks while selecting an On-Premise DataCenter.

• A new section in the menu has been added for Virtual Machines where you can get the shell access to a kiosk which is available as a node on the on-premise DataCenter.

• Datacenter Monitoring page has been added for getting a status of the performance of all the nodes in the datacenter cluster along with a provision to view the monitoring logs and graphs of a specific node too.

• A button to view the Ai-WorkStation or the MicroService pod logs has been given to view logs while the spawned resource is in running mode.

• Session monitoring of all aiws,microservices and aiapi has been enabled for all the users so that the users can monitor the workloads and resources being consumed by their spawned resources and also decide if they need to upgrade to another plan.

• A brand New user interface has been released giving a rich and smoother experience of the whole Ai-MicroCloud.

Version 0.0.9 (SEPTEMBER 2021)

PaaS Updates:

• Admin analytics dashboard has been updated with more precise and accurate data along with bug fixes providing a more precise idea of the usage by the users.

• Zeblok Authentication MicroService has been updated with more secure tokens and authorization logics while making the user’s authentication and signup process easier than before.

• Zeblok Ai-MicroCloud introduces a brand new workflow for microservices where you can run pre-uploaded and modified images in an isolated and an independent environment in just a few clicks like MongoDB, Intel DLWorkBench, etc.

• Session page now also handles metrics for spawned microservices along with Ai-WorkStations.

• User’s profile has two new tabs for Spawned MicroServices and one for their total runtime consumptions, both of which can be accessed by the SuperAdmin and the Organization’s Admin.

• Periodic Backup in every 6 hours has been established in aws s3 buckets as a disaster management measure.

• Superadmin now gets a new tab in their menu called “Resource Manager” where you can have a look at all and every kind of resource in the Ai-MicroCloud like Ai-WorkStation, MicroServices and Ai-API and also control them if required.

Version 0.0.8 (JUNE 2021)

Infrastructure Re-Architecture is done for better performance.

• Jupyterhub is taken out and Kuberntetes APIs are Introduced for Orchestration giving a more stable infrastructure and debugging system.

• This new Architecture allows more control over resources and gives a faster experience so that the users don’t have to wait for the spawning process for too long.

• Dynamic Plans can be introduced now giving full access to the power of the infrastructure.

• Istio Mesh Networking is introduced for Load Balancing and Networking among the pods for better connectivity along with a better security.

PaaS Updates:

• Login and Signup pages have a new UI now which is also mobile responsive.

• Update has been rolled out for the new Admin analytics dashboard with more analytical metrics for viewing the activities of specific users in an organization.

• Session page has more attributes added for more in depth metering and analysis.

• User’s profile has a new tab for durations of the Ai-WorkStations now.

• The Organizations table has a new View button for viewing the users and their duration of work in the Ai-Workstations.

• Server Side pagination is implemented for reducing the bandwidth usage for users.

• We now introduce a new workflow in our Ai-MicroCloud called Ai-API Engine which can be accessed by going to the Ai-Api section in the menu and clicking on the Create Ai-API button. For more information, you can visit https://computationaldocs.zeblok.com/zeblok-computational-1/ai-api/introduction

• A new separate Zeblok Authentication microservice has been added exclusively for enhanced Authentication Processes and validation and also giving users the ability to secure their account using 2 factor authentication.

• The Login Method has been improved with the addition of Refresh Tokens and JWT Token for a better and new level of security.

Version 0.0.7 (MARCH 2021)

IaaS Updates

All the Zeblok benefits, now in AWS:

Automated/scripted the deployment of the Zeblok platform within AWS, which will help us serve our customers better. How?

• They don’t have to move their data across datacenter or platforms, reducing a large amount of effort and billing, as they don’t have to engineer the data movement in and out of AWS, which also impacts data security. Less movement of data in and out of AWS saves bandwidth cost.

• Usage can be customized as per individual organization needs. Doesn’t matter if the requirement is of 1 GPU or 10 or 100, the system can easily be scaled as and when required. Increasing impact or ROI and decreasing un-utilized cost.

To learn more about our AWS Deployment. Visit here.

PaaS Updates

• Admin can now view stats such as how many users per day, per week have onboarded.

• Admin can sort by Each organization and view how many notebooks and users.

• New menu called Activity Monitor is added. All data aggregation happens here.

• Which user has access to what type of notebooks

• Activity Report is now available.

• Usage statistics are now available - by organization, user group, plan

• Updated Menu Hierarchy and rearranged icons for enhanced user experience

• Successfully implemented and deployed PaaS Foundational components and AI data lake in the AWS environment.

SaaS Updates

• Documentation for AI-Rover is now available.

• Recently collaborated and acquired new video analytics algorithms for edge IoT applications

• Custom AI-rover development workstations are available for the fintech use-cases

• Data Scientists and ML developers can now containerize and deploy their own algorithm workstations in the Zeblok Intelligence Marketplace. The user guide for containerizing of algorithms is available here.

Version 0.0.6 (DECEMBER 2020)

ZEBLOK SUPERADMIN

• A new button of DATA LAKE is added besides the create workstation button where users can experience object storage provided via zeblok for storing their necessary files for their Ai-WorkStation.

• Session Icon (Time Watch) is added to the listed spawned workstation (Active) on the landing page , where you can see your sessions.

• Activity Logs

  1. A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• DashBoard

  1. All users display more information like Allowed Notebook , Last Active etc are visible.

  2. A new Section in View Button of Users is added to Activity Logs , where Super Admin can monitor users activities.

  3. A quick summary of users is displayed and a “View More analytics” button is added for further resources monitoring page.

  4. Users Section - In the users information display , on clicking “View” for a particular user , 2 new tabs of activities and spawnedImages are created to show its activities log and spawned Workstation by user.

  Resources Monitoring

• Super Admin can see following data

  • Total number of resources created like Workstations ,User Groups,Roles, Organizations,Plans etc.

  • Further re-distribution pie charts of various different sub categories of resource like -

    • Workstations : Data Science , Algorithms , Hyperconvergence .

    • Plans : CPU , GPU , Both

    • Data Center : Public , Private

  • A User Statistics Bar graph showing all new Users , all new Beta Users , all new Non Beta Users created along with that all active users , all active Beta users , all active non Beta users.

  • A Stacked Graph of users created each day is shown with categories of Beta and Non Beta User.

  • A pie chart showing Spawned Images data of users along with a table of further different categories of data.

  • Stacked Bar Graphs showing Workstations Created Day wise ,Workstation which are currently running as Day wise ,Number of CPU/GPU spawned with the notebooks on the respective date.

  • A stacked Bar graph showing the count of All Notebooks spawned with different plans.

  • For more detailed information , please refer to https://docs.google.com/document/d/1sv0aMzLhc63X5HKsAPfSufRn8kz8mH4eXnkTHMcPBEU/edit?usp=sharing

  • All the data can be filtered out between any time intervals. While the data which is related to any organization then it will be updated as per the organization.

  • Admin can use filters for both categories like Search by Organization , Search by Duration or Both.

• Workstation

  • In the workstation table , a new column of licence is added to put licenses in algorithms and hpc’s.

• IAM Menu

  • A new menu of IAM introduced which consists of all access management menus like roles , resources , menu and user groups from where superadmin can give or modify access for a specific role in the Ai-MicroCloud.

  • This helps to customize the side navigation menu also.

Enterprise Admin

• Landing Page

  • A new button of DATA LAKE is added besides the create workstation button.

• Session Icon (Time Watch) is added to listed spawned Images (Active) on the landing page , where you can see your sessions.

• Activity Logs

  • A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• DashBoard

  • All users display more information like Allowed Notebook , Last Active etc are visible.

  • A new Section in View Button of Users is added to Activity Logs, where Super Admin can monitor users activities.

  • A quick summary of users is displayed and a “View More analytics” button is added for further resources monitoring page

  • Users Section

    • In the users information display , on clicking “View” for a particular user , 2 new tabs of activities and spawnedImages are created to show its activities log and spawned images by user.

• Resources Monitoring

  • A User Statistics Bar graph showing all new Users , all new Beta Users , all new Non Beta Users created along with that all active users , all active Beta users , all active non Beta users.

  • A Stacked Graph of users onboarded each day is shown with categories of Beta and Non Beta User.

  • A pie chart showing Spawned Images data of users along with a table of further different categories of data.

  • Stacked Bar Graphs showing Workstations Created Day wise ,Workstation which are currently running as Day wise ,Number of CPU/GPU spawned with the notebooks on the respective date.

  • A stacked Bar graph showing the count of All Notebooks spawned with different plans.

  • For more detailed information , please refer to https://docs.google.com/document/d/1sv0aMzLhc63X5HKsAPfSufRn8kz8mH4eXnkTHMcPBEU/edit?usp=sharing (Organization Admin section)

  • All the data can be filtered out between any time intervals. By default , data of the last 6 months is displayed.

Enterprise User

• Activity Logs

  • A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• Landing Page

  • A new button of DATA LAKE is added besides the create workstation button.

• Session Icon (Time Watch) is added to listed spawned Images (Active) on the landing page , where you can see your sessions.

Individual Users

• Activity Logs

  • A new tab is added in the profile section where you can see all your activities and the resources which you have visited.

• Landing Page

  • A new button of DATA LAKE is added besides the create workstation button.

• Session Icon (Time Watch) is added to listed spawned Images (Active) on the landing page, where you can see your sessions.

Version 0.0.5 (SEPTEMBER 2020)

• An AlgoStore is now made available for the users to go and get detailed information about all the containers giving knowledge and also making the selection easier according to the needs.

• Read More button on each algorithm provides information on capabilities, a youtube video link and links to other sources for more information.

• Join Slack option provided for all users to join our dedicated Slack channel for any kind of clarification, bug posting and discussion with our team.

• Documentation link is provided at the navbar to read and understand the design and workflows of the Ai-MicroCloud for a non ambiguous experience.

ZEBLOK SUPERADMIN

• Dashboard

  1. Can view all the users present on the platform segregated according to their roles, organizations for getting a view of the whole microcloud users.

  2. Each user is categorized into a beta and non-beta user. Admin can update the user as beta or non-beta. Beta users have many more features unlocked for them than a non beta user.

  3. Each user has a no. of allowed notebooks assigned to him. The user can only spawn that many number of notebooks if he is a beta user which depends on his subscriptions and resource management rules.

  4. Beta users are the ones who are already present in the computational-beta environment. For these users they do not have to buy plans. Their billing would continue as it was happening before. They can spawn a limited number of notebooks as given access by the Zeblok Admin.

• Workstations

  1. All notebook containers are displayed here as a list in a table where the superadmin can perform CRUD operations on the notebooks.

  2. Superadmin can edit the notebook image, name, description, restrict public access, add video hyperlink and other sources, and can add the stripe product ID for charging this workstation.

  3. Superadmin can set the related plan and default plan for the container.

• Spawned Images

  1. Workstations spawned by the users are shown in Ai-WorkSpace along with the current status of their workstations and corresponding sessions.

  2. All the activities of each workstation can be listed by clicking on their respective sessions icon giving a full in-depth overview of the activities done on the Ai-WorkStation.

• Roles

  1. Orgadmin role added giving full access to the organizational unit which consists of an orgadmin and all org users.

  2. Orguser Role added as the role given to the users who are invited to the Ai-MicroCloud via an invite sent out by the OrgAdmin from the dashboard.

• Plans

  1. Plans can now be edited and deleted by the zeblok superadmin giving a more dynamic resource allocation system for the Ai-WorkStations.

• Data Center

  1. Data center requests can be seen here (Requests are by default given a Pending status).

  2. It is the responsibility of zeblok admin to check and approve those data center requests and make them active.

  3. Once approved these data centers would be visible to the users while creating workstations. (shown on the world map)

Enterprise Admin

• Dashboard

  1. Enterprise Admin can invite users to be a part of his enterprise. He/She will be able to send out the mail to the users he wants to invite.

  2. Can view all the users of his enterprise and according to their roles and beta users.

• Other accessibility

  1. The enterprise admin can use the zeblok platform the same way a normal user (spawning workstations, use data lake etc.)

Enterprise User

• SignUp

  1. Enterprise users are invited by enterprise admins to join the zeblok platform under the enterprise.

  2. Once invited, enterprise users will receive a mail to signup to zeblok platform under their respective enterprise.

Individual Users

• Create Workstation

  1. Select Your Plan

     • Available Plans now show all data center locations on map.

     • Plan details (vCPU, GPU, RAM and storage) displayed by hovering mouse over the specific plan card with Buy Plan Button if subscribed and select plan if not subscribed.

     Reference Link : https://computationaldocs.zeblok.com/zeblok-computational-1/spawn-workstation

• Computational App non-HPC

  1. Zeblok Admin Role enhancements with permissions and access

  2. Enterprise Admin Role enhancements with permissions and access

• Computational App HPC

  1. Slurm Workers support for Conda

  2. Slurm Workers support for MPI

• Computational Algo Store

  1. HPC Notebook showing Distributed Tensor flow (CPU only)

• Infrastructure

  1. Full featured TEST environment

  2. HPC file system with LUSTER.

  3. Storage Virtualization re-architecture with CEPH block store

• Encryption in Transit

  1. VPN based for kube traffic

Version 0.0.4 (JUNE 2020)

• Each Notebook has some predefined plans by the admin, and among them is a default plan which is recommended by us for the selected workstation to run without any resource limitations.

• Organization Admin Role Added for better handling of access control within the organization so that the onboarded users can make the microcloud their own.

• Organization Admin has been given the access to view/edit/update/delete all the users under his organization.

Version 0.0.3 (MARCH 2020)

• The better, fresh and responsive user interface is now available.

• Jupyterlab and Notebooks are updated to their latest Versions.

• Each user will now have access to a dedicated GPU and from 4GB to 8GB of memory.

• Each user will be able to spawn one server at a time.

• Cull feature is now introduced. If a workstation is not utilized by users for two hours then it is automatically culled and resources released, if the browser session is killed. JupyterHub will run the culling process every ten minutes and will cull any user pods that have been inactive for more than one hour.

• A license agreement is now required on signUp which is stored in the Database.

• Zeblok Readme Notebook is now available in the environment showing tutorial instructions on retrieving compute, datalake and other platform features.

• Nvidia Rapids example Notebooks are available on spawning the server using Nvidia Rapids Image.

• Now the infrastructure has been moved within a VPN, making it more secure and easy to expand the infrastructure.

• Slack community is added.

Version 0.0.2 (DECEMBER 2019)

• A wide range of Ai-ML and DataScience Notebooks is added now as a library of notebooks giving users multiple options to spawn in JupyterHub like PySpark, TensorFlow and many more.

• Ai-AppStore now includes trademarked notebooks and available for use upon agreeing the license agreement for Terms and usage. For example: Explainable AI by Akai Kaeru.

• Notebooks have been CUDA optimized for the NVIDIA GPU with SLI support.

Version 0.0.1 (SEPTEMBER 2019)

• Users are now able to spawn JupyterHub based notebooks as Ai-Workstation within CEWIT (Center of Excellence in Wireless and Information Technology) Datacenter cluster.

• Users are now allowed to spawn basic minimal notebooks with cuda optimization for NVIDIA GPU cards (RTX6000) saving enormous time for users.

• JWT Authentication layer is now available on top of our JupyterHub that authenticates only the valid users to spawn in a secure manner.