Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-83395

AI: Reporting - AI usage for admins

XMLWordPrintable

    • MOODLE_500_STABLE
    • MDL-83395-main
    • Hide

      Setup

      To quickly generate some AI usage data for this manual test, run the file 'script-ai-usage-data.php' attached to this issue. Save the file to the root of your Moodle installation and then run it via CLI:

      php script-ai-usage-data.php 

      Test (manager role is able to view report)

      1. Login as admin
      2. Create a user called 'manager1'
      3. Go to Site admin -> Users -> Permissions -> Assign system roles
      4. Click on 'Manager'
      5. Add 'manager1' 
      6. Log in as 'manager1'
      7. Go to Site admin -> Reports
      8. CONFIRM you can see 'AI usage' in the list of reports
      9. Click on 'AI usage'
      10. CONFIRM you can see the report.
      11. CONFIRM all filters are working correctly
      12. Click the 'Download' button
      13. CONFIRM that the report downloads with the name of 'AI usage'
      Show
      Setup To quickly generate some AI usage data for this manual test, run the file 'script-ai-usage-data.php' attached to this issue. Save the file to the root of your Moodle installation and then run it via CLI: php script-ai-usage-data.php  Test (manager role is able to view report) Login as admin Create a user called 'manager1' Go to  Site admin -> Users -> Permissions -> Assign system roles Click on 'Manager' Add 'manager1'  Log in as 'manager1' Go to  Site admin -> Reports CONFIRM you can see 'AI usage' in the list of reports Click on 'AI usage' CONFIRM you can see the report. CONFIRM all filters are working correctly Click the 'Download' button CONFIRM that the report downloads with the name of 'AI usage'
    • Hide

      Code verified against automated checks.

      Checked MDL-83395 using repository: https://github.com/davewoloszyn/moodle.git

      More information about this report

      Built on: Wed Dec 18 11:56:35 PM UTC 2024

      Show
      Code verified against automated checks. Checked MDL-83395 using repository: https://github.com/davewoloszyn/moodle.git main (0 errors / 0 warnings) [branch: MDL-83395-main | CI Job ] More information about this report Built on: Wed Dec 18 11:56:35 PM UTC 2024
    • Hide

      Launching automatic jobs for branch MDL-83395-main

      Built on: Wed Dec 18 03:55:38 AM UTC 2024

      Show
      Launching automatic jobs for branch MDL-83395 -main https://ci.moodle.org/view/Testing/job/DEV.02%20-%20Developer-requested%20PHPUnit/17749/ PHPUnit (sqlsrv / complete) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/60464/ Behat (NonJS - boost and classic / complete) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/60465/ Behat (Firefox - boost / complete) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/60466/ Behat (Firefox - classic / complete) https://ci.moodle.org/view/Testing/job/DEV.01%20-%20Developer-requested%20Behat/60467/ App tests (stable app version) / complete) Built on: Wed Dec 18 03:55:38 AM UTC 2024
    • 6
    • Team Hedgehog 2024 Sprint 4.1, Team Hedgehog 2024 Sprint 4.2, Team Hedgehog 2024 Sprint 4.3

      Create a report builder report that makes available AI usage stats to administrators and other users.

      The aim of this report is to allow users to view AI usage in their system.  We currently collect all of the required data in the database, this issue is to make that information more readily available for users in LMS.

      The report access should be controlled by capability and be aware of context. So it could be granted to a manager role in a category for example. Admins should get this capability by default.

      Most of the data will be in the "ai_action_register" table with links on the provider column to get specific data from the action tables, like: "ai_action_generate_image"

      The report should include and be able to be filtered on (where possible):

      • actionname: e.g. generate image, summarise text
      • providername: e.g OpenAI
      • success status
      • prompt tokens (if available)
      • completion tokens (if available)
      • time/date information

      These can also be reviewed and updated during the development process

        1. (1) 10 Passed -- (Main)MDL-83395.png
          (1) 10 Passed -- (Main)MDL-83395.png
          80 kB
        2. (1) 11 Passed -- (Main)MDL-83395.png
          (1) 11 Passed -- (Main)MDL-83395.png
          59 kB
        3. (1) 13 Passed -- (Main)MDL-83395.png
          (1) 13 Passed -- (Main)MDL-83395.png
          93 kB
        4. (1) 8 Passed -- (Main)MDL-83395.png
          (1) 8 Passed -- (Main)MDL-83395.png
          40 kB
        5. help-icon-added.png
          help-icon-added.png
          113 kB
        6. MDL-83395_Test_Step10_OK.png
          MDL-83395_Test_Step10_OK.png
          103 kB
        7. MDL-83395_Test_Step11_OK.png
          MDL-83395_Test_Step11_OK.png
          96 kB
        8. MDL-83395_Test_Step13_OK.png
          MDL-83395_Test_Step13_OK.png
          139 kB
        9. MDL-83395_Test_Step8_NoOK.png
          MDL-83395_Test_Step8_NoOK.png
          47 kB
        10. script-ai-usage-data.php
          1 kB

            david.woloszyn@moodle.com David Woloszyn
            matt.porritt@moodle.com Matt Porritt
            Raquel Ortega Raquel Ortega
            Safat Shahin Safat Shahin
            Kim Jared Lucas Kim Jared Lucas
            Votes:
            1 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated:
              Resolved:

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 1 day, 3 hours, 38 minutes
                1d 3h 38m

                  Error rendering 'clockify-timesheets-time-tracking-reports:timer-sidebar'. Please contact your Jira administrators.