Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-55759

New failures happening after MDL-55072 with BEHAT_FEATURE_TIMING_FILE enabled

XMLWordPrintable

    • MOODLE_32_STABLE
    • MOODLE_32_STABLE
    • wip-mdl-55759
    • Hide
      1. set define('BEHAT_FEATURE_TIMING_FILE', '/some/path/timing.txt'); in config.php
      2. Initialize bahat with parallel run (php admin/tool/behat/cli/init.php -j=2)
      3. Run behat with tags mod_assign
      4. ensure timing.txt has timing information for features.
      5. Run behat_manager_util testcase and ensure it passes.

      NOTE: Run above on mac, windows and linux.

      Show
      set define('BEHAT_FEATURE_TIMING_FILE', '/some/path/timing.txt'); in config.php Initialize bahat with parallel run (php admin/tool/behat/cli/init.php -j=2) Run behat with tags mod_assign ensure timing.txt has timing information for features. Run behat_manager_util testcase and ensure it passes. NOTE: Run above on mac, windows and linux.

      Hi,

      just came back and was testing another issue when I ended with these 2 failures in master. Looking to logs, tracker... I seems that MDL-55072 could be the cause, although I've not investigated it too much.

      Also, note that unit tests are passing everywhere (nightlies, CIs, other devs...) so surely it's something in my sites configuration. But think it would be great to, at least, detect why it's happening here, document it and, if it's a bug... fix it.

      Failures (mac, php 5.6, master, postgres):

      There were 2 failures:
      		 
       
      		 
      1) tool_behat_manager_util_testcase::test_get_config_file_contents_with_parallel_run
      		 
      Failed asserting that 'default:
      		 
        formatters:
      		 
          moodle_progress:
      		 
            output_styles:
      		 
              comment:
      		 
                - magenta
      		 
        suites:
      		 
          default:
      		 
            paths:
      		 
              - 'C:\test\moodle/login/tests/behat/behat_test3.feature'
      		 
            contexts:
      		 
              - behat_context1
      		 
              - behat_context2
      		 
              - behat_context3
      		 
          testtheme:
      		 
            paths: {  }
      		 
            contexts:
      		 
              - behat_theme_testtheme_behat_context1
      		 
              - behat_theme_testtheme_behat_context2
      		 
              - behat_theme_testtheme_behat_context3
      		 
        extensions:
      		 
          Behat\MinkExtension:
      		 
            base_url: 'http://example.com/behat'
      		 
            goutte: null
      		 
            selenium2:
      		 
              wd_host: 'http://localhost:4444/wd/hub'
      		 
          Moodle\BehatExtension:
      		 
            moodledirroot: /Users/stronk7/git_moodle/integration
      		 
            steps_definitions:
      		 
              behat_context1: /test/moodle/mod/assign/feedback/editpdf/tests/behat/behat_context1.php
      		 
              behat_context2: 'C:\test\moodle\blocks\comments\tests\behat\behat_context2.php'
      		 
              behat_context3: 'C:\test\moodle/lib/editor/atto/tests/behat/behat_context3.php'
      		 
      ' contains "/test/moodle/mod/assign/feedback/editpdf/tests/behat/behat_test1.feature".
      		 
       
      		 
      /Users/stronk7/git_moodle/integration/admin/tool/behat/tests/manager_util_test.php:192
      		 
      /Users/stronk7/git_moodle/integration/lib/phpunit/classes/advanced_testcase.php:80
      		 
       
      		 
      To re-run:
      		 
       vendor/bin/phpunit tool_behat_manager_util_testcase admin/tool/behat/tests/manager_util_test.php
      		 
       
      		 
      2) tool_behat_manager_util_testcase::test_get_config_file_contents_with_theme_and_parallel_run
      		 
      Failed asserting that 'default:
      		 
        formatters:
      		 
          moodle_progress:
      		 
            output_styles:
      		 
              comment:
      		 
                - magenta
      		 
        suites:
      		 
          default:
      		 
            paths:
      		 
              - 'C:\test\moodle/login/tests/behat/behat_test3.feature'
      		 
            contexts: {  }
      		 
          testtheme:
      		 
            paths:
      		 
              - 'C:\test\moodle/theme/testtheme/tests/behat/behat_themetest3.feature'
      		 
            contexts:
      		 
              - behat_theme_testtheme_behat_context1
      		 
              - behat_theme_testtheme_behat_context2
      		 
              - behat_theme_testtheme_behat_context3
      		 
        extensions:
      		 
          Behat\MinkExtension:
      		 
            base_url: 'http://example.com/behat'
      		 
            goutte: null
      		 
            selenium2:
      		 
              wd_host: 'http://localhost:4444/wd/hub'
      		 
          Moodle\BehatExtension:
      		 
            moodledirroot: /Users/stronk7/git_moodle/integration
      		 
            steps_definitions:
      		 
              behat_theme_testtheme_behat_context1: /test/moodle/theme/testtheme/tests/behat/mod_assign/behat_theme_testtheme_behat_context1.php
      		 
              behat_theme_testtheme_behat_context2: 'C:\test\moodle\theme\testtheme\tests\behat\block_comments\behat_theme_testtheme_behat_context2.php'
      		 
              behat_theme_testtheme_behat_context3: 'C:\test\moodle/theme/testtheme/tests/behat/editor_atto/behat_theme_testtheme_behat_context3.php'
      		 
      ' contains "/test/moodle/mod/assign/feedback/editpdf/tests/behat/behat_test1.feature".
      		 
       
      		 
      /Users/stronk7/git_moodle/integration/admin/tool/behat/tests/manager_util_test.php:324
      		 
      /Users/stronk7/git_moodle/integration/lib/phpunit/classes/advanced_testcase.php:80
      		 
       
      		 
      To re-run:
      		 
       vendor/bin/phpunit tool_behat_manager_util_testcase admin/tool/behat/tests/manager_util_test.php
      		 
       
      		 
      FAILURES!
      		 
      Tests: 6243, Assertions: 76319, Failures: 2, Skipped: 43.

      Ciao

        1. MDL-55759_behat_output.txt
          12 kB
        2. MDL-55759_phpunit_output.txt
          7 kB

            rajeshtaneja Rajesh Taneja
            stronk7 Eloy Lafuente (stronk7)
            Eloy Lafuente (stronk7) Eloy Lafuente (stronk7)
            Dan Poltawski Dan Poltawski
            Ryan Wyllie Ryan Wyllie
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved:

                Error rendering 'clockify-timesheets-time-tracking-reports:timer-sidebar'. Please contact your Jira administrators.