Uploaded image for project: 'onedata'
  1. onedata
  2. VFS-11808

Investigate a race condition with space support and dir size stats

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Minor Minor
    • 22.02.2
    • None
    • None
    • None
    • Sprint 255: Ribald Rename, Sprint 256: Stinky Storage, Sprint 289
    • 3

      Problem występuje na tym commicie: https://git.onedata.org/projects/VFS/repos/op-worker/commits/4635b579360a9d34622042db6f6c702534c48b8d#test_distributed/suites/authorization/api/authz_api_test_SUITE.erl

      Walko: zrównoleglam testy authz, tam są grupy i inity per tescase sie robią równolegle, więc nie wkleje ci jednego kawałka kodu co robi to wszystko; mogę to wypchnąć na stasha jeśli chcesz z tego korzystać; jak nie to jest po prostu
      init_per_testcase(Case, Config) ->
      SpaceId = space_setup_utils:set_up_space(#space_spec{
      name = Case,
      owner = space_owner,
      users = [user1, user2],
      supports = [#support_spec

      { provider = krakow, size = 10000000, storage_spec = ?config(storage_id, Config) }

      ]
      }),
      [

      {space_id, SpaceId}

      | Config].
      puszczany równolegle 5-8 razy

      (op_worker@dev-oneprovider-krakow-0.dev-oneprovider-krakow.default.svc.cluster.local)1> [I 09:36:17.340 <0.8912.22>] couchbase_changes_worker for scope <<"bd4d6092d488324ce381c334d21c50a5chfb30">> init with seq: 0, seq_safe 0, propagation since 1
      [N 09:36:17.420 <0.8855.22>] New space has been supported: 'test_open_for_write' (bd4d6092d488324ce381c334d21c50a5chfb30) with 9.54 MiB quota on storage 's3' (71c2c7f8f978322ecacb1dc27f6a7e61ch019d)
      [E 09:36:17.531 <0.9128.22>] An unexpected exception occurred in pes_server_slave:process_cast_request/3 line 196
      > Stacktrace:
      pes_server_slave:handle_cast/2 line 117
      lists:foldl/3 line 1350
      pes_server_slave:process_cast_request/3 line 193
      dir_stats_collector:handle_cast/2 line 524
      dir_stats_collector:update_in_cache/4 line 964
      dir_size_stats:acquire/1 line 457
      dir_size_stats:gen_empty_current_stats/1 line 733
      dir_size_stats:stat_names/1 line 648
      > Details: PES server slave handle_cast error error:{case_clause,
      {error,forbidden}} for plug-in dir_stats_collector and request {dsc_update_request,
      <<"Z3VpZCN0bXBfZGE2NzJkNjg1OTM0Njk0MzMxNjA4MGQ3MDEyODAxOTJjaDRjYzkjZGE2NzJkNjg1OTM0Njk0MzMxNjA4MGQ3MDEyODAxOTJjaDRjYzk">>,
      external,
      dir_size_stats,
      #{<<"dir_count">> =>
      1}}
      [E 09:36:17.533 <0.9136.22>] An unexpected exception occurred in pes_server_slave:process_slave_task/3 line 179
      > Stacktrace:
      pes_server_slave:handle_cast/2 line 117
      lists:foldl/3 line 1350
      pes_server_slave:process_slave_task/3 line 174
      dir_stats_collector:handle_call/2 line 453
      dir_stats_collector:update_in_cache/4 line 964
      dir_size_stats:acquire/1 line 457
      dir_size_stats:gen_empty_current_stats/1 line 733
      dir_size_stats:stat_names/1 line 648
      > Details: PES server slave handle_call error error:{case_clause,
      {error,forbidden}} for plug-in dir_stats_collector and request

      {dsc_get_request, <<"Z3VpZCNzcGFjZV9kYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOSNkYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOQ">>, dir_size_stats, [<<"logical_size">>]}

      [E 09:36:17.533 <0.8987.22>] Dir stats collector PES fun submit_and_await error:

      {error, internal_server_error}

      for guid <<"Z3VpZCNzcGFjZV9kYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOSNkYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOQ">>
      [E 09:36:17.533 <0.8987.22>] An unexpected exception occurred in file_meta:setup_onedata_user/2 line 727
      > Stacktrace:
      file_meta:'setup_onedata_user/2-fun-1'/2 line 698
      lists:foreach_1/2 line 1442
      file_meta:emit_space_dir_created/2 line 1245
      attr_req:get_file_attr_insecure/3 line 168
      file_attr:resolve/3 line 111
      lists:foldl_1/3 line 1355
      file_attr:'resolve/3-fun-12'/3 line 115
      file_attr:resolve_location_attrs_for_dir/1 line 468
      > Details: Failed to setup user c14b0e1b048c177a0e246a611e17655cch407b - error:{case_clause,

      {error, internal_server_error}

      }

            plglopiola Łukasz Opioła
            plglopiola Łukasz Opioła
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: