Uploaded image for project: 'onedata'
  1. onedata
  2. VFS-11808

Investigate a race condition with space support and dir size stats

      • Icon: Task Task
      • Resolution: Unresolved
      • Icon: Minor Minor
      • 22.02.2
      • None
      • None
      • None
      • Sprint 255: Ribald Rename, Sprint 256: Stinky Storage, Sprint 272
      • 3

        Problem występuje na tym commicie: https://git.onedata.org/projects/VFS/repos/op-worker/commits/4635b579360a9d34622042db6f6c702534c48b8d#test_distributed/suites/authorization/api/authz_api_test_SUITE.erl

        Walko: zrównoleglam testy authz, tam są grupy i inity per tescase sie robią równolegle, więc nie wkleje ci jednego kawałka kodu co robi to wszystko; mogę to wypchnąć na stasha jeśli chcesz z tego korzystać; jak nie to jest po prostu
        init_per_testcase(Case, Config) ->
        SpaceId = space_setup_utils:set_up_space(#space_spec{
        name = Case,
        owner = space_owner,
        users = [user1, user2],
        supports = [#support_spec

        { provider = krakow, size = 10000000, storage_spec = ?config(storage_id, Config) }

        ]
        }),
        [

        {space_id, SpaceId}

        | Config].
        puszczany równolegle 5-8 razy

        (op_worker@dev-oneprovider-krakow-0.dev-oneprovider-krakow.default.svc.cluster.local)1> [I 09:36:17.340 <0.8912.22>] couchbase_changes_worker for scope <<"bd4d6092d488324ce381c334d21c50a5chfb30">> init with seq: 0, seq_safe 0, propagation since 1
        [N 09:36:17.420 <0.8855.22>] New space has been supported: 'test_open_for_write' (bd4d6092d488324ce381c334d21c50a5chfb30) with 9.54 MiB quota on storage 's3' (71c2c7f8f978322ecacb1dc27f6a7e61ch019d)
        [E 09:36:17.531 <0.9128.22>] An unexpected exception occurred in pes_server_slave:process_cast_request/3 line 196
        > Stacktrace:
        pes_server_slave:handle_cast/2 line 117
        lists:foldl/3 line 1350
        pes_server_slave:process_cast_request/3 line 193
        dir_stats_collector:handle_cast/2 line 524
        dir_stats_collector:update_in_cache/4 line 964
        dir_size_stats:acquire/1 line 457
        dir_size_stats:gen_empty_current_stats/1 line 733
        dir_size_stats:stat_names/1 line 648
        > Details: PES server slave handle_cast error error:{case_clause,
        {error,forbidden}} for plug-in dir_stats_collector and request {dsc_update_request,
        <<"Z3VpZCN0bXBfZGE2NzJkNjg1OTM0Njk0MzMxNjA4MGQ3MDEyODAxOTJjaDRjYzkjZGE2NzJkNjg1OTM0Njk0MzMxNjA4MGQ3MDEyODAxOTJjaDRjYzk">>,
        external,
        dir_size_stats,
        #{<<"dir_count">> =>
        1}}
        [E 09:36:17.533 <0.9136.22>] An unexpected exception occurred in pes_server_slave:process_slave_task/3 line 179
        > Stacktrace:
        pes_server_slave:handle_cast/2 line 117
        lists:foldl/3 line 1350
        pes_server_slave:process_slave_task/3 line 174
        dir_stats_collector:handle_call/2 line 453
        dir_stats_collector:update_in_cache/4 line 964
        dir_size_stats:acquire/1 line 457
        dir_size_stats:gen_empty_current_stats/1 line 733
        dir_size_stats:stat_names/1 line 648
        > Details: PES server slave handle_call error error:{case_clause,
        {error,forbidden}} for plug-in dir_stats_collector and request

        {dsc_get_request, <<"Z3VpZCNzcGFjZV9kYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOSNkYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOQ">>, dir_size_stats, [<<"logical_size">>]}

        [E 09:36:17.533 <0.8987.22>] Dir stats collector PES fun submit_and_await error:

        {error, internal_server_error}

        for guid <<"Z3VpZCNzcGFjZV9kYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOSNkYTY3MmQ2ODU5MzQ2OTQzMzE2MDgwZDcwMTI4MDE5MmNoNGNjOQ">>
        [E 09:36:17.533 <0.8987.22>] An unexpected exception occurred in file_meta:setup_onedata_user/2 line 727
        > Stacktrace:
        file_meta:'setup_onedata_user/2-fun-1'/2 line 698
        lists:foreach_1/2 line 1442
        file_meta:emit_space_dir_created/2 line 1245
        attr_req:get_file_attr_insecure/3 line 168
        file_attr:resolve/3 line 111
        lists:foldl_1/3 line 1355
        file_attr:'resolve/3-fun-12'/3 line 115
        file_attr:resolve_location_attrs_for_dir/1 line 468
        > Details: Failed to setup user c14b0e1b048c177a0e246a611e17655cch407b - error:{case_clause,

        {error, internal_server_error}

        }

                  plglopiola Łukasz Opioła
                  plglopiola Łukasz Opioła
                  Votes:
                  0 Vote for this issue
                  Watchers:
                  1 Start watching this issue

                    Created:
                    Updated: