[Bug]: flush timeout after upgrading from v2.3.4 to 2.4-20240517-780f3137-amd64

[zhuwenxing]

Is there an existing issue for this?

• I have searched the existing issues

Environment

- Milvus version:v2.3.4 --> 2.4-20240517-780f3137-amd64
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

[2024-05-19T09:03:29.864Z] [2024-05-19 08:59:19 - INFO - ci_test]: *********************************** setup *********************************** (client_base.py:44)

[2024-05-19T09:03:29.864Z] [2024-05-19 08:59:19 - INFO - ci_test]: [setup_method] Start setup test case test_milvus_default. (client_base.py:45)

[2024-05-19T09:03:29.864Z] ------------------------------ Captured log call -------------------------------

[2024-05-19T09:03:29.864Z] [2024-05-19 08:59:19 - DEBUG - ci_test]: (api_request)  : [Connections.connect] args: ['default', '', '', 'default', ''], kwargs: {'host': '10.255.168.95', 'port': 19530} (api_request.py:62)

[2024-05-19T09:03:29.864Z] [2024-05-19 08:59:19 - DEBUG - ci_test]: (api_response) : None  (api_request.py:37)

[2024-05-19T09:03:29.864Z] [2024-05-19 08:59:19 - DEBUG - ci_test]: (api_request)  : [Connections.has_connection] args: ['default'], kwargs: {} (api_request.py:62)

[2024-05-19T09:03:29.864Z] [2024-05-19 08:59:19 - DEBUG - ci_test]: (api_response) : True  (api_request.py:37)

[2024-05-19T09:03:29.865Z] [2024-05-19 08:59:19 - DEBUG - ci_test]: (api_request)  : [Collection] args: ['InsertChecker__ypf3ooxY', {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', 'type': <Da......, kwargs: {'consistency_level': 'Strong'} (api_request.py:62)

[2024-05-19T09:03:29.865Z] [2024-05-19 08:59:19 - DEBUG - ci_test]: (api_response) : <Collection>:

[2024-05-19T09:03:29.865Z] -------------

[2024-05-19T09:03:29.865Z] <name>: InsertChecker__ypf3ooxY

[2024-05-19T09:03:29.865Z] <description>: 

[2024-05-19T09:03:29.865Z] <schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT......  (api_request.py:37)

[2024-05-19T09:03:29.865Z] [2024-05-19 08:59:19 - DEBUG - ci_test]: (api_request)  : [Collection.flush] args: [], kwargs: {'timeout': 180} (api_request.py:62)

[2024-05-19T09:03:29.865Z] ________ TestAllCollection.test_milvus_default[IndexChecker__4sQfFU0R] _________

[2024-05-19T09:03:29.865Z] [gw2] linux -- Python 3.8.10 /usr/bin/python3.8

[2024-05-19T09:03:29.865Z] 

[2024-05-19T09:03:29.865Z] self = <test_all_collections_after_chaos.TestAllCollection object at 0x7fc4215e7a90>

[2024-05-19T09:03:29.865Z] collection_name = 'IndexChecker__4sQfFU0R'

[2024-05-19T09:03:29.865Z] 

[2024-05-19T09:03:29.865Z]     @pytest.mark.tags(CaseLabel.L1)

[2024-05-19T09:03:29.865Z]     def test_milvus_default(self, collection_name):

[2024-05-19T09:03:29.865Z]         self._connect()

[2024-05-19T09:03:29.865Z]         # create

[2024-05-19T09:03:29.865Z]         name = collection_name if collection_name else cf.gen_unique_str("Checker_")

[2024-05-19T09:03:29.865Z]         t0 = time.time()

[2024-05-19T09:03:29.865Z]         schema = Collection(name=name).schema

[2024-05-19T09:03:29.865Z]         collection_w = self.init_collection_wrap(name=name, schema=schema)

[2024-05-19T09:03:29.865Z]         tt = time.time() - t0

[2024-05-19T09:03:29.865Z]         assert collection_w.name == name

[2024-05-19T09:03:29.865Z]         # get collection info

[2024-05-19T09:03:29.865Z]         schema = collection_w.schema

[2024-05-19T09:03:29.865Z]         dim = cf.get_dim_by_schema(schema=schema)

[2024-05-19T09:03:29.865Z]         int64_field_name = cf.get_int64_field_name(schema=schema)

[2024-05-19T09:03:29.865Z]         float_vector_field_name = cf.get_float_vec_field_name(schema=schema)

[2024-05-19T09:03:29.865Z]         float_vector_field_name_list = cf.get_float_vec_field_name_list(schema=schema)

[2024-05-19T09:03:29.865Z]         # compact collection before getting num_entities

[2024-05-19T09:03:29.865Z] >       collection_w.flush(timeout=180)

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

failed job: https://qa-jenkins.milvus.io/blue/organizations/jenkins/deploy_test_for_release_cron/detail/deploy_test_for_release_cron/1811/pipeline

log:
artifacts-pulsar-cluster-upgrade-1811-server-logs.tar.gz

Anything else?

No response

[XuanYang-cn]

/assign

[XuanYang-cn]

@zhuwenxing is v2.3.4 are way too old, please use v2.3.15 later when PR's ready

[XuanYang-cn]

https://qa-jenkins.milvus.io/blue/organizations/jenkins/deploy_test_for_release_cron/detail/deploy_test_for_release_cron/1822/pipeline/
tested on master and it passed, wait for 2.4 to merge

[XuanYang-cn]

/assign @zhuwenxing
Please help verify

[zhuwenxing]

verified and fixed