Problem description
The Disaster Recovery (DR) Restore job fails with the error code: DR32779.
Cause
The failure is due to the AWS Lambda function exceeding its concurrency quota, which results in throttling during execution.
Traceback
[2025-11-09 11:48:42,458] [ERROR] [130949866063424] Failed to check and complete EBS Snapshot thread, snapshot: snap-0cda5efbe5a6de Error: Max retries exceeded for lambda invocation (#1000b800b) (Error Code : DR32779)
[2025-11-09 11:48:42,459] [ERROR] [130949866063424] Error <class 'inSyncLib.inSyncError.SyncError'>:Max retries exceeded for lambda invocation (#1000b800b) (Error Code : DR32779). Traceback -Traceback (most recent call last):
File "clouddragent_py3/drRestore/drRestore.py", line 1500, in _check_and_complete_snapshot_thread
File "clouddragent_py3/drRestore/drRestore.py", line 178, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 294, in _launch_lambda
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 223, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 381, in invoke_lambda
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 223, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 294, in _launch_lambda
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 223, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 381, in invoke_lambda
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 223, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 318, in _invoke_lambdas
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 243, in _get_next_s3_key
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 223, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 381, in invoke_lambda
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 223, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 294, in _launch_lambda
File "clouddragent_py3/drRestore/lambdaOrchestrator.py", line 223, in check_fault
File "clouddragent_py3/drUtils.py", line 52, in check_fault
inSyncLib.inSyncError.SyncError: Max retries exceeded for lambda invocation (#1000b800b) (Error Code : DR32779)
Resolution
To resolve this issue:
Verify the Lambda concurrency quota in your AWS account:
Navigate to: AWS Console > Service Quotas > AWS Services > Lambda > Concurrent Executions
Ensure the quota is set to 1000 or higher.
If the quota is below the required threshold, submit a request to AWS Support to increase it.
Verification
Once the concurrency quota has been increased, re-trigger the DR Restore job. It should complete successfully without encountering the rate limit error.