Skip to content

elasticsearch bulk upload in smaller chunks#1199

Open
raboof wants to merge 1 commit intoNixOS:mainfrom
raboof:es-export-smaller-chunks
Open

elasticsearch bulk upload in smaller chunks#1199
raboof wants to merge 1 commit intoNixOS:mainfrom
raboof:es-export-smaller-chunks

Conversation

@raboof
Copy link
Copy Markdown
Member

@raboof raboof commented Apr 13, 2026

since #1189 it seems the unstable crossed some threshold and is causing gateway timeouts while performing bulk upload calls. If that problem persists then let's see if splitting the upload in smaller chunks helps.

Seen twice now - I just started a third attempt, let's see if that times out as well, if so try with this change.

Towards #1197

since NixOS#1189 it seems the unstable crossed some threshold
and is causing gateway timeouts while performing bulk upload
calls. If that problem persists then let's see if splitting
the upload in smaller chunks helps.
@raboof
Copy link
Copy Markdown
Member Author

raboof commented Apr 13, 2026

Hmm it succeeded the third time... but maybe we should still make the chunks smaller as it seems we're just on the edge.

@raboof raboof marked this pull request as ready for review April 13, 2026 11:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants