Skip to content

Commit 8ff98d0

Browse files
jbrockmendelclaude
andcommitted
BENCH: add Linux 4-vCPU comparison job for large-file regression
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
1 parent f0d0db4 commit 8ff98d0

1 file changed

Lines changed: 44 additions & 0 deletions

File tree

.github/workflows/bench-read-csv-windows.yml

Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -109,3 +109,47 @@ jobs:
109109
bench-stdout.txt
110110
bench-oom.json
111111
bench-oom-stdout.txt
112+
113+
# Same 4-vCPU runner class as windows-2025, different OS: tells us whether the
114+
# large-file (>1GB) parallel regression is Windows-specific or a shared cloud-VM
115+
# memory-bandwidth property that the already-shipping non-Windows default has too.
116+
bench-linux:
117+
name: Linux parallel read_csv bench (4-vCPU comparison)
118+
runs-on: ubuntu-24.04
119+
timeout-minutes: 90
120+
steps:
121+
- name: Checkout
122+
uses: actions/checkout@9c091bb21b7c1c1d1991bb908d89e4e9dddfe3e0 # v7.0.0
123+
with:
124+
fetch-depth: 0
125+
126+
- name: Set up pixi env
127+
uses: ./.github/actions/setup-pixi
128+
with:
129+
environment: py313
130+
131+
- name: Build pandas (editable)
132+
run: pixi run --environment py313 build-pandas --editable
133+
134+
- name: Report CPU
135+
run: pixi run --environment py313 python -c "import os; print('cpu_count', os.cpu_count())"
136+
137+
- name: Run bench + OOM probe
138+
run: |
139+
pixi run --environment py313 python scripts/bench_read_csv_parallel.py \
140+
--fixtures ints,floats,strings,mixed --threads 1,2,4 --reps 9 \
141+
--out bench-results.json | tee bench-stdout.txt
142+
pixi run --environment py313 python scripts/bench_read_csv_parallel.py \
143+
--fixtures ints --threads 1,2,4,8,12 --reps 3 --rows 15000000 \
144+
--out bench-oom.json | tee bench-oom-stdout.txt
145+
146+
- name: Upload results
147+
if: always()
148+
uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7
149+
with:
150+
name: bench-results-linux
151+
path: |
152+
bench-results.json
153+
bench-stdout.txt
154+
bench-oom.json
155+
bench-oom-stdout.txt

0 commit comments

Comments
 (0)