Skip to content

Commit 3e16038

Browse files
authored
handle missing dependencies while benchmarking (#1271)
* handle missing dependencies while benchmarking * setup test_sql * job name change * set auto-push to true * remove auto-push * add personal access token * use alternate method to push to gh-pages * add name to the action * use different id * modify creds * use github_token * change repo name * set auto-push * set origin and push results * set env * use PERSONAL_GITHUB_TOKEN * use push changes action * use github.head_ref to push the changes * try using fetch-depth * modify branch name * use alternative push approach * git switch - * test by merging with forked master
1 parent ccb321c commit 3e16038

File tree

1 file changed

+11
-5
lines changed

1 file changed

+11
-5
lines changed

.github/workflows/benchmarks.yml

Lines changed: 11 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -27,15 +27,15 @@ jobs:
2727
set -x -e
2828
python -m pip install -U wheel setuptools
2929
python --version
30-
- name: Test macOS
30+
- name: Benchmark on macOS
3131
run: |
3232
set -x -e
3333
python --version
3434
df -h
3535
rm -rf tensorflow_io
3636
echo ${{ matrix.version }} | awk -F: '{print $1}' | xargs python -m pip install -U
3737
echo ${{ matrix.version }} | awk -F: '{print $2}' | xargs python -m pip install --no-deps -U
38-
python -m pip install pytest-benchmark scikit-image
38+
python -m pip install -q scikit-image pytest pytest-benchmark boto3 fastavro avro-python3 scikit-image pandas pyarrow==2.0.0 google-cloud-pubsub==2.1.0 google-cloud-bigquery-storage==1.1.0 google-cloud-bigquery==2.3.1 google-cloud-storage==1.32.0
3939
python -m pip freeze
4040
python -c 'import tensorflow as tf; print(tf.version.VERSION)'
4141
python -c 'import tensorflow_io as tfio; print(tfio.version.VERSION)'
@@ -51,28 +51,34 @@ jobs:
5151
version: ['tensorflow==2.4.0:tensorflow-io-nightly', 'tensorflow==2.4.0:tensorflow-io']
5252
steps:
5353
- uses: actions/checkout@v2
54+
with:
55+
fetch-depth: 0
5456
- uses: actions/setup-python@v1
5557
with:
5658
python-version: ${{ matrix.python }}
5759
- name: Setup Linux
5860
run: |
5961
set -x -e
6062
bash -x -e .github/workflows/build.space.sh
61-
- name: Test Linux
63+
bash -x -e tests/test_sql/sql_test.sh
64+
- name: Benchmark on Linux
6265
run: |
6366
set -x -e
6467
python --version
6568
df -h
6669
rm -rf tensorflow_io
6770
echo ${{ matrix.version }} | awk -F: '{print $1}' | xargs python -m pip install -U
6871
echo ${{ matrix.version }} | awk -F: '{print $2}' | xargs python -m pip install --no-deps -U
69-
python -m pip install pytest-benchmark scikit-image
72+
python -m pip install -q scikit-image pytest pytest-benchmark boto3 fastavro avro-python3 scikit-image pandas pyarrow==2.0.0 google-cloud-pubsub==2.1.0 google-cloud-bigquery-storage==1.1.0 google-cloud-bigquery==2.3.1 google-cloud-storage==1.32.0
7073
python -m pip freeze
7174
python -c 'import tensorflow as tf; print(tf.version.VERSION)'
7275
python -c 'import tensorflow_io as tfio; print(tfio.version.VERSION)'
7376
python -m pytest --benchmark-only --benchmark-json benchmark.json -v --import-mode=append $(find . -type f \( -iname "test_*_eager.py" ! \( -iname "test_bigquery_eager.py" \) \))
7477
- name: Store benchmark result
7578
uses: rhysd/github-action-benchmark@v1
7679
with:
80+
name: Tensorflow-IO Benchmarks
7781
tool: 'pytest'
78-
output-file-path: benchmark.json
82+
output-file-path: benchmark.json
83+
github-token: ${{ secrets.GITHUB_TOKEN }}
84+
auto-push: true

0 commit comments

Comments
 (0)