Skip to content

Commit

Permalink
Add information about length conversion
Browse files Browse the repository at this point in the history
  • Loading branch information
Abacn committed Nov 7, 2022
1 parent 560aa8d commit 31b469b
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions sdks/python/apache_beam/io/filebasedio_perf_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -73,6 +73,9 @@ class SyntheticRecordToStrFn(beam.DoFn):
"""
A DoFn that convert key-value bytes from synthetic source to string record.
It uses base64 to convert random bytes emitted from the synthetic source.
Therefore, every 3 bytes give 4 bytes long ascii characters.
Output length = 4(ceil[len(key)/3] + ceil[len(value)/3]) + 1
"""
def process(self, element):
Expand Down

0 comments on commit 31b469b

Please sign in to comment.