Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DEV-60 Feat/ch09 #45

Merged
merged 39 commits into from
Dec 8, 2024
Merged
Changes from 1 commit
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
5fc9757
wip
yuwtennis Oct 12, 2024
7254850
feat: Linear classification with Activation function with keras
yuwtennis Oct 12, 2024
79892a7
feat: Custom container for Vertex AI with dependency management
yuwtennis Oct 13, 2024
cf38efb
fix: Rely on Vertex AI provided dependency management instead of thir…
yuwtennis Oct 13, 2024
c02d771
chore: Add comments for clarity
yuwtennis Oct 14, 2024
ddcb20c
wip: Vertex AI
yuwtennis Oct 14, 2024
6874135
chore: Wrapper for running training job
yuwtennis Oct 21, 2024
bf1e9ca
chore: Makefile instead of shell script
yuwtennis Oct 21, 2024
343282b
chore: Remove wrapper
yuwtennis Oct 21, 2024
24a65d2
chore: Let user calibrate examples to read from csv and batch size fo…
yuwtennis Oct 27, 2024
cc4c062
experiment: Embeddings for sparse features
yuwtennis Nov 4, 2024
0bccf50
fix: Parameterize args related to embeddings
yuwtennis Nov 9, 2024
d137df1
fix: model_type must be ModelType
yuwtennis Nov 9, 2024
0be90e4
chore: Truncate as argument for testing
yuwtennis Nov 10, 2024
d2fc1ac
fix: Populate missing argument
yuwtennis Nov 10, 2024
2473b9c
chore: Add func argument for deployment
yuwtennis Nov 10, 2024
6c8020a
fix: Fix unit test results
yuwtennis Nov 10, 2024
896d622
chore: Unit test as ci
yuwtennis Nov 10, 2024
6f97253
fix: Use integer as num of eval examples when batch number is below c…
yuwtennis Nov 10, 2024
944a1e4
chore: Add .dockerignore
yuwtennis Nov 10, 2024
21d462b
chore: Exclude pycache directory
yuwtennis Nov 10, 2024
e37bba0
chore: Use relative import to deal with vertex AI
yuwtennis Nov 10, 2024
3999a86
experiment: Ch09 as python package
yuwtennis Nov 10, 2024
c22b400
experiment: wip
yuwtennis Nov 10, 2024
7a11795
chore: Ignore stubs at global level.
yuwtennis Nov 10, 2024
cb2787a
feat: Wide and deep classification
yuwtennis Nov 10, 2024
8d7d877
chore: Remove unused config.yaml
yuwtennis Nov 17, 2024
a42fe47
feat: Hyperparameter tuning
yuwtennis Nov 17, 2024
95f0f2b
chore: Uniquely store checkpoint and model by using UUID
yuwtennis Nov 17, 2024
b49a990
chore: Adjust logging level
yuwtennis Nov 17, 2024
df23885
chore: Adjust hyperparameter config file
yuwtennis Nov 17, 2024
22461ed
chore: Add hp tuning target to Makefile
yuwtennis Nov 17, 2024
fb9ccb7
chore: Add comments
yuwtennis Nov 17, 2024
fdae07c
chore: Add comments
yuwtennis Nov 17, 2024
a27d737
fix: Save model by also with time
yuwtennis Nov 17, 2024
33feff3
fix: Use hyphen instead of comma not to collide with IFS of shell
yuwtennis Nov 24, 2024
4d6518c
fix: Wrong arg parsing
yuwtennis Nov 24, 2024
98094ae
feat: Hyperparameter tuning
yuwtennis Nov 30, 2024
3185993
feat: Online prediction
yuwtennis Dec 8, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: Populate missing argument
yuwtennis committed Nov 10, 2024
commit d2fc1ac03ec78dc172ab33cf65dccd2d969fed66
6 changes: 3 additions & 3 deletions Ch09/trainer/model.py
Original file line number Diff line number Diff line change
@@ -188,13 +188,13 @@ def get_inputs(

# Cross columns that make sense in combination
sparse['dep_loc'] = tf.feature_column.crossed_column(
[disc['d_dep_lat'], disc['d_dep_lon'], num_of_buckets * num_of_buckets])
[disc['d_dep_lat'], disc['d_dep_lon']], num_of_buckets * num_of_buckets)

sparse['arr_loc'] = tf.feature_column.crossed_column(
[disc['d_arr_lat'], disc['d_arr_lon'], num_of_buckets * num_of_buckets])
[disc['d_arr_lat'], disc['d_arr_lon']], num_of_buckets * num_of_buckets)

sparse['dep_arr'] = tf.feature_column.crossed_column(
[disc['dep_loc'], disc['arr_loc'], num_of_buckets ** 4])
[sparse['dep_loc'], sparse['arr_loc']], num_of_buckets ** 4)

# Embed all the sparse columns
embed = {