You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fetching database metadata for JDBC sources sometimes gets 10s of gigabytes of data from the server.
Until this is fixed, let's disable fetching column descriptions for MS SQL Server.
The driver is: "com.microsoft.sqlserver.jdbc.SQLServerDriver"
Steps to reproduce
valstatement= connection.createStatement(ResultSet.TYPE_FORWARD_ONLY, ResultSet.CONCUR_READ_ONLY)
valrs= statement.executeQuery("SELECT CAST(SERVERPROPERTY('EngineEdition') as INT)")
rs.next()
println(rs.getLong(1))
Expected behavior
Pramen pipelines should not fail with out of memory exceptions when loading column descriptions.
Root cause
The route cause is the the above query, but the fact that we query the data query to get the resultset to get metadata from. This is fixed by ensuring that the metadata query does not return any actual records.
The text was updated successfully, but these errors were encountered:
Describe the bug
Fetching database metadata for JDBC sources sometimes gets 10s of gigabytes of data from the server.
Until this is fixed, let's disable fetching column descriptions for MS SQL Server.
The driver is: "com.microsoft.sqlserver.jdbc.SQLServerDriver"
Steps to reproduce
Expected behavior
Pramen pipelines should not fail with out of memory exceptions when loading column descriptions.
Root cause
The route cause is the the above query, but the fact that we query the data query to get the resultset to get metadata from. This is fixed by ensuring that the metadata query does not return any actual records.
The text was updated successfully, but these errors were encountered: