Weekly Report of ShardingSphere (2019-3-8 to 2019-3-15)

[Harper0122]

This report is to review recent changes and developments of ShardingSphere.

Basic Data

Basic data shows how the watch, star and fork have changed during the past week.

Watch	Star	Fork
855	7055	2490

This Week's Development

This part is to show new developments of ShardingSphere during the past week.

Feature Development

New Module Development

1. Finished the joint test of symmetrical data masking method with Data Security Sector of JD Digital.
2. Added the unit test for data masking module, with test coverage rate increasing to 1.1%.
3. Re-factored sharding-sphere-accept-test project and added jdbc-performance-test module that can be directly applied to pressure test

Feature Optimization & Refactoring

1. Finished Split sharding-core to multiple modules #1864, splitting Sharding-core to multiple unidirectional dependent sub-modules and SQL parsing module totally to SPI.
2. Optimized the problem that default data masking strategy is optional when independently using data masking data source.
3. Reviewed base-saga codes, using less threadLocal in the local branch
4. Finished revise scope of datasource & database-connector-driver. #2058, reviewing the dependent scope of database-driver and datasource
5. Saga revert unit test and refactoring

Bug Fix

1. Finished fix UnicastBackendHandler execute error while switching multi-schema. #2067, fixing the problem that after proxy shifts multiple schema, single broadcast table handler still uses the first schema
2. Finished Add unit tests for independent encrypt module #2069, fixing the problem of only encrypting the first column when using multiple-column encryption in data masking module

Issue

1. Responded to and dealt with How to deal that One of Slaves is down? #1287, spring JPA simple sql update error #1798, MySQL Replace In v4.0.0? #2030, select limit offset statement has a bug #2039, sharding databases error: java.lang.NullPointerException #2041, When will next version planned to be released? #2043, limit bug #2044, Mave moudle has wrong compile order, sharding-sql-test should be compiled before sharding-core #2045, 2个数据源事务无法回滚 #2051, sharding-jdbc-spring-namespace 4.0.0-RC1 namespcae configuration #2052, Two datasources one datasources TX can not be roll-backed #2053, Wrong LIMIT rewrite while using nested SELECT #2059, automCommit not support #2060, Why shardingspere need to load all meta data? #2063, 全库所有表如何统一配置分表 #2064, why it throw SQLParsingException when i execut a sql like 'CREATE TABLE IF NOT EXIST a1 LIKE a' #2066, dataSourceName #2070.

ShardingSphere Ecology Construction

Official Website Construction

1. Upgraded the using company list.
2. Upgraded the coding norm of unit test.
3. Finished part of XA transaction documents.
4. Added example module document and updated the development plan of example.
5. Optimized saga documents.
6. Translated SPI, Configuration Manual and Docker documents.

Release

1. Finished the release of source codes, binary files and sharding-proxy package
2. Finished the review of LICENSE and deleted questionable LICENSE etcd orchestration module
3. Finished gpg settings
4. Finished mvn release process
5. Finished svn release process
6. Finished writing sharding-proxy README
7. Finished Apache release checklist
8. Apache ShardingSphere Release Guide (doing)

Publicity

1. On-line ShardingSphere Technology Presentation at DBAPlus Community
2. Sought to post an article to Postgres Community: Sharding-Proxy Will Support PostgreSQL Server in the Next Version

Next Week's Plan

This part is to show ShardingSphere's plan for the next week.

Feature Development

New Module Development

1. Increase the coverage rate of the unit test in the data masking module.
2. Finish the joint test of assistant query data masking method with Data Security Sector of JD Digital.
3. plan to add newly found features in example.

Feature Optimization & Refactoring

1. Start to re-factor SQL parsing module

Problem Investigation

1. Try using jetcd to communicate with etcd directly
2. When keyGenerator is joint primary key in reverting insert statements, investigate how to deal with it
3. Investigate Wrong LIMIT rewrite while GROUP BY and ORDER BY on different items #2062: the logic error of LIMIT sub-statement rewrite causes the increase of SQL return result

ShardingSphere Ecology Construction

Official Website Construction

1. Translate documents: Sharding-Sidecar, FAQ, newly added SPI documents, etc.

Release

1. Finish Apache ShardingSphere Release Guide.
2. Finish the release of jar files in apache nexus staging
3. Finish the release of source codes and binary files in svn dev
4. Finish the internal vote
5. Start the incubator vote

Publicity

1. 27th JD Tech Salon Presentation: An Introduction to Apache ShardingSphere Technology-Core Features and Production Practice
2. 27th JD Tech Salon Presentation: Apache ShardingSphere Architecture & Open-Source Eco-sphere Discovery
3. JD Tech Community Presentation: Build a Distributed Database Middleware from the Start--(2) Sharding Core Discovery II