Current state: Done
Discussion thread: here
Vote thread: here
Released: will be in 4.1, https://github.com/apache/cassandra/commit/24dcc280c2e442eea27e7129c4c948eb6199ed91
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
Cassandra's adoption is growing day-by-day in the industry and it is used by all sizes of organizations serving varied technical and business domains like banking, entertainment, food/transportation logistics, financial technology to name a few. These organizations depending upon their size and domain may have more internal and external InfoSec/AppSec/Compliance standards they have to meet while using Cassanddra. SSL/TLS communication is very critical part of those standards. While Cassandra supports SSL communication sometimes it becomes challenging to use out-of-the-box solution provided by Cassandra for SSL/TLS given the organization's needs.
Currently Cassandra creates the SSLContext via SSLFactory.java. SSLFactory is a final class with static methods and not overridable. The SSLFactory loads the keys and certs from the file based artifacts for the same. While this works for many, in the industry where security is stricter and contextual, this approach falls short. Many big organizations need flexibility to load the SSL artifacts from a custom resource (like custom Key Management Solution, HashiCorp Vault, Amazon KMS etc). While JSSE SecurityProvider architecture allows us flexibility to build our custom mechanisms to validate and process security artifacts, many times all we need is to build upon Java's existing extensibility that Trust/Key Manager interfaces provide to load keystores from various resources with the absence of any customized requirements on the Keys/Certificate formats.
According to JSSE Documentation SSLContext and SSLEngine are the endpoint classes for the secure connection. Moreover, SSLEngine is created by SSLContext and can be further customized according to the needs. Hence if Cassandra provides a way to customize SSLContext it would be a great lever and provide the ultimate extensibility for the Cassandra users.
My proposal here is to make the SSLContext creation pluggable/extensible and have the current SSLFactory.java implement an extensible interface. Of course we would need to also address requirements of Hot reloading of the SSLContext, currently implemented by this class for file based keystores.
- To allow users to customize the class for SSLContext creation via Cassandra Configuration and provide complete control of how SSLContext object is created
- Keep existing functionality like cache for the SSLContext objects, periodic thread to check for hot reloading etc "as-is"
- To allow plugging in custom JSSE Provider. The requirement to plugin a custom JSSE Provider is out of scope for this CIP.
- To make SSLFactory#tlsInstanceProtocolSubstituion() pluggable because regardless of pluggability requirements it is just fetching the list of TLS protocol list
- To modify stress tool's configuration, LoaderOptions, some test classes to allow them having similar extensibility for the SSL Context generation in a custom way
I propose following changes,
- Create a new Java interface 'ISslContextFactory'
- Adding a new configuration like 'ssl_context_factory' with default value provided by newly created DefaultSslContextFactoryImpl.java
- Create a new DefaultSslContextFactoryImpl.java implementing the new ISslContextFactory interface
- This will be a 'final' class and will be considered internal without expectations of being extensible by any other public implementation
- This will be the only default implementation class for the SslContextFactory interface
- Make changes in the existing SSLFactory and other classes to use the dependency on the newly created SslContextFactory
- Make necessary changes to the existing code to allow triggering Hotreloading on the pluggable SslContextFactory
- Make changes in the existing EncryptionOptions.java that uses 'keystore' to determine if it needs to enable encrypted connection
New or Changed Public Interfaces
New configuration (optional)
The new optional configuration key under client/server_encryption_options introduced to be configured ONLY in the case you need to use your own implementation for SSL Context creation.
New ISslContextFactory interface
Important note about common SSL configurations
Currently the EncryptionOptions contains the keystore/truststore paths and other important SSL configuration parameters for the SSL connection (like ciphers, ssl protocol version, client-auth-required flag, endpoint verification flag etc). These "other important" configuration options we refer as the "common SSL configurations" in the title here.
Any implementation of the ISslContextFactory would still need to use these common configurations AND may require additional configuration parameters of their own. Since we are going to modify EncryptionOption to have one more option to define the pluggable implementation for the ISslContextFacgtory, this raises couple of questions which we need to address in terms of design-
- Should not ideally we move out the common SSL configurations in the EncryptionOption and may be define a parent class like CommonEncryptionOption?
- Response: Ideally yes. While it is little weird to have conflicting configuration options in the EncryptionOption (i.e. file based keystore/truststore paths and pluggable sslcontext factory which mostly intended toward not using file based artifacts), practically we could still live with little imperfection. However we will be open to discuss if the community members feel it is best to have a parent class to move out 'common' ssl configurations between file based and pluggable sslcontext factory.
- Above stated reason results into the current design of the interface which requires EncryptionOptions to be passed to most of it's methods because the implementation needs to know the "common SSL configurations".
- Changes would look like this Git commit
- Should we move to model of having Map<String,String> type as passing all the SSL configuration options to any implementation of the ISslContextFactory including the Default/Common one?
- Yes we could do that but for that we would have to "copy" all the common SSL configurations to the Map<String,String> while creating the instance of the ISslContextFactory's implementation including the Default one. This would also help make the imperfection of not adding CommonEncryptionOption suggested in the 1st question.
- Again, we would need community's input on the preference. Changes would look like this Git commit
- As you would notice from the above Git commit link, this option means we would need to move EncryptedOptions#acceptedProtocols() and EncryptionOptions#cipherSuiteArray() to ISslContextFactory interface
Based on community input (discussion on the JIRA), having a Map makes more sense here. However a minor modification we have to do is it would be a Map<String,Object> instead of Map<String,String> since there are certain SSL configurations which are List type (e.g. cipher suites, accepted protocols etc).
Compatibility, Deprecation, and Migration Plan
- What impact (if any) will there be on existing users?
No impact expected by existing users. Default implementation of SslContextFactory will ensure existing functionality is kept intact.
- If we are changing behavior how will we phase out the older behavior?
No need to phase out older behavior.
- If we need special migration tools, describe them here.
- When will we remove the existing behavior?
- Successful integration tests
- Successful local system test to use existing mechanism for the keystores and make sure the default SslContextFactory works for JSSE and Netty SSL Context creation
- For any additional requirements from the Cassandra community, will seek guidance on the discussion thread
Modify existing SSLFactory to allow custom mechanism to load keystores only
If we allow custom mechanism to load keystores from any source, it could still limit ability to customize other parameters in the SSLContext. This could become a limitation for a use-case. Delegating the creation of the whole SSLContext object is more flexible approach that can fit variety of use-cases.
Writing a new JSSE Security Provider
JSSE Security Provider is more suitable when we need to customize security implementation for validating certs (example SPIFFE) or other specific JSSE 'services' like digest etc. Here our primary goal is to make SSLContext creation only as a pluggable mechanism and the JSSE Security Provider seems a mis-fit solution for that.