Rolls-Royce has witnessed the transformative power of the Databricks Data Intelligence Platform in various AI projects. One example is a collaboration between Rolls-Royce and Databricks, focused on optimizing Conditional Generative Adversarial Network (GCN) training processes, that demonstrate the numerous benefits of using Databricks Mosaic AI tools.
For this joint cGAN training optimization project, the team considered the use of numerical, text and image data. The primary goal was to enhance Rolls-Royce’s design space exploration capabilities and overcome the limitations of parametric models. This was achieved by enabling the assessment of innovative design concepts through a free-form geometry modeling approach.
The joint Databricks and Rolls-Royce team investigated best practices for model configuration, including consideration of the dimensionality limits. The approach included embedding knowledge of unsuccessful solutions into the training dataset to help the neural network avoid certain areas and find solutions faster. Another aspect of the project was handling multi-objective constraints in the design process, in this project we were working with multiple requirements that were potentially in conflict: for example, we were trying to reduce the model weight while also trying to increase its efficiency. The goal was to produce a solution that is broadly optimized, not just optimal for a particular facet of the design.
The conceptual architecture for the cGAN project is below.
Description of the conceptual architecture:
- Data Modeling: Data tables are set up to ensure they are optimized for the specific use case. This involves generating identity columns, setting table properties, and managing unique tuples.
- 3D Model Training: the 3D models are trained using our data set. This involves embedding knowledge of unsuccessful solutions to help the neural network avoid certain areas and find solutions faster.
- Implementation: Once we developed and optimized models and algorithms, we would then implement them into the product design process
- Optimization: Based on current results, we plan to continually optimize the models and algorithms by adjusting parameters, refining the dataset, and ultimately changing the approach to handling multi-objective constraints.
- Next Steps: Moving forward, we plan to build in mechanisms to handle Multi-Objective Constraints. We need to handle multiple requirements that can conflict with each other. This will involve developing an algorithm or method to balance these conflicting objectives and arrive at an optimal solution.
There were many benefits to Rolls-Royce in leveraging the Databricks Data Intelligence Platform and Databricks Mosaic AI tools for this project:
- Total Cost of Ownership (TCO): Databricks provides a unified Lakehouse platform that accelerates innovation while significantly reducing costs. As data needs grow exponentially, Databricks is a cost-effective solution for data processing. This is particularly beneficial for large-scale projects at enterprises like Rolls-Royce.
- Faster Time-to-Model: Databricks Mosaic AI tools reduce model training and deployment complexity, enabling faster time-to-model. This is achieved through features such as AutoML and Managed MLflow which automate ML development and manage the full lifecycle of ML models.
- From Experimentation to Deployment: Databricks provides a seamless transition from experimentation to deployment. This is crucial as moving from experiments to production deployments can be challenging.
- Improvement of Model Accuracy: The use of Databricks resulted in a significant reduction in runtime, approximately by a factor of 30, achieved through distributed computing for parallel hyper-parameter tuning. This not only speeds up the process but also improves the accuracy of the models.
- Data Management / Governance Benefits: The Databricks Data Intelligence Platform provides complete control over both the models and the data. This level of control is crucial for compliance-centric industries like aerospace. The implementation of Unity Catalog establishes a crucial governance framework, providing a unified view of all data assets and making it easier to manage and control access to sensitive data.
- Insights Gained from the Models: The integration of MLflow in Databricks ensures transparency and reproducibility, key factors in any AI project. It allows for efficient experiment tracking, results sharing, and collaborative model tuning. These insights are invaluable in driving business innovation and enhancing productivity.
In conclusion, Databricks provides a robust, efficient, and secure platform for implementing image genAI projects. The collaboration between Rolls-Royce and Databricks has demonstrated the transformative power of this new technology. Future work will include exploring the transition from 2D models to 3D models, given the three-dimensional nature of engines.
