June 2024 changelog🔗
Here you'll find the June 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our New Features blog.
25th June🔗
DesignerNew features 🎉
- Connecting your own Azure DevOps repo to Data Productivity Cloud projects is now generally available. This feature lets you connect your Azure DevOps repository when you create a project in the Data Productivity Cloud. Follow the documentation to get started:
- Added the following Flex connectors for developing data pipelines:
- Added an SAP ODP orchestration component, for connecting directly through SAP ODP to access available data sources in SAPI and ABAP CDS views.
- Added the ability to upload external drivers to allow you to enable third-party connectors that don't have a driver supplied by default in a Hybrid SaaS configuration, such as SAP ODP.
- Added support for the OAuth 2.0 client credentials authentication type in Designer when using custom connectors.
- Updated data sampling for orchestration components to include a drop-down menu where you can set the number of rows sampled, for example 1, 10, 250, 1000. The default is 25 rows.
20th June🔗
CDCImprovements 🔧
- Updated the CDC agent version from
2.93.8to2.95.1. - Added an option to map date and time source columns to the corresponding Snowflake data types when using Snowflake as a target.
- Changed the
MTLN_CDC_LAST_COMMIT_TIMESTAMPcolumn when using Snowflake as a target with the Change Log transformation type. - Library updates and security fixes.
18th June🔗
DesignerNew features 🎉
- Added a component action bar that will be displayed when you click on a component in the canvas. The action bar currently supports copying the component and deleting the component.
- Updated data sampling for transformation components to include a drop-down menu where you can set the number of rows sampled, for example 1, 10, 250, 1000. The default is 25 rows.
- Added an Append To Grid component, which lets you append or prepend data to a pre-existing grid variable in the Data Productivity Cloud. Running this component can add rows to existing columns, but doesn't add columns to the grid.
- Added the following Flex connectors for developing data pipelines:
10th June🔗
DesignerNew features 🎉
- Project administrators can now delete projects.
6th June🔗
DesignerNew features 🎉
- Added support for GPT-4o to the OpenAI Prompt component. When this model is selected, the Image input type is available. Images should be in either Base64 format or a direct, public URL of the image. If you're feeding images in Base64 format, you will need to add
data:image/{format_of_your_image};base64,before the encoded image. - Added a Volume to Delta Table orchestration component for Databricks, which lets users transfer data from a pre-existing volume in Databricks in to a Delta Lake table without replacing or deleting any existing data.
- Added a Convert String To Struct transformation component, which takes a string input and converts it to a struct data type.
- Renamed the Extract Nested Data component to Extract Structured Data for Databricks. This transformation component unpacks arrays of structured data into columns and rows of data in a table. Any existing pipelines will still display an Extract Nested Data component.
- The Query Result To Grid component is now available for Databricks projects.
- Added the following Flex connectors for developing data pipelines:
- A user's account ID is now visible in the user menu (top right of the Data Productivity Cloud UI), to help users easily identify their account.